tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker1 # Disk image does not exist, creating the virtualisation disk image... worker1 # Formatting '/build/vm-state-worker1/tmp.SKpXJvGDa2', fmt=raw size=1073741824 worker1: QEMU running (pid 51) lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 50) worker1 # mke2fs 1.47.4 (6-Mar-2025) lb # Formatting '/build/vm-state-lb/tmp.exMiGMgJUS', fmt=raw size=1073741824 client: QEMU running (pid 49) client # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 52) worker2 # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.bGFFMN1F6n', fmt=raw size=1073741824 worker1 # Discarding device blocks: 0/262144 done lb # mke2fs 1.47.4 (6-Mar-2025) (finished: start all VMs, in 0.50 seconds) worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Discarding device blocks: 0/262144 done client: waiting for unit network-addresses-eth1.service worker1 # Filesystem UUID: b5ce059f-4a59-46b4-bd3f-48aa5e04944e lb # Creating filesystem with 262144 4k blocks and 65536 inodes client: waiting for the VM to finish booting client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Superblock backups stored on blocks: worker2 # Formatting '/build/vm-state-worker2/tmp.P3YjaNsM29', fmt=raw size=1073741824 lb # Filesystem UUID: ad359d95-b0e5-48b9-a22f-93ffc0000a4d worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 client # Discarding device blocks: 0/262144 done worker2 # Discarding device blocks: 0/262144 done lb # 32768, 98304, 163840, 229376 worker1 # client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # worker1 # Allocating group tables: 0/8 done client # Filesystem UUID: 449ab7fb-d156-4db5-9325-439d708b0383 worker2 # Filesystem UUID: 386cf252-64d3-4618-a226-465d74eae136 lb # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done client # Superblock backups stored on blocks: worker2 # Superblock backups stored on blocks: client # 32768, 98304, 163840, 229376 worker1 # Creating journal (8192 blocks): done lb # Writing inode tables: 0/8 done client # worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # 32768, 98304, 163840, 229376 worker1 # worker2 # client # Allocating group tables: 0/8 done lb # Creating journal (8192 blocks): done worker1 # Virtualisation disk image created. worker2 # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done lb # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Starting virtiofs daemons... worker2 # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done lb # worker1 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Creating journal (8192 blocks): done client # Writing superblocks and filesystem accounting information: 0/8 done lb # Virtualisation disk image created. worker1 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # lb # Starting virtiofs daemons... worker1 # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # client # Virtualisation disk image created. lb # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Virtualisation disk image created. client # Starting virtiofs daemons... lb # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Starting virtiofs daemons... client # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T10:58:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T10:58:24Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T10:58:24Z INFO virtiofsd] Client connected, servicing requests worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Zone ranges: worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] Normal empty worker2 # [ 0.000000] Device empty worker2 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] KASLR enabled lb # [ 0.000000] random: crng init done lb # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/n25zl0ms12n9s2746s41c1gc7jq6ai9z-nixos-system-worker2-test/init regInfo=/nix/store/4aixqcvid266vaphk497m20cjsylkwqq-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] Zone ranges: lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty lb # [ 0.000000] Normal empty worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/4aixqcvid266vaphk497m20cjsylkwqq-closure-info/registration", will be passed to user space. lb # [ 0.000000] Device empty lb # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 lb # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages lb # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] random: crng init done worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hw6sjiya3fqcxqx5sjqhqri1ayky0v1l-nixos-system-lb-test/init regInfo=/nix/store/icv2rkyzy36dhd3gwpgrrp51zhv2f8w0-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] KASLR enabled worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] random: crng init done worker1 # [ 0.000000] Zone ranges: lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/icv2rkyzy36dhd3gwpgrrp51zhv2f8w0-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] Normal empty client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] Device empty worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Zone ranges: lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] DMA32 empty lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] Normal empty worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] Device empty worker1 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 client # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] ftrace: allocating 74950 entries in 294 pages worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 worker2 # [ 0.000036] arm-pv: using stolen time PV worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000687] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000870] Console: colour dummy device 80x25 lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000878] printk: legacy console [tty0] enabled client # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.001100] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.001107] pid_max: default: 32768 minimum: 301 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.001189] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c7rqk0rlr4l2j2rnw1rm976l59blicb7-nixos-system-worker1-test/init regInfo=/nix/store/56r3zx0w60z363pcikqhfcwz8a6gnw3f-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.001349] landlock: Up and running. worker2 # [ 0.001352] Yama: becoming mindful. lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.002019] LSM support for eBPF active lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.002189] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/56r3zx0w60z363pcikqhfcwz8a6gnw3f-closure-info/registration", will be passed to user space. lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.002229] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.004059] rcu: Hierarchical SRCU implementation. worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ylfbn6z3ahrh8hrrlqp2284fnn7jlrh4-nixos-system-client-test/init regInfo=/nix/store/s0il4g14jhd7gjas9f6wd09h5hkggkfy-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.004064] rcu: Max phase no-delay instances is 1000. lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.005357] fsl-mc MSI: its@8080000 domain created lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.005448] EFI services will not be available. worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.005524] smp: Bringing up secondary CPUs ... worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.005532] smp: Brought up 1 node, 1 CPU client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/s0il4g14jhd7gjas9f6wd09h5hkggkfy-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.005535] SMP: Total of 1 processors activated. client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.005540] CPU: All CPU(s) started at EL1 worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.005550] CPU features: detected: Branch Target Identification client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.005556] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.005559] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.005562] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.005566] CPU features: detected: Common not Private translations worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.005570] CPU features: detected: CRC32 instructions lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages worker2 # [ 0.005572] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] Policy zone: DMA worker2 # [ 0.005576] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.005579] CPU features: detected: Data independent timing control (DIT) lb # [ 0.000033] arm-pv: using stolen time PV worker2 # [ 0.005582] CPU features: detected: E0PD worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.005585] CPU features: detected: Enhanced Counter Virtualization client # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000545] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] ftrace: allocating 74950 entries in 294 pages lb # [ 0.000741] Console: colour dummy device 80x25 worker2 # [ 0.005588] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000749] printk: legacy console [tty0] enabled worker2 # [ 0.005592] CPU features: detected: Enhanced Virtualization Traps client # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.005595] CPU features: detected: Fine Grained Traps worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000962] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.005599] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.000969] pid_max: default: 32768 minimum: 301 client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.001048] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.005604] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.001198] landlock: Up and running. client # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.005607] CPU features: detected: LSE atomic instructions lb # [ 0.001202] Yama: becoming mindful. client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.005610] CPU features: detected: Privileged Access Never lb # [ 0.001741] LSM support for eBPF active worker2 # [ 0.005612] CPU features: detected: PMUv3 client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.001909] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.005615] CPU features: detected: RAS Extension Support client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.005618] CPU features: detected: RASv1p1 Extension Support lb # [ 0.001942] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.005621] CPU features: detected: Random Number Generator lb # [ 0.003786] rcu: Hierarchical SRCU implementation. client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.003790] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005089] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.005623] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.005187] EFI services will not be available. worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.005626] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.005255] smp: Bringing up secondary CPUs ... client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.005264] smp: Brought up 1 node, 1 CPU worker2 # [ 0.005629] CPU features: detected: TLB range maintenance instructions client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.005267] SMP: Total of 1 processors activated. client # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.005633] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.005272] CPU: All CPU(s) started at EL1 client # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.005675] alternatives: applying system-wide alternatives worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.005283] CPU features: detected: Branch Target Identification worker2 # [ 0.008728] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.005288] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.005291] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.008926] Memory: 1405880K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124632K reserved, 32768K cma-reserved) client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.009311] devtmpfs: initialized worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.005295] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.011127] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.005298] CPU features: detected: Common not Private translations client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.005302] CPU features: detected: CRC32 instructions worker2 # [ 0.011149] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.005304] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.011325] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.011329] 0 pages in range for non-PLT usage lb # [ 0.005308] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.011331] 508272 pages in range for PLT usage client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.005311] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.011447] pinctrl core: initialized pinctrl subsystem client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.005314] CPU features: detected: E0PD worker2 # [ 0.012236] DMI not present or invalid. worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.005317] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.015839] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.000029] arm-pv: using stolen time PV client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.018140] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.005320] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000425] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.005323] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.018320] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.000599] Console: colour dummy device 80x25 lb # [ 0.005327] CPU features: detected: Fine Grained Traps worker1 # [ 0.000606] printk: legacy console [tty0] enabled client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.018533] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.005331] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.018555] audit: initializing netlink subsys (disabled) client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000794] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.000030] arm-pv: using stolen time PV lb # [ 0.005335] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.019122] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.000800] pid_max: default: 32768 minimum: 301 lb # [ 0.005338] CPU features: detected: LSE atomic instructions worker2 # [ 0.019124] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.000872] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.000384] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.005341] CPU features: detected: Privileged Access Never worker1 # [ 0.001018] landlock: Up and running. worker2 # [ 0.019127] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.000552] Console: colour dummy device 80x25 lb # [ 0.005344] CPU features: detected: PMUv3 worker1 # [ 0.001021] Yama: becoming mindful. client # [ 0.000559] printk: legacy console [tty0] enabled lb # [ 0.005347] CPU features: detected: RAS Extension Support worker1 # [ 0.001491] LSM support for eBPF active worker2 # [ 0.019130] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.019136] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.005350] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.001639] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000757] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.005353] CPU features: detected: Random Number Generator worker2 # [ 0.019160] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.000763] pid_max: default: 32768 minimum: 301 worker1 # [ 0.001677] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.019169] cpuidle: using governor ladder lb # [ 0.005355] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.003526] rcu: Hierarchical SRCU implementation. worker2 # [ 0.019175] cpuidle: using governor menu client # [ 0.000871] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.001010] landlock: Up and running. lb # [ 0.005358] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.003530] rcu: Max phase no-delay instances is 1000. client # [ 0.001013] Yama: becoming mindful. worker2 # [ 0.019367] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.004795] fsl-mc MSI: its@8080000 domain created lb # [ 0.005361] CPU features: detected: TLB range maintenance instructions client # [ 0.001448] LSM support for eBPF active worker2 # [ 0.019384] ASID allocator initialised with 65536 entries worker1 # [ 0.004885] EFI services will not be available. lb # [ 0.005366] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.020691] Serial: AMBA PL011 UART driver client # [ 0.001579] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.004953] smp: Bringing up secondary CPUs ... lb # [ 0.005404] alternatives: applying system-wide alternatives worker1 # [ 0.004960] smp: Brought up 1 node, 1 CPU worker2 # [ 0.026031] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.001612] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.004964] SMP: Total of 1 processors activated. lb # [ 0.008392] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.026163] printk: console [ttyAMA0] enabled client # [ 0.003569] rcu: Hierarchical SRCU implementation. worker1 # [ 0.004969] CPU: All CPU(s) started at EL1 client # [ 0.003575] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.004979] CPU features: detected: Branch Target Identification client # [ 0.004852] fsl-mc MSI: its@8080000 domain created lb # [ 0.008589] Memory: 1405664K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124636K reserved, 32768K cma-reserved) worker1 # [ 0.004984] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.004942] EFI services will not be available. lb # [ 0.008988] devtmpfs: initialized client # [ 0.005008] smp: Bringing up secondary CPUs ... worker1 # [ 0.004987] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.010809] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.005016] smp: Brought up 1 node, 1 CPU client # [ 0.005019] SMP: Total of 1 processors activated. worker1 # [ 0.004990] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.010832] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.005025] CPU: All CPU(s) started at EL1 worker1 # [ 0.004994] CPU features: detected: Common not Private translations lb # [ 0.011028] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.005035] CPU features: detected: Branch Target Identification worker1 # [ 0.004997] CPU features: detected: CRC32 instructions client # [ 0.005040] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.005000] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.005043] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.005004] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.144535] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.005047] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.005007] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.144552] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.005010] CPU features: detected: E0PD client # [ 0.005051] CPU features: detected: Common not Private translations client # [ 0.005054] CPU features: detected: CRC32 instructions worker2 # [ 0.144558] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.005012] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.144562] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.005057] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.005016] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.144566] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.005019] CPU features: detected: Enhanced Virtualization Traps client # [ 0.005060] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.005022] CPU features: detected: Fine Grained Traps worker2 # [ 0.144571] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.005063] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.144575] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.005067] CPU features: detected: E0PD worker1 # [ 0.005025] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.144579] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.005069] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.005031] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.011032] 0 pages in range for non-PLT usage worker1 # [ 0.005034] CPU features: detected: LSE atomic instructions client # [ 0.005072] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.011033] 508272 pages in range for PLT usage worker1 # [ 0.005037] CPU features: detected: Privileged Access Never lb # [ 0.011142] pinctrl core: initialized pinctrl subsystem client # [ 0.005076] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.005039] CPU features: detected: PMUv3 lb # [ 0.011946] DMI not present or invalid. client # [ 0.005079] CPU features: detected: Fine Grained Traps worker2 # [ 0.151858] fbcon: Taking over console worker1 # [ 0.005042] CPU features: detected: RAS Extension Support worker2 # [ 0.151873] ACPI: Interpreter disabled. lb # [ 0.015265] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.005045] CPU features: detected: RASv1p1 Extension Support client # [ 0.005082] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.017461] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.005087] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.005048] CPU features: detected: Random Number Generator lb # [ 0.017640] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.005090] CPU features: detected: LSE atomic instructions worker1 # [ 0.005050] CPU features: detected: Speculation barrier (SB) client # [ 0.005093] CPU features: detected: Privileged Access Never lb # [ 0.017838] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.005053] CPU features: detected: Stage-2 Force Write-Back client # [ 0.005096] CPU features: detected: PMUv3 lb # [ 0.017859] audit: initializing netlink subsys (disabled) worker1 # [ 0.005056] CPU features: detected: TLB range maintenance instructions client # [ 0.005099] CPU features: detected: RAS Extension Support lb # [ 0.018370] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.005061] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.005101] CPU features: detected: RASv1p1 Extension Support lb # [ 0.018372] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.005099] alternatives: applying system-wide alternatives client # [ 0.005104] CPU features: detected: Random Number Generator lb # [ 0.018375] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.008065] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.005107] CPU features: detected: Speculation barrier (SB) lb # [ 0.018378] thermal_sys: Registered thermal governor 'user_space' client # [ 0.005109] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.018383] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.005112] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.008218] Memory: 1405616K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124664K reserved, 32768K cma-reserved) lb # [ 0.018407] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.008588] devtmpfs: initialized client # [ 0.005117] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.018415] cpuidle: using governor ladder worker2 # [ 0.160892] iommu: Default domain type: Translated worker1 # [ 0.010348] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.005155] alternatives: applying system-wide alternatives lb # [ 0.018421] cpuidle: using governor menu worker2 # [ 0.160902] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.018599] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.008143] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.161319] SCSI subsystem initialized worker1 # [ 0.010370] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.018614] ASID allocator initialised with 65536 entries lb # [ 0.019829] Serial: AMBA PL011 UART driver worker2 # [ 0.163257] usbcore: registered new interface driver usbfs client # [ 0.008307] Memory: 1405688K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124660K reserved, 32768K cma-reserved) client # [ 0.008680] devtmpfs: initialized worker2 # [ 0.163289] usbcore: registered new interface driver hub lb # [ 0.025116] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.025241] printk: console [ttyAMA0] enabled worker2 # [ 0.163305] usbcore: registered new device driver usb client # [ 0.010464] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.163572] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.146042] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.163578] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.146061] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.163588] PTP clock support registered worker2 # [ 0.163636] EDAC MC: Ver: 3.0.0 lb # [ 0.146067] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.168208] scmi_core: SCMI protocol bus registered lb # [ 0.146071] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.169163] FPGA manager framework lb # [ 0.146076] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.170149] vgaarb: loaded lb # [ 0.146080] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.170779] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.146085] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.010547] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.010551] 0 pages in range for non-PLT usage lb # [ 0.146089] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.010552] 508272 pages in range for PLT usage worker1 # [ 0.010665] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.011391] DMI not present or invalid. worker1 # [ 0.014617] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.153607] fbcon: Taking over console client # [ 0.010487] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.174446] VFS: Disk quotas dquot_6.6.0 lb # [ 0.153621] ACPI: Interpreter disabled. worker1 # [ 0.016790] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.010662] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.174482] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.155468] iommu: Default domain type: Translated client # [ 0.010666] 0 pages in range for non-PLT usage worker1 # [ 0.016976] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.155478] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.010667] 508272 pages in range for PLT usage client # [ 0.010814] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.017176] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.157123] SCSI subsystem initialized client # [ 0.011611] DMI not present or invalid. worker1 # [ 0.017199] audit: initializing netlink subsys (disabled) client # [ 0.014797] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.017796] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.178275] netfs: FS-Cache loaded worker2 # [ 0.178401] pnp: PnP ACPI: disabled client # [ 0.017001] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.017798] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.017801] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.017183] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.017804] thermal_sys: Registered thermal governor 'user_space' client # [ 0.017380] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.017810] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.017400] audit: initializing netlink subsys (disabled) worker1 # [ 0.017843] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.017951] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.017852] cpuidle: using governor ladder worker2 # [ 0.182373] NET: Registered PF_INET protocol family client # [ 0.017953] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.017858] cpuidle: using governor menu client # [ 0.017957] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.182668] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.018042] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.017959] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.018058] ASID allocator initialised with 65536 entries worker1 # [ 0.019286] Serial: AMBA PL011 UART driver client # [ 0.017965] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.164833] usbcore: registered new interface driver usbfs lb # [ 0.164868] usbcore: registered new interface driver hub client # [ 0.017989] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.024539] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.164892] usbcore: registered new device driver usb client # [ 0.017998] cpuidle: using governor ladder worker1 # [ 0.024686] printk: console [ttyAMA0] enabled client # [ 0.018003] cpuidle: using governor menu lb # [ 0.165183] pps_core: LinuxPPS API ver. 1 registered client # [ 0.018182] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.145691] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.165190] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.018198] ASID allocator initialised with 65536 entries lb # [ 0.165200] PTP clock support registered worker1 # [ 0.145711] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.019414] Serial: AMBA PL011 UART driver lb # [ 0.165238] EDAC MC: Ver: 3.0.0 worker1 # [ 0.145716] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.169785] scmi_core: SCMI protocol bus registered client # [ 0.024646] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.145721] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.024794] printk: console [ttyAMA0] enabled lb # [ 0.170709] FPGA manager framework worker1 # [ 0.145725] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.171730] vgaarb: loaded worker1 # [ 0.145729] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.146086] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.146103] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.145733] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.172372] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.145737] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.146107] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.172974] VFS: Disk quotas dquot_6.6.0 client # [ 0.146112] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.172999] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.146116] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.175339] netfs: FS-Cache loaded lb # [ 0.175451] pnp: PnP ACPI: disabled client # [ 0.146120] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.153175] fbcon: Taking over console worker1 # [ 0.153189] ACPI: Interpreter disabled. client # [ 0.146124] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.155056] iommu: Default domain type: Translated client # [ 0.146128] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.155066] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.156821] SCSI subsystem initialized client # [ 0.153599] fbcon: Taking over console client # [ 0.153614] ACPI: Interpreter disabled. client # [ 0.155538] iommu: Default domain type: Translated client # [ 0.155548] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.157242] SCSI subsystem initialized lb # [ 0.181514] NET: Registered PF_INET protocol family lb # [ 0.181795] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.163921] usbcore: registered new interface driver usbfs worker1 # [ 0.163961] usbcore: registered new interface driver hub worker1 # [ 0.163978] usbcore: registered new device driver usb worker1 # [ 0.164251] pps_core: LinuxPPS API ver. 1 registered client # [ 0.162466] usbcore: registered new interface driver usbfs client # [ 0.162499] usbcore: registered new interface driver hub worker1 # [ 0.164258] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.162515] usbcore: registered new device driver usb worker1 # [ 0.164269] PTP clock support registered worker1 # [ 0.164324] EDAC MC: Ver: 3.0.0 client # [ 0.162817] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.169058] scmi_core: SCMI protocol bus registered client # [ 0.162823] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.162833] PTP clock support registered worker1 # [ 0.170043] FPGA manager framework client # [ 0.162883] EDAC MC: Ver: 3.0.0 worker1 # [ 0.171011] vgaarb: loaded client # [ 0.167690] scmi_core: SCMI protocol bus registered worker1 # [ 0.171652] clocksource: Switched to clocksource arch_sys_counter client # [ 0.168664] FPGA manager framework client # [ 0.169606] vgaarb: loaded worker1 # [ 0.173699] VFS: Disk quotas dquot_6.6.0 client # [ 0.170245] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.173727] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.213286] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.177412] netfs: FS-Cache loaded client # [ 0.174107] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.177527] pnp: PnP ACPI: disabled worker2 # [ 0.213335] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.174135] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.213368] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.213448] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.213593] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.177810] netfs: FS-Cache loaded worker2 # [ 0.213680] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.177926] pnp: PnP ACPI: disabled worker2 # [ 0.213725] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.213761] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.181452] NET: Registered PF_INET protocol family worker2 # [ 0.213854] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.181713] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.213875] NET: Registered PF_XDP protocol family worker2 # [ 0.213892] PCI: CLS 0 bytes, default 64 client # [ 0.181821] NET: Registered PF_INET protocol family worker2 # [ 0.214150] Trying to unpack rootfs image as initramfs... client # [ 0.182093] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.228365] kvm [1]: HYP mode not available lb # [ 0.210745] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.210787] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.210812] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.210879] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.211022] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.211105] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.211149] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211184] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211299] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.211319] NET: Registered PF_XDP protocol family lb # [ 0.211335] PCI: CLS 0 bytes, default 64 lb # [ 0.211580] Trying to unpack rootfs image as initramfs... lb # [ 0.226158] kvm [1]: HYP mode not available worker1 # [ 0.211115] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.211160] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.211189] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.211265] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.211408] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.211500] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.211536] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.211573] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.212723] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.212773] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.212805] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.212889] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.213032] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.213118] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.213166] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.219048] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.219085] NET: Registered PF_XDP protocol family client # [ 0.213234] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.219105] PCI: CLS 0 bytes, default 64 client # [ 0.213326] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.219341] Trying to unpack rootfs image as initramfs... client # [ 0.213346] NET: Registered PF_XDP protocol family client # [ 0.213364] PCI: CLS 0 bytes, default 64 client # [ 0.213620] Trying to unpack rootfs image as initramfs... worker1 # [ 0.230173] kvm [1]: HYP mode not available client # [ 0.228138] kvm [1]: HYP mode not available worker2 # [ 0.324432] Initialise system trusted keyrings worker2 # [ 0.325170] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.326409] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.327223] 9p: Installing v9fs 9p2000 file system support lb # [ 0.320956] Initialise system trusted keyrings lb # [ 0.321705] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.323024] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.323790] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.355272] Key type asymmetric registered worker2 # [ 0.355298] Asymmetric key parser 'x509' registered worker2 # [ 0.355385] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.357485] io scheduler mq-deadline registered worker2 # [ 0.357497] io scheduler kyber registered worker1 # [ 0.324198] Initialise system trusted keyrings worker1 # [ 0.324979] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.366940] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.326262] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.323745] Initialise system trusted keyrings worker1 # [ 0.327063] 9p: Installing v9fs 9p2000 file system support client # [ 0.324492] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.368360] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.325713] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.368747] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.352466] Key type asymmetric registered worker2 # [ 0.368765] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.352493] Asymmetric key parser 'x509' registered lb # [ 0.352570] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.368777] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.354701] io scheduler mq-deadline registered worker2 # [ 0.368786] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.354713] io scheduler kyber registered client # [ 0.326561] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.368806] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.368832] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.368908] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.368917] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.368923] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.368928] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.368933] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.368990] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.369433] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.369619] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.369636] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.369666] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.364518] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.369682] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.370303] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.370485] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.370501] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.365937] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.370530] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.366334] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.366351] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.366363] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.366371] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.351106] Key type asymmetric registered lb # [ 0.366393] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.351131] Asymmetric key parser 'x509' registered worker1 # [ 0.351207] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.366425] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.366511] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.366520] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.366526] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.366532] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.366537] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.366627] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.354632] Key type asymmetric registered client # [ 0.354659] Asymmetric key parser 'x509' registered lb # [ 0.367072] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.367260] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.354727] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.367277] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.356922] io scheduler mq-deadline registered client # [ 0.356933] io scheduler kyber registered lb # [ 0.367307] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.395097] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.367323] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.395304] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.395321] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.367782] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.395352] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.367964] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.359714] io scheduler mq-deadline registered worker1 # [ 0.359733] io scheduler kyber registered lb # [ 0.367979] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.395808] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.368009] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.395990] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.396006] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.364899] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.396035] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.387681] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.396054] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.387867] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.366411] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.387883] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.396531] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.366797] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.387913] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.396718] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.366814] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.396748] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.397200] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.366391] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.366834] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.397387] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.366843] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.397417] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.366868] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.397849] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.398031] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.367836] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.366890] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.368237] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.366969] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.398286] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.366979] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.398473] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.368254] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.366985] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.398503] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.368266] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.366990] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.398962] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.366996] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.399147] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.368275] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.399176] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.367097] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.368295] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.399622] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.367534] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.368319] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.399807] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.368399] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.399844] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.368408] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.400305] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.368414] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.396448] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.400586] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.368419] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.396655] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.400604] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.396672] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.368424] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.400633] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.396701] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.368522] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.401085] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.396721] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.401266] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.368961] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.397248] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.401282] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.369146] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.397435] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.401312] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.369163] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.397465] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.401874] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.369193] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.369210] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.401885] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.397927] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.398123] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.369664] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.401891] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.369847] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.398152] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.401935] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.369863] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.398555] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.401982] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.369893] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.398737] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.402031] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.399023] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.402076] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.399210] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.399239] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.402122] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.387800] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.402168] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.399698] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.387832] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.399886] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.402213] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.387862] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.399916] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.402259] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.387878] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.400411] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.402304] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.388398] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.400597] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.402378] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.388588] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.400627] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.388603] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.402424] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.401096] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.402445] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.388632] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.401385] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.402467] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.401402] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.389093] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.389276] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.402488] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.401440] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.389292] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.402509] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.401903] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.389322] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.402530] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.402088] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.402551] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.402106] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.389775] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.389963] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.402577] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.402140] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.394414] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.389978] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.402598] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.402711] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.394626] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.390008] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.402620] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned client # [ 0.394643] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.402722] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.390026] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.402643] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.394674] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.402727] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.390507] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.402664] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.395193] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.402772] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.390696] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.402686] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.395381] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.402819] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.402707] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.390726] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.395397] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.402727] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned lb # [ 0.402866] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.395428] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.391178] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.402748] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned worker1 # [ 0.391366] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.395447] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.402913] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.402769] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.391395] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.395929] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.402960] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.396116] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.391818] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.403006] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.396146] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.392002] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.403052] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.396602] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.392279] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.403097] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.396791] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.392467] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.403144] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.396820] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.392497] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.403212] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.397207] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.392956] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.403257] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.397390] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.393143] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.403279] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.397670] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.393172] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.458855] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.403301] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.397856] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.393623] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.458905] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.403322] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.397886] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.393810] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.458915] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.403344] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.393839] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.458920] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.398353] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.403365] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.459777] pci 0000:00:07.0: enabling device (0000 -> 0002) client # [ 0.398546] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.394309] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.403387] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.394592] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.398580] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.403412] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.394610] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.399068] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.403433] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.394640] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.399255] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.403455] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.395100] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.399295] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.403477] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.395283] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.399752] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.403499] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.395298] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.400035] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.403521] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.395327] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.400052] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.403542] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.400083] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.403563] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned lb # [ 0.403584] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned client # [ 0.400544] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.403605] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.400728] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.403626] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.400744] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.403652] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.400774] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.403661] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.401350] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.403665] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.401362] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.401367] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.401412] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.401460] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.401507] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.401555] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.436051] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.401602] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.460587] pci 0000:00:07.0: enabling device (0000 -> 0002) worker1 # [ 0.436073] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.401649] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.436078] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.401696] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.436131] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.401742] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.436178] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.401789] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.436224] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.401858] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.436272] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.401904] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.401926] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.436319] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.401948] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.436367] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.401970] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.436414] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.401991] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.489154] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.436461] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.402013] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.436507] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.402035] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned client # [ 0.402060] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.436631] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.402082] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.436679] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.402104] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.436700] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.402127] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.436721] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.402149] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.436742] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.402171] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.436763] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.402192] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.436784] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.402214] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker1 # [ 0.436805] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned client # [ 0.402235] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned worker1 # [ 0.436830] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.436852] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.436874] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.436895] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.436917] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.436938] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.436958] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.436979] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker1 # [ 0.437000] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned worker2 # [ 0.499017] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.437020] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.502373] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 0.437041] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.486639] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.504513] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.437066] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.506480] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) worker1 # [ 0.437075] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.437080] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.437900] pci 0000:00:07.0: enabling device (0000 -> 0002) client # [ 0.466352] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.466397] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.466435] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.466445] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.492628] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.466450] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.494668] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.467281] pci 0000:00:07.0: enabling device (0000 -> 0002) worker2 # [ 0.516843] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) worker2 # [ 0.518648] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.504597] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.506643] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) worker2 # [ 0.529208] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.488880] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.491041] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.488446] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.535795] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.537702] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.516534] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) lb # [ 0.519038] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.502143] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.520876] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.522668] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.498490] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.501799] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.548309] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.508209] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.510224] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) lb # [ 0.532545] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.534859] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.557650] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.511604] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.519843] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) worker2 # [ 0.564037] msm_serial: driver initialized worker1 # [ 0.521597] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.564215] SuperH (H)SCI(F) driver initialized worker1 # [ 0.523558] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.564269] STM32 USART driver initialized lb # [ 0.552465] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.522869] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) lb # [ 0.555103] msm_serial: driver initialized lb # [ 0.555257] SuperH (H)SCI(F) driver initialized client # [ 0.525046] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) lb # [ 0.555313] STM32 USART driver initialized client # [ 0.526876] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.533590] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.528813] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.535576] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.538868] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.540768] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.545764] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.595674] loop: module loaded worker2 # [ 0.595859] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 0.596806] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.550878] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.559710] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.587290] loop: module loaded lb # [ 0.587500] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 0.588482] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.566407] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.568728] msm_serial: driver initialized worker1 # [ 0.568878] SuperH (H)SCI(F) driver initialized worker1 # [ 0.568933] STM32 USART driver initialized worker2 # [ 0.607412] megasas: 07.734.00.00-rc1 client # [ 0.568952] msm_serial: driver initialized worker2 # [ 0.608184] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.569102] SuperH (H)SCI(F) driver initialized lb # [ 0.592936] megasas: 07.734.00.00-rc1 client # [ 0.569155] STM32 USART driver initialized worker2 # [ 0.610423] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.593636] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.610447] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.611975] Using buffer write method worker2 # [ 0.612050] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.613768] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.613791] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.627358] Using buffer write method worker2 # [ 0.627392] Concatenating MTD devices: worker2 # [ 0.627396] (0): "0.flash" worker2 # [ 0.627400] (1): "0.flash" worker2 # [ 0.627409] into device "0.flash" lb # [ 0.605414] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.605445] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.606987] Using buffer write method lb # [ 0.607065] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.598476] loop: module loaded worker1 # [ 0.598661] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 0.599473] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.597239] loop: module loaded client # [ 0.597409] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 0.622464] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.598180] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.622494] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.626432] Using buffer write method lb # [ 0.626456] Concatenating MTD devices: lb # [ 0.626460] (0): "0.flash" lb # [ 0.626464] (1): "0.flash" lb # [ 0.626475] into device "0.flash" worker1 # [ 0.604260] megasas: 07.734.00.00-rc1 worker1 # [ 0.604944] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.616176] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.616209] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.617847] Using buffer write method client # [ 0.610981] megasas: 07.734.00.00-rc1 worker1 # [ 0.617927] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.611744] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.613996] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.614023] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.615647] Using buffer write method client # [ 0.615720] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.617431] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.617455] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.632415] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.632446] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.634140] Using buffer write method worker1 # [ 0.634168] Concatenating MTD devices: worker1 # [ 0.634172] (0): "0.flash" worker1 # [ 0.634176] (1): "0.flash" worker1 # [ 0.634187] into device "0.flash" client # [ 0.634877] Using buffer write method client # [ 0.634914] Concatenating MTD devices: client # [ 0.634918] (0): "0.flash" client # [ 0.634922] (1): "0.flash" client # [ 0.634932] into device "0.flash" worker2 # [ 0.888168] Freeing initrd memory: 26944K worker2 # [ 0.894180] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.898025] thunder_xcv, ver 1.0 worker2 # [ 0.898073] thunder_bgx, ver 1.0 lb # [ 0.877907] Freeing initrd memory: 26948K worker2 # [ 0.898096] nicpf, ver 1.0 worker2 # [ 0.898665] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.898673] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.898697] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.898705] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.898733] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.898739] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.883881] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.898761] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.898766] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.905486] sky2: driver version 1.30 lb # [ 0.887692] thunder_xcv, ver 1.0 worker2 # [ 0.907466] ehci-pci 0000:00:07.0: EHCI Host Controller lb # [ 0.887736] thunder_bgx, ver 1.0 lb # [ 0.887758] nicpf, ver 1.0 worker2 # [ 0.907498] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 lb # [ 0.888332] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.907783] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 lb # [ 0.888339] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.888362] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.888371] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.892171] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.910888] usbcore: registered new interface driver usb-storage lb # [ 0.892182] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.910979] usbcore: registered new interface driver usbserial_generic lb # [ 0.892231] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.910993] usbserial: USB Serial support registered for generic lb # [ 0.892237] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.911583] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.895293] sky2: driver version 1.30 worker2 # [ 0.915373] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.915398] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T10:58:26 UTC (1790074706) worker2 # [ 0.915699] i2c_dev: i2c /dev entries driver lb # [ 0.897357] usbcore: registered new interface driver usb-storage lb # [ 0.897411] usbcore: registered new interface driver usbserial_generic lb # [ 0.897424] usbserial: USB Serial support registered for generic lb # [ 0.898023] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.899240] ehci-pci 0000:00:07.0: EHCI Host Controller lb # [ 0.899265] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.921093] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.899498] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 worker2 # [ 0.921103] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.921366] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.921735] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.905024] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.922818] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.923132] hub 1-0:1.0: USB hub found lb # [ 0.905050] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T10:58:26 UTC (1790074706) worker2 # [ 0.923151] hub 1-0:1.0: 6 ports detected lb # [ 0.905385] i2c_dev: i2c /dev entries driver worker2 # [ 0.928324] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.928564] usbcore: registered new interface driver usbhid worker2 # [ 0.928571] usbhid: USB HID core driver client # [ 0.884912] Freeing initrd memory: 26972K worker1 # [ 0.890615] Freeing initrd memory: 26976K lb # [ 0.910714] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.910726] sdhci: Copyright(c) Pierre Ossman lb # [ 0.910993] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.931527] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.911362] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.933070] drop_monitor: Initializing network drop monitor service lb # [ 0.915110] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.933218] NET: Registered PF_INET6 protocol family worker2 # [ 0.936268] Segment Routing with IPv6 client # [ 0.891065] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.936298] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.936326] NET: Registered PF_PACKET protocol family lb # [ 0.916475] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.916747] usbcore: registered new interface driver usbhid worker1 # [ 0.896714] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.937940] 9pnet: Installing 9P2000 support lb # [ 0.916754] usbhid: USB HID core driver worker2 # [ 0.937989] Key type dns_resolver registered lb # [ 0.919854] hub 1-0:1.0: USB hub found lb # [ 0.920412] hub 1-0:1.0: 6 ports detected lb # [ 0.921365] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.922898] drop_monitor: Initializing network drop monitor service client # [ 0.894747] thunder_xcv, ver 1.0 client # [ 0.894799] thunder_bgx, ver 1.0 lb # [ 0.923075] NET: Registered PF_INET6 protocol family client # [ 0.894822] nicpf, ver 1.0 client # [ 0.895416] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.926218] Segment Routing with IPv6 worker1 # [ 0.900438] thunder_xcv, ver 1.0 lb # [ 0.926237] In-situ OAM (IOAM) with IPv6 client # [ 0.895425] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.900484] thunder_bgx, ver 1.0 worker2 # [ 0.944781] registered taskstats version 1 lb # [ 0.926263] NET: Registered PF_PACKET protocol family worker1 # [ 0.900506] nicpf, ver 1.0 client # [ 0.895448] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.944934] Loading compiled-in X.509 certificates worker1 # [ 0.901082] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.895457] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.927899] 9pnet: Installing 9P2000 support worker1 # [ 0.901090] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.895487] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.927943] Key type dns_resolver registered worker1 # [ 0.901112] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.895493] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 0.901120] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.895517] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.901148] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.895523] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.901154] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.895658] sky2: driver version 1.30 worker1 # [ 0.901177] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.897250] usbcore: registered new interface driver usb-storage worker1 # [ 0.901183] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.897372] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.901319] sky2: driver version 1.30 client # [ 0.897387] usbserial: USB Serial support registered for generic worker1 # [ 0.902934] usbcore: registered new interface driver usb-storage client # [ 0.897989] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.953904] Demotion targets for Node 0: null worker1 # [ 0.903025] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.954023] Key type .fscrypt registered client # [ 0.899090] ehci-pci 0000:00:07.0: EHCI Host Controller worker1 # [ 0.903039] usbserial: USB Serial support registered for generic worker2 # [ 0.954030] Key type fscrypt-provisioning registered client # [ 0.899120] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.903638] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.954127] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.934536] registered taskstats version 1 worker2 # [ 0.954146] ima: Allocated hash algorithm: sha1 worker1 # [ 0.904376] ehci-pci 0000:00:07.0: EHCI Host Controller lb # [ 0.934716] Loading compiled-in X.509 certificates worker2 # [ 0.954168] ima: No architecture policies found client # [ 0.899403] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 worker1 # [ 0.904402] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 client # [ 0.911052] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 client # [ 0.911361] hub 1-0:1.0: USB hub found worker2 # [ 0.958076] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.911377] hub 1-0:1.0: 6 ports detected worker1 # [ 0.904716] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 worker1 # [ 0.916301] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.916596] hub 1-0:1.0: USB hub found worker1 # [ 0.916610] hub 1-0:1.0: 6 ports detected client # [ 0.914776] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.914806] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T10:58:26 UTC (1790074706) client # [ 0.915127] i2c_dev: i2c /dev entries driver worker1 # [ 0.920310] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.943477] Demotion targets for Node 0: null lb # [ 0.943583] Key type .fscrypt registered worker1 # [ 0.920337] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T10:58:26 UTC (1790074706) worker1 # [ 0.920638] i2c_dev: i2c /dev entries driver lb # [ 0.943590] Key type fscrypt-provisioning registered lb # [ 0.943688] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.943707] ima: Allocated hash algorithm: sha1 lb # [ 0.943727] ima: No architecture policies found client # [ 0.920572] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.947956] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.920582] sdhci: Copyright(c) Pierre Ossman client # [ 0.920851] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.925881] sdhci: Secure Digital Host Controller Interface driver client # [ 0.921237] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.925892] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.926158] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.926539] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 0.925514] hid: raw HID events driver (C) Jiri Kosina client # [ 0.925765] usbcore: registered new interface driver usbhid client # [ 0.925771] usbhid: USB HID core driver worker1 # [ 0.930800] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.931063] usbcore: registered new interface driver usbhid worker1 # [ 0.931069] usbhid: USB HID core driver client # [ 0.928704] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.931389] drop_monitor: Initializing network drop monitor service client # [ 0.931535] NET: Registered PF_INET6 protocol family worker1 # [ 0.933964] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.976717] clk: Disabling unused clocks worker1 # [ 0.935532] drop_monitor: Initializing network drop monitor service client # [ 0.933488] Segment Routing with IPv6 client # [ 0.933518] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.976743] PM: genpd: Disabling unused power domains worker1 # [ 0.937566] NET: Registered PF_INET6 protocol family client # [ 0.933546] NET: Registered PF_PACKET protocol family worker1 # [ 0.938735] Segment Routing with IPv6 worker1 # [ 0.938755] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.980899] Freeing unused kernel memory: 4736K worker1 # [ 0.938783] NET: Registered PF_PACKET protocol family worker2 # [ 0.981171] Run /init as init process client # [ 0.935382] 9pnet: Installing 9P2000 support client # [ 0.935429] Key type dns_resolver registered worker1 # [ 0.940630] 9pnet: Installing 9P2000 support worker1 # [ 0.940678] Key type dns_resolver registered lb # [ 0.966041] clk: Disabling unused clocks lb # [ 0.966071] PM: genpd: Disabling unused power domains worker1 # [ 0.947201] registered taskstats version 1 worker1 # [ 0.947345] Loading compiled-in X.509 certificates lb # [ 0.970253] Freeing unused kernel memory: 4736K lb # [ 0.970493] Run /init as init process client # [ 0.942314] registered taskstats version 1 client # [ 0.942479] Loading compiled-in X.509 certificates client # [ 0.951115] Demotion targets for Node 0: null worker2 # [ 0.997078] systemd[1]: Successfully made /usr/ read-only. client # [ 0.951222] Key type .fscrypt registered client # [ 0.951229] Key type fscrypt-provisioning registered worker1 # [ 0.956100] Demotion targets for Node 0: null client # [ 0.951330] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.956198] Key type .fscrypt registered client # [ 0.951349] ima: Allocated hash algorithm: sha1 worker1 # [ 0.956205] Key type fscrypt-provisioning registered client # [ 0.951372] ima: No architecture policies found worker1 # [ 0.956299] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.956318] ima: Allocated hash algorithm: sha1 worker1 # [ 0.956340] ima: No architecture policies found client # [ 0.955664] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.960686] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.986625] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 0.979218] clk: Disabling unused clocks client # [ 0.974284] clk: Disabling unused clocks worker1 # [ 0.979248] PM: genpd: Disabling unused power domains client # [ 0.974307] PM: genpd: Disabling unused power domains client # [ 0.978474] Freeing unused kernel memory: 4736K client # [ 0.978690] Run /init as init process worker1 # [ 0.983429] Freeing unused kernel memory: 4736K worker1 # [ 0.983628] Run /init as init process worker1 # [ 0.997921] systemd[1]: Successfully made /usr/ read-only. client # [ 0.996534] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.170871] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.168457] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.158333] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.163728] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.323619] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.331938] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.344322] systemd[1]: Detected virtualization qemu. worker2 # [ 1.346403] systemd[1]: Detected architecture arm64. worker2 # [ 1.348387] systemd[1]: Running in initrd. worker2 # [ 1.351097] systemd[1]: Initializing machine ID from random generator. lb # [ 1.321505] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.354107] systemd[1]: Hostname set to . lb # [ 1.334264] systemd[1]: Detected virtualization qemu. lb # [ 1.336307] systemd[1]: Detected architecture arm64. client # [ 1.310893] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.316275] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.339347] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.345355] systemd[1]: Running in initrd. lb # [ 1.347944] systemd[1]: Initializing machine ID from random generator. lb # [ 1.351173] systemd[1]: Hostname set to . worker1 # [ 1.332807] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.344921] systemd[1]: Detected virtualization qemu. client # [ 1.331370] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.346974] systemd[1]: Detected architecture arm64. client # [ 1.343566] systemd[1]: Detected virtualization qemu. worker1 # [ 1.348978] systemd[1]: Running in initrd. client # [ 1.345607] systemd[1]: Detected architecture arm64. client # [ 1.347649] systemd[1]: Running in initrd. worker1 # [ 1.351595] systemd[1]: Initializing machine ID from random generator. client # [ 1.350328] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.354700] systemd[1]: Hostname set to . client # [ 1.353234] systemd[1]: Hostname set to . worker2 # [ 1.403072] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 worker1 # [ 1.399968] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 client # [ 1.398595] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 lb # [ 1.428603] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 worker2 # [ 1.522830] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.523738] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.522299] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.548447] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.657135] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.643165] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.683171] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.685540] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 worker1 # [ 1.660047] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.666930] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.707136] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.730944] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.686319] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.683238] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.712537] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 worker1 # [ 1.691180] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 client # [ 1.690857] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 worker2 # [ 1.740974] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.742055] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.743287] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.744243] systemd[1]: Reached target Path Units. worker2 # [ 1.744987] systemd[1]: Reached target Slice Units. worker2 # [ 1.745722] systemd[1]: Reached target Swaps. worker2 # [ 1.746485] systemd[1]: Reached target Timer Units. worker2 # [ 1.747465] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.727702] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.748589] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.749601] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.750482] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.751439] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.751464] systemd[1]: Reached target Socket Units. worker2 # [ 1.754453] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.755624] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.738986] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.740272] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.741720] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.742786] systemd[1]: Reached target Path Units. lb # [ 1.743606] systemd[1]: Reached target Slice Units. lb # [ 1.744482] systemd[1]: Reached target Swaps. lb # [ 1.745226] systemd[1]: Reached target Timer Units. worker2 # [ 1.766027] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.746274] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.747640] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.748859] systemd[1]: Listening on Journal Sockets. lb # [ 1.749010] systemd[1]: Listening on udev Control Socket. lb # [ 1.749130] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.749153] systemd[1]: Reached target Socket Units. lb # [ 1.754650] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.755816] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.764560] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.786020] systemd[1]: Starting Journal Service... lb # [ 1.772655] systemd[1]: Starting Journal Service... worker2 # [ 1.794743] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.795707] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.802429] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.765843] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.795817] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.773986] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.796865] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.775165] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.776559] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.817446] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.773327] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.777586] systemd[1]: Reached target Path Units. worker2 # [ 1.818131] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.778398] systemd[1]: Reached target Slice Units. worker1 # [ 1.779197] systemd[1]: Reached target Swaps. worker1 # [ 1.779985] systemd[1]: Reached target Timer Units. worker1 # [ 1.780959] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.782135] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.783232] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.784227] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.827686] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.784360] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.784383] systemd[1]: Reached target Socket Units. client # [ 1.784338] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.788526] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.785367] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.786547] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.789645] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.787498] systemd[1]: Reached target Path Units. client # [ 1.788190] systemd[1]: Reached target Slice Units. client # [ 1.788894] systemd[1]: Reached target Swaps. client # [ 1.789525] systemd[1]: Reached target Timer Units. client # [ 1.790553] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.791600] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.792556] systemd[1]: Listening on Journal Sockets. client # [ 1.793392] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.797056] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.794288] systemd[1]: Listening on udev Kernel Socket. client # [ 1.795063] systemd[1]: Reached target Socket Units. client # [ 1.797183] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.798204] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.816422] systemd-journald[72]: Collecting audit messages is disabled. lb # [ 1.825720] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.827878] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.807927] systemd[1]: Starting Journal Service... client # [ 1.806433] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.858007] systemd-journald[72]: Collecting audit messages is disabled. client # [ 1.814528] systemd[1]: Starting Journal Service... lb # [ 1.841115] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.831467] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.832573] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.870576] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.852788] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.842440] systemd[1]: Starting Load Kernel Modules... client # [ 1.843296] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.846621] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.891389] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.847805] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.893856] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.898104] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.879485] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.856294] systemd-journald[72]: Collecting audit messages is disabled. client # [ 1.857280] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.858903] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.863263] systemd-journald[72]: Collecting audit messages is disabled. worker2 # [ 1.908200] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 client # [ 1.864396] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.908434] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.908444] [drm] features: -context_init worker2 # [ 1.909166] [drm] number of scanouts: 1 worker2 # [ 1.909184] [drm] number of cap sets: 0 lb # [ 1.893138] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.894668] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.875863] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.876881] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.898145] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.904342] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 worker1 # [ 1.888095] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.935149] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic lb # [ 1.920635] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.920653] [drm] features: -context_init worker2 # [ 1.935170] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 lb # [ 1.921402] [drm] number of scanouts: 1 lb # [ 1.921419] [drm] number of cap sets: 0 worker2 # [ 1.947427] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.947626] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.947654] systemd[1]: Reached target Local File Systems. worker2 # [ 1.951649] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.910896] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.932747] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.916512] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.932764] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 client # [ 1.913442] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.963070] Console: switching to colour frame buffer device 160x50 lb # [ 1.949183] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.949372] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.949398] systemd[1]: Reached target Local File Systems. worker1 # [ 1.932289] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.953361] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.934548] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.940195] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.964740] Console: switching to colour frame buffer device 160x50 worker1 # [ 1.949808] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 worker1 # [ 1.950050] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.947822] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.950060] [drm] features: -context_init worker1 # [ 1.950886] [drm] number of scanouts: 1 worker1 # [ 1.950905] [drm] number of cap sets: 0 client # [ 1.950808] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.995409] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 1.984965] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 1.963513] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 client # [ 1.963747] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 2.011475] systemd[1]: Finished Load Kernel Modules. client # [ 1.963757] [drm] features: -context_init client # [ 1.964451] [drm] number of scanouts: 1 worker1 # [ 1.968014] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic client # [ 1.964468] [drm] number of cap sets: 0 worker1 # [ 1.968032] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 lb # [ 1.996972] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.019189] systemd[1]: Starting Apply Kernel Variables... client # [ 1.979030] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.979414] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.979443] systemd[1]: Reached target Local File Systems. lb # [ 2.004806] systemd[1]: Starting Apply Kernel Variables... client # [ 1.986645] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.004512] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 1.992272] Console: switching to colour frame buffer device 160x50 lb # [ 2.005608] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 1.990805] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic lb # [ 2.006692] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 1.990825] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 lb # [ 2.007736] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.025121] systemd[1]: Started Journal Service. worker2 # [ 2.036389] systemd-modules-load[73]: Inserted module 'dm_mod' worker2 # [ 2.037492] systemd-modules-load[73]: Module 'virtio_balloon' is built in worker2 # [ 2.038622] systemd-modules-load[73]: Module 'virtio_console' is built in worker2 # [ 2.039669] systemd-modules-load[73]: Inserted module 'virtio_gpu' worker1 # [ 2.012327] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.012528] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.020500] systemd-modules-load[74]: Module 'virtio_rng' is built in worker1 # [ 2.012554] systemd[1]: Reached target Local File Systems. worker2 # [ 2.059039] systemd[1]: Started Journal Service. worker1 # [ 2.020105] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.014546] Console: switching to colour frame buffer device 160x50 lb # [ 2.032121] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.056534] systemd-modules-load[73]: Module 'virtio_rng' is built in worker1 # [ 2.028293] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.057896] systemd-udevd[78]: Using default interface naming scheme 'v261'. worker1 # [ 2.040307] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.068294] systemd[1]: Starting Create System Files and Directories... client # [ 2.038477] systemd[1]: Started Journal Service. worker2 # [ 2.073242] systemd[1]: Finished Apply Kernel Variables. client # [ 2.028491] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.045534] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.052124] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.053857] systemd[1]: Finished Apply Kernel Variables. client # [ 2.046946] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.035843] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.041562] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.042637] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.045407] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.043657] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.048472] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.049593] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.050675] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.051682] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.073642] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.075941] systemd[1]: Started Journal Service. worker2 # [ 2.104858] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.060703] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.063966] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.111302] systemd[1]: Finished Create System Files and Directories. lb # [ 2.093314] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.079625] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.088931] systemd[1]: Starting Create System Files and Directories... client # [ 2.092502] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker1 # [ 2.096750] systemd[1]: Finished Apply Kernel Variables. client # [ 2.105535] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.113182] systemd-udevd[78]: Using default interface naming scheme 'v261'. worker1 # [ 2.115209] systemd[1]: Finished Create System Files and Directories. client # [ 2.121513] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.174347] systemd[1]: Starting Virtual Console Setup... lb # [ 2.152293] systemd[1]: Starting Virtual Console Setup... client # [ 2.137259] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.144979] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.224509] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.204542] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.227954] systemd[1]: Finished Virtual Console Setup. lb # [ 2.208059] systemd[1]: Finished Virtual Console Setup. client # [ 2.196788] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.200828] systemd[1]: Starting Virtual Console Setup... client # [ 2.252552] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.256503] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.256007] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.260066] systemd[1]: Finished Virtual Console Setup. lb # [ 2.801927] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.804148] systemd[1]: Reached target System Initialization. lb # [ 2.808135] systemd[1]: Reached target Basic System. worker2 # [ 2.844795] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.845781] systemd[1]: Reached target System Initialization. worker2 # [ 2.848164] systemd[1]: Reached target Basic System. client # [ 2.860371] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.861475] systemd[1]: Reached target System Initialization. client # [ 2.862321] systemd[1]: Reached target Basic System. worker1 # [ 2.879545] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.880594] systemd[1]: Reached target System Initialization. worker1 # [ 2.881402] systemd[1]: Reached target Basic System. lb # [ 2.971545] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.995780] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.976500] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.988704] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.025399] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.028643] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.036273] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.041420] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.066049] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.048573] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.048191] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.072089] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.052726] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.076890] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.058719] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.120380] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.121780] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.124982] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.123922] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.131625] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.134439] systemd[1]: Mounting /sysroot... client # [ 3.120064] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.125081] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.170050] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.130976] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.178680] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.136125] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.140175] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.183898] systemd[1]: Mounting /sysroot... worker1 # [ 3.145770] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.191184] EXT4-fs (vda): mounted filesystem ad359d95-b0e5-48b9-a22f-93ffc0000a4d r/w with ordered data mode. Quota mode: none. lb # [ 3.180040] systemd[1]: Mounted /sysroot. lb # [ 3.182054] systemd[1]: Reached target Initrd Root File System. lb # [ 3.185549] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.238502] EXT4-fs (vda): mounted filesystem 386cf252-64d3-4618-a226-465d74eae136 r/w with ordered data mode. Quota mode: none. client # [ 3.180729] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.230982] systemd[1]: Mounted /sysroot. worker2 # [ 3.232609] systemd[1]: Reached target Initrd Root File System. lb # [ 3.210661] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.187630] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.189818] systemd[1]: Mounting /sysroot... worker2 # [ 3.236646] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.217101] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.221161] systemd[1]: Reloading... worker1 # [ 3.199678] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.212161] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.215666] systemd[1]: Mounting /sysroot... worker2 # [ 3.263699] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.270975] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.275807] systemd[1]: Reloading... client # [ 3.246108] EXT4-fs (vda): mounted filesystem 449ab7fb-d156-4db5-9325-439d708b0383 r/w with ordered data mode. Quota mode: none. client # [ 3.237347] systemd[1]: Mounted /sysroot. client # [ 3.241283] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.259589] EXT4-fs (vda): mounted filesystem b5ce059f-4a59-46b4-bd3f-48aa5e04944e r/w with ordered data mode. Quota mode: none. worker1 # [ 3.249809] systemd[1]: Mounted /sysroot. client # [ 3.248134] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.251140] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.254894] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.271568] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.278446] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.282483] systemd[1]: Reloading... worker1 # [ 3.283618] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.290108] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.294381] systemd[1]: Reloading... lb # [ 3.427366] systemd[1]: Reloading finished in 207 ms. worker2 # [ 3.483719] systemd[1]: Reloading finished in 209 ms. lb # [ 3.462791] systemd-sysroot-fstab-check[118]: Requesting initrd-fs.target/start/replace... lb # [ 3.469708] systemd-sysroot-fstab-check[118]: Requesting swap.target/start/replace... lb # [ 3.474351] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.476888] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.478727] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.517886] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.521664] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... worker2 # [ 3.527395] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.529840] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.532624] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.488115] systemd[1]: Reloading finished in 206 ms. worker1 # [ 3.505815] systemd[1]: Reloading finished in 213 ms. client # [ 3.523549] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... client # [ 3.527752] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... client # [ 3.531413] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.533831] systemd-sysroot-fstab-check[118]: Requesting initrd-fs.target/start/replace... client # [ 3.534301] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.536145] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.539055] systemd-sysroot-fstab-check[118]: Requesting swap.target/start/replace... worker1 # [ 3.545321] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.547669] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.550360] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.804996] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.823723] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.828096] systemd[1]: Mounting /sysroot/run... lb # [ 3.813769] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.830398] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.855204] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.836181] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.865858] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.854531] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.845954] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.850415] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.875269] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.916834] fuse: init (API version 7.45) client # [ 3.859061] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.907153] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.867502] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.872077] systemd[1]: Mounting /sysroot/run... client # [ 3.872370] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.934399] virtiofs virtio6: discovered new tag: nix-store worker1 # [ 3.883506] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.944484] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 3.933757] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.891938] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.960577] virtiofs virtio7: discovered new tag: shared worker2 # [ 3.961338] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 3.906055] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.929442] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.906531] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.947356] fuse: init (API version 7.45) worker2 # [ 3.968308] virtiofs virtio8: discovered new tag: xchg worker2 # [ 3.969070] virtiofs virtio8: virtio_fs_setup_dax: No cache capability lb # [ 3.952618] virtiofs virtio6: discovered new tag: nix-store lb # [ 3.953433] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 3.929221] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.970664] virtiofs virtio7: discovered new tag: shared lb # [ 3.971422] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 3.977751] virtiofs virtio8: discovered new tag: xchg lb # [ 3.978481] virtiofs virtio8: virtio_fs_setup_dax: No cache capability worker2 # [ 3.986101] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.990136] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.993492] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.973172] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.996215] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.998375] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.977283] systemd[1]: Mounted /sysroot/run. worker2 # [ 4.001665] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.989133] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.991137] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.971490] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.969388] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.998164] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.992186] fuse: init (API version 7.45) client # [ 3.992586] fuse: init (API version 7.45) lb # [ 4.009273] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.998612] virtiofs virtio6: discovered new tag: nix-store lb # [ 4.010361] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.002751] virtiofs virtio6: discovered new tag: nix-store client # [ 3.999444] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 4.003599] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 3.998930] systemd[1]: Mounted /sysroot/run. worker1 # [ 4.017338] virtiofs virtio7: discovered new tag: shared worker1 # [ 4.018093] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 4.015932] virtiofs virtio7: discovered new tag: shared worker1 # [ 4.006067] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.016695] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 4.026287] virtiofs virtio8: discovered new tag: xchg client # [ 4.023515] virtiofs virtio8: discovered new tag: xchg worker1 # [ 4.027041] virtiofs virtio8: virtio_fs_setup_dax: No cache capability client # [ 4.024252] virtiofs virtio8: virtio_fs_setup_dax: No cache capability worker1 # [ 4.019364] systemd[1]: Mounted /sysroot/run. client # [ 4.030533] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 4.035776] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 4.037161] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 4.037444] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 4.039958] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 4.039127] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 4.043131] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.046805] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.055601] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.056886] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.354546] (udev-worker)[92]: mtd0ro: Failed to find and pin callout binary "/nix/store/gnadg5slifq2r638xvz4pv6vrsdl9xkj-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.361999] (udev-worker)[92]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.383821] (udev-worker)[91]: mtd0ro: Failed to find and pin callout binary "/nix/store/gnadg5slifq2r638xvz4pv6vrsdl9xkj-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker2 # [ 4.390127] (udev-worker)[91]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory lb # [ 4.396492] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.421227] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.425485] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.404257] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.405038] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.426890] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.405791] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.431355] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.436760] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.438503] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.446711] systemd[1]: Starting Virtual Console Setup... lb # [ 4.437123] systemd-vconsole-setup[152]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.440413] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.473656] systemd-vconsole-setup[153]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.477259] systemd[1]: Finished Virtual Console Setup. client # [ 4.435390] (udev-worker)[92]: mtd0ro: Failed to find and pin callout binary "/nix/store/gnadg5slifq2r638xvz4pv6vrsdl9xkj-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.444278] (udev-worker)[92]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.453455] (udev-worker)[93]: mtd0ro: Failed to find and pin callout binary "/nix/store/gnadg5slifq2r638xvz4pv6vrsdl9xkj-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.457594] (udev-worker)[93]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.476359] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.478727] systemd[1]: Stopped Virtual Console Setup. client # [ 4.480134] systemd[1]: Stopping Virtual Console Setup... client # [ 4.484221] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.490485] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.492431] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.493804] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.496267] systemd[1]: Starting Virtual Console Setup... client # [ 4.508754] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.512156] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.514143] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.515287] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.516499] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.538356] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.541883] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.808288] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.814287] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.873920] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.855630] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.876999] systemd[1]: Reached target Initrd File Systems. lb # [ 4.857609] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.881667] systemd[1]: Starting Find NixOS closure... lb # [ 4.860775] systemd[1]: Starting Find NixOS closure... lb # [ 4.868367] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.889521] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.849520] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.847222] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.905192] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.928181] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.907796] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.931965] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.918492] systemd[1]: Finished Find NixOS closure. lb # [ 4.919386] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.942825] systemd[1]: Finished Find NixOS closure. lb # [ 4.924301] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.946468] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.952553] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.907897] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.910708] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.913525] systemd[1]: Reached target Initrd File Systems. client # [ 4.912336] systemd[1]: Reached target Initrd File Systems. client # [ 4.915371] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.917944] systemd[1]: Starting Find NixOS closure... lb # [ 4.945969] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.947453] systemd[1]: Stopped target Basic System. worker1 # [ 4.925830] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.948667] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.952393] systemd[1]: Stopped target Path Units. client # [ 4.928357] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.953285] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.976386] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.955224] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.978192] systemd[1]: Stopped target Basic System. worker2 # [ 4.980460] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.960254] systemd[1]: Stopped target Slice Units. lb # [ 4.961069] systemd[1]: Stopped target Socket Units. lb # [ 4.961830] systemd[1]: Stopped target System Initialization. lb # [ 4.962737] systemd[1]: Stopped target Swaps. worker2 # [ 4.984394] systemd[1]: Stopped target Path Units. lb # [ 4.963428] systemd[1]: Stopped target Timer Units. worker2 # [ 4.985417] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.988150] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.968754] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.993174] systemd[1]: Stopped target Slice Units. lb # [ 4.972895] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.974828] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.996985] systemd[1]: Stopped target Socket Units. worker2 # [ 4.998752] systemd[1]: Stopped target System Initialization. lb # [ 4.982009] systemd[1]: Stopped Find NixOS closure. worker2 # [ 5.003739] systemd[1]: Stopped target Swaps. lb # [ 4.982778] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.983589] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.007983] systemd[1]: Stopped target Timer Units. worker2 # [ 5.008885] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 5.009771] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.989131] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.010607] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.967733] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.989982] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.011679] systemd[1]: Stopped Find NixOS closure. lb # [ 4.991970] systemd[1]: Stopped Load Kernel Modules. client # [ 4.972143] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 5.019391] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.998697] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.971349] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 5.002595] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.978684] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 5.025639] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.026613] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.027469] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.985943] systemd[1]: Finished Find NixOS closure. lb # [ 5.008663] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.988254] systemd[1]: Reached target Initrd Default Target. lb # [ 5.010621] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.011516] systemd[1]: Stopped target Local File Systems. client # [ 4.989257] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.991488] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 5.013724] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 5.035655] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.014683] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.015653] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.991937] systemd[1]: Reached target Initrd Default Target. worker2 # [ 5.036948] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 5.038082] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 5.039148] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 4.996326] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 5.044241] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 5.045135] systemd[1]: Stopped target Local File Systems. lb # [ 5.024155] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.045911] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.025284] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.046833] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 5.047815] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.028293] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.029225] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 5.050859] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.051929] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.053130] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.032325] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 5.053896] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.033273] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 5.054813] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.055811] systemd[1]: systemd-udevd.service: Consumed 1.408s CPU time over 3.082s wall clock time, 22.4M memory peak. lb # [ 5.036099] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 5.037103] systemd[1]: systemd-udevd.service: Consumed 1.418s CPU time over 3.054s wall clock time, 25.5M memory peak. lb # [ 5.040302] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 5.062000] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.020560] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 5.064267] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.019858] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.044252] systemd[1]: Closed udev Control Socket. lb # [ 5.044985] systemd[1]: Starting Cleanup udev Database... client # [ 5.021773] systemd[1]: Stopped target Basic System. worker1 # [ 5.024428] systemd[1]: Stopped target Basic System. lb # [ 5.045758] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.025484] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.068338] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.024164] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.069559] systemd[1]: Closed udev Control Socket. lb # [ 5.048301] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.027011] systemd[1]: Stopped target Path Units. worker2 # [ 5.070275] systemd[1]: Starting Cleanup udev Database... client # [ 5.025525] systemd[1]: Stopped target Path Units. lb # [ 5.049171] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 5.072147] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.030154] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.028340] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 5.052504] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.053494] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.032492] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.076141] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.031042] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.077039] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.056277] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.078152] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.037288] systemd[1]: Stopped target Slice Units. worker2 # [ 5.080255] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.036278] systemd[1]: Stopped target Slice Units. lb # [ 5.060179] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.037246] systemd[1]: Stopped target Socket Units. lb # [ 5.061480] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.040195] systemd[1]: Stopped target Socket Units. client # [ 5.038168] systemd[1]: Stopped target System Initialization. client # [ 5.039180] systemd[1]: Stopped target Swaps. worker2 # [ 5.084375] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.085289] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 5.086290] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.044228] systemd[1]: Stopped target System Initialization. client # [ 5.043850] systemd[1]: Stopped target Timer Units. worker1 # [ 5.047006] systemd[1]: Stopped target Swaps. client # [ 5.046834] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.049292] systemd[1]: Stopped target Timer Units. lb # [ 5.075213] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.052314] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.055970] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.054282] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.057056] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.078847] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.057963] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.079661] systemd[1]: Reached target Switch Root. worker1 # [ 5.059105] systemd[1]: Stopped Find NixOS closure. lb # [ 5.080937] systemd[1]: Starting NixOS Activation... worker1 # [ 5.059837] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.064411] systemd[1]: Stopped Find NixOS closure. worker2 # [ 5.108985] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 5.111962] systemd[1]: Finished Cleanup udev Database. worker2 # [ 5.113375] systemd[1]: Reached target Switch Root. client # [ 5.068334] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 5.114565] systemd[1]: Starting NixOS Activation... client # [ 5.070294] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.072422] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.073512] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.074397] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.075419] systemd[1]: Stopped Load Kernel Modules. client # [ 5.074429] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.078642] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.081963] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.081193] systemd[1]: Stopped Load Kernel Modules. client # [ 5.081997] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.084208] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.085010] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.087235] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.089707] systemd[1]: Stopped Create System Files and Directories. client # [ 5.088261] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.089367] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.092333] systemd[1]: Stopped target Local File Systems. client # [ 5.091207] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.095862] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.097117] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.098191] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.096219] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.099025] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.097251] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 5.098239] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.100149] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.101174] systemd[1]: Stopped Virtual Console Setup. client # [ 5.099042] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.101952] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.100577] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.102857] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.101616] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.103836] systemd[1]: systemd-udevd.service: Consumed 1.435s CPU time over 3.072s wall clock time, 22.2M memory peak. client # [ 5.102351] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.103278] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.104316] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.105246] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.106235] systemd[1]: systemd-udevd.service: Consumed 1.436s CPU time over 3.108s wall clock time, 22.3M memory peak. client # [ 5.107622] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.112409] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.113406] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.112264] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.113254] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.116207] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.117278] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.115253] systemd[1]: Closed udev Control Socket. worker1 # [ 5.120138] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.121157] systemd[1]: Closed udev Control Socket. client # [ 5.120260] systemd[1]: Starting Cleanup udev Database... client # [ 5.121150] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.124138] systemd[1]: Starting Cleanup udev Database... client # [ 5.122213] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.124956] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.123102] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.126029] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.128257] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.128211] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.129264] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.130221] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.132284] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.133308] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.136208] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.160893] initrd-nixos-activation-start[176]: booting system configuration /nix/store/hw6sjiya3fqcxqx5sjqhqri1ayky0v1l-nixos-system-lb-test worker2 # [ 5.197914] initrd-nixos-activation-start[176]: booting system configuration /nix/store/n25zl0ms12n9s2746s41c1gc7jq6ai9z-nixos-system-worker2-test worker1 # [ 5.156987] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.159608] systemd[1]: Finished Cleanup udev Database. client # [ 5.157436] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.161369] systemd[1]: Reached target Switch Root. client # [ 5.160915] systemd[1]: Finished Cleanup udev Database. client # [ 5.161741] systemd[1]: Reached target Switch Root. worker1 # [ 5.164652] systemd[1]: Starting NixOS Activation... client # [ 5.163143] systemd[1]: Starting NixOS Activation... lb # [ 5.190485] initrd-nixos-activation-start[176]: running activation script... worker2 # [ 5.230337] initrd-nixos-activation-start[176]: running activation script... worker1 # [ 5.244863] initrd-nixos-activation-start[178]: booting system configuration /nix/store/c7rqk0rlr4l2j2rnw1rm976l59blicb7-nixos-system-worker1-test client # [ 5.249654] initrd-nixos-activation-start[178]: booting system configuration /nix/store/ylfbn6z3ahrh8hrrlqp2284fnn7jlrh4-nixos-system-client-test worker1 # [ 5.278223] initrd-nixos-activation-start[178]: running activation script... client # [ 5.282996] initrd-nixos-activation-start[178]: running activation script... lb # [ 5.441263] initrd-nixos-activation-start[199]: setting up /etc... worker2 # [ 5.489713] initrd-nixos-activation-start[199]: setting up /etc... worker1 # [ 5.536526] initrd-nixos-activation-start[201]: setting up /etc... lb # [ 5.560569] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.562335] systemd[1]: Finished NixOS Activation. client # [ 5.539441] initrd-nixos-activation-start[201]: setting up /etc... lb # [ 5.564687] systemd[1]: Starting Switch Root... lb # [ 5.583266] systemd[1]: Switching root. worker2 # [ 5.608642] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.611375] systemd[1]: Finished NixOS Activation. worker2 # [ 5.616276] systemd[1]: Starting Switch Root... worker2 # [ 5.635479] systemd[1]: Switching root. worker1 # [ 5.654982] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.657858] systemd[1]: Finished NixOS Activation. worker1 # [ 5.659030] systemd[1]: Starting Switch Root... client # [ 5.657847] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 5.660209] systemd[1]: Finished NixOS Activation. client # [ 5.661848] systemd[1]: Starting Switch Root... worker1 # [ 5.675146] systemd[1]: Switching root. client # [ 5.683462] systemd[1]: Switching root. lb # [ 5.769348] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.809188] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.859541] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). client # [ 5.863037] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). lb # [ 6.289066] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.301887] systemd[1]: Detected virtualization qemu. worker2 # [ 6.312697] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.325304] systemd[1]: Detected virtualization qemu. lb # [ 6.305064] systemd[1]: Detected architecture arm64. lb # [ 6.308992] systemd[1]: Detected first boot. worker2 # [ 6.328609] systemd[1]: Detected architecture arm64. worker2 # [ 6.332633] systemd[1]: Detected first boot. lb # [ 6.314745] systemd[1]: Initializing machine ID from random generator. worker2 # [ 6.338592] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.363881] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.376672] systemd[1]: Detected virtualization qemu. worker1 # [ 6.378748] systemd[1]: Detected architecture arm64. client # [ 6.366878] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.381155] systemd[1]: Detected first boot. client # [ 6.379691] systemd[1]: Detected virtualization qemu. worker1 # [ 6.386764] systemd[1]: Initializing machine ID from random generator. client # [ 6.382997] systemd[1]: Detected architecture arm64. client # [ 6.387044] systemd[1]: Detected first boot. client # [ 6.392909] systemd[1]: Initializing machine ID from random generator. lb # [ 6.634244] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.670660] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 6.710904] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.713929] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.821456] systemd[1]: Applying preset policy. worker2 # [ 6.896925] systemd[1]: Applying preset policy. client # [ 6.894525] systemd[1]: Applying preset policy. worker1 # [ 6.923860] systemd[1]: Applying preset policy. lb # [ 7.061812] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.117843] systemd[1]: Populated /etc with preset unit settings. client # [ 7.127396] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.161251] systemd[1]: Populated /etc with preset unit settings. lb # [ 7.302623] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 7.303977] systemd[1]: Stopped initrd-switch-root.service. lb # [ 7.308474] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 7.313010] systemd[1]: Created slice Slice /system/getty. lb # [ 7.314969] systemd[1]: Created slice User and Session Slice. lb # [ 7.317331] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 7.319677] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 7.322070] systemd[1]: Expecting device /dev/hvc0... lb # [ 7.323951] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 7.325989] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 7.327091] systemd[1]: Stopped target initrd-fs.target. lb # [ 7.329517] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.350279] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 7.330584] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.351677] systemd[1]: Stopped initrd-switch-root.service. lb # [ 7.333189] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 7.334413] systemd[1]: Reached target Path Units. worker2 # [ 7.355996] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 7.335886] systemd[1]: Reached target Remote File Systems. lb # [ 7.338399] systemd[1]: Reached target Slice Units. lb # [ 7.339402] systemd[1]: Reached target Swaps. worker2 # [ 7.359133] systemd[1]: Created slice Slice /system/getty. lb # [ 7.342408] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.362037] systemd[1]: Created slice User and Session Slice. lb # [ 7.345500] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.364453] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 7.347729] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.366813] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.369012] systemd[1]: Expecting device /dev/hvc0... lb # [ 7.350200] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.370954] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 7.351434] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.371983] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.373619] systemd[1]: Stopped target initrd-fs.target. lb # [ 7.355660] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.375227] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.377640] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 7.357878] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.378757] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.380485] systemd[1]: Reached target Path Units. lb # [ 7.361646] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.381938] systemd[1]: Reached target Remote File Systems. lb # [ 7.363206] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.384615] systemd[1]: Reached target Slice Units. lb # [ 7.364922] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.385585] systemd[1]: Reached target Swaps. lb # [ 7.367435] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.388537] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.391553] systemd[1]: Listening on Process Core Dump Socket. lb # [ 7.373408] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.393803] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 7.374795] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.396325] systemd[1]: Listening on Factory Reset Management. lb # [ 7.376430] systemd[1]: Listening on udev Varlink Socket. client # [ 7.352388] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.397547] systemd[1]: Listening on Hostname Service Socket. client # [ 7.353735] systemd[1]: Stopped initrd-switch-root.service. lb # [ 7.379983] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.401878] systemd[1]: Starting Journal Log Access Socket... client # [ 7.357179] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 7.385065] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 7.404243] systemd[1]: Listening on Journal Audit Socket. client # [ 7.361326] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.407846] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 7.363491] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.409412] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 7.364775] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.411544] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.366816] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.413430] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 7.369378] systemd[1]: Expecting device /dev/hvc0... client # [ 7.370471] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 7.372884] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.419164] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 7.374011] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.420537] systemd[1]: Listening on udev Control Socket. client # [ 7.375602] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 7.379984] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 7.401347] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.422153] systemd[1]: Listening on udev Varlink Socket. client # [ 7.377217] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 7.381669] systemd[1]: Stopped initrd-switch-root.service. client # [ 7.378961] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.425850] systemd[1]: Mounting Huge Pages File System... client # [ 7.381467] systemd[1]: Reached target Path Units. lb # [ 7.407360] systemd[1]: Mounting Kernel Trace File System... client # [ 7.382762] systemd[1]: Reached target Remote File Systems. worker1 # [ 7.386248] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 7.385117] systemd[1]: Reached target Slice Units. worker1 # [ 7.390633] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.431062] systemd[1]: Mounting POSIX Message Queue File System... client # [ 7.386098] systemd[1]: Reached target Swaps. worker1 # [ 7.392671] systemd[1]: Created slice User and Session Slice. client # [ 7.389837] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 7.393887] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 7.392974] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.438880] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 7.395760] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 7.419686] systemd[1]: Starting Create List of Static Device Nodes... client # [ 7.395262] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 7.398394] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 7.400408] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 7.397664] systemd[1]: Listening on Factory Reset Management. client # [ 7.398983] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 7.402298] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 7.424681] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 7.404324] systemd[1]: Stopped target initrd-fs.target. client # [ 7.403322] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.406164] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 7.408142] systemd[1]: Stopped target initrd-switch-root.target. client # [ 7.405667] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 7.410137] systemd[1]: Reached target Virtual Machines and Containers. client # [ 7.408631] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.454642] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 7.412339] systemd[1]: Reached target Path Units. client # [ 7.410207] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 7.414167] systemd[1]: Reached target Remote File Systems. client # [ 7.411970] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.416132] systemd[1]: Reached target Slice Units. client # [ 7.414357] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.417979] systemd[1]: Reached target Swaps. lb # [ 7.442536] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 7.421322] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 7.443854] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 7.420544] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.465932] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.424400] systemd[1]: Listening on Process Core Dump Socket. client # [ 7.421914] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.467686] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 7.426610] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 7.423683] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 7.428947] systemd[1]: Listening on Factory Reset Management. worker1 # [ 7.430146] systemd[1]: Listening on Hostname Service Socket. lb # [ 7.452023] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.428215] systemd[1]: Mounting Huge Pages File System... lb # [ 7.454914] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.434378] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.436434] systemd[1]: Listening on Journal Audit Socket. client # [ 7.435043] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.440167] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 7.441725] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 7.438815] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 7.443416] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.485707] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.486124] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.486395] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.445446] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.486664] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.453038] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 7.454408] systemd[1]: Listening on udev Control Socket. client # [ 7.450971] systemd[1]: Mounting Kernel Trace File System... lb # [ 7.476821] systemd[1]: Mounting FUSE Control File System... worker1 # [ 7.456243] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 7.460776] systemd[1]: Mounting Huge Pages File System... lb # [ 7.481590] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.508401] systemd[1]: Mounting FUSE Control File System... worker1 # [ 7.468389] systemd[1]: Mounting POSIX Message Queue File System... client # [ 7.467012] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 7.508830] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.475798] systemd[1]: Mounting Kernel Debug File System... client # [ 7.474411] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 7.489286] systemd[1]: Mounting Kernel Trace File System... client # [ 7.486228] systemd[1]: Mounting Kernel Configuration File System... lb # [ 7.516761] systemd[1]: Starting Journal Service... client # [ 7.489881] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.537117] systemd[1]: Starting Journal Service... client # [ 7.495090] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.500074] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.507994] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.508404] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 7.534407] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.555262] systemd[1]: Starting Load Kernel Modules... worker1 # [ 7.516560] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 7.520287] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 7.523931] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.522934] systemd[1]: Mounting FUSE Control File System... worker1 # [ 7.525736] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.571134] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 7.525240] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.554314] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.582330] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.584878] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.567940] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 7.547222] systemd[1]: Mounting FUSE Control File System... lb # [ 7.568359] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.548558] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.600278] systemd[1]: Starting Coldplug All udev Devices... client # [ 7.558532] systemd[1]: Starting Journal Service... worker2 # [ 7.606526] systemd[1]: Listening on Journal Log Access Socket. lb # [ 7.587265] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 7.612437] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.616503] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 7.598185] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 7.619712] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.579307] systemd[1]: Starting Journal Service... worker2 # [ 7.623097] systemd[1]: Mounted Kernel Trace File System. lb # [ 7.605836] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.625321] systemd[1]: Mounted Kernel Configuration File System. client # [ 7.582443] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.627525] systemd[1]: Mounted FUSE Control File System. worker1 # [ 7.597122] systemd[1]: Starting Load Kernel Modules... lb # [ 7.621939] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 7.625690] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.604653] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 7.628893] systemd-journald[269]: Collecting audit messages is enabled. lb # [ 7.630653] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 7.651228] systemd[1]: Finished Create List of Static Device Nodes. client # [ 7.611164] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.659642] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 7.641056] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 7.641630] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 7.626807] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 7.628928] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.624494] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 7.624885] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.653326] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 7.659578] systemd[1]: Finished Load Kernel Modules. worker1 # [ 7.640406] systemd[1]: Starting Coldplug All udev Devices... client # [ 7.637966] systemd[1]: Starting Coldplug All udev Devices... client # [ 7.641943] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 7.645355] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 7.648686] systemd[1]: Mounted Huge Pages File System. lb # [ 7.673267] systemd[1]: Starting Firewall... lb # [ 7.651959] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 7.655128] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 7.655643] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.658517] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.658978] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 7.659357] systemd[1]: Mounted FUSE Control File System. client # [ 7.658821] systemd-journald[271]: Collecting audit messages is enabled. client # [ 7.660072] systemd[1]: Mounted Huge Pages File System. lb # [ 7.688462] systemd[1]: Starting Apply Kernel Variables... lb # [ 7.689028] systemd[1]: Started Journal Service. client # [ 7.664314] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 7.714906] EXT4-fs (vda): re-mounted 386cf252-64d3-4618-a226-465d74eae136. worker1 # [ 7.671963] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 7.678410] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 7.677952] systemd[1]: Mounted Kernel Debug File System. client # [ 7.665294] systemd[1]: Queued start job for default target Multi-User System. client # [ 7.682064] systemd[1]: Started Journal Service. client # [ 7.669223] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 7.728421] systemd[1]: Finished Load Kernel Modules. worker2 # [ 7.735482] systemd[1]: Starting Firewall... client # [ 7.678438] systemd[1]: Mounted Kernel Trace File System. client # [ 7.686511] systemd[1]: Finished Create List of Static Device Nodes. client # [ 7.687470] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.731324] EXT4-fs (vda): re-mounted ad359d95-b0e5-48b9-a22f-93ffc0000a4d. worker2 # [ 7.751302] systemd[1]: Starting Apply Kernel Variables... client # [ 7.695891] systemd-modules-load[272]: Module 'atkbd' is built in worker2 # [ 7.754751] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 7.757167] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 7.760095] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.704454] systemd-modules-load[272]: Module 'loop' is built in client # [ 7.705432] systemd[1]: Finished Load Kernel Modules. worker2 # [ 7.771881] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 7.772250] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.776673] systemd-journald[269]: Collecting audit messages is enabled. client # [ 7.718741] systemd[1]: Starting Apply Kernel Variables... client # [ 7.722065] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 7.748957] systemd[1]: Finished Load Kernel Modules. worker1 # [ 7.755991] systemd[1]: Starting Firewall... worker1 # [ 7.764491] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 7.777055] EXT4-fs (vda): re-mounted b5ce059f-4a59-46b4-bd3f-48aa5e04944e. worker2 # [ 7.824961] systemd[1]: Started Journal Service. client # [ 7.780817] EXT4-fs (vda): re-mounted 449ab7fb-d156-4db5-9325-439d708b0383. worker1 # [ 7.784610] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 7.785197] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.785495] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.822239] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 7.823417] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 7.780955] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 7.782632] systemd[1]: Mounted FUSE Control File System. worker1 # [ 7.800340] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 7.802642] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.791450] systemd-oomd[274]: No swap; memory pressure usage will be degraded worker2 # [ 7.838650] systemd-modules-load[270]: Module 'atkbd' is built in worker1 # [ 7.811372] systemd-journald[271]: Collecting audit messages is enabled. client # [ 7.800300] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 7.801292] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 7.847556] systemd-modules-load[270]: Module 'loop' is built in client # [ 7.802199] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.857723] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 7.814818] systemd[1]: Starting Load/Save OS Random Seed... client # [ 7.815744] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.820607] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 7.870151] systemd-oomd[271]: No swap; memory pressure usage will be degraded worker2 # [ 7.886462] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.864020] systemd[1]: Started Journal Service. worker2 # [ 7.895781] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 7.904659] systemd[1]: Reached target First Boot Complete. client # [ 7.889434] systemd-journald[271]: Received client request to flush runtime journal. worker1 # [ 7.882902] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 7.884221] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 7.889557] systemd-modules-load[272]: Module 'atkbd' is built in worker2 # [ 7.932659] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.897301] systemd-modules-load[272]: Module 'loop' is built in worker1 # [ 7.906798] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 7.907927] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 7.958907] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 7.919399] systemd[1]: Reached target First Boot Complete. worker2 # [ 7.968458] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 7.985402] systemd-journald[269]: Received client request to flush runtime journal. client # [ 7.928512] systemd[1]: Finished Load/Save OS Random Seed. client # [ 7.929461] systemd[1]: Reached target First Boot Complete. client # [ 7.930254] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.942368] systemd-oomd[273]: No swap; memory pressure usage will be degraded client # [ 7.941042] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 7.956857] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.957701] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 7.958701] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 7.969265] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 8.000800] systemd-journald[271]: Received client request to flush runtime journal. worker2 # [ 8.045588] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.041799] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 8.112290] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.113681] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 8.117979] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.131753] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 8.136212] systemd[1]: Reached target Preparation for Local File Systems. client # [ 8.136855] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 8.140570] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.144281] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 8.242725] systemd-udevd[309]: Using default interface naming scheme 'v261'. worker1 # [ 8.253771] systemd-udevd[311]: Using default interface naming scheme 'v261'. lb # [ 7.661895] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.301902] systemd-journald[269]: Received client request to flush runtime journal. worker2 # [ 8.338940] systemd[1]: Mounting /run/wrappers... worker2 # [ 8.393850] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 8.375549] systemd-modules-load[270]: Module 'atkbd' is built in lb # [ 8.384180] systemd-modules-load[270]: Module 'loop' is built in lb # [ 8.385648] systemd-oomd[271]: No swap; memory pressure usage will be degraded lb # [ 8.387157] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.409709] systemd[1]: Mounted /run/wrappers. worker1 # [ 8.367598] systemd[1]: Mounting /run/wrappers... worker2 # [ 8.410549] systemd[1]: Reached target Local File Systems. lb # [ 8.397702] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.419181] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 8.398870] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.399950] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.426489] systemd[1]: Starting register-nix-paths.service... worker2 # [ 8.427386] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 8.410527] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 8.411506] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.421611] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 8.422709] systemd[1]: Mounted FUSE Control File System. lb # [ 8.423615] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 8.448860] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.432885] systemd[1]: Reached target First Boot Complete. lb # [ 8.433916] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.434825] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 8.435971] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 8.459687] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 8.418508] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 8.463150] systemd[1]: Starting Create System Files and Directories... worker1 # [ 8.429840] systemd[1]: Mounted /run/wrappers. worker1 # [ 8.430673] systemd[1]: Reached target Local File Systems. lb # [ 8.452733] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 8.453755] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 8.454735] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 8.455754] systemd[1]: Mounting /run/wrappers... worker1 # [ 8.438587] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 8.470200] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.449267] systemd[1]: Starting register-nix-paths.service... lb # [ 8.471461] systemd-udevd[295]: Using default interface naming scheme 'v261'. lb # [ 8.478212] systemd[1]: Mounted /run/wrappers. lb # [ 8.478919] systemd[1]: Reached target Local File Systems. lb # [ 8.479701] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 8.464160] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 8.487954] systemd[1]: Starting register-nix-paths.service... lb # [ 8.491548] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 8.470737] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.476183] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 8.498393] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.499867] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 8.484101] systemd[1]: Starting Create System Files and Directories... lb # [ 8.513526] systemd[1]: Starting Create System Files and Directories... client # [ 8.490614] systemd[1]: Finished Coldplug All udev Devices. client # [ 8.498590] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 8.501057] systemd[1]: Reached target Preparation for Local File Systems. client # [ 8.504581] systemd[1]: Mounting /run/wrappers... client # [ 8.516289] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 8.574746] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 8.581730] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.551336] systemd[1]: Mounted /run/wrappers. client # [ 8.552763] systemd[1]: Reached target Local File Systems. lb # [ 8.582166] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 8.559572] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 8.563450] systemd[1]: Starting register-nix-paths.service... client # [ 8.569610] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 8.571385] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.597644] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.575470] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 8.580693] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.586526] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.584951] systemd[1]: Starting Create System Files and Directories... client # [ 8.602831] systemd-udevd[302]: Using default interface naming scheme 'v261'. worker2 # [ 8.678991] systemd[1]: Finished Create System Files and Directories. worker2 # [ 8.683029] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 8.697622] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.659920] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 8.669621] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 8.703566] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 8.689749] systemd[1]: Finished Create System Files and Directories. worker1 # [ 8.695417] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 8.704866] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 8.737214] systemd[1]: Finished Create System Files and Directories. client # [ 8.735609] systemd[1]: Finished Create System Files and Directories. lb # [ 8.760324] systemd[1]: Starting Rebuild Journal Catalog... client # [ 8.744286] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 8.768425] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.748372] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 8.813903] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 8.782438] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 8.824747] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 8.879579] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 8.883469] systemd[1]: Starting Update is Completed... client # [ 8.853870] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 8.899760] systemd[1]: Finished Rebuild Journal Catalog. client # [ 8.901969] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 8.905294] systemd[1]: Starting Update is Completed... client # [ 8.904315] systemd[1]: Starting Update is Completed... lb # [ 8.929756] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 8.974448] systemd[1]: Finished Update is Completed. lb # [ 8.995557] systemd[1]: Finished Rebuild Journal Catalog. client # [ 8.973508] systemd[1]: Finished Update is Completed. lb # [ 9.006376] systemd[1]: Starting Update is Completed... worker1 # [ 8.995868] systemd[1]: Finished Update is Completed. lb # [ 9.108037] systemd[1]: Finished Update is Completed. client # [ 9.167406] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 9.228406] systemd[1]: Finished Coldplug All udev Devices. client # [ 9.220566] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 9.327429] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 9.330377] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 9.420183] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 9.424485] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 9.422459] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 9.450277] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 9.441918] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 9.445160] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 9.473825] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 9.487096] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 9.583147] systemd[1]: Finished Firewall. lb # [ 9.677983] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 9.660601] systemd[1]: Finished Firewall. lb # [ 9.684654] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 9.687823] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 9.691513] (udev-worker)[352]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 9.697920] (udev-worker)[352]: Network interface NamePolicy= disabled on kernel command line. client # [ 9.702593] (udev-worker)[348]: Network interface NamePolicy= disabled on kernel command line. lb # [ 9.774583] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 9.808063] systemd[1]: Finished register-nix-paths.service. lb # [ 9.809019] systemd[1]: Reached target System Initialization. lb # [ 9.809835] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 9.810815] systemd[1]: Started niks3 garbage collection timer. lb # [ 9.811631] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 9.820345] systemd[1]: Reached target Timer Units. lb # [ 9.821116] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 9.831052] systemd[1]: Listening on niks3 server socket. lb # [ 9.832255] systemd[1]: Listening on Nix Daemon Socket. lb # [ 9.833023] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 9.834148] systemd[1]: Reached target Socket Units. lb # [ 9.834848] systemd[1]: Reached target Basic System. lb # [ 9.849098] systemd[1]: Started backdoor.service. lb # [ 9.851185] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 9.858476] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 9.866920] systemd[1]: Starting Post-Boot Actions... worker2 # [ 9.894919] systemd[1]: Finished Coldplug All udev Devices. lb # [ 9.895006] systemd[1]: Started Reset console on configuration changes. worker1 # [ 9.881742] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 9.939637] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 9.950587] systemd[1]: Starting resolvconf update... worker2 # [ 9.974525] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 9.934307] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 9.963284] systemd[1]: Started rustfs.service. client # [ 9.944106] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 9.945414] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 9.951372] systemd[1]: Starting Create SUID/SGID Wrappers... lb # connecting to host... client # [ 9.953883] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.956175] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 9.955160] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 9.965302] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.966906] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 9.972551] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.999018] systemd[1]: Starting rustfs-bucket.service... client # [ 9.998056] mousedev: PS/2 mouse device common for all mice client # [ 9.986699] systemd[1]: Finished register-nix-paths.service. lb # [ 10.039452] (udev-worker)[401]: Network interface NamePolicy= disabled on kernel command line. lb # [ 10.069126] nsncd[452]: Sep 22 10:58:35.678 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.100746] systemd[1]: Finished register-nix-paths.service. worker2 # [ 10.102756] systemd[1]: Reached target System Initialization. worker2 # [ 10.105197] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 10.083619] (udev-worker)[404]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 10.107824] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 10.112969] systemd[1]: Reached target Timer Units. lb # [ 10.093535] (udev-worker)[404]: Network interface NamePolicy= disabled on kernel command line. lb # [ 10.094691] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 10.095536] systemd[1]: Finished Post-Boot Actions. worker2 # [ 10.119339] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 10.130694] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 10.131486] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 10.092085] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.094208] systemd[1]: Reached target System Initialization. worker1 # [ 10.096386] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 10.102400] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 10.125999] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 10.149821] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 10.108534] systemd[1]: Reached target Timer Units. worker1 # [ 10.109328] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 10.110427] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 10.111208] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 10.154340] systemd[1]: Reached target Socket Units. lb # [ 10.137059] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 10.161278] systemd[1]: Reached target Basic System. worker2 # [ 10.167321] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 10.148947] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 10.179924] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.142056] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 10.163896] systemd[1]: Starting User Login Management... worker2 # [ 10.192566] systemd[1]: Starting Post-Boot Actions... worker1 # [ 10.150237] systemd[1]: Reached target Socket Units. worker1 # [ 10.151654] systemd[1]: Reached target Basic System. worker1 # [ 10.153970] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 10.201681] systemd[1]: Started Reset console on configuration changes. worker1 # [ 10.162098] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 10.208533] systemd[1]: Starting resolvconf update... worker1 # [ 10.171814] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.217243] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 10.179862] systemd[1]: Started Reset console on configuration changes. lb # [ 10.204292] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 10.198467] systemd[1]: Starting resolvconf update... worker1 # [ 10.202515] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 10.259139] systemd[1]: Finished Post-Boot Actions. worker2 # [ 10.271912] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 10.286837] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.292556] nsncd[487]: Sep 22 10:58:35.886 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.251142] systemd[1]: Finished Post-Boot Actions. worker2 # [ 10.307367] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.266779] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 10.317363] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.278535] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.321451] systemd[1]: Starting User Login Management... worker1 # [ 10.286082] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.295784] nsncd[488]: Sep 22 10:58:35.875 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.342513] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 10.352425] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 10.311634] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.316488] systemd[1]: Starting User Login Management... worker2 # [ 10.359845] systemd[1]: Started backdoor.service. worker2 # [ 10.373548] dbus-broker-launch[491]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 10.333433] dbus-broker-launch[492]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 10.343229] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 10.390291] dbus-broker-launch[491]: NSS returned no entry for 'systemd-timesync' worker1 # [ 10.349682] dbus-broker-launch[492]: NSS returned no entry for 'systemd-timesync' worker2 # [ 10.395919] dbus-broker-launch[491]: Invalid user-name in /nix/store/flsxa7d757b7zpdiv9wsbs42iawcisak-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 10.355211] dbus-broker-launch[492]: Invalid user-name in /nix/store/flsxa7d757b7zpdiv9wsbs42iawcisak-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 10.369009] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 10.418199] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 10.411163] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 10.419242] dbus-broker-launch[492]: Ready worker2 # [ 10.463576] dbus-broker-launch[491]: Ready worker1 # [ 10.434847] systemd[1]: Started backdoor.service. client # [ 10.434867] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.438304] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.442510] systemd[1]: Reached target System Initialization. client # [ 10.443402] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # connecting to host... client # [ 10.448513] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 10.449483] systemd[1]: Reached target Timer Units. client # [ 10.450192] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 10.451079] systemd[1]: Listening on Nix Daemon Socket. client # [ 10.451839] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 10.485007] systemd-logind[491]: New seat seat0. client # [ 10.464327] systemd[1]: Reached target Socket Units. client # [ 10.466272] systemd[1]: Reached target Basic System. client # [ 10.467632] systemd[1]: Started backdoor.service. client # [ 10.472279] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 10.495913] dbus-broker-launch[490]: Looking up NSS user entry for 'systemd-timesync'... client # [ 10.473349] systemd[1]: Starting nftables firewall... worker2 # [ 10.525807] systemd-logind[500]: New seat seat0. lb # [ 10.506049] dbus-broker-launch[490]: NSS returned no entry for 'systemd-timesync' client # [ 10.488111] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 10.511028] dbus-broker-launch[490]: Invalid user-name in /nix/store/4yiprls1sll47jid3xzq0m9nmi1qz2ww-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 10.535038] systemd[1]: Started User Login Management. worker1 # [ 10.497913] systemd-logind[501]: New seat seat0. worker2 # [ 10.541978] systemd[1]: Starting linger-users.service... lb # [ 10.522888] systemd[1]: Started User Login Management. lb # [ 10.523646] systemd[1]: Starting linger-users.service... worker1 # [ 10.503163] systemd[1]: Started User Login Management. client # [ 10.504659] systemd[1]: Starting Post-Boot Actions... worker1 # [ 10.509961] systemd[1]: Starting linger-users.service... lb # [ 10.537512] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 10.561207] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 10.540163] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 10.562414] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 10.563258] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 10.547969] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 10.549820] systemd[1]: Stopping User and Group Name Lookups... worker1 # connecting to host... lb # [ 10.554104] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 10.534685] systemd[1]: Started Reset console on configuration changes. worker2 # [ 10.580764] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 10.581631] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 10.582491] systemd[1]: nscd.service: Deactivated successfully. lb # [ 10.561098] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 10.583311] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 10.541325] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 10.566350] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 10.592143] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.548857] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 10.582646] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 10.568899] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 10.575488] systemd[1]: Stopping User and Group Name Lookups... client # [ 10.578975] systemd[1]: Starting resolvconf update... worker1 # [ 10.581815] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 10.582723] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 10.583521] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 10.613449] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.594034] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 10.641478] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 10.642463] systemd[1]: Finished linger-users.service. client # connecting to host... worker2 # [ 10.656321] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.657287] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.615049] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 10.658182] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.619986] systemd[1]: Finished linger-users.service. worker2 # [ 10.666096] nsncd[561]: Sep 22 10:58:36.258 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.673855] (udev-worker)[350]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 10.657052] dbus-broker-launch[490]: Ready worker2 # [ 10.680571] (udev-worker)[350]: Network interface NamePolicy= disabled on kernel command line. client # [ 10.644936] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.693115] systemd[1]: Finished resolvconf update. worker2 # [ 10.693877] systemd[1]: Reached target Preparation for Network. client # [ 10.650148] nsncd[454]: Sep 22 10:58:36.245 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.700775] systemd[1]: Starting DHCP Client... worker1 # [ 10.658674] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 10.681812] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 10.659948] nsncd[562]: Sep 22 10:58:36.252 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 10.708554] systemd[1]: Starting Extra networking commands.... lb # [ 10.687618] systemd[1]: Finished linger-users.service. worker1 # [ 10.668947] systemd[1]: Reached target Host and Network Name Lookups. client # [ 10.671318] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.669838] systemd[1]: Reached target User and Group Name Lookups. client # [ 10.676360] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 10.721723] (udev-worker)[470]: Network interface NamePolicy= disabled on kernel command line. lb # [ 10.739660] nsncd[566]: Sep 22 10:58:36.348 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client: connected to guest root shell client # [ 10.699268] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 10.686123] systemd[1]: Finished resolvconf update. lb # [ 10.746598] systemd[1]: Started Name Service Cache Daemon (nsncd). client: (connecting took 11.17 seconds) client # [ 10.712751] systemd[1]: Starting User Login Management... worker1 # [ 10.686943] systemd[1]: Reached target Preparation for Network. lb # [ 10.749090] systemd[1]: Reached target Host and Network Name Lookups. client: (finished: waiting for the VM to finish booting, in 11.17 seconds) client # [ 10.719503] systemd[1]: Finished Post-Boot Actions. worker1 # [ 10.694682] systemd[1]: Starting DHCP Client... client # [ 10.729474] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 10.695788] (udev-worker)[462]: Network interface NamePolicy= disabled on kernel command line. lb # [ 10.749936] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.709590] systemd[1]: Starting Extra networking commands.... worker1 # [ 10.757007] (udev-worker)[350]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 10.763885] (udev-worker)[350]: Network interface NamePolicy= disabled on kernel command line. lb # [ 10.793774] systemd[1]: Finished resolvconf update. lb # [ 10.798340] systemd-logind[491]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 10.805365] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 10.813546] systemd[1]: Starting DHCP Client... worker2 # [ 10.936438] dhcpcd[596]: dhcpcd-10.3.2 starting worker2 # [ 10.945299] dhcpcd[640]: dev: loaded udev worker2 # [ 10.995922] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 10.939456] dhcpcd[598]: dhcpcd-10.3.2 starting worker1 # [ 10.950274] dhcpcd[641]: dev: loaded udev worker2 # [ 11.002608] systemd[1]: Finished Extra networking commands.. worker2 # [ 11.003545] systemd[1]: Reached target Network. worker2 # [ 11.009093] systemd[1]: Starting Permit User Sessions... client # [ 10.966200] systemd-logind[483]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 10.972636] systemd-logind[483]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 10.973790] systemd-logind[483]: New seat seat0. client # [ 10.982465] systemd[1]: Started User Login Management. client # [ 10.983523] dbus-broker-launch[481]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.004774] 8021q: 802.1Q VLAN Support v1.8 client # [ 10.999606] dbus-broker-launch[481]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.012366] systemd[1]: Finished Extra networking commands.. worker1 # [ 11.013286] systemd[1]: Reached target Network. worker1 # [ 11.018952] systemd[1]: Starting Permit User Sessions... client # [ 11.002736] dbus-broker-launch[481]: Invalid user-name in /nix/store/6wvgzhp3xj1v1xybf1ixpbqi5gif5fbv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.018402] systemd[1]: Starting linger-users.service... worker2 # [ 11.076767] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 11.039797] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.092197] systemd[1]: Starting Address configuration of eth1... lb # [ 11.078734] systemd[1]: Finished Firewall. lb # [ 11.082935] systemd[1]: Reached target Preparation for Network. worker2 # [ 11.119836] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 11.092194] systemd[1]: Starting Address configuration of eth1... lb # [ 11.096805] systemd[1]: Starting Extra networking commands.... worker2 # [ 11.121078] systemd[1]: Finished Permit User Sessions. worker2 # [ 11.126967] systemd[1]: Started Getty on tty1. worker2 # [ 11.127705] systemd[1]: Reached target Login Prompts. lb # [ 11.113121] dhcpcd[615]: dhcpcd-10.3.2 starting client # [ 11.094583] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.095631] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 11.118249] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 11.103574] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.109141] systemd[1]: Stopping User and Group Name Lookups... lb # [ 11.133529] dhcpcd[630]: dev: loaded udev client # [ 11.110035] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.111171] dbus-broker-launch[481]: Ready client # [ 11.111790] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 11.115412] systemd[1]: Finished Permit User Sessions. worker2 # [ 11.175145] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 11.175690] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 11.119757] systemd[1]: Started Getty on tty1. worker1 # [ 11.122425] systemd[1]: Reached target Login Prompts. worker2 # [ 11.178462] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 11.178848] cfg80211: failed to load regulatory.db client # [ 11.121315] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.122220] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.127382] systemd[1]: Finished linger-users.service. client # [ 11.145291] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.148670] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 11.153120] systemd[1]: Starting Address configuration of eth1... worker1 # [ 11.165953] systemd-logind[501]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 11.204732] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 11.215922] systemd-logind[500]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 11.189848] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 11.190374] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 11.193404] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 11.236651] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 11.193716] cfg80211: failed to load regulatory.db worker2 # [ 11.242218] network-addresses-eth1-start[651]: adding address 192.168.1.4/24... done lb # [ 11.243941] mousedev: PS/2 mouse device common for all mice worker2 # [ 11.268056] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 11.255084] dhcpcd[640]: eth0: waiting for carrier worker2 # [ 11.262117] dhcpcd[640]: eth0: waiting for carrier worker2 # [ 11.262859] dhcpcd[640]: eth0: carrier acquired client # [ 11.220602] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.268128] network-addresses-eth1-start[651]: adding address 2001:db8:1::4/64... done client # [ 11.226036] nsncd[546]: Sep 22 10:58:36.821 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.230892] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.231827] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.280118] dhcpcd[640]: DUID 00:01:00:01:32:45:1b:dc:52:54:00:12:34:56 worker2 # [ 11.281111] dhcpcd[640]: eth0: IAID 00:12:34:56 worker2 # [ 11.281766] dhcpcd[640]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 11.261699] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 11.291023] systemd[1]: Finished Address configuration of eth1. lb # [ 11.293527] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 11.257205] systemd[1]: Finished resolvconf update. client # [ 11.267277] systemd[1]: Starting DHCP Client... worker1 # [ 11.269489] network-addresses-eth1-start[656]: adding address 192.168.1.3/24... done worker1 # [ 11.287357] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 11.276271] dhcpcd[641]: eth0: waiting for carrier worker1 # [ 11.280669] dhcpcd[641]: eth0: waiting for carrier worker1 # [ 11.281433] dhcpcd[641]: eth0: carrier acquired worker1 # [ 11.288404] network-addresses-eth1-start[656]: adding address 2001:db8:1::3/64... done worker1 # [ 11.301308] dhcpcd[641]: DUID 00:01:00:01:32:45:1b:dc:52:54:00:12:34:56 worker1 # [ 11.302302] dhcpcd[641]: eth0: IAID 00:12:34:56 worker1 # [ 11.302958] dhcpcd[641]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 11.309274] systemd[1]: Finished Address configuration of eth1. lb # [ 11.367608] systemd-logind[491]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 11.372071] network-addresses-eth1-start[627]: adding address 192.168.1.2/24... done worker2 # [ 11.414965] mousedev: PS/2 mouse device common for all mice lb # [ 11.396213] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 11.396578] network-addresses-eth1-start[627]: adding address 2001:db8:1::2/64... done worker1 # [ 11.423788] mousedev: PS/2 mouse device common for all mice lb # [ 11.434069] systemd[1]: Finished Address configuration of eth1. lb # [ 11.474123] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 11.474643] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 11.478625] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 11.478941] cfg80211: failed to load regulatory.db client # [ 11.462630] dhcpcd[581]: dhcpcd-10.3.2 starting client # [ 11.473055] dhcpcd[588]: dev: loaded udev worker2 # [ 11.519228] systemd-logind[500]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 11.522904] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 11.531691] dhcpcd[641]: eth0: soliciting a DHCP lease worker1 # [ 11.537633] systemd-logind[501]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 11.538935] dhcpcd[641]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 11.544240] dhcpcd[641]: eth0: probing address 10.0.2.15/24 lb # [ 11.570144] dhcpcd[689]: /nix/store/1ki7bgdr0niilkg9jbkpcdaggbv0kb8a-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (635) - Operation not permitted lb # [ 11.575109] dhcpcd[689]: .resolvconf-wrapped: clearing stale lock pid 635 lb # [ 11.614660] systemd[1]: Finished Extra networking commands.. lb # [ 11.620955] systemd[1]: Reached target Network. lb # [ 11.630620] systemd[1]: Starting PostgreSQL Server... client # [ 11.625509] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 11.639424] systemd[1]: Starting Permit User Sessions... client # [ 11.666879] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 11.667381] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 11.694543] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 11.679821] dhcpcd[630]: eth0: waiting for carrier client # [ 11.669946] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 11.670357] cfg80211: failed to load regulatory.db lb # [ 11.683201] dhcpcd[630]: libudev: received NULL device lb # [ 11.691323] dhcpcd[630]: libudev: received NULL device lb # [ 11.694905] dhcpcd[630]: eth0: carrier acquired lb # [ 11.709938] dhcpcd[630]: DUID 00:01:00:01:32:45:1b:dd:52:54:00:12:34:56 lb # [ 11.710916] dhcpcd[630]: eth0: IAID 00:12:34:56 lb # [ 11.711545] dhcpcd[630]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 11.718164] systemd[1]: Finished nftables firewall. client # [ 11.720248] systemd[1]: Reached target Preparation for Network. lb # [ 11.749595] systemd[1]: Finished Permit User Sessions. client # [ 11.728356] systemd[1]: Starting Address configuration of eth1... client # [ 11.733548] systemd[1]: Starting Extra networking commands.... lb # [ 11.759148] systemd[1]: Started Getty on tty1. lb # [ 11.765199] systemd[1]: Reached target Login Prompts. client # [ 11.777710] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 11.766786] dhcpcd[588]: eth0: waiting for carrier client # [ 11.768950] dhcpcd[588]: libudev: received NULL device client # [ 11.771962] dhcpcd[588]: libudev: received NULL device client # [ 11.776233] dhcpcd[588]: eth0: carrier acquired client # [ 11.792705] dhcpcd[588]: DUID 00:01:00:01:32:45:1b:dd:52:54:00:12:34:56 client # [ 11.793658] dhcpcd[588]: eth0: IAID 00:12:34:56 client # [ 11.794307] dhcpcd[588]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 11.856751] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 11.867686] network-addresses-eth1-start[613]: adding address 192.168.1.1/24... done client # [ 11.895144] network-addresses-eth1-start[613]: adding address 2001:db8:1::1/64... done client # [ 11.928298] systemd[1]: Finished Address configuration of eth1. lb # [ 12.021232] postgresql-pre-start[729]: The files belonging to this database system will be owned by user "postgres". lb # [ 12.022657] postgresql-pre-start[729]: This user must also own the server process. lb # [ 12.041192] postgresql-pre-start[729]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 12.044738] postgresql-pre-start[729]: The default database encoding has accordingly been set to "UTF8". lb # [ 12.045988] postgresql-pre-start[729]: The default text search configuration will be set to "english". lb # [ 12.047228] postgresql-pre-start[729]: Data page checksums are enabled. lb # [ 12.051728] postgresql-pre-start[729]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.055848] postgresql-pre-start[729]: creating subdirectories ... ok client # [ 12.032984] systemd[1]: Finished Extra networking commands.. lb # [ 12.058268] postgresql-pre-start[729]: selecting dynamic shared memory implementation ... posix client # [ 12.036365] systemd[1]: Reached target Network. client # [ 12.041052] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.110354] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 client # [ 12.077840] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 client # [ 12.104957] dhcpcd[588]: eth0: soliciting a DHCP lease client # [ 12.107125] systemd[1]: Finished Permit User Sessions. client # [ 12.113200] dhcpcd[588]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 12.118098] systemd[1]: Started Getty on tty1. client # [ 12.120605] systemd[1]: Reached target Login Prompts. client # [ 12.121352] dhcpcd[588]: eth0: probing address 10.0.2.15/24 worker1 # [ 12.138218] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 lb # [ 12.178389] postgresql-pre-start[729]: selecting default "max_connections" ... 100 client: (finished: waiting for unit network-addresses-eth1.service, in 12.64 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } worker2 # [ 12.317655] dhcpcd[640]: eth0: soliciting a DHCP lease worker2 # [ 12.324499] dhcpcd[640]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 12.304885] postgresql-pre-start[729]: selecting default "shared_buffers" ... 128MB worker2 # [ 12.332220] dhcpcd[640]: eth0: probing address 10.0.2.15/24 client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.09 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2 # [ 12.418022] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 12.427326] systemd[1]: Starting Virtual Console Setup... lb: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker2 # [ 12.447200] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 12.450800] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 12.455665] systemd[1]: Starting Virtual Console Setup... worker1 # [ 12.428514] systemd[1]: Starting Virtual Console Setup... lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 12.446680] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 12.518275] systemd-logind[500]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 12.476895] systemd[1]: Starting Virtual Console Setup... worker1 # [ 12.483693] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 12.490948] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 12.499149] systemd[1]: Starting Virtual Console Setup... client # [ 12.497808] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 12.503647] systemd[1]: Stopped Virtual Console Setup. client # [ 12.509454] systemd[1]: Starting Virtual Console Setup... client # [ 12.524152] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker2 # [ 12.599110] systemd-vconsole-setup[692]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 12.601797] systemd[1]: Finished Virtual Console Setup. client # [ 12.566756] systemd-logind[483]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.06 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 12.600793] systemd-logind[501]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.04 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } client # [ 12.655844] systemd-vconsole-setup[698]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service client # [ 12.659938] systemd[1]: Finished Virtual Console Setup. worker1 # [ 12.677916] systemd-vconsole-setup[698]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 12.682663] systemd[1]: Finished Virtual Console Setup. worker2 # [ 12.782239] dhcpcd[640]: eth0: soliciting an IPv6 router worker2 # [ 12.785334] dhcpcd[640]: eth0: Router Advertisement from fe80::2 worker2 # [ 12.786839] dhcpcd[640]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 12.788518] dhcpcd[640]: eth0: adding route to fec0::/64 worker2 # [ 12.789897] dhcpcd[640]: eth0: adding default route via fe80::2 lb # [ 12.803859] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 worker1 # [ 12.790758] dhcpcd[641]: eth0: soliciting an IPv6 router worker1 # [ 12.794636] dhcpcd[641]: eth0: Router Advertisement from fe80::2 worker1 # [ 12.796814] dhcpcd[641]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 12.799227] dhcpcd[641]: eth0: adding route to fec0::/64 worker1 # [ 12.801333] dhcpcd[641]: eth0: adding default route via fe80::2 lb # [ 13.157279] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 13.164663] systemd[1]: Starting Virtual Console Setup... lb # [ 13.185257] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 13.192137] systemd[1]: Stopped Virtual Console Setup. lb # [ 13.197671] systemd[1]: Starting Virtual Console Setup... lb # [ 13.258702] systemd-logind[491]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 13.441950] systemd-vconsole-setup[760]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 13.445670] systemd[1]: Finished Virtual Console Setup. lb # [ 13.554936] dhcpcd[630]: eth0: soliciting a DHCP lease lb # [ 13.556469] dhcpcd[630]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 13.564143] dhcpcd[630]: eth0: probing address 10.0.2.15/24 lb # [ 13.787335] postgresql-pre-start[729]: selecting default time zone ... UTC lb # [ 13.790055] postgresql-pre-start[729]: creating configuration files ... ok client # [ 13.929570] dhcpcd[588]: eth0: soliciting an IPv6 router client # [ 13.933042] dhcpcd[588]: eth0: Router Advertisement from fe80::2 client # [ 13.935590] dhcpcd[588]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 13.938982] dhcpcd[588]: eth0: adding route to fec0::/64 client # [ 13.941315] dhcpcd[588]: eth0: adding default route via fe80::2 lb # [ 14.065539] postgresql-pre-start[729]: running bootstrap script ... ok lb # [ 14.265109] dhcpcd[630]: eth0: soliciting an IPv6 router lb # [ 14.266696] dhcpcd[630]: eth0: Router Advertisement from fe80::2 lb # [ 14.267531] dhcpcd[630]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 14.270442] dhcpcd[630]: eth0: adding route to fec0::/64 lb # [ 14.271231] dhcpcd[630]: eth0: adding default route via fe80::2 lb # [ 14.575319] postgresql-pre-start[729]: performing post-bootstrap initialization ... ok lb # [ 14.729631] postgresql-pre-start[729]: syncing data to disk ... ok lb # [ 14.731733] postgresql-pre-start[729]: initdb: warning: enabling "trust" authentication for local connections lb # [ 14.733258] postgresql-pre-start[729]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 14.735250] postgresql-pre-start[729]: Success. You can now start the database server using: lb # [ 14.736422] postgresql-pre-start[729]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 14.831366] postgres[779]: [779] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 14.840484] postgres[779]: [779] LOG: listening on IPv6 address "::1", port 5432 lb # [ 14.842712] postgres[779]: [779] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 14.847487] postgres[779]: [779] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 14.869002] postgres[788]: [788] LOG: database system was shut down at 2026-09-22 10:58:40 GMT lb # [ 14.878296] postgres[779]: [779] LOG: database system is ready to accept connections lb # [ 14.883368] systemd[1]: Started PostgreSQL Server. lb # [ 14.889370] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 15.110452] postgresql-setup-start[800]: CREATE DATABASE lb # [ 15.148530] postgresql-setup-start[814]: CREATE ROLE lb # [ 15.164353] postgresql-setup-start[816]: ALTER DATABASE lb # [ 15.169944] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 15.171791] systemd[1]: Reached target PostgreSQL. worker1 # [ 15.690368] dhcpcd[641]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 15.693574] dhcpcd[641]: eth0: adding route to 10.0.2.0/24 worker1 # [ 15.695896] dhcpcd[641]: eth0: adding default route via 10.0.2.2 worker1 # [ 15.826272] systemd[1]: Started DHCP Client. worker1 # [ 15.828280] systemd[1]: Reached target Multi-User System. worker1 # [ 15.829079] systemd[1]: Startup finished in 972ms (kernel) + 4.952s (initrd) + 9.902s (userspace) = 15.827s. client # [ 16.524179] dhcpcd[588]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 16.524491] dhcpcd[588]: eth0: adding route to 10.0.2.0/24 client # [ 16.524625] dhcpcd[588]: eth0: adding default route via 10.0.2.2 client # [ 16.666447] systemd[1]: Started DHCP Client. client # [ 16.668836] systemd[1]: Reached target Multi-User System. client # [ 16.672518] systemd[1]: Startup finished in 969ms (kernel) + 4.965s (initrd) + 10.735s (userspace) = 16.670s. worker2 # [ 17.117754] dhcpcd[640]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 17.121741] dhcpcd[640]: eth0: adding route to 10.0.2.0/24 worker2 # [ 17.127021] dhcpcd[640]: eth0: adding default route via 10.0.2.2 worker2 # [ 17.275486] systemd[1]: Started DHCP Client. worker2 # [ 17.278175] systemd[1]: Reached target Multi-User System. worker2 # [ 17.279186] systemd[1]: Startup finished in 970ms (kernel) + 4.906s (initrd) + 11.399s (userspace) = 17.277s. lb # [ 18.070183] dhcpcd[630]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 18.073343] dhcpcd[630]: eth0: adding route to 10.0.2.0/24 lb # [ 18.075630] dhcpcd[630]: eth0: adding default route via 10.0.2.2 lb # [ 18.252750] systemd[1]: Started DHCP Client. lb # [ 18.254740] systemd[1]: Reached target Network is Online. lb # [ 18.259061] systemd[1]: Started Envoy reverse proxy. lb # [ 18.262852] systemd[1]: Started mock-oidc.service. lb # [ 18.357197] mock-oidc-server[899]: Mock OIDC Server running lb # [ 18.358078] mock-oidc-server[899]: OIDC Address: 192.168.1.2:8080 lb # [ 18.358890] mock-oidc-server[899]: Issue Address: 0.0.0.0:8081 lb # [ 18.359658] mock-oidc-server[899]: Issuer: http://192.168.1.2:8080/oidc lb # [ 18.360864] mock-oidc-server[899]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 18.363974] mock-oidc-server[899]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 18.365584] mock-oidc-server[899]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 18.577565] envoy[898]: [2026-09-22 10:58:44.188][898][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 18.580413] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 18.581853] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 18.583605] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 18.586258] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 18.592260] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 18.621841] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 18.625616] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 18.627752] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 18.631487] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 18.633946] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 18.637163] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 18.639210] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 18.642242] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 18.645099] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 18.646903] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 18.649824] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 18.651521] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 18.659074] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 18.660978] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 18.667141] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 18.670422] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 18.672874] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 18.677952] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 18.682260] envoy[898]: [2026-09-22 10:58:44.190][898][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 18.684399] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 18.686321] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 18.689591] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 18.691510] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 18.693295] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 18.695301] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 18.697251] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 18.700325] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 18.703489] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 18.708486] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 18.711755] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 18.714031] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 18.716028] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 18.723418] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 18.726024] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 18.728101] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 18.729963] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 18.733081] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 18.765621] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 18.774467] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 18.776729] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 18.779894] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 18.784254] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 18.787309] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 18.789874] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple worker2 # [ 18.809814] systemd[1]: Reached target Network is Online. lb # [ 18.792207] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 18.794995] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default worker1 # [ 18.776666] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 18.819654] systemd[1]: Starting scheduler-token.service... lb # [ 18.798353] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 18.801763] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 18.803499] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 18.805389] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 18.808776] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 18.811383] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 18.817892] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 18.819581] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.822356] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 18.832992] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 18.834780] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 18.837007] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 18.838786] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 18.842132] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 18.844626] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 18.849672] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 18.854051] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 18.861324] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 18.862964] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 18.864589] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 18.866677] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 18.868837] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 18.870650] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 18.872461] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 18.874174] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 18.876652] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 18.879967] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 18.883071] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 18.886569] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 18.889814] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd worker2 # [ 18.920350] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 18.928220] systemd[1]: Finished scheduler-token.service. lb # [ 18.895331] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 18.909071] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 18.910812] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 worker2 # [ 18.930182] systemd[1]: scheduler-token.service: Consumed 65ms CPU time over 104ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb # [ 18.912645] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 18.914840] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 18.917138] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 18.919006] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 18.921010] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.923460] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san worker2 # [ 18.951778] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 18.930523] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 18.932825] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 18.934739] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 18.936601] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 18.938550] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 18.940325] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 18.942516] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 18.946063] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 18.948083] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 18.951163] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 18.953716] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 18.956334] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 18.958684] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 18.962945] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 18.965297] envoy[898]: [2026-09-22 10:58:44.191][898][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 18.969937] envoy[898]: [2026-09-22 10:58:44.214][898][info][main] [source/server/server.cc:531] HTTP header map info: worker1 # [ 18.962053] nix-grpc-daemon[768]: ts=2026-09-22T10:58:44Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 18.971297] envoy[898]: [2026-09-22 10:58:44.214][898][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 18.986636] envoy[898]: [2026-09-22 10:58:44.214][898][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: worker1 # [ 18.970590] nix-grpc-daemon[768]: ts=2026-09-22T10:58:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 18.972718] nix-grpc-daemon[768]: ts=2026-09-22T10:58:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 18.988128] envoy[898]: [2026-09-22 10:58:44.214][898][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 18.996853] envoy[898]: [2026-09-22 10:58:44.214][898][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 18.998591] envoy[898]: [2026-09-22 10:58:44.232][898][info][main] [source/server/server.cc:968] runtime: {} lb # [ 18.999845] envoy[898]: [2026-09-22 10:58:44.236][898][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 19.001575] envoy[898]: [2026-09-22 10:58:44.236][898][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 19.003302] envoy[898]: [2026-09-22 10:58:44.236][898][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 19.004852] envoy[898]: [2026-09-22 10:58:44.241][898][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration worker1 # [ 18.982636] nix-grpc-daemon[768]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR lb # [ 19.006390] envoy[898]: [2026-09-22 10:58:44.241][898][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) worker1 # [ 18.985216] nix-grpc-daemon[768]: E0000 00:00:1790074724.577648 768 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 19.007931] envoy[898]: [2026-09-22 10:58:44.241][898][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 19.009587] envoy[898]: [2026-09-22 10:58:44.394][898][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 19.011068] envoy[898]: [2026-09-22 10:58:44.411][898][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker1 # [ 18.989872] nix-grpc-daemon[768]: E0000 00:00:1790074724.584880 768 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 19.012674] envoy[898]: [2026-09-22 10:58:44.412][898][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 19.015679] envoy[898]: [2026-09-22 10:58:44.412][898][info][main] [source/server/server.cc:1077] starting main dispatch loop worker1 # [ 19.010503] nix-grpc-daemon[768]: ts=2026-09-22T10:58:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 19.012605] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 19.038370] envoy[898]: [2026-09-22 10:58:44.649][898][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker1 # [ 19.018168] nix-grpc-daemon[768]: E0000 00:00:1790074724.612461 810 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 19.040641] envoy[898]: [2026-09-22 10:58:44.649][898][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 19.042426] envoy[898]: [2026-09-22 10:58:44.649][898][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 19.046336] envoy[898]: [2026-09-22 10:58:44.656][898][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 19.036567] nix-grpc-daemon[768]: E0000 00:00:1790074724.631567 810 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 19.040065] nix-grpc-daemon[768]: E0000 00:00:1790074724.634429 810 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 19.083992] nix-grpc-daemon[769]: ts=2026-09-22T10:58:44Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 19.093619] nix-grpc-daemon[769]: ts=2026-09-22T10:58:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 19.096231] nix-grpc-daemon[769]: ts=2026-09-22T10:58:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 19.058141] nix-grpc-daemon[768]: E0000 00:00:1790074724.652611 810 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 19.106930] nix-grpc-daemon[769]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 19.068318] nix-grpc-daemon[768]: ts=2026-09-22T10:58:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.110342] nix-grpc-daemon[769]: E0000 00:00:1790074724.705800 769 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 19.071111] nix-grpc-daemon[768]: ts=2026-09-22T10:58:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.115465] nix-grpc-daemon[769]: E0000 00:00:1790074724.714481 769 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 19.136797] nix-grpc-daemon[769]: ts=2026-09-22T10:58:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 19.140640] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 19.146947] nix-grpc-daemon[769]: E0000 00:00:1790074724.744784 811 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 19.165475] nix-grpc-daemon[769]: E0000 00:00:1790074724.764133 811 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 19.172104] nix-grpc-daemon[769]: E0000 00:00:1790074724.767378 811 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 19.188073] nix-grpc-daemon[769]: E0000 00:00:1790074724.786456 811 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 19.202034] nix-grpc-daemon[769]: ts=2026-09-22T10:58:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.203866] nix-grpc-daemon[769]: ts=2026-09-22T10:58:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.272336] nix-grpc-daemon[768]: ts=2026-09-22T10:58:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.277437] nix-grpc-daemon[768]: ts=2026-09-22T10:58:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.405763] nix-grpc-daemon[769]: ts=2026-09-22T10:58:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.411002] nix-grpc-daemon[769]: ts=2026-09-22T10:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.478381] nix-grpc-daemon[768]: ts=2026-09-22T10:58:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.483614] nix-grpc-daemon[768]: ts=2026-09-22T10:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.612129] nix-grpc-daemon[769]: ts=2026-09-22T10:58:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.618125] nix-grpc-daemon[769]: ts=2026-09-22T10:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.684712] nix-grpc-daemon[768]: ts=2026-09-22T10:58:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.690605] nix-grpc-daemon[768]: ts=2026-09-22T10:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.818894] nix-grpc-daemon[769]: ts=2026-09-22T10:58:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.824381] nix-grpc-daemon[769]: ts=2026-09-22T10:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.891611] nix-grpc-daemon[768]: ts=2026-09-22T10:58:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.897155] nix-grpc-daemon[768]: ts=2026-09-22T10:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.025477] nix-grpc-daemon[769]: ts=2026-09-22T10:58:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.030985] nix-grpc-daemon[769]: ts=2026-09-22T10:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.099674] nix-grpc-daemon[768]: ts=2026-09-22T10:58:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.103909] nix-grpc-daemon[768]: ts=2026-09-22T10:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.233969] nix-grpc-daemon[769]: ts=2026-09-22T10:58:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.238160] nix-grpc-daemon[769]: ts=2026-09-22T10:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.300375] nix-grpc-daemon[768]: ts=2026-09-22T10:58:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.305679] nix-grpc-daemon[768]: ts=2026-09-22T10:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.434490] nix-grpc-daemon[769]: ts=2026-09-22T10:58:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.439629] nix-grpc-daemon[769]: ts=2026-09-22T10:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.506590] nix-grpc-daemon[768]: ts=2026-09-22T10:58:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.511819] nix-grpc-daemon[768]: ts=2026-09-22T10:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.640952] nix-grpc-daemon[769]: ts=2026-09-22T10:58:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.646029] nix-grpc-daemon[769]: ts=2026-09-22T10:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.713096] nix-grpc-daemon[768]: ts=2026-09-22T10:58:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.718554] nix-grpc-daemon[768]: ts=2026-09-22T10:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.847225] nix-grpc-daemon[769]: ts=2026-09-22T10:58:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.852513] nix-grpc-daemon[769]: ts=2026-09-22T10:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.919325] nix-grpc-daemon[768]: ts=2026-09-22T10:58:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.924724] nix-grpc-daemon[768]: ts=2026-09-22T10:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.054074] nix-grpc-daemon[769]: ts=2026-09-22T10:58:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.059458] nix-grpc-daemon[769]: ts=2026-09-22T10:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.127369] nix-grpc-daemon[768]: ts=2026-09-22T10:58:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.131332] nix-grpc-daemon[768]: ts=2026-09-22T10:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.264940] nix-grpc-daemon[769]: ts=2026-09-22T10:58:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.273645] nix-grpc-daemon[769]: ts=2026-09-22T10:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.327750] nix-grpc-daemon[768]: ts=2026-09-22T10:58:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.333064] nix-grpc-daemon[768]: ts=2026-09-22T10:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.463674] nix-grpc-daemon[769]: ts=2026-09-22T10:58:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.469271] nix-grpc-daemon[769]: ts=2026-09-22T10:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.533929] nix-grpc-daemon[768]: ts=2026-09-22T10:58:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.539132] nix-grpc-daemon[768]: ts=2026-09-22T10:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.670338] nix-grpc-daemon[769]: ts=2026-09-22T10:58:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.675606] nix-grpc-daemon[769]: ts=2026-09-22T10:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.740041] nix-grpc-daemon[768]: ts=2026-09-22T10:58:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.745151] nix-grpc-daemon[768]: ts=2026-09-22T10:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.876851] nix-grpc-daemon[769]: ts=2026-09-22T10:58:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.882094] nix-grpc-daemon[769]: ts=2026-09-22T10:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.946110] nix-grpc-daemon[768]: ts=2026-09-22T10:58:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.951375] nix-grpc-daemon[768]: ts=2026-09-22T10:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.083177] nix-grpc-daemon[769]: ts=2026-09-22T10:58:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.088223] nix-grpc-daemon[769]: ts=2026-09-22T10:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.153904] nix-grpc-daemon[768]: ts=2026-09-22T10:58:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.158051] nix-grpc-daemon[768]: ts=2026-09-22T10:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.291116] nix-grpc-daemon[769]: ts=2026-09-22T10:58:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.295337] nix-grpc-daemon[769]: ts=2026-09-22T10:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.354562] nix-grpc-daemon[768]: ts=2026-09-22T10:58:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.359762] nix-grpc-daemon[768]: ts=2026-09-22T10:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.492055] nix-grpc-daemon[769]: ts=2026-09-22T10:58:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.497248] nix-grpc-daemon[769]: ts=2026-09-22T10:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.560681] nix-grpc-daemon[768]: ts=2026-09-22T10:58:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.565924] nix-grpc-daemon[768]: ts=2026-09-22T10:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.698415] nix-grpc-daemon[769]: ts=2026-09-22T10:58:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.703502] nix-grpc-daemon[769]: ts=2026-09-22T10:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.766756] nix-grpc-daemon[768]: ts=2026-09-22T10:58:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.772151] nix-grpc-daemon[768]: ts=2026-09-22T10:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.904627] nix-grpc-daemon[769]: ts=2026-09-22T10:58:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.909724] nix-grpc-daemon[769]: ts=2026-09-22T10:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.973061] nix-grpc-daemon[768]: ts=2026-09-22T10:58:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.978265] nix-grpc-daemon[768]: ts=2026-09-22T10:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.111226] nix-grpc-daemon[769]: ts=2026-09-22T10:58:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.116477] nix-grpc-daemon[769]: ts=2026-09-22T10:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.181062] nix-grpc-daemon[768]: ts=2026-09-22T10:58:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.185203] nix-grpc-daemon[768]: ts=2026-09-22T10:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.319284] nix-grpc-daemon[769]: ts=2026-09-22T10:58:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.323375] nix-grpc-daemon[769]: ts=2026-09-22T10:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.381489] nix-grpc-daemon[768]: ts=2026-09-22T10:58:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.386620] nix-grpc-daemon[768]: ts=2026-09-22T10:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.520203] nix-grpc-daemon[769]: ts=2026-09-22T10:58:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.524941] nix-grpc-daemon[769]: ts=2026-09-22T10:58:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.587500] nix-grpc-daemon[768]: ts=2026-09-22T10:58:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.593111] nix-grpc-daemon[768]: ts=2026-09-22T10:58:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.725958] nix-grpc-daemon[769]: ts=2026-09-22T10:58:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.731052] nix-grpc-daemon[769]: ts=2026-09-22T10:58:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.793753] nix-grpc-daemon[768]: ts=2026-09-22T10:58:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.798930] nix-grpc-daemon[768]: ts=2026-09-22T10:58:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.932074] nix-grpc-daemon[769]: ts=2026-09-22T10:58:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.937189] nix-grpc-daemon[769]: ts=2026-09-22T10:58:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.999845] nix-grpc-daemon[768]: ts=2026-09-22T10:58:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.005063] nix-grpc-daemon[768]: ts=2026-09-22T10:58:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.138214] nix-grpc-daemon[769]: ts=2026-09-22T10:58:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.143326] nix-grpc-daemon[769]: ts=2026-09-22T10:58:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.207545] nix-grpc-daemon[768]: ts=2026-09-22T10:58:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.211766] nix-grpc-daemon[768]: ts=2026-09-22T10:58:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.346407] nix-grpc-daemon[769]: ts=2026-09-22T10:58:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.350553] nix-grpc-daemon[769]: ts=2026-09-22T10:58:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.408115] nix-grpc-daemon[768]: ts=2026-09-22T10:58:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.412935] nix-grpc-daemon[768]: ts=2026-09-22T10:58:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.547623] nix-grpc-daemon[769]: ts=2026-09-22T10:58:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.558839] nix-grpc-daemon[769]: ts=2026-09-22T10:58:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.613796] nix-grpc-daemon[768]: ts=2026-09-22T10:58:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.619656] nix-grpc-daemon[768]: ts=2026-09-22T10:58:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.755915] nix-grpc-daemon[769]: ts=2026-09-22T10:58:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.761384] nix-grpc-daemon[769]: ts=2026-09-22T10:58:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.819145] nix-grpc-daemon[768]: ts=2026-09-22T10:58:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.824580] nix-grpc-daemon[768]: ts=2026-09-22T10:58:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.962595] nix-grpc-daemon[769]: ts=2026-09-22T10:58:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.967942] nix-grpc-daemon[769]: ts=2026-09-22T10:58:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.025346] nix-grpc-daemon[768]: ts=2026-09-22T10:58:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.030552] nix-grpc-daemon[768]: ts=2026-09-22T10:58:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.169073] nix-grpc-daemon[769]: ts=2026-09-22T10:58:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.174330] nix-grpc-daemon[769]: ts=2026-09-22T10:58:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.233374] nix-grpc-daemon[768]: ts=2026-09-22T10:58:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.237698] nix-grpc-daemon[768]: ts=2026-09-22T10:58:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.377025] nix-grpc-daemon[769]: ts=2026-09-22T10:58:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.381741] nix-grpc-daemon[769]: ts=2026-09-22T10:58:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.433880] nix-grpc-daemon[768]: ts=2026-09-22T10:58:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.439029] nix-grpc-daemon[768]: ts=2026-09-22T10:58:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.583114] nix-grpc-daemon[769]: ts=2026-09-22T10:58:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.588602] nix-grpc-daemon[769]: ts=2026-09-22T10:58:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.639971] nix-grpc-daemon[768]: ts=2026-09-22T10:58:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.646223] nix-grpc-daemon[768]: ts=2026-09-22T10:58:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.789585] nix-grpc-daemon[769]: ts=2026-09-22T10:58:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.795454] nix-grpc-daemon[769]: ts=2026-09-22T10:58:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.845938] nix-grpc-daemon[768]: ts=2026-09-22T10:58:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.851265] nix-grpc-daemon[768]: ts=2026-09-22T10:58:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.996690] nix-grpc-daemon[769]: ts=2026-09-22T10:58:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.001954] nix-grpc-daemon[769]: ts=2026-09-22T10:58:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.052300] nix-grpc-daemon[768]: ts=2026-09-22T10:58:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.058406] nix-grpc-daemon[768]: ts=2026-09-22T10:58:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.202935] nix-grpc-daemon[769]: ts=2026-09-22T10:58:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.208318] nix-grpc-daemon[769]: ts=2026-09-22T10:58:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.260780] nix-grpc-daemon[768]: ts=2026-09-22T10:58:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.264724] nix-grpc-daemon[768]: ts=2026-09-22T10:58:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.412313] nix-grpc-daemon[769]: ts=2026-09-22T10:58:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.416552] nix-grpc-daemon[769]: ts=2026-09-22T10:58:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.462613] nix-grpc-daemon[768]: ts=2026-09-22T10:58:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.468749] nix-grpc-daemon[768]: ts=2026-09-22T10:58:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.613078] nix-grpc-daemon[769]: ts=2026-09-22T10:58:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.618954] nix-grpc-daemon[769]: ts=2026-09-22T10:58:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.669170] nix-grpc-daemon[768]: ts=2026-09-22T10:58:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.674656] nix-grpc-daemon[768]: ts=2026-09-22T10:58:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.821103] nix-grpc-daemon[769]: ts=2026-09-22T10:58:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.827804] nix-grpc-daemon[769]: ts=2026-09-22T10:58:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.875872] nix-grpc-daemon[768]: ts=2026-09-22T10:58:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.881539] nix-grpc-daemon[768]: ts=2026-09-22T10:58:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 27.002564] rustfs-bucket-start[989]: mb s3://farm worker2 # [ 27.030146] nix-grpc-daemon[769]: ts=2026-09-22T10:58:52Z level=info event=scheduler_connected addr=lb:50051 lb # [ 27.017424] systemd[1]: Finished rustfs-bucket.service. worker2 # [ 27.036864] nix-grpc-daemon[769]: ts=2026-09-22T10:58:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 27.032815] systemd[1]: Starting niks3 server... worker1 # [ 27.082497] nix-grpc-daemon[768]: ts=2026-09-22T10:58:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.088488] nix-grpc-daemon[768]: ts=2026-09-22T10:58:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 27.198062] postgres[1007]: [1007] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 27.199364] postgres[1007]: [1007] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker2 # [ 27.238231] nix-grpc-daemon[769]: ts=2026-09-22T10:58:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.243725] nix-grpc-daemon[769]: ts=2026-09-22T10:58:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 27.253141] niks3-server[998]: 2026/09/22 10:58:52 OK 20241026095416_initial_model.sql (34.58ms) lb # [ 27.257308] niks3-server[998]: 2026/09/22 10:58:52 OK 20251210153512_drop_unused_gin_index.sql (4.51ms) lb # [ 27.265963] niks3-server[998]: 2026/09/22 10:58:52 OK 20251218171726_add_pins.sql (8.64ms) lb # [ 27.270774] niks3-server[998]: 2026/09/22 10:58:52 OK 20260628120000_add_object_size_and_stats.sql (4.78ms) lb # [ 27.276449] niks3-server[998]: 2026/09/22 10:58:52 OK 20260905000000_add_claims.sql (5.59ms) lb # [ 27.280701] niks3-server[998]: 2026/09/22 10:58:52 OK 20260920000000_drop_claims.sql (4.16ms) lb # [ 27.281906] niks3-server[998]: 2026/09/22 10:58:52 goose: successfully migrated database to version: 20260920000000 lb # [ 27.286336] niks3-server[998]: 2026/09/22 10:58:52 OK 1_commit_pending_closure.sql (5.61ms) lb # [ 27.289219] niks3-server[998]: 2026/09/22 10:58:52 OK 2_object_stats_trigger.sql (2.82ms) lb # [ 27.291154] niks3-server[998]: 2026/09/22 10:58:52 goose: up to current file version: 2 lb # [ 27.293289] niks3-server[998]: 2026/09/22 10:58:52 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key worker1 # [ 27.294217] nix-grpc-daemon[768]: ts=2026-09-22T10:58:52Z level=info event=scheduler_connected addr=lb:50051 lb # [ 27.319635] niks3-server[998]: 2026/09/22 10:58:52 INFO Read proxy enabled — serving cache objects from S3 worker1 # [ 27.298613] nix-grpc-daemon[768]: ts=2026-09-22T10:58:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 27.325037] niks3-server[998]: 2026/09/22 10:58:52 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 27.331305] niks3-server[998]: 2026/09/22 10:58:52 INFO systemd watchdog enabled interval=15s lb # [ 27.333901] niks3-server[998]: 2026/09/22 10:58:52 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 27.335170] systemd[1]: Started niks3 server. lb # [ 27.336557] systemd[1]: Reached target Multi-User System. lb # [ 27.337412] systemd[1]: Startup finished in 958ms (kernel) + 4.897s (initrd) + 21.474s (userspace) = 27.330s. worker2 # [ 27.445142] nix-grpc-daemon[769]: ts=2026-09-22T10:58:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.449646] nix-grpc-daemon[769]: ts=2026-09-22T10:58:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.493583] nix-grpc-daemon[768]: ts=2026-09-22T10:58:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.500130] nix-grpc-daemon[768]: ts=2026-09-22T10:58:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.645943] nix-grpc-daemon[769]: ts=2026-09-22T10:58:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.651795] nix-grpc-daemon[769]: ts=2026-09-22T10:58:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.701854] nix-grpc-daemon[768]: ts=2026-09-22T10:58:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.708341] nix-grpc-daemon[768]: ts=2026-09-22T10:58:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.853422] nix-grpc-daemon[769]: ts=2026-09-22T10:58:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.859202] nix-grpc-daemon[769]: ts=2026-09-22T10:58:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.909943] nix-grpc-daemon[768]: ts=2026-09-22T10:58:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.921936] nix-grpc-daemon[768]: ts=2026-09-22T10:58:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.060937] nix-grpc-daemon[769]: ts=2026-09-22T10:58:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.066547] nix-grpc-daemon[769]: ts=2026-09-22T10:58:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.122986] nix-grpc-daemon[768]: ts=2026-09-22T10:58:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.129318] nix-grpc-daemon[768]: ts=2026-09-22T10:58:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.268096] nix-grpc-daemon[769]: ts=2026-09-22T10:58:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.274101] nix-grpc-daemon[769]: ts=2026-09-22T10:58:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.334097] nix-grpc-daemon[768]: ts=2026-09-22T10:58:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.338526] nix-grpc-daemon[768]: ts=2026-09-22T10:58:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 15.70 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! worker2 # [ 28.478520] nix-grpc-daemon[769]: ts=2026-09-22T10:58:54Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds) lb: waiting for unit envoy.service worker2 # [ 28.482983] nix-grpc-daemon[769]: ts=2026-09-22T10:58:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit envoy.service, in 0.05 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 28.550982] envoy[898]: conn peer=[::1]:51586 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=4 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) worker1 # [ 28.538725] nix-grpc-daemon[768]: ts=2026-09-22T10:58:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.545872] nix-grpc-daemon[768]: ts=2026-09-22T10:58:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.679432] nix-grpc-daemon[769]: ts=2026-09-22T10:58:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.687601] nix-grpc-daemon[769]: ts=2026-09-22T10:58:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.772716] systemd[1]: Starting scheduler-token.service... worker1 # [ 28.738176] nix-grpc-daemon[768]: ts=2026-09-22T10:58:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.744149] nix-grpc-daemon[768]: ts=2026-09-22T10:58:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.850587] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 28.853579] systemd[1]: Finished scheduler-token.service. worker2 # [ 28.859272] systemd[1]: scheduler-token.service: Consumed 44ms CPU time over 83ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 28.886183] nix-grpc-daemon[769]: ts=2026-09-22T10:58:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.890103] nix-grpc-daemon[769]: ts=2026-09-22T10:58:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 28.945785] nix-grpc-daemon[768]: ts=2026-09-22T10:58:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.951463] nix-grpc-daemon[768]: ts=2026-09-22T10:58:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 29.092238] nix-grpc-daemon[769]: ts=2026-09-22T10:58:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.100559] nix-grpc-daemon[769]: ts=2026-09-22T10:58:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.152857] nix-grpc-daemon[768]: ts=2026-09-22T10:58:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.158375] nix-grpc-daemon[768]: ts=2026-09-22T10:58:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.301129] nix-grpc-daemon[769]: ts=2026-09-22T10:58:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.306833] nix-grpc-daemon[769]: ts=2026-09-22T10:58:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.361804] nix-grpc-daemon[768]: ts=2026-09-22T10:58:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.366938] nix-grpc-daemon[768]: ts=2026-09-22T10:58:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.511062] nix-grpc-daemon[769]: ts=2026-09-22T10:58:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.515674] nix-grpc-daemon[769]: ts=2026-09-22T10:58:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.568182] nix-grpc-daemon[768]: ts=2026-09-22T10:58:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.573883] nix-grpc-daemon[768]: ts=2026-09-22T10:58:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.712330] nix-grpc-daemon[769]: ts=2026-09-22T10:58:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.717890] nix-grpc-daemon[769]: ts=2026-09-22T10:58:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.775282] nix-grpc-daemon[768]: ts=2026-09-22T10:58:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.781232] nix-grpc-daemon[768]: ts=2026-09-22T10:58:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.919745] nix-grpc-daemon[769]: ts=2026-09-22T10:58:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.925932] nix-grpc-daemon[769]: ts=2026-09-22T10:58:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 29.982116] nix-grpc-daemon[768]: ts=2026-09-22T10:58:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.988240] nix-grpc-daemon[768]: ts=2026-09-22T10:58:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2 # [ 30.129381] nix-grpc-daemon[769]: ts=2026-09-22T10:58:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.135096] nix-grpc-daemon[769]: ts=2026-09-22T10:58:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.189007] nix-grpc-daemon[768]: ts=2026-09-22T10:58:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.194606] nix-grpc-daemon[768]: ts=2026-09-22T10:58:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.336840] nix-grpc-daemon[769]: ts=2026-09-22T10:58:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.342272] nix-grpc-daemon[769]: ts=2026-09-22T10:58:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.398095] nix-grpc-daemon[768]: ts=2026-09-22T10:58:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.403226] nix-grpc-daemon[768]: ts=2026-09-22T10:58:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.546625] nix-grpc-daemon[769]: ts=2026-09-22T10:58:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.551127] nix-grpc-daemon[769]: ts=2026-09-22T10:58:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.604907] nix-grpc-daemon[768]: ts=2026-09-22T10:58:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.610407] nix-grpc-daemon[768]: ts=2026-09-22T10:58:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.747386] nix-grpc-daemon[769]: ts=2026-09-22T10:58:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.753337] nix-grpc-daemon[769]: ts=2026-09-22T10:58:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.811768] nix-grpc-daemon[768]: ts=2026-09-22T10:58:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.817935] nix-grpc-daemon[768]: ts=2026-09-22T10:58:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.954982] nix-grpc-daemon[769]: ts=2026-09-22T10:58:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.961381] nix-grpc-daemon[769]: ts=2026-09-22T10:58:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.019275] nix-grpc-daemon[768]: ts=2026-09-22T10:58:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.025381] nix-grpc-daemon[768]: ts=2026-09-22T10:58:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 31.162521] nix-grpc-daemon[769]: ts=2026-09-22T10:58:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.168174] nix-grpc-daemon[769]: ts=2026-09-22T10:58:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 31.227102] nix-grpc-daemon[768]: ts=2026-09-22T10:58:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.233069] nix-grpc-daemon[768]: ts=2026-09-22T10:58:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.369334] nix-grpc-daemon[769]: ts=2026-09-22T10:58:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.374649] nix-grpc-daemon[769]: ts=2026-09-22T10:58:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.434347] nix-grpc-daemon[768]: ts=2026-09-22T10:58:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.439199] nix-grpc-daemon[768]: ts=2026-09-22T10:58:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.577331] nix-grpc-daemon[769]: ts=2026-09-22T10:58:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.581963] nix-grpc-daemon[769]: ts=2026-09-22T10:58:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.639985] nix-grpc-daemon[768]: ts=2026-09-22T10:58:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.645437] nix-grpc-daemon[768]: ts=2026-09-22T10:58:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.783030] nix-grpc-daemon[769]: ts=2026-09-22T10:58:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.788355] nix-grpc-daemon[769]: ts=2026-09-22T10:58:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.846178] nix-grpc-daemon[768]: ts=2026-09-22T10:58:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.851429] nix-grpc-daemon[768]: ts=2026-09-22T10:58:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.989308] nix-grpc-daemon[769]: ts=2026-09-22T10:58:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.994636] nix-grpc-daemon[769]: ts=2026-09-22T10:58:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.052107] nix-grpc-daemon[768]: ts=2026-09-22T10:58:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.058147] nix-grpc-daemon[768]: ts=2026-09-22T10:58:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 32.195626] nix-grpc-daemon[769]: ts=2026-09-22T10:58:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.201011] nix-grpc-daemon[769]: ts=2026-09-22T10:58:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 32.259431] nix-grpc-daemon[768]: ts=2026-09-22T10:58:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.264687] nix-grpc-daemon[768]: ts=2026-09-22T10:58:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.402126] nix-grpc-daemon[769]: ts=2026-09-22T10:58:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.407688] nix-grpc-daemon[769]: ts=2026-09-22T10:58:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.463237] nix-grpc-daemon[768]: ts=2026-09-22T10:58:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.467423] nix-grpc-daemon[768]: ts=2026-09-22T10:58:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.611033] nix-grpc-daemon[769]: ts=2026-09-22T10:58:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.615270] nix-grpc-daemon[769]: ts=2026-09-22T10:58:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.663872] nix-grpc-daemon[768]: ts=2026-09-22T10:58:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.669022] nix-grpc-daemon[768]: ts=2026-09-22T10:58:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.813127] nix-grpc-daemon[769]: ts=2026-09-22T10:58:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.817714] nix-grpc-daemon[769]: ts=2026-09-22T10:58:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.869666] nix-grpc-daemon[768]: ts=2026-09-22T10:58:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.874805] nix-grpc-daemon[768]: ts=2026-09-22T10:58:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.014562] nix-grpc-daemon[769]: ts=2026-09-22T10:58:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.020426] nix-grpc-daemon[769]: ts=2026-09-22T10:58:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.075577] nix-grpc-daemon[768]: ts=2026-09-22T10:58:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.080800] nix-grpc-daemon[768]: ts=2026-09-22T10:58:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.221382] nix-grpc-daemon[769]: ts=2026-09-22T10:58:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.226821] nix-grpc-daemon[769]: ts=2026-09-22T10:58:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 33.281304] nix-grpc-daemon[768]: ts=2026-09-22T10:58:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.284592] nix-grpc-daemon[768]: ts=2026-09-22T10:58:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.427806] nix-grpc-daemon[769]: ts=2026-09-22T10:58:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.433037] nix-grpc-daemon[769]: ts=2026-09-22T10:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.487304] nix-grpc-daemon[768]: ts=2026-09-22T10:58:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.491486] nix-grpc-daemon[768]: ts=2026-09-22T10:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.635798] nix-grpc-daemon[769]: ts=2026-09-22T10:58:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.640091] nix-grpc-daemon[769]: ts=2026-09-22T10:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.687679] nix-grpc-daemon[768]: ts=2026-09-22T10:58:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.692970] nix-grpc-daemon[768]: ts=2026-09-22T10:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.836498] nix-grpc-daemon[769]: ts=2026-09-22T10:58:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.841492] nix-grpc-daemon[769]: ts=2026-09-22T10:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.893787] nix-grpc-daemon[768]: ts=2026-09-22T10:58:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.898965] nix-grpc-daemon[768]: ts=2026-09-22T10:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.042662] nix-grpc-daemon[769]: ts=2026-09-22T10:58:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.047829] nix-grpc-daemon[769]: ts=2026-09-22T10:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.099646] nix-grpc-daemon[768]: ts=2026-09-22T10:58:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.104905] nix-grpc-daemon[768]: ts=2026-09-22T10:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.248564] nix-grpc-daemon[769]: ts=2026-09-22T10:58:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.253588] nix-grpc-daemon[769]: ts=2026-09-22T10:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 34.305690] nix-grpc-daemon[768]: ts=2026-09-22T10:58:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.310913] nix-grpc-daemon[768]: ts=2026-09-22T10:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 34.454707] nix-grpc-daemon[769]: ts=2026-09-22T10:59:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.459891] nix-grpc-daemon[769]: ts=2026-09-22T10:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.513394] nix-grpc-daemon[768]: ts=2026-09-22T10:59:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.517494] nix-grpc-daemon[768]: ts=2026-09-22T10:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.662916] nix-grpc-daemon[769]: ts=2026-09-22T10:59:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.667549] nix-grpc-daemon[769]: ts=2026-09-22T10:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.713891] nix-grpc-daemon[768]: ts=2026-09-22T10:59:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.719179] nix-grpc-daemon[768]: ts=2026-09-22T10:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.863975] nix-grpc-daemon[769]: ts=2026-09-22T10:59:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.869153] nix-grpc-daemon[769]: ts=2026-09-22T10:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.920098] nix-grpc-daemon[768]: ts=2026-09-22T10:59:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.925550] nix-grpc-daemon[768]: ts=2026-09-22T10:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.070139] nix-grpc-daemon[769]: ts=2026-09-22T10:59:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.075360] nix-grpc-daemon[769]: ts=2026-09-22T10:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.126696] nix-grpc-daemon[768]: ts=2026-09-22T10:59:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.132273] nix-grpc-daemon[768]: ts=2026-09-22T10:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.276420] nix-grpc-daemon[769]: ts=2026-09-22T10:59:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.281597] nix-grpc-daemon[769]: ts=2026-09-22T10:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.333092] nix-grpc-daemon[768]: ts=2026-09-22T10:59:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.338444] nix-grpc-daemon[768]: ts=2026-09-22T10:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 35.482845] nix-grpc-daemon[769]: ts=2026-09-22T10:59:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.488159] nix-grpc-daemon[769]: ts=2026-09-22T10:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.541372] nix-grpc-daemon[768]: ts=2026-09-22T10:59:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.545559] nix-grpc-daemon[768]: ts=2026-09-22T10:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.691262] nix-grpc-daemon[769]: ts=2026-09-22T10:59:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.695608] nix-grpc-daemon[769]: ts=2026-09-22T10:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.741811] nix-grpc-daemon[768]: ts=2026-09-22T10:59:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.747494] nix-grpc-daemon[768]: ts=2026-09-22T10:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.892106] nix-grpc-daemon[769]: ts=2026-09-22T10:59:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.897442] nix-grpc-daemon[769]: ts=2026-09-22T10:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.948491] nix-grpc-daemon[768]: ts=2026-09-22T10:59:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.953749] nix-grpc-daemon[768]: ts=2026-09-22T10:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.098552] nix-grpc-daemon[769]: ts=2026-09-22T10:59:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.103740] nix-grpc-daemon[769]: ts=2026-09-22T10:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.154536] nix-grpc-daemon[768]: ts=2026-09-22T10:59:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.159895] nix-grpc-daemon[768]: ts=2026-09-22T10:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.304933] nix-grpc-daemon[769]: ts=2026-09-22T10:59:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.310113] nix-grpc-daemon[769]: ts=2026-09-22T10:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.360947] nix-grpc-daemon[768]: ts=2026-09-22T10:59:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.366178] nix-grpc-daemon[768]: ts=2026-09-22T10:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 36.511360] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.516810] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 36.568967] nix-grpc-daemon[768]: ts=2026-09-22T10:59:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.572781] nix-grpc-daemon[768]: ts=2026-09-22T10:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.719663] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.723894] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.769763] nix-grpc-daemon[768]: ts=2026-09-22T10:59:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.774682] nix-grpc-daemon[768]: ts=2026-09-22T10:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.920461] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.925647] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.975753] nix-grpc-daemon[768]: ts=2026-09-22T10:59:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.981328] nix-grpc-daemon[768]: ts=2026-09-22T10:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.126825] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.132742] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.182121] nix-grpc-daemon[768]: ts=2026-09-22T10:59:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.187623] nix-grpc-daemon[768]: ts=2026-09-22T10:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.333232] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.338358] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.354293] nix-grpc-daemon[769]: ts=2026-09-22T10:59:02Z level=info event=scheduler_take_over lb # [ 37.333839] niks3-server[998]: 2026/09/22 10:59:02 INFO lead: acquired remote=192.168.1.4:49332 worker1 # [ 37.388625] nix-grpc-daemon[768]: ts=2026-09-22T10:59:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.393897] nix-grpc-daemon[768]: ts=2026-09-22T10:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 37.539452] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.544762] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 37.597131] nix-grpc-daemon[768]: ts=2026-09-22T10:59:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.601336] nix-grpc-daemon[768]: ts=2026-09-22T10:59:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.747776] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.752066] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.797608] nix-grpc-daemon[768]: ts=2026-09-22T10:59:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.803185] nix-grpc-daemon[768]: ts=2026-09-22T10:59:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.948588] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.953330] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.004279] nix-grpc-daemon[768]: ts=2026-09-22T10:59:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.010170] nix-grpc-daemon[768]: ts=2026-09-22T10:59:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.153122] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.158561] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.210785] nix-grpc-daemon[768]: ts=2026-09-22T10:59:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.260185] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45324 worker2 # [ 38.265545] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 38.359412] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.374810] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 38.379287] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:45324 worker2 # [ 38.384629] nix-grpc-daemon[769]: ts=2026-09-22T10:59:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.39 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 39.603564] nix-grpc-daemon[768]: ts=2026-09-22T10:59:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 39.619785] systemd[1]: Started Nix Daemon. worker1 # [ 39.806467] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 39.828912] nix-grpc-daemon[768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 1/5) worker1 # [ 39.926200] nix-grpc-daemon[768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 174 ms (attempt 2/5) worker1 # [ 40.102155] nix-grpc-daemon[768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 240 ms (attempt 3/5) worker1 # [ 40.344356] nix-grpc-daemon[768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 574 ms (attempt 4/5) worker1 # [ 40.922169] nix-grpc-daemon[768]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 40.928257] nix-grpc-daemon[768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 41.008253] nix-grpc-daemon[769]: ts=2026-09-22T10:59:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 41.020915] systemd[1]: Started Nix Daemon. worker2 # [ 41.239156] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 41.272397] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 1/5) worker2 # [ 41.356694] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 2/5) worker2 # [ 41.446652] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 121 ms (attempt 3/5) worker2 # [ 41.569664] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 616 ms (attempt 4/5) worker2 # [ 42.189336] nix-grpc-daemon[769]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 42.195020] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 42.207296] nix-grpc-daemon[769]: ts=2026-09-22T10:59:07Z level=debug event=path_info_miss path=ylfbn6z3ahrh8hrrlqp2284fnn7jlrh4-nixos-system-client-test error="error: path '/nix/store/ylfbn6z3ahrh8hrrlqp2284fnn7jlrh4-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 42.222352] nix-grpc-daemon[769]: ts=2026-09-22T10:59:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 42.230350] nix-grpc-daemon[769]: ts=2026-09-22T10:59:07Z level=debug event=path_info_miss path=ylfbn6z3ahrh8hrrlqp2284fnn7jlrh4-nixos-system-client-test error="error: path '/nix/store/ylfbn6z3ahrh8hrrlqp2284fnn7jlrh4-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds) client: must succeed: install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds) worker1 # [ 42.519965] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 42.521907] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:47994 worker1 # [ 42.541026] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:47994 worker1 # [ 42.555315] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=debug event=path_info_miss path=ylfbn6z3ahrh8hrrlqp2284fnn7jlrh4-nixos-system-client-test error="error: path '/nix/store/ylfbn6z3ahrh8hrrlqp2284fnn7jlrh4-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 42.571762] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:47994 worker1 # [ 42.583667] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=debug event=path_info_miss path=ylfbn6z3ahrh8hrrlqp2284fnn7jlrh4-nixos-system-client-test error="error: path '/nix/store/ylfbn6z3ahrh8hrrlqp2284fnn7jlrh4-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds) worker2 # [ 42.873430] nix-grpc-daemon[769]: ts=2026-09-22T10:59:08Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 43.041975] nix-grpc-daemon[769]: ts=2026-09-22T10:59:08Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.70 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2 worker1 # [ 43.168469] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47994 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 43.178558] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker2 # [ 43.263466] nix-grpc-daemon[769]: ts=2026-09-22T10:59:08Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 43.270359] nix-grpc-daemon[769]: ts=2026-09-22T10:59:08Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 43.267609] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 43.289622] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 client # copying 1 paths to 'lb:50051'... worker1 # [ 43.305658] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 43.332905] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 43.371854] nix-grpc-daemon[768]: ts=2026-09-22T10:59:08Z level=info event=niks3_push_started pid=847 worker1 # [ 43.559332] nix-grpc-daemon[847]: time=2026-09-22T10:59:09.153Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca="" worker1 # [ 43.672633] nix-daemon[834]: accepted connection from pid 860, user nix-grpc-daemon (trusted) worker1 # [ 43.695358] nix-daemon[834]: reaped child process 863, status = succeeded worker1 # [ 43.794637] nix-daemon[834]: accepted connection from pid 865, user nix-grpc-daemon (trusted) worker1 # [ 43.814381] nix-daemon[834]: reaped child process 868, status = succeeded lb # [ 43.834282] niks3-server[998]: 2026/09/22 10:59:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.833016] nix-grpc-daemon[847]: time=2026-09-22T10:59:09.426Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 43.834585] nix-grpc-daemon[847]: time=2026-09-22T10:59:09.426Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 43.900916] niks3-server[998]: 2026/09/22 10:59:09 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 43.908398] niks3-server[998]: 2026/09/22 10:59:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 43.928220] niks3-server[998]: 2026/09/22 10:59:09 INFO Signed narinfos id=1 count=1 worker1 # [ 43.911036] nix-grpc-daemon[847]: time=2026-09-22T10:59:09.505Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.946866] niks3-server[998]: 2026/09/22 10:59:09 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 43.977016] niks3-server[998]: 2026/09/22 10:59:09 INFO Completed upload id=1 worker1 # [ 43.955279] nix-grpc-daemon[847]: time=2026-09-22T10:59:09.550Z level=INFO msg="Upload complete. (391ms)" lb # [ 43.985363] niks3-server[998]: 2026/09/22 10:59:09 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls worker1 # [ 43.969259] nix-grpc-daemon[768]: ts=2026-09-22T10:59:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 43.987806] nix-grpc-daemon[768]: ts=2026-09-22T10:59:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 43.999458] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 44.003279] nix-daemon[834]: reaped child process 845, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker1 # [ 44.020650] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 45.319508] nix-daemon[834]: reaped child process 872, status = succeeded worker1 # [ 45.387547] nix-daemon[834]: accepted connection from pid 889, user nix-grpc-daemon (trusted) worker1 # [ 45.408290] nix-daemon[834]: reaped child process 892, status = succeeded lb # [ 45.433438] niks3-server[998]: 2026/09/22 10:59:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.428496] nix-grpc-daemon[847]: time=2026-09-22T10:59:11.021Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 45.430229] nix-grpc-daemon[847]: time=2026-09-22T10:59:11.021Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 45.500866] niks3-server[998]: 2026/09/22 10:59:11 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 45.508881] niks3-server[998]: 2026/09/22 10:59:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker1 # [ 45.494562] nix-grpc-daemon[847]: time=2026-09-22T10:59:11.088Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.517266] niks3-server[998]: 2026/09/22 10:59:11 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 45.524868] niks3-server[998]: 2026/09/22 10:59:11 INFO Signed narinfos id=2 count=1 lb # [ 45.526728] niks3-server[998]: 2026/09/22 10:59:11 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 45.538484] niks3-server[998]: 2026/09/22 10:59:11 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 45.544825] niks3-server[998]: 2026/09/22 10:59:11 INFO Completed upload id=2 worker1 # [ 45.523322] nix-grpc-daemon[847]: time=2026-09-22T10:59:11.118Z level=INFO msg="Upload complete. (290ms)" lb # [ 45.547836] niks3-server[998]: 2026/09/22 10:59:11 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 45.537176] nix-grpc-daemon[768]: ts=2026-09-22T10:59:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 45.588674] nix-grpc-daemon[769]: ts=2026-09-22T10:59:11Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 45.594164] nix-grpc-daemon[769]: ts=2026-09-22T10:59:11Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 45.556487] nix-daemon[834]: reaped child process 870, status = succeeded worker1 # [ 45.591778] nix-grpc-daemon[768]: ts=2026-09-22T10:59:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 45.607457] nix-grpc-daemon[768]: ts=2026-09-22T10:59:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 45.623075] nix-grpc-daemon[847]: time=2026-09-22T10:59:11.218Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 45.633516] nix-grpc-daemon[768]: ts=2026-09-22T10:59:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 45.655379] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 45.825439] nix-daemon[834]: accepted connection from pid 896, user nix-grpc-daemon (trusted) worker1 # [ 45.849436] nix-daemon[834]: reaped child process 899, status = succeeded worker1 # [ 45.948662] nix-daemon[834]: accepted connection from pid 901, user nix-grpc-daemon (trusted) worker1 # [ 45.967183] nix-daemon[834]: reaped child process 904, status = succeeded lb # [ 45.992341] niks3-server[998]: 2026/09/22 10:59:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.980799] nix-grpc-daemon[847]: time=2026-09-22T10:59:11.575Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 45.982312] nix-grpc-daemon[847]: time=2026-09-22T10:59:11.575Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 46.020188] niks3-server[998]: 2026/09/22 10:59:11 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst worker1 # [ 46.011806] nix-grpc-daemon[847]: time=2026-09-22T10:59:11.606Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.034760] niks3-server[998]: 2026/09/22 10:59:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 46.046724] niks3-server[998]: 2026/09/22 10:59:11 INFO Signed narinfos id=3 count=1 lb # [ 46.053364] niks3-server[998]: 2026/09/22 10:59:11 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 46.065074] niks3-server[998]: 2026/09/22 10:59:11 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 46.073952] niks3-server[998]: 2026/09/22 10:59:11 INFO Completed upload id=3 worker1 # [ 46.051732] nix-grpc-daemon[847]: time=2026-09-22T10:59:11.646Z level=INFO msg="Upload complete. (378ms)" lb # [ 46.078202] niks3-server[998]: 2026/09/22 10:59:11 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker1 # [ 46.064285] nix-grpc-daemon[768]: ts=2026-09-22T10:59:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 46.076255] nix-grpc-daemon[768]: ts=2026-09-22T10:59:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 46.088320] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 46.091555] nix-daemon[834]: reaped child process 894, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker1 # [ 46.106772] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 47.412511] nix-daemon[834]: reaped child process 908, status = succeeded worker1 # [ 47.479125] nix-daemon[834]: accepted connection from pid 924, user nix-grpc-daemon (trusted) worker1 # [ 47.501172] nix-daemon[834]: reaped child process 927, status = succeeded lb # [ 47.522147] niks3-server[998]: 2026/09/22 10:59:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 47.511596] nix-grpc-daemon[847]: time=2026-09-22T10:59:13.106Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 47.514233] nix-grpc-daemon[847]: time=2026-09-22T10:59:13.108Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 47.567066] niks3-server[998]: 2026/09/22 10:59:13 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst worker1 # [ 47.560428] nix-grpc-daemon[847]: time=2026-09-22T10:59:13.155Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.582367] niks3-server[998]: 2026/09/22 10:59:13 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 47.597469] niks3-server[998]: 2026/09/22 10:59:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 47.617510] niks3-server[998]: 2026/09/22 10:59:13 INFO Signed narinfos id=4 count=1 worker1 # [ 47.601984] nix-grpc-daemon[847]: time=2026-09-22T10:59:13.197Z level=INFO msg="Upload complete. (283ms)" lb # [ 47.629267] niks3-server[998]: 2026/09/22 10:59:13 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 47.633675] niks3-server[998]: 2026/09/22 10:59:13 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 47.637352] niks3-server[998]: 2026/09/22 10:59:13 INFO Completed upload id=4 worker1 # [ 47.613219] nix-grpc-daemon[768]: ts=2026-09-22T10:59:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 lb # [ 47.641964] niks3-server[998]: 2026/09/22 10:59:13 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker2 # [ 47.665045] nix-grpc-daemon[769]: ts=2026-09-22T10:59:13Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 47.671081] nix-grpc-daemon[769]: ts=2026-09-22T10:59:13Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 47.634440] nix-daemon[834]: reaped child process 906, status = succeeded worker1 # [ 47.671182] nix-grpc-daemon[768]: ts=2026-09-22T10:59:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 47.686933] nix-grpc-daemon[768]: ts=2026-09-22T10:59:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 47.700917] nix-grpc-daemon[847]: time=2026-09-22T10:59:13.296Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 47.711070] nix-grpc-daemon[768]: ts=2026-09-22T10:59:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 47.729282] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 47.890268] nix-daemon[834]: accepted connection from pid 931, user nix-grpc-daemon (trusted) worker1 # [ 47.912742] nix-daemon[834]: reaped child process 934, status = succeeded worker1 # [ 48.012566] nix-daemon[834]: accepted connection from pid 936, user nix-grpc-daemon (trusted) worker1 # [ 48.032483] nix-daemon[834]: reaped child process 939, status = succeeded lb # [ 48.055297] niks3-server[998]: 2026/09/22 10:59:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.043794] nix-grpc-daemon[847]: time=2026-09-22T10:59:13.638Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 48.045513] nix-grpc-daemon[847]: time=2026-09-22T10:59:13.638Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" worker1 # [ 48.071312] nix-grpc-daemon[847]: time=2026-09-22T10:59:13.666Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.092175] niks3-server[998]: 2026/09/22 10:59:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 48.103903] niks3-server[998]: 2026/09/22 10:59:13 INFO Signed narinfos id=5 count=1 lb # [ 48.114466] niks3-server[998]: 2026/09/22 10:59:13 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 48.127790] niks3-server[998]: 2026/09/22 10:59:13 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls worker1 # [ 48.105900] nix-grpc-daemon[847]: time=2026-09-22T10:59:13.701Z level=INFO msg="Upload complete. (358ms)" worker1 # [ 48.112449] nix-grpc-daemon[768]: ts=2026-09-22T10:59:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 48.138726] niks3-server[998]: 2026/09/22 10:59:13 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete worker1 # [ 48.120779] nix-grpc-daemon[768]: ts=2026-09-22T10:59:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 lb # [ 48.144506] niks3-server[998]: 2026/09/22 10:59:13 INFO Completed upload id=5 lb # [ 48.146963] niks3-server[998]: 2026/09/22 10:59:13 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 48.132669] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 48.135351] nix-daemon[834]: reaped child process 929, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... worker1 # [ 48.147066] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 48.789388] envoy[898]: conn peer=[2001:db8:1::1]:56802 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2622 lb # [ 48.794548] envoy[898]: conn peer=[2001:db8:1::1]:58602 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=91 lb # [ 48.799223] envoy[898]: conn peer=[2001:db8:1::1]:58608 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=11 lb # [ 48.803883] envoy[898]: conn peer=[2001:db8:1::1]:58612 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=13 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 49.655272] nix-daemon[834]: reaped child process 943, status = succeeded worker1 # [ 49.727029] nix-daemon[834]: accepted connection from pid 959, user nix-grpc-daemon (trusted) worker1 # [ 49.746785] nix-daemon[834]: reaped child process 962, status = succeeded lb # [ 49.773431] niks3-server[998]: 2026/09/22 10:59:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.764205] nix-grpc-daemon[847]: time=2026-09-22T10:59:15.357Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 49.765909] nix-grpc-daemon[847]: time=2026-09-22T10:59:15.357Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 49.818926] niks3-server[998]: 2026/09/22 10:59:15 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 49.829280] niks3-server[998]: 2026/09/22 10:59:15 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst worker1 # [ 49.818026] nix-grpc-daemon[847]: time=2026-09-22T10:59:15.412Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.842291] niks3-server[998]: 2026/09/22 10:59:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 49.849827] niks3-server[998]: 2026/09/22 10:59:15 INFO Signed narinfos id=6 count=1 lb # [ 49.854710] niks3-server[998]: 2026/09/22 10:59:15 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 49.864632] niks3-server[998]: 2026/09/22 10:59:15 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete worker1 # [ 49.850066] nix-grpc-daemon[847]: time=2026-09-22T10:59:15.445Z level=INFO msg="Upload complete. (293ms)" lb # [ 49.874233] niks3-server[998]: 2026/09/22 10:59:15 INFO Completed upload id=6 lb # [ 49.878882] niks3-server[998]: 2026/09/22 10:59:15 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker1 # [ 49.861175] nix-grpc-daemon[768]: ts=2026-09-22T10:59:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker1 # [ 49.881190] nix-daemon[834]: reaped child process 941, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2, in 6.89 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.19 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.24 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.44 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.22 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.24 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2 worker1 # [ 51.138191] nix-grpc-daemon[768]: ts=2026-09-22T10:59:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47994 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # [ 51.155188] nix-grpc-daemon[768]: ts=2026-09-22T10:59:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 51.169035] nix-grpc-daemon[847]: time=2026-09-22T10:59:16.762Z level=INFO msg="All 2 paths already cached" worker2 # [ 51.226845] nix-grpc-daemon[769]: ts=2026-09-22T10:59:16Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2, in 0.31 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.15 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.19 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&2 worker1 # [ 52.023323] nix-grpc-daemon[768]: ts=2026-09-22T10:59:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47994 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 52.032864] nix-grpc-daemon[768]: ts=2026-09-22T10:59:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 52.043409] nix-grpc-daemon[847]: time=2026-09-22T10:59:17.638Z level=INFO msg="All 2 paths already cached" worker2 # [ 52.101906] nix-grpc-daemon[769]: ts=2026-09-22T10:59:17Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 52.107934] nix-grpc-daemon[769]: ts=2026-09-22T10:59:17Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 52.107439] nix-grpc-daemon[768]: ts=2026-09-22T10:59:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 52.123011] nix-grpc-daemon[768]: ts=2026-09-22T10:59:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 52.138239] nix-grpc-daemon[847]: time=2026-09-22T10:59:17.733Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 52.149861] nix-grpc-daemon[768]: ts=2026-09-22T10:59:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 52.166932] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 52.324557] nix-daemon[834]: accepted connection from pid 979, user nix-grpc-daemon (trusted) worker1 # [ 52.344925] nix-daemon[834]: reaped child process 982, status = succeeded worker1 # [ 52.452263] nix-daemon[834]: accepted connection from pid 984, user nix-grpc-daemon (trusted) worker1 # [ 52.472204] nix-daemon[834]: reaped child process 987, status = succeeded lb # [ 52.497619] niks3-server[998]: 2026/09/22 10:59:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.488814] nix-grpc-daemon[847]: time=2026-09-22T10:59:18.083Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 52.490320] nix-grpc-daemon[847]: time=2026-09-22T10:59:18.083Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 52.535856] niks3-server[998]: 2026/09/22 10:59:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 52.525119] nix-grpc-daemon[847]: time=2026-09-22T10:59:18.120Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.549573] niks3-server[998]: 2026/09/22 10:59:18 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 52.560945] niks3-server[998]: 2026/09/22 10:59:18 INFO Signed narinfos id=7 count=1 lb # [ 52.572137] niks3-server[998]: 2026/09/22 10:59:18 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 52.575959] niks3-server[998]: 2026/09/22 10:59:18 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 52.584367] niks3-server[998]: 2026/09/22 10:59:18 INFO Completed upload id=7 lb # [ 52.588143] niks3-server[998]: 2026/09/22 10:59:18 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker1 # [ 52.562362] nix-grpc-daemon[847]: time=2026-09-22T10:59:18.157Z level=INFO msg="Upload complete. (379ms)" worker1 # [ 52.573903] nix-grpc-daemon[768]: ts=2026-09-22T10:59:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 52.583659] nix-grpc-daemon[768]: ts=2026-09-22T10:59:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 52.593614] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 52.596751] nix-daemon[834]: reaped child process 977, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker1 # [ 52.610908] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 53.242492] nix-daemon[834]: reaped child process 991, status = succeeded worker1 # [ 53.341399] nix-daemon[834]: accepted connection from pid 1007, user nix-grpc-daemon (trusted) worker1 # [ 53.360418] nix-daemon[834]: reaped child process 1010, status = succeeded lb # [ 53.385454] niks3-server[998]: 2026/09/22 10:59:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.376079] nix-grpc-daemon[847]: time=2026-09-22T10:59:18.969Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 53.377555] nix-grpc-daemon[847]: time=2026-09-22T10:59:18.969Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 53.423202] niks3-server[998]: 2026/09/22 10:59:19 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 53.440117] niks3-server[998]: 2026/09/22 10:59:19 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 53.453754] niks3-server[998]: 2026/09/22 10:59:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker1 # [ 53.439520] nix-grpc-daemon[847]: time=2026-09-22T10:59:19.034Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.466178] niks3-server[998]: 2026/09/22 10:59:19 INFO Signed narinfos id=8 count=1 lb # [ 53.472215] niks3-server[998]: 2026/09/22 10:59:19 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls worker1 # [ 53.464277] nix-grpc-daemon[847]: time=2026-09-22T10:59:19.059Z level=INFO msg="Upload complete. (244ms)" lb # [ 53.484585] niks3-server[998]: 2026/09/22 10:59:19 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 53.495938] niks3-server[998]: 2026/09/22 10:59:19 INFO Completed upload id=8 worker1 # [ 53.477084] nix-grpc-daemon[768]: ts=2026-09-22T10:59:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 lb # [ 53.502288] niks3-server[998]: 2026/09/22 10:59:19 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker1 # [ 53.494767] nix-daemon[834]: reaped child process 989, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.71 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.22 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup client # [ 53.930169] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 858319fc617945e5a4d7e6d53cb3bcc4 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 0.09 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup client # [ 54.133154] nix[927]: don't know how to build these paths: client # [ 54.134250] nix[927]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 54.133822] nix-grpc-daemon[768]: ts=2026-09-22T10:59:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47994 worker2 # [ 54.191294] nix-grpc-daemon[769]: ts=2026-09-22T10:59:19Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 54.193310] nix-grpc-daemon[769]: ts=2026-09-22T10:59:19Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 54.193500] nix-grpc-daemon[769]: ts=2026-09-22T10:59:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 54.220552] nix-grpc-daemon[769]: ts=2026-09-22T10:59:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36202 client # [ 54.187101] nix[927]: copying 1 paths to 'lb:50051'... client # [ 54.190569] nix[927]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 54.235619] nix-grpc-daemon[769]: ts=2026-09-22T10:59:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 54.250932] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 54.278091] nix-grpc-daemon[769]: ts=2026-09-22T10:59:19Z level=info event=niks3_push_started pid=907 worker2 # [ 54.445993] nix-grpc-daemon[907]: time=2026-09-22T10:59:20.044Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 54.559318] nix-daemon[855]: accepted connection from pid 920, user nix-grpc-daemon (trusted) worker2 # [ 54.579675] nix-daemon[855]: reaped child process 923, status = succeeded worker2 # [ 54.686909] nix-daemon[855]: accepted connection from pid 925, user nix-grpc-daemon (trusted) worker2 # [ 54.704823] nix-daemon[855]: reaped child process 928, status = succeeded lb # [ 54.689040] niks3-server[998]: 2026/09/22 10:59:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 54.721904] nix-grpc-daemon[907]: time=2026-09-22T10:59:20.320Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 54.723394] nix-grpc-daemon[907]: time=2026-09-22T10:59:20.320Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 54.729387] niks3-server[998]: 2026/09/22 10:59:20 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst worker2 # [ 54.763465] nix-grpc-daemon[907]: time=2026-09-22T10:59:20.362Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.744764] niks3-server[998]: 2026/09/22 10:59:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 54.754113] niks3-server[998]: 2026/09/22 10:59:20 INFO Signed narinfos id=9 count=1 lb # [ 54.759597] niks3-server[998]: 2026/09/22 10:59:20 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 54.769397] niks3-server[998]: 2026/09/22 10:59:20 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete worker2 # [ 54.797042] nix-grpc-daemon[907]: time=2026-09-22T10:59:20.396Z level=INFO msg="Upload complete. (346ms)" lb # [ 54.777482] niks3-server[998]: 2026/09/22 10:59:20 INFO Completed upload id=9 lb # [ 54.781753] niks3-server[998]: 2026/09/22 10:59:20 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 54.808120] nix-grpc-daemon[769]: ts=2026-09-22T10:59:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 54.819042] nix-grpc-daemon[769]: ts=2026-09-22T10:59:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 54.826548] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 54.831888] nix-daemon[855]: reaped child process 905, status = succeeded client # [ 54.798269] nix[927]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 54.845982] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) client # [ 55.041651] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 18fce0d980bd42a192a7dc89cbb0bb07 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 1.12 seconds) worker1 # [ 55.278377] nix-grpc-daemon[768]: ts=2026-09-22T10:59:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47994 client # [ 55.286689] nix[943]: don't know how to build these paths: client # [ 55.287609] nix[943]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 55.341700] nix-grpc-daemon[769]: ts=2026-09-22T10:59:20Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 client # [ 55.303274] nix[943]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 55.348315] nix-grpc-daemon[769]: ts=2026-09-22T10:59:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.05 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 58.679406] nix-daemon[855]: reaped child process 932, status = succeeded worker2 # [ 58.776882] nix-daemon[855]: accepted connection from pid 964, user nix-grpc-daemon (trusted) worker2 # [ 58.794162] nix-daemon[855]: reaped child process 967, status = succeeded lb # [ 58.779617] niks3-server[998]: 2026/09/22 10:59:24 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 58.789858] envoy[898]: conn peer=[2001:db8:1::1]:58624 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9605 tx=4111 ms=6715 worker2 # [ 58.818091] nix-grpc-daemon[907]: time=2026-09-22T10:59:24.417Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 58.822837] nix-grpc-daemon[907]: time=2026-09-22T10:59:24.419Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 58.796605] envoy[898]: conn peer=[2001:db8:1::1]:47662 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=70 lb # [ 58.806619] envoy[898]: conn peer=[2001:db8:1::1]:47670 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4198 tx=1783 ms=1465 lb # [ 58.827538] niks3-server[998]: 2026/09/22 10:59:24 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 58.842260] niks3-server[998]: 2026/09/22 10:59:24 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 58.856185] niks3-server[998]: 2026/09/22 10:59:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker2 # [ 58.884100] nix-grpc-daemon[907]: time=2026-09-22T10:59:24.482Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.863536] niks3-server[998]: 2026/09/22 10:59:24 INFO Signed narinfos id=10 count=1 lb # [ 58.870800] niks3-server[998]: 2026/09/22 10:59:24 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 58.882202] niks3-server[998]: 2026/09/22 10:59:24 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 58.889764] niks3-server[998]: 2026/09/22 10:59:24 INFO Completed upload id=10 worker2 # [ 58.911350] nix-grpc-daemon[907]: time=2026-09-22T10:59:24.510Z level=INFO msg="Upload complete. (253ms)" lb # [ 58.893818] niks3-server[998]: 2026/09/22 10:59:24 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 58.925190] nix-grpc-daemon[769]: ts=2026-09-22T10:59:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 58.944633] nix-grpc-daemon[769]: ts=2026-09-22T10:59:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 58.952315] nix-daemon[855]: reaped child process 930, status = succeeded client # [ 58.913911] systemd[1]: dedup1.service: Deactivated successfully. client # [ 58.919624] systemd[1]: dedup1.service: Consumed 174ms CPU time over 4.985s wall clock time, 41.4M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. client # [ 58.968817] systemd[1]: dedup2.service: Deactivated successfully. client # [ 58.972389] systemd[1]: dedup2.service: Consumed 212ms CPU time over 3.932s wall clock time, 35.3M memory peak, 5.8K incoming IP traffic, 5.6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.13 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.06 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.16 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 60.281041] nix-grpc-daemon[769]: ts=2026-09-22T10:59:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 60.297985] nix-grpc-daemon[769]: ts=2026-09-22T10:59:25Z level=debug event=want client=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=0 worker2 # [ 60.303844] nix-grpc-daemon[769]: ts=2026-09-22T10:59:25Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 60.305022] nix-grpc-daemon[768]: ts=2026-09-22T10:59:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 60.321016] nix-grpc-daemon[768]: ts=2026-09-22T10:59:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 60.335822] nix-grpc-daemon[768]: ts=2026-09-22T10:59:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 60.350982] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 60.516660] nix-daemon[834]: accepted connection from pid 1035, user nix-grpc-daemon (trusted) worker1 # [ 60.543098] nix-daemon[834]: reaped child process 1038, status = succeeded worker1 # [ 60.639697] nix-daemon[834]: accepted connection from pid 1040, user nix-grpc-daemon (trusted) worker1 # [ 60.657360] nix-daemon[834]: reaped child process 1043, status = succeeded lb # [ 60.684664] niks3-server[998]: 2026/09/22 10:59:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.672876] nix-grpc-daemon[847]: time=2026-09-22T10:59:26.267Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 60.674397] nix-grpc-daemon[847]: time=2026-09-22T10:59:26.267Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)" lb # [ 60.717510] niks3-server[998]: 2026/09/22 10:59:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker1 # [ 60.704591] nix-grpc-daemon[847]: time=2026-09-22T10:59:26.299Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.731429] niks3-server[998]: 2026/09/22 10:59:26 INFO Signed narinfos id=11 count=1 lb # [ 60.738448] niks3-server[998]: 2026/09/22 10:59:26 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst lb # [ 60.751663] niks3-server[998]: 2026/09/22 10:59:26 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls worker1 # [ 60.738029] nix-grpc-daemon[847]: time=2026-09-22T10:59:26.333Z level=INFO msg="Upload complete. (370ms)" lb # [ 60.763806] niks3-server[998]: 2026/09/22 10:59:26 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker1 # [ 60.745438] nix-grpc-daemon[768]: ts=2026-09-22T10:59:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 60.769926] niks3-server[998]: 2026/09/22 10:59:26 INFO Completed upload id=11 lb # [ 60.773615] niks3-server[998]: 2026/09/22 10:59:26 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo worker1 # [ 60.760367] nix-grpc-daemon[768]: ts=2026-09-22T10:59:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 60.767791] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 60.773525] nix-daemon[834]: reaped child process 1033, status = succeeded worker1 # [ 60.787607] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 66.802963] nix-grpc-daemon[768]: ts=2026-09-22T10:59:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=6 outputs=0 worker1 # [ 66.821906] nix-daemon[834]: reaped child process 1045, status = succeeded worker1 # [ 66.823066] nix-daemon[834]: reaped child process 1047, status = succeeded worker1 # [ 67.103604] nix-grpc-daemon[768]: ts=2026-09-22T10:59:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47994 worker2 # [ 67.168293] nix-grpc-daemon[769]: ts=2026-09-22T10:59:32Z level=debug event=want client=7 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=0 worker2 # [ 67.168589] nix-grpc-daemon[769]: ts=2026-09-22T10:59:32Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 67.181193] nix-grpc-daemon[769]: ts=2026-09-22T10:59:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 67.198337] nix-grpc-daemon[769]: ts=2026-09-22T10:59:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 67.213317] nix-grpc-daemon[769]: ts=2026-09-22T10:59:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 67.228447] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 67.400411] nix-daemon[855]: accepted connection from pid 984, user nix-grpc-daemon (trusted) worker2 # [ 67.420973] nix-daemon[855]: reaped child process 987, status = succeeded worker2 # [ 67.528206] nix-daemon[855]: accepted connection from pid 989, user nix-grpc-daemon (trusted) worker2 # [ 67.550479] nix-daemon[855]: reaped child process 992, status = succeeded lb # [ 67.530312] niks3-server[998]: 2026/09/22 10:59:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 67.559816] nix-grpc-daemon[907]: time=2026-09-22T10:59:33.158Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 67.562564] nix-grpc-daemon[907]: time=2026-09-22T10:59:33.158Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)" lb # [ 67.563727] niks3-server[998]: 2026/09/22 10:59:33 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst worker2 # [ 67.612926] nix-grpc-daemon[907]: time=2026-09-22T10:59:33.211Z level=INFO msg="Uploading 1 narinfos" lb # [ 67.584316] niks3-server[998]: 2026/09/22 10:59:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 67.595556] niks3-server[998]: 2026/09/22 10:59:33 INFO Signed narinfos id=12 count=1 lb # [ 67.602935] niks3-server[998]: 2026/09/22 10:59:33 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls lb # [ 67.616767] niks3-server[998]: 2026/09/22 10:59:33 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 67.624476] niks3-server[998]: 2026/09/22 10:59:33 INFO Completed upload id=12 worker2 # [ 67.645453] nix-grpc-daemon[907]: time=2026-09-22T10:59:33.244Z level=INFO msg="Upload complete. (398ms)" lb # [ 67.631582] niks3-server[998]: 2026/09/22 10:59:33 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo worker2 # [ 67.656370] nix-grpc-daemon[769]: ts=2026-09-22T10:59:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 67.674040] nix-grpc-daemon[769]: ts=2026-09-22T10:59:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 67.681377] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 67.696849] nix-daemon[855]: reaped child process 982, status = succeeded worker2 # [ 67.717933] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) lb # [ 68.788768] envoy[898]: conn peer=[2001:db8:1::1]:47672 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3018 tx=1429 ms=4761 lb # [ 68.789012] envoy[898]: conn peer=[2001:db8:1::1]:47684 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=3674 lb # [ 68.789172] envoy[898]: conn peer=[2001:db8:1::1]:47700 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3001 tx=952 ms=6626 worker2 # [ 73.736705] nix-grpc-daemon[769]: ts=2026-09-22T10:59:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=6 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=7 outputs=0 worker2 # [ 73.774426] nix-daemon[855]: reaped child process 996, status = succeeded worker2 # [ 73.776847] nix-daemon[855]: reaped child process 994, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.87 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share client # [ 73.948903] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: ba3b5935a2174c8da2bd5cb06506d004 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 0.09 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share worker1 # [ 74.157235] nix-grpc-daemon[768]: ts=2026-09-22T10:59:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47994 client # [ 74.162967] nix[1017]: don't know how to build these paths: client # [ 74.163943] nix[1017]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker2 # [ 74.220306] nix-grpc-daemon[769]: ts=2026-09-22T10:59:39Z level=debug event=want client=8 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=0 worker1 # [ 74.181035] nix-grpc-daemon[768]: ts=2026-09-22T10:59:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker2 # [ 74.226213] nix-grpc-daemon[769]: ts=2026-09-22T10:59:39Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 74.198363] nix-grpc-daemon[768]: ts=2026-09-22T10:59:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 client # [ 74.208950] nix[1017]: copying 1 paths to 'lb:50051'... client # [ 74.211992] nix[1017]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'... worker1 # [ 74.215419] nix-grpc-daemon[768]: ts=2026-09-22T10:59:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 74.230601] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 74.401881] nix-daemon[834]: accepted connection from pid 1070, user nix-grpc-daemon (trusted) worker1 # [ 74.423305] nix-daemon[834]: reaped child process 1073, status = succeeded worker1 # [ 74.527833] nix-daemon[834]: accepted connection from pid 1075, user nix-grpc-daemon (trusted) worker1 # [ 74.545554] nix-daemon[834]: reaped child process 1078, status = succeeded lb # [ 74.573014] niks3-server[998]: 2026/09/22 10:59:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 74.564935] nix-grpc-daemon[847]: time=2026-09-22T10:59:40.159Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 74.566418] nix-grpc-daemon[847]: time=2026-09-22T10:59:40.159Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)" lb # [ 74.612140] niks3-server[998]: 2026/09/22 10:59:40 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst worker1 # [ 74.604595] nix-grpc-daemon[847]: time=2026-09-22T10:59:40.199Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.627261] niks3-server[998]: 2026/09/22 10:59:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 74.637491] niks3-server[998]: 2026/09/22 10:59:40 INFO Signed narinfos id=13 count=1 lb # [ 74.645032] niks3-server[998]: 2026/09/22 10:59:40 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls worker1 # [ 74.635286] nix-grpc-daemon[847]: time=2026-09-22T10:59:40.230Z level=INFO msg="Upload complete. (386ms)" lb # [ 74.656872] niks3-server[998]: 2026/09/22 10:59:40 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 74.668445] niks3-server[998]: 2026/09/22 10:59:40 INFO Completed upload id=13 worker1 # [ 74.645243] nix-grpc-daemon[768]: ts=2026-09-22T10:59:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 74.671849] niks3-server[998]: 2026/09/22 10:59:40 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo worker1 # [ 74.660539] nix-grpc-daemon[768]: ts=2026-09-22T10:59:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 74.667088] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 74.671966] nix-daemon[834]: reaped child process 1068, status = succeeded client # [ 74.680546] nix[1017]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051... worker1 # [ 74.686017] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) client # [ 75.050724] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: cd1ac9a4a2354f289988cf8eebddaa3f client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 1.11 seconds) client # [ 75.266796] nix[1033]: don't know how to build these paths: client # [ 75.267810] nix[1033]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker2 # [ 75.310544] nix-grpc-daemon[769]: ts=2026-09-22T10:59:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 75.323267] nix-grpc-daemon[769]: ts=2026-09-22T10:59:40Z level=debug event=want client=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=0 worker1 # [ 75.286312] nix-grpc-daemon[768]: ts=2026-09-22T10:59:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 client # [ 75.291212] nix[1033]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 78.435970] systemd[1]: share1.service: Sent signal SIGINT to main process 1017 (nix) on client request. client # [ 78.446004] nix[1017]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.09 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 78.461824] nix[1017]: error: interrupted by the user client # [ 78.518745] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 78.521334] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 78.524425] systemd[1]: share1.service: Consumed 175ms CPU time over 4.572s wall clock time, 41.4M memory peak, 6.2K incoming IP traffic, 8.1K outgoing IP traffic. lb # [ 78.793124] envoy[898]: conn peer=[2001:db8:1::1]:60898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2976 tx=978 ms=6617 lb # [ 78.798149] envoy[898]: conn peer=[2001:db8:1::1]:42416 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3003 tx=811 ms=4311 client: (finished: waiting for success: ! systemctl is-active share1, in 1.09 seconds) client: waiting for success: ! systemctl is-active share2 worker1 # [ 79.997217] nix-daemon[834]: reaped child process 1082, status = succeeded worker1 # [ 80.068083] nix-daemon[834]: accepted connection from pid 1116, user nix-grpc-daemon (trusted) worker1 # [ 80.090516] nix-daemon[834]: reaped child process 1119, status = succeeded lb # [ 80.111607] niks3-server[998]: 2026/09/22 10:59:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 80.099840] nix-grpc-daemon[847]: time=2026-09-22T10:59:45.694Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 80.104134] nix-grpc-daemon[847]: time=2026-09-22T10:59:45.697Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)" lb # [ 80.157161] niks3-server[998]: 2026/09/22 10:59:45 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv lb # [ 80.168322] niks3-server[998]: 2026/09/22 10:59:45 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst worker1 # [ 80.162222] nix-grpc-daemon[847]: time=2026-09-22T10:59:45.756Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.182776] niks3-server[998]: 2026/09/22 10:59:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 80.191597] niks3-server[998]: 2026/09/22 10:59:45 INFO Signed narinfos id=14 count=1 lb # [ 80.196211] niks3-server[998]: 2026/09/22 10:59:45 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls lb # [ 80.205684] niks3-server[998]: 2026/09/22 10:59:45 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 80.210836] niks3-server[998]: 2026/09/22 10:59:45 INFO Completed upload id=14 lb # [ 80.217056] niks3-server[998]: 2026/09/22 10:59:45 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo worker1 # [ 80.189152] nix-grpc-daemon[847]: time=2026-09-22T10:59:45.784Z level=INFO msg="Upload complete. (288ms)" worker1 # [ 80.205417] nix-grpc-daemon[768]: ts=2026-09-22T10:59:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=4 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=8 outputs=1 worker1 # [ 80.220458] nix-grpc-daemon[768]: ts=2026-09-22T10:59:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=5 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=8 outputs=1 worker1 # [ 80.228524] nix-daemon[834]: reaped child process 1080, status = succeeded client # [ 80.236931] systemd[1]: share2.service: Deactivated successfully. client # [ 80.241265] systemd[1]: share2.service: Consumed 190ms CPU time over 5.190s wall clock time, 35.3M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.12 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.05 seconds) (finished: subtest: the first client leaving does not fail the second, in 7.09 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 81.107149] systemd[1]: Started Nix Daemon. client # [ 81.224947] nix-daemon[1085]: accepted connection from pid 1082, user root (trusted) worker2 # [ 81.417796] nix-grpc-daemon[769]: ts=2026-09-22T10:59:47Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36202 worker1 # [ 81.379838] nix-grpc-daemon[768]: ts=2026-09-22T10:59:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker2 # [ 81.440973] nix-grpc-daemon[769]: ts=2026-09-22T10:59:47Z level=debug event=want client=10 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 81.448431] nix-grpc-daemon[769]: ts=2026-09-22T10:59:47Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 81.457964] nix-grpc-daemon[769]: ts=2026-09-22T10:59:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 81.469081] nix-grpc-daemon[769]: ts=2026-09-22T10:59:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 81.483371] nix-grpc-daemon[769]: ts=2026-09-22T10:59:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 81.498526] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 81.653377] nix-daemon[855]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker2 # [ 81.670155] nix-daemon[855]: reaped child process 1044, status = succeeded worker2 # [ 81.772691] nix-daemon[855]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 81.791958] nix-daemon[855]: reaped child process 1049, status = succeeded lb # [ 81.773566] niks3-server[998]: 2026/09/22 10:59:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 81.803619] nix-grpc-daemon[907]: time=2026-09-22T10:59:47.402Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 81.805242] nix-grpc-daemon[907]: time=2026-09-22T10:59:47.402Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 81.799348] niks3-server[998]: 2026/09/22 10:59:47 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 81.815742] niks3-server[998]: 2026/09/22 10:59:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker2 # [ 81.843075] nix-grpc-daemon[907]: time=2026-09-22T10:59:47.442Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.826330] niks3-server[998]: 2026/09/22 10:59:47 INFO Signed narinfos id=15 count=1 lb # [ 81.833465] niks3-server[998]: 2026/09/22 10:59:47 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 81.843957] niks3-server[998]: 2026/09/22 10:59:47 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 81.852296] niks3-server[998]: 2026/09/22 10:59:47 INFO Completed upload id=15 lb # [ 81.855390] niks3-server[998]: 2026/09/22 10:59:47 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker2 # [ 81.873888] nix-grpc-daemon[907]: time=2026-09-22T10:59:47.473Z level=INFO msg="Upload complete. (359ms)" worker2 # [ 81.884432] nix-grpc-daemon[769]: ts=2026-09-22T10:59:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 81.898165] nix-grpc-daemon[769]: ts=2026-09-22T10:59:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 81.906497] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 81.909497] nix-daemon[855]: reaped child process 1039, status = succeeded worker2 # [ 81.921551] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 82.967897] nix-daemon[855]: reaped child process 1053, status = succeeded worker2 # [ 83.078073] nix-daemon[855]: accepted connection from pid 1069, user nix-grpc-daemon (trusted) worker2 # [ 83.099499] nix-daemon[855]: reaped child process 1072, status = succeeded lb # [ 83.082830] niks3-server[998]: 2026/09/22 10:59:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 83.114658] nix-grpc-daemon[907]: time=2026-09-22T10:59:48.712Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 83.116232] nix-grpc-daemon[907]: time=2026-09-22T10:59:48.712Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 83.119449] niks3-server[998]: 2026/09/22 10:59:48 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 83.132379] niks3-server[998]: 2026/09/22 10:59:48 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 83.141758] niks3-server[998]: 2026/09/22 10:59:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker2 # [ 83.169618] nix-grpc-daemon[907]: time=2026-09-22T10:59:48.768Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.151905] niks3-server[998]: 2026/09/22 10:59:48 INFO Signed narinfos id=16 count=1 lb # [ 83.158845] niks3-server[998]: 2026/09/22 10:59:48 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 83.171222] niks3-server[998]: 2026/09/22 10:59:48 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete worker2 # [ 83.196933] nix-grpc-daemon[907]: time=2026-09-22T10:59:48.796Z level=INFO msg="Upload complete. (265ms)" lb # [ 83.179893] niks3-server[998]: 2026/09/22 10:59:48 INFO Completed upload id=16 lb # [ 83.183068] niks3-server[998]: 2026/09/22 10:59:48 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker2 # [ 83.210496] nix-grpc-daemon[769]: ts=2026-09-22T10:59:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=9 outputs=1 worker1 # [ 83.173155] nix-grpc-daemon[768]: ts=2026-09-22T10:59:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:47994 worker2 # [ 83.229777] nix-daemon[855]: reaped child process 1051, status = succeeded worker1 # [ 83.186971] nix-grpc-daemon[768]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 83.232114] nix-grpc-daemon[768]: ts=2026-09-22T10:59:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 83.238273] nix-grpc-daemon[768]: ts=2026-09-22T10:59:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 83.514735] nix-grpc-daemon[768]: ts=2026-09-22T10:59:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:47994 worker2 # [ 83.562071] nix-grpc-daemon[769]: ts=2026-09-22T10:59:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 83.572086] nix-grpc-daemon[907]: time=2026-09-22T10:59:49.171Z level=INFO msg="All 1 paths already cached" worker2 # [ 83.589489] nix-grpc-daemon[769]: ts=2026-09-22T10:59:49Z level=debug event=want client=11 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 83.596571] nix-grpc-daemon[769]: ts=2026-09-22T10:59:49Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 83.638066] nix-grpc-daemon[769]: ts=2026-09-22T10:59:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 83.653608] nix-grpc-daemon[769]: ts=2026-09-22T10:59:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 83.668323] nix-grpc-daemon[907]: time=2026-09-22T10:59:49.267Z level=INFO msg="All 1 paths already cached" worker2 # [ 83.674811] nix-grpc-daemon[769]: ts=2026-09-22T10:59:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 83.689345] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 83.844126] nix-daemon[855]: accepted connection from pid 1078, user nix-grpc-daemon (trusted) worker2 # [ 83.862083] nix-daemon[855]: reaped child process 1081, status = succeeded worker2 # [ 83.962055] nix-daemon[855]: accepted connection from pid 1083, user nix-grpc-daemon (trusted) worker2 # [ 83.979069] nix-daemon[855]: reaped child process 1086, status = succeeded lb # [ 83.962641] niks3-server[998]: 2026/09/22 10:59:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 83.993554] nix-grpc-daemon[907]: time=2026-09-22T10:59:49.592Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 83.995052] nix-grpc-daemon[907]: time=2026-09-22T10:59:49.592Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 83.995268] niks3-server[998]: 2026/09/22 10:59:49 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker2 # [ 84.026925] nix-grpc-daemon[907]: time=2026-09-22T10:59:49.626Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.010825] niks3-server[998]: 2026/09/22 10:59:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 84.020926] niks3-server[998]: 2026/09/22 10:59:49 INFO Signed narinfos id=17 count=1 worker2 # [ 84.051553] nix-grpc-daemon[907]: time=2026-09-22T10:59:49.650Z level=INFO msg="Upload complete. (345ms)" lb # [ 84.030000] niks3-server[998]: 2026/09/22 10:59:49 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 84.037390] niks3-server[998]: 2026/09/22 10:59:49 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 84.042036] niks3-server[998]: 2026/09/22 10:59:49 INFO Completed upload id=17 worker2 # [ 84.061171] nix-grpc-daemon[769]: ts=2026-09-22T10:59:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 84.044252] niks3-server[998]: 2026/09/22 10:59:49 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker2 # [ 84.071076] nix-grpc-daemon[769]: ts=2026-09-22T10:59:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 84.077177] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 84.081638] nix-daemon[855]: reaped child process 1076, status = succeeded worker2 # [ 84.093545] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 85.176710] nix-daemon[855]: reaped child process 1090, status = succeeded worker2 # [ 85.272507] nix-daemon[855]: accepted connection from pid 1106, user nix-grpc-daemon (trusted) worker2 # [ 85.290038] nix-daemon[855]: reaped child process 1109, status = succeeded lb # [ 85.277850] niks3-server[998]: 2026/09/22 10:59:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.308421] nix-grpc-daemon[907]: time=2026-09-22T10:59:50.906Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 85.310151] nix-grpc-daemon[907]: time=2026-09-22T10:59:50.906Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 85.327256] niks3-server[998]: 2026/09/22 10:59:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign worker2 # [ 85.359713] nix-grpc-daemon[907]: time=2026-09-22T10:59:50.958Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.341791] niks3-server[998]: 2026/09/22 10:59:50 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 85.351927] niks3-server[998]: 2026/09/22 10:59:50 INFO Signed narinfos id=18 count=1 lb # [ 85.359349] niks3-server[998]: 2026/09/22 10:59:50 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker2 # [ 85.380626] nix-grpc-daemon[907]: time=2026-09-22T10:59:50.979Z level=INFO msg="Upload complete. (274ms)" lb # [ 85.366257] niks3-server[998]: 2026/09/22 10:59:50 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 85.370151] niks3-server[998]: 2026/09/22 10:59:50 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 85.374175] niks3-server[998]: 2026/09/22 10:59:50 INFO Completed upload id=18 worker2 # [ 85.393509] nix-grpc-daemon[769]: ts=2026-09-22T10:59:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=10 outputs=1 lb # [ 85.376251] niks3-server[998]: 2026/09/22 10:59:50 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker1 # [ 85.362254] nix-grpc-daemon[768]: ts=2026-09-22T10:59:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:47994 worker2 # [ 85.410349] nix-daemon[855]: reaped child process 1088, status = succeeded worker1 # [ 85.376776] nix-grpc-daemon[768]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker2 # [ 85.460112] nix-grpc-daemon[769]: ts=2026-09-22T10:59:51Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 85.466100] nix-grpc-daemon[769]: ts=2026-09-22T10:59:51Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 85.704295] nix-grpc-daemon[769]: ts=2026-09-22T10:59:51Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36202 worker1 # [ 85.666354] nix-grpc-daemon[768]: ts=2026-09-22T10:59:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 85.678250] nix-grpc-daemon[847]: time=2026-09-22T10:59:51.272Z level=INFO msg="All 2 paths already cached" worker2 # [ 85.739004] nix-grpc-daemon[769]: ts=2026-09-22T10:59:51Z level=debug event=want client=12 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 85.746414] nix-grpc-daemon[769]: ts=2026-09-22T10:59:51Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 85.755005] nix-grpc-daemon[769]: ts=2026-09-22T10:59:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 85.766642] nix-grpc-daemon[769]: ts=2026-09-22T10:59:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 85.781183] nix-grpc-daemon[907]: time=2026-09-22T10:59:51.380Z level=INFO msg="All 2 paths already cached" worker2 # [ 85.787692] nix-grpc-daemon[769]: ts=2026-09-22T10:59:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 85.801822] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 85.959458] nix-daemon[855]: accepted connection from pid 1115, user nix-grpc-daemon (trusted) worker2 # [ 85.977527] nix-daemon[855]: reaped child process 1118, status = succeeded worker2 # [ 86.078552] nix-daemon[855]: accepted connection from pid 1120, user nix-grpc-daemon (trusted) worker2 # [ 86.097152] nix-daemon[855]: reaped child process 1123, status = succeeded lb # [ 86.079974] niks3-server[998]: 2026/09/22 10:59:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.112769] nix-grpc-daemon[907]: time=2026-09-22T10:59:51.711Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 86.114277] nix-grpc-daemon[907]: time=2026-09-22T10:59:51.711Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 86.111382] niks3-server[998]: 2026/09/22 10:59:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign worker2 # [ 86.137527] nix-grpc-daemon[907]: time=2026-09-22T10:59:51.736Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.119292] niks3-server[998]: 2026/09/22 10:59:51 INFO Signed narinfos id=19 count=1 lb # [ 86.126827] niks3-server[998]: 2026/09/22 10:59:51 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 86.133913] niks3-server[998]: 2026/09/22 10:59:51 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 86.142189] niks3-server[998]: 2026/09/22 10:59:51 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 86.147628] niks3-server[998]: 2026/09/22 10:59:51 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo lb # [ 86.152755] niks3-server[998]: 2026/09/22 10:59:51 INFO Completed upload id=19 worker2 # [ 86.174044] nix-grpc-daemon[907]: time=2026-09-22T10:59:51.773Z level=INFO msg="Upload complete. (355ms)" worker2 # [ 86.180317] nix-grpc-daemon[769]: ts=2026-09-22T10:59:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 86.194503] nix-grpc-daemon[769]: ts=2026-09-22T10:59:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 86.203370] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 86.206368] nix-daemon[855]: reaped child process 1113, status = succeeded worker2 # [ 86.218511] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 87.685389] nix-daemon[855]: reaped child process 1127, status = succeeded worker2 # [ 87.799854] nix-daemon[855]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker2 # [ 87.819951] nix-daemon[855]: reaped child process 1146, status = succeeded lb # [ 87.806283] niks3-server[998]: 2026/09/22 10:59:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 87.836423] nix-grpc-daemon[907]: time=2026-09-22T10:59:53.434Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 87.838107] nix-grpc-daemon[907]: time=2026-09-22T10:59:53.434Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 87.854156] niks3-server[998]: 2026/09/22 10:59:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker2 # [ 87.885683] nix-grpc-daemon[907]: time=2026-09-22T10:59:53.484Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.870216] niks3-server[998]: 2026/09/22 10:59:53 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 87.878031] niks3-server[998]: 2026/09/22 10:59:53 INFO Signed narinfos id=20 count=1 lb # [ 87.882453] niks3-server[998]: 2026/09/22 10:59:53 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 87.890261] niks3-server[998]: 2026/09/22 10:59:53 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 87.893405] niks3-server[998]: 2026/09/22 10:59:53 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 87.898470] niks3-server[998]: 2026/09/22 10:59:53 INFO Completed upload id=20 worker2 # [ 87.918602] nix-grpc-daemon[907]: time=2026-09-22T10:59:53.517Z level=INFO msg="Upload complete. (289ms)" lb # [ 87.900565] niks3-server[998]: 2026/09/22 10:59:53 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 87.934377] nix-grpc-daemon[769]: ts=2026-09-22T10:59:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=11 outputs=1 worker2 # [ 87.950402] nix-grpc-daemon[769]: ts=2026-09-22T10:59:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 87.955857] nix-daemon[855]: reaped child process 1125, status = succeeded worker1 # [ 87.915132] nix-grpc-daemon[768]: ts=2026-09-22T10:59:53Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 87.932471] nix-grpc-daemon[768]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker1 # [ 87.948786] nix-grpc-daemon[768]: ts=2026-09-22T10:59:53Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=1 nar_bytes_out=232 client # [ 88.080413] nix-daemon[1085]: reaped child process 1087, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.13 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.25 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only, in 0.30 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.12 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure lb # [ 88.791029] envoy[898]: conn peer=[2001:db8:1::1]:42428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=4951 worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 89.064929] nix-daemon[1085]: accepted connection from pid 1168, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 89.257163] nix-grpc-daemon[769]: ts=2026-09-22T10:59:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36202 worker1 # [ 89.218982] nix-grpc-daemon[768]: ts=2026-09-22T10:59:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 89.396034] nix-daemon[834]: accepted connection from pid 1129, user nix-grpc-daemon (trusted) lb # [ 88.796109] envoy[898]: conn peer=[2001:db8:1::1]:47316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3427 tx=1855 ms=1922 lb # [ 88.796282] envoy[898]: conn peer=[2001:db8:1::1]:47324 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=73 lb # [ 88.796399] envoy[898]: conn peer=[2001:db8:1::1]:47336 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3901 tx=2046 ms=1925 worker1 # [ 89.414257] nix-daemon[834]: reaped child process 1132, status = succeeded lb # [ 88.796493] envoy[898]: conn peer=[2001:db8:1::1]:47348 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=29 lb # [ 88.796600] envoy[898]: conn peer=[2001:db8:1::1]:47364 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2167 ms=2347 lb # [ 88.796712] envoy[898]: conn peer=[2001:db8:1::1]:47372 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=407 ms=97 lb # [ 89.450592] niks3-server[998]: 2026/09/22 10:59:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 89.438866] nix-grpc-daemon[847]: time=2026-09-22T10:59:55.033Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 89.440997] nix-grpc-daemon[847]: time=2026-09-22T10:59:55.033Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 89.479354] niks3-server[998]: 2026/09/22 10:59:55 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker1 # [ 89.471369] nix-grpc-daemon[847]: time=2026-09-22T10:59:55.066Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.493888] niks3-server[998]: 2026/09/22 10:59:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 89.503730] niks3-server[998]: 2026/09/22 10:59:55 INFO Signed narinfos id=21 count=1 lb # [ 89.510193] niks3-server[998]: 2026/09/22 10:59:55 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 89.520298] niks3-server[998]: 2026/09/22 10:59:55 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete worker1 # [ 89.499472] nix-grpc-daemon[847]: time=2026-09-22T10:59:55.094Z level=INFO msg="Upload complete. (274ms)" lb # [ 89.529617] niks3-server[998]: 2026/09/22 10:59:55 INFO Completed upload id=21 lb # [ 89.532214] niks3-server[998]: 2026/09/22 10:59:55 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker2 # [ 89.564422] nix-grpc-daemon[769]: ts=2026-09-22T10:59:55Z level=debug event=want client=13 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 89.571219] nix-grpc-daemon[769]: ts=2026-09-22T10:59:55Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 89.575714] nix-grpc-daemon[768]: ts=2026-09-22T10:59:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 89.591036] nix-grpc-daemon[768]: ts=2026-09-22T10:59:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 89.609687] nix-grpc-daemon[768]: ts=2026-09-22T10:59:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 89.625301] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 89.790502] nix-daemon[834]: accepted connection from pid 1136, user nix-grpc-daemon (trusted) worker1 # [ 89.809901] nix-daemon[834]: reaped child process 1139, status = succeeded worker1 # [ 89.912939] nix-daemon[834]: accepted connection from pid 1141, user nix-grpc-daemon (trusted) worker1 # [ 89.931335] nix-daemon[834]: reaped child process 1144, status = succeeded lb # [ 89.955937] niks3-server[998]: 2026/09/22 10:59:55 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 89.965158] niks3-server[998]: 2026/09/22 10:59:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 89.952774] nix-grpc-daemon[847]: time=2026-09-22T10:59:55.547Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 89.954287] nix-grpc-daemon[847]: time=2026-09-22T10:59:55.547Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker1 # [ 89.956083] nix-grpc-daemon[847]: time=2026-09-22T10:59:55.547Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 90.001318] niks3-server[998]: 2026/09/22 10:59:55 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 90.014870] niks3-server[998]: 2026/09/22 10:59:55 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 90.026629] niks3-server[998]: 2026/09/22 10:59:55 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 90.036248] niks3-server[998]: 2026/09/22 10:59:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 90.043676] niks3-server[998]: 2026/09/22 10:59:55 INFO Signed narinfos id=22 count=1 worker1 # [ 90.021834] nix-grpc-daemon[847]: time=2026-09-22T10:59:55.616Z level=INFO msg="Uploading 3 narinfos" lb # [ 90.048598] niks3-server[998]: 2026/09/22 10:59:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 90.054531] niks3-server[998]: 2026/09/22 10:59:55 INFO Signed narinfos id=23 count=2 lb # [ 90.058847] niks3-server[998]: 2026/09/22 10:59:55 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 90.067967] niks3-server[998]: 2026/09/22 10:59:55 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 90.078482] niks3-server[998]: 2026/09/22 10:59:55 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 90.085258] niks3-server[998]: 2026/09/22 10:59:55 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 90.092667] niks3-server[998]: 2026/09/22 10:59:55 INFO Completed upload id=23 lb # [ 90.096993] niks3-server[998]: 2026/09/22 10:59:55 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete worker1 # [ 90.076040] nix-grpc-daemon[847]: time=2026-09-22T10:59:55.671Z level=INFO msg="Upload complete. (431ms)" lb # [ 90.099630] niks3-server[998]: 2026/09/22 10:59:55 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 90.103483] niks3-server[998]: 2026/09/22 10:59:55 INFO Completed upload id=22 worker1 # [ 90.088158] nix-grpc-daemon[768]: ts=2026-09-22T10:59:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=2 nar_bytes_in=984 worker1 # [ 90.104803] nix-grpc-daemon[768]: ts=2026-09-22T10:59:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 90.114121] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 90.121719] nix-daemon[834]: reaped child process 1134, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker1 # [ 90.135877] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 91.379327] nix-daemon[834]: reaped child process 1148, status = succeeded worker1 # [ 91.479968] nix-daemon[834]: accepted connection from pid 1164, user nix-grpc-daemon (trusted) worker1 # [ 91.497740] nix-daemon[834]: reaped child process 1167, status = succeeded lb # [ 91.526953] niks3-server[998]: 2026/09/22 10:59:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 91.516424] nix-grpc-daemon[847]: time=2026-09-22T10:59:57.110Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 91.560241] niks3-server[998]: 2026/09/22 10:59:57 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls worker1 # [ 91.549774] nix-grpc-daemon[847]: time=2026-09-22T10:59:57.144Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.572950] niks3-server[998]: 2026/09/22 10:59:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 91.584220] niks3-server[998]: 2026/09/22 10:59:57 INFO Signed narinfos id=24 count=1 lb # [ 91.588909] niks3-server[998]: 2026/09/22 10:59:57 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 91.596948] niks3-server[998]: 2026/09/22 10:59:57 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete worker1 # [ 91.581816] nix-grpc-daemon[847]: time=2026-09-22T10:59:57.177Z level=INFO msg="Upload complete. (231ms)" lb # [ 91.604759] niks3-server[998]: 2026/09/22 10:59:57 INFO Completed upload id=24 lb # [ 91.606905] niks3-server[998]: 2026/09/22 10:59:57 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo client # copying 1 paths... worker1 # [ 91.592925] nix-grpc-daemon[768]: ts=2026-09-22T10:59:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=12 outputs=1 worker1 # [ 91.607009] nix-grpc-daemon[768]: ts=2026-09-22T10:59:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:47994 client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 91.611413] nix-daemon[834]: reaped child process 1146, status = succeeded worker1 # [ 91.634388] nix-grpc-daemon[768]: ts=2026-09-22T10:59:57Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 91.639723] nix-grpc-daemon[768]: ts=2026-09-22T10:59:57Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=1 nar_bytes_out=120 client # [ 91.762496] nix-daemon[1085]: reaped child process 1171, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.90 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 91.934162] nix-daemon[1085]: accepted connection from pid 1190, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 92.083170] nix-grpc-daemon[768]: ts=2026-09-22T10:59:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:47994 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 92.090809] nix-grpc-daemon[768]: ts=2026-09-22T10:59:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 92.097528] nix-grpc-daemon[847]: time=2026-09-22T10:59:57.691Z level=INFO msg="All 1 paths already cached" worker2 # [ 92.159631] nix-grpc-daemon[769]: ts=2026-09-22T10:59:57Z level=debug event=want client=14 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 92.159931] nix-grpc-daemon[769]: ts=2026-09-22T10:59:57Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 92.173468] nix-grpc-daemon[769]: ts=2026-09-22T10:59:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 92.181041] nix-grpc-daemon[769]: ts=2026-09-22T10:59:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36202 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 92.214478] nix-grpc-daemon[769]: ts=2026-09-22T10:59:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 92.229408] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 92.252758] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 1/5) worker2 # [ 92.261550] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5) worker2 # [ 92.354641] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 203 ms (attempt 3/5) worker2 # [ 92.559825] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 335 ms (attempt 4/5) worker2 # [ 92.897645] nix-grpc-daemon[769]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 92.903231] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 92.911254] nix-grpc-daemon[769]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 93.090214] nix-daemon[855]: accepted connection from pid 1162, user nix-grpc-daemon (trusted) worker2 # [ 93.110459] nix-daemon[855]: reaped child process 1165, status = succeeded worker2 # [ 93.214969] nix-daemon[855]: accepted connection from pid 1167, user nix-grpc-daemon (trusted) worker2 # [ 93.232529] nix-daemon[855]: reaped child process 1170, status = succeeded lb # [ 93.217089] niks3-server[998]: 2026/09/22 10:59:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 93.248797] nix-grpc-daemon[907]: time=2026-09-22T10:59:58.847Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 93.250236] nix-grpc-daemon[907]: time=2026-09-22T10:59:58.847Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 93.248521] niks3-server[998]: 2026/09/22 10:59:58 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker2 # [ 93.292352] nix-grpc-daemon[907]: time=2026-09-22T10:59:58.891Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.270511] niks3-server[998]: 2026/09/22 10:59:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 93.277944] niks3-server[998]: 2026/09/22 10:59:58 INFO Signed narinfos id=25 count=1 lb # [ 93.287566] niks3-server[998]: 2026/09/22 10:59:58 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 93.299874] niks3-server[998]: 2026/09/22 10:59:58 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 93.310037] niks3-server[998]: 2026/09/22 10:59:58 INFO Completed upload id=25 worker2 # [ 93.330368] nix-grpc-daemon[907]: time=2026-09-22T10:59:58.929Z level=INFO msg="Upload complete. (399ms)" lb # [ 93.317619] niks3-server[998]: 2026/09/22 10:59:58 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker2 # [ 93.340992] nix-grpc-daemon[769]: ts=2026-09-22T10:59:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=1 paths=1 nar_bytes_in=568 worker2 # [ 93.357136] nix-grpc-daemon[769]: ts=2026-09-22T10:59:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 93.367941] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) worker2 # [ 93.372490] nix-daemon[855]: reaped child process 1155, status = succeeded worker2 # [ 93.387753] nix-grpc-daemon[769]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 93.408311] nix-daemon[855]: accepted connection from pid 769, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 94.476152] nix-daemon[855]: reaped child process 1175, status = succeeded worker2 # [ 94.564891] nix-daemon[855]: accepted connection from pid 1191, user nix-grpc-daemon (trusted) worker2 # [ 94.583884] nix-daemon[855]: reaped child process 1194, status = succeeded lb # [ 94.569022] niks3-server[998]: 2026/09/22 11:00:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 94.603010] nix-grpc-daemon[907]: time=2026-09-22T11:00:00.199Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 94.602098] niks3-server[998]: 2026/09/22 11:00:00 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls worker2 # [ 94.633832] nix-grpc-daemon[907]: time=2026-09-22T11:00:00.232Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.614083] niks3-server[998]: 2026/09/22 11:00:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 94.626671] niks3-server[998]: 2026/09/22 11:00:00 INFO Signed narinfos id=26 count=1 lb # [ 94.633176] niks3-server[998]: 2026/09/22 11:00:00 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 94.641867] niks3-server[998]: 2026/09/22 11:00:00 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete worker2 # [ 94.674011] nix-grpc-daemon[907]: time=2026-09-22T11:00:00.273Z level=INFO msg="Upload complete. (253ms)" lb # [ 94.654450] niks3-server[998]: 2026/09/22 11:00:00 INFO Completed upload id=26 lb # [ 94.659996] niks3-server[998]: 2026/09/22 11:00:00 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo client # copying 1 paths... worker2 # [ 94.689162] nix-grpc-daemon[769]: ts=2026-09-22T11:00:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=13 outputs=1 worker1 # [ 94.650326] nix-grpc-daemon[768]: ts=2026-09-22T11:00:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:47994 worker2 # [ 94.704936] nix-daemon[855]: reaped child process 1172, status = succeeded worker1 # [ 94.662724] nix-grpc-daemon[768]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 94.749226] nix-grpc-daemon[769]: ts=2026-09-22T11:00:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 94.756112] nix-grpc-daemon[769]: ts=2026-09-22T11:00:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=0 paths=1 nar_bytes_out=120 client # [ 94.796333] nix-daemon[1085]: reaped child process 1193, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.03 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 94.968692] nix-daemon[1085]: accepted connection from pid 1212, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 95.117408] nix-grpc-daemon[768]: ts=2026-09-22T11:00:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:47994 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 95.164803] nix-grpc-daemon[769]: ts=2026-09-22T11:00:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 95.176236] nix-grpc-daemon[907]: time=2026-09-22T11:00:00.775Z level=INFO msg="All 1 paths already cached" worker2 # [ 95.193852] nix-grpc-daemon[769]: ts=2026-09-22T11:00:00Z level=debug event=want client=15 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker1 # [ 95.153993] nix-grpc-daemon[768]: ts=2026-09-22T11:00:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker2 # [ 95.200578] nix-grpc-daemon[769]: ts=2026-09-22T11:00:00Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 95.170243] nix-grpc-daemon[768]: ts=2026-09-22T11:00:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47994 client # copying 1 paths to 'lb:50051'... worker1 # [ 95.186037] nix-grpc-daemon[847]: time=2026-09-22T11:00:00.779Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 95.191484] nix-grpc-daemon[768]: ts=2026-09-22T11:00:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 95.206647] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 95.362239] nix-daemon[834]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker1 # [ 95.382298] nix-daemon[834]: reaped child process 1175, status = succeeded worker1 # [ 95.486537] nix-daemon[834]: accepted connection from pid 1177, user nix-grpc-daemon (trusted) worker1 # [ 95.505370] nix-daemon[834]: reaped child process 1180, status = succeeded lb # [ 95.530384] niks3-server[998]: 2026/09/22 11:00:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 95.520061] nix-grpc-daemon[847]: time=2026-09-22T11:00:01.115Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 95.521556] nix-grpc-daemon[847]: time=2026-09-22T11:00:01.115Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 95.562641] niks3-server[998]: 2026/09/22 11:00:01 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 95.579209] niks3-server[998]: 2026/09/22 11:00:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker1 # [ 95.567801] nix-grpc-daemon[847]: time=2026-09-22T11:00:01.162Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.589248] niks3-server[998]: 2026/09/22 11:00:01 INFO Signed narinfos id=27 count=1 lb # [ 95.596464] niks3-server[998]: 2026/09/22 11:00:01 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 95.607343] niks3-server[998]: 2026/09/22 11:00:01 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete worker1 # [ 95.592657] nix-grpc-daemon[847]: time=2026-09-22T11:00:01.187Z level=INFO msg="Upload complete. (369ms)" lb # [ 95.617657] niks3-server[998]: 2026/09/22 11:00:01 INFO Completed upload id=27 worker1 # [ 95.600203] nix-grpc-daemon[768]: ts=2026-09-22T11:00:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=0 paths=1 nar_bytes_in=568 lb # [ 95.622428] niks3-server[998]: 2026/09/22 11:00:01 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker1 # [ 95.615464] nix-grpc-daemon[768]: ts=2026-09-22T11:00:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 95.622920] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) worker1 # [ 95.628282] nix-daemon[834]: reaped child process 1170, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker1 # [ 95.643207] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 96.536715] nix-daemon[834]: reaped child process 1184, status = succeeded worker1 # [ 96.623870] nix-daemon[834]: accepted connection from pid 1200, user nix-grpc-daemon (trusted) worker1 # [ 96.645479] nix-daemon[834]: reaped child process 1203, status = succeeded lb # [ 96.673881] niks3-server[998]: 2026/09/22 11:00:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 96.662905] nix-grpc-daemon[847]: time=2026-09-22T11:00:02.255Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 96.705126] niks3-server[998]: 2026/09/22 11:00:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker1 # [ 96.691183] nix-grpc-daemon[847]: time=2026-09-22T11:00:02.286Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.720259] niks3-server[998]: 2026/09/22 11:00:02 INFO Signed narinfos id=28 count=1 lb # [ 96.722966] niks3-server[998]: 2026/09/22 11:00:02 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 96.731941] niks3-server[998]: 2026/09/22 11:00:02 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 96.721531] nix-grpc-daemon[847]: time=2026-09-22T11:00:02.316Z level=INFO msg="Upload complete. (268ms)" lb # [ 96.745057] niks3-server[998]: 2026/09/22 11:00:02 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 96.749475] niks3-server[998]: 2026/09/22 11:00:02 INFO Completed upload id=28 client # copying 1 paths... lb # [ 96.753264] niks3-server[998]: 2026/09/22 11:00:02 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker1 # [ 96.733033] nix-grpc-daemon[768]: ts=2026-09-22T11:00:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47994 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=14 outputs=1 worker2 # [ 96.781179] nix-grpc-daemon[769]: ts=2026-09-22T11:00:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36202 worker1 # [ 96.749151] nix-daemon[834]: reaped child process 1182, status = succeeded worker2 # [ 96.793641] nix-grpc-daemon[769]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 96.838046] nix-grpc-daemon[769]: ts=2026-09-22T11:00:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36202 worker2 # [ 96.843225] nix-grpc-daemon[769]: ts=2026-09-22T11:00:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36202 duration_s=0 paths=1 nar_bytes_out=120 client # [ 96.920809] nix-daemon[1085]: reaped child process 1215, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.12 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 8.71 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache, in 0.34 seconds) client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache, in 0.30 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.12 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.19 seconds) worker2 # [ 97.984969] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 98.185221] nix-grpc-daemon[769]: ts=2026-09-22T11:00:03Z level=info event=signal_exit lb # [ 98.333459] niks3-server[998]: 2026/09/22 11:00:03 INFO lead: released remote=192.168.1.4:49332 lb # [ 98.790725] envoy[898]: conn peer=[2001:db8:1::1]:47386 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3879 tx=1857 ms=2478 lb # [ 98.795896] envoy[898]: conn peer=[2001:db8:1::1]:39016 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=62 lb # [ 98.800863] envoy[898]: conn peer=[2001:db8:1::1]:39024 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3740 tx=2015 ms=2648 lb # [ 98.805623] envoy[898]: conn peer=[2001:db8:1::1]:39034 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=29 lb # [ 98.810251] envoy[898]: conn peer=[2001:db8:1::1]:39036 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3741 tx=2012 ms=1738 lb # [ 98.815345] envoy[898]: conn peer=[2001:db8:1::1]:39048 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=67 worker1 # [ 99.315658] nix-grpc-daemon[768]: ts=2026-09-22T11:00:04Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 99.360008] nix-grpc-daemon[769]: ts=2026-09-22T11:00:04Z level=info event=scheduler_restarting worker2 # [ 99.362471] nix-grpc-daemon[769]: ts=2026-09-22T11:00:04Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 99.362668] nix-grpc-daemon[769]: ts=2026-09-22T11:00:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45324 worker2 # [ 99.362805] nix-grpc-daemon[769]: ts=2026-09-22T11:00:04Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 99.362936] nix-grpc-daemon[769]: ts=2026-09-22T11:00:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45324 worker2 # [ 99.363043] nix-grpc-daemon[769]: ts=2026-09-22T11:00:04Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 99.413951] nix-daemon[855]: reaped child process 857, status = succeeded worker1 # [ 99.515437] nix-grpc-daemon[768]: ts=2026-09-22T11:00:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.520748] nix-grpc-daemon[768]: ts=2026-09-22T11:00:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 99.579888] nix-grpc-daemon[769]: ts=2026-09-22T11:00:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 99.721673] nix-grpc-daemon[768]: ts=2026-09-22T11:00:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.726931] nix-grpc-daemon[768]: ts=2026-09-22T11:00:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 99.927825] nix-grpc-daemon[768]: ts=2026-09-22T11:00:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.933285] nix-grpc-daemon[768]: ts=2026-09-22T11:00:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 100.132556] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 100.140301] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 100.142855] systemd[1]: nix-grpc-daemon.service: Consumed 3.030s CPU time over 1min 21.197s wall clock time, 61.9M memory peak, 80.2K incoming IP traffic, 221.8K outgoing IP traffic. worker2 # [ 100.161416] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 100.163432] systemd[1]: Closed Nix worker-protocol over gRPC. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 100.172232] systemd[1]: nix-grpc-daemon.socket: Consumed 562us CPU time over 1min 30.058s wall clock time, 256K memory peak, 95.3K incoming IP traffic, 81K outgoing IP traffic. worker1 # [ 100.133961] nix-grpc-daemon[768]: ts=2026-09-22T11:00:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.139278] nix-grpc-daemon[768]: ts=2026-09-22T11:00:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 100.341240] nix-grpc-daemon[768]: ts=2026-09-22T11:00:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.346018] nix-grpc-daemon[768]: ts=2026-09-22T11:00:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 100.418997] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47994 worker1 # [ 100.428483] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:47994 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.26 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds) worker1 # [ 100.542859] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.548121] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 100.598990] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 100.627305] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 100.749093] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.754411] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 100.955241] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.960556] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 101.039167] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=signal_exit worker1 # [ 101.161173] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.166222] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 101.329069] systemd[1]: Starting scheduler-token.service... worker1 # [ 101.370321] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 101.415907] systemd[1]: scheduler-token.service: Deactivated successfully. worker1 # [ 101.374756] nix-grpc-daemon[768]: ts=2026-09-22T11:00:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 101.420642] systemd[1]: Finished scheduler-token.service. worker2 # [ 101.429910] systemd[1]: scheduler-token.service: Consumed 57ms CPU time over 91ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 101.453524] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 101.571568] nix-grpc-daemon[768]: ts=2026-09-22T11:00:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.577501] nix-grpc-daemon[768]: ts=2026-09-22T11:00:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 101.625326] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 101.627645] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 101.631580] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 101.637487] nix-grpc-daemon[1221]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 101.638956] nix-grpc-daemon[1221]: E0000 00:00:1790074807.235933 1221 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 101.647177] niks3-server[998]: 2026/09/22 11:00:07 INFO lead: acquired remote=192.168.1.4:53814 worker2 # [ 101.680177] nix-grpc-daemon[1221]: E0000 00:00:1790074807.242226 1221 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 101.682531] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 101.708216] nix-grpc-daemon[1221]: E0000 00:00:1790074807.259977 1261 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 101.711157] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=scheduler_take_over worker2 # [ 101.713165] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 101.713988] nix-grpc-daemon[1221]: E0000 00:00:1790074807.289615 1261 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 101.716390] nix-grpc-daemon[1221]: E0000 00:00:1790074807.289824 1261 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 101.722773] nix-grpc-daemon[1221]: E0000 00:00:1790074807.305741 1261 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 101.727616] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 101.741822] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 101.743206] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:50576 worker2 # [ 101.746563] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 101.779439] nix-grpc-daemon[768]: ts=2026-09-22T11:00:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 101.825064] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:50576 worker2 # [ 101.829356] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 102.315314] nix-grpc-daemon[768]: ts=2026-09-22T11:00:07Z level=info event=scheduler_restarting worker2 # [ 102.377824] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50576 worker2 # [ 102.383005] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:07Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 102.385474] nix-grpc-daemon[768]: ts=2026-09-22T11:00:07Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 102.417187] nix-daemon[834]: reaped child process 836, status = succeeded worker1 # [ 103.158362] nix-grpc-daemon[768]: E0000 00:00:1790074808.753363 813 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 103.175491] nix-grpc-daemon[768]: E0000 00:00:1790074808.770573 813 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 104.025151] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 104.030844] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 104.040491] systemd[1]: nix-grpc-daemon.service: Consumed 3.940s CPU time over 1min 25.254s wall clock time, 61.9M memory peak, 99.3K incoming IP traffic, 177.9K outgoing IP traffic. worker1 # [ 104.053288] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 104.061397] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 104.063200] systemd[1]: nix-grpc-daemon.socket: Consumed 543us CPU time over 1min 33.961s wall clock time, 256K memory peak, 92.9K incoming IP traffic, 75.8K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 104.429592] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 104.447396] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 104.475033] nix-grpc-daemon[1221]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 1/5) worker2 # [ 104.491622] nix-grpc-daemon[1221]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 2/5) worker2 # [ 104.537879] nix-grpc-daemon[1221]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 3/5) worker2 # [ 104.630455] nix-grpc-daemon[1221]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 730 ms (attempt 4/5) worker2 # [ 105.363758] nix-grpc-daemon[1221]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 105.367574] nix-grpc-daemon[1221]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 105.394769] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50592 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 105.415885] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 105.449095] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:11Z level=info event=niks3_push_started pid=1281 worker2 # [ 105.607281] nix-grpc-daemon[1281]: time=2026-09-22T11:00:11.206Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 105.722891] nix-daemon[855]: accepted connection from pid 1294, user nix-grpc-daemon (trusted) worker2 # [ 105.742322] nix-daemon[855]: reaped child process 1297, status = succeeded lb # [ 105.727646] niks3-server[998]: 2026/09/22 11:00:11 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 105.741482] niks3-server[998]: 2026/09/22 11:00:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 105.773081] nix-grpc-daemon[1281]: time=2026-09-22T11:00:11.371Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 105.774624] nix-grpc-daemon[1281]: time=2026-09-22T11:00:11.371Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 105.778358] nix-grpc-daemon[1281]: time=2026-09-22T11:00:11.371Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 105.785538] niks3-server[998]: 2026/09/22 11:00:11 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 105.807993] niks3-server[998]: 2026/09/22 11:00:11 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 105.821095] niks3-server[998]: 2026/09/22 11:00:11 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 105.829233] niks3-server[998]: 2026/09/22 11:00:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 105.835820] niks3-server[998]: 2026/09/22 11:00:11 INFO Signed narinfos id=29 count=1 worker2 # [ 105.863429] nix-grpc-daemon[1281]: time=2026-09-22T11:00:11.460Z level=INFO msg="Uploading 3 narinfos" lb # [ 105.842756] niks3-server[998]: 2026/09/22 11:00:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 105.848838] niks3-server[998]: 2026/09/22 11:00:11 INFO Signed narinfos id=30 count=2 lb # [ 105.853447] niks3-server[998]: 2026/09/22 11:00:11 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 105.867251] niks3-server[998]: 2026/09/22 11:00:11 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 105.877756] niks3-server[998]: 2026/09/22 11:00:11 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 105.886243] niks3-server[998]: 2026/09/22 11:00:11 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 105.894006] niks3-server[998]: 2026/09/22 11:00:11 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 105.907971] niks3-server[998]: 2026/09/22 11:00:11 INFO Completed upload id=29 lb # [ 105.910672] niks3-server[998]: 2026/09/22 11:00:11 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 105.914490] niks3-server[998]: 2026/09/22 11:00:11 INFO Completed upload id=30 worker2 # [ 105.936471] nix-grpc-daemon[1281]: time=2026-09-22T11:00:11.535Z level=INFO msg="Upload complete. (325ms)" worker2 # [ 105.948616] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50592 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 105.964853] nix-daemon[855]: reaped child process 1279, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.79 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds) worker1 # [ 106.053215] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 106.060652] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 106.194850] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:11Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 106.197147] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 106.201143] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 106.208239] nix-grpc-daemon[1226]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 106.232548] nix-grpc-daemon[1226]: E0000 00:00:1790074811.800972 1226 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 106.234928] nix-grpc-daemon[1226]: E0000 00:00:1790074811.803145 1226 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 106.258098] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 106.260322] nix-grpc-daemon[1226]: E0000 00:00:1790074811.813747 1265 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 106.262818] nix-grpc-daemon[1226]: E0000 00:00:1790074811.836502 1265 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 106.265089] nix-grpc-daemon[1226]: E0000 00:00:1790074811.836674 1265 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 106.267342] nix-grpc-daemon[1226]: E0000 00:00:1790074811.852189 1265 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 106.269720] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 106.277829] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.322254] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:11Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:50576 worker2 # [ 106.327765] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.15 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.46 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 107.562500] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:13Z level=info event=scheduler_lock_lost status=200 worker1 # [ 107.519709] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:13Z level=info event=scheduler_lock_lost status=200 lb # [ 107.540589] niks3-server[998]: 2026/09/22 11:00:13 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 107.540778] niks3-server[998]: 2026/09/22 11:00:13 INFO lead: released remote=192.168.1.4:53814 lb # [ 107.552681] systemd[1]: Stopping niks3 server... lb # [ 107.568275] systemd[1]: niks3.service: Deactivated successfully. lb # [ 107.570718] systemd[1]: Stopped niks3 server. lb # [ 107.571471] systemd[1]: niks3.service: Consumed 569ms CPU time over 1min 20.537s wall clock time, 26.2M memory peak, 77.9K incoming IP traffic, 112.8K outgoing IP traffic. lb # [ 107.581207] systemd[1]: Starting niks3 server... lb # [ 107.637013] niks3-server[1138]: 2026/09/22 11:00:13 goose: no migrations to run. current version: 20260920000000 lb # [ 107.643464] niks3-server[1138]: 2026/09/22 11:00:13 OK 1_commit_pending_closure.sql (4.64ms) lb # [ 107.647059] niks3-server[1138]: 2026/09/22 11:00:13 OK 2_object_stats_trigger.sql (3.23ms) lb # [ 107.648991] niks3-server[1138]: 2026/09/22 11:00:13 goose: up to current file version: 2 lb # [ 107.650641] niks3-server[1138]: 2026/09/22 11:00:13 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key lb # [ 107.661402] niks3-server[1138]: 2026/09/22 11:00:13 INFO Read proxy enabled — serving cache objects from S3 lb # [ 107.662717] niks3-server[1138]: 2026/09/22 11:00:13 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 107.667411] niks3-server[1138]: 2026/09/22 11:00:13 INFO systemd watchdog enabled interval=15s lb # [ 107.671240] niks3-server[1138]: 2026/09/22 11:00:13 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb # [ 107.673785] systemd[1]: Started niks3 server. lb: (finished: waiting for unit niks3.service, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 108.127218] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 108.142116] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker1 # [ 108.165686] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 108.180269] nix-grpc-daemon[1226]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 1/5) worker1 # [ 108.245444] nix-grpc-daemon[1226]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 2/5) worker1 # [ 108.322359] nix-grpc-daemon[1226]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 274 ms (attempt 3/5) lb # [ 108.546280] niks3-server[1138]: 2026/09/22 11:00:14 INFO lead: acquired remote=192.168.1.4:53870 worker1 # [ 108.599414] nix-grpc-daemon[1226]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 4/5) worker1 # [ 108.692245] nix-grpc-daemon[1226]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 108.698900] nix-grpc-daemon[1226]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 108.790009] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:14Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=0 worker2 # [ 108.790428] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:14Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.4:50051 clients=1 lb # [ 108.790493] envoy[898]: conn peer=[2001:db8:1::4]:37328 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=73016 tx=3791 ms=80365 lb # [ 108.795811] envoy[898]: conn peer=[2001:db8:1::1]:39052 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=29 lb # [ 108.800752] envoy[898]: conn peer=[2001:db8:1::3]:47196 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=16215 tx=4346 ms=83273 lb # [ 108.805748] envoy[898]: conn peer=[2001:db8:1::1]:58986 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=305 ms=1539 worker2 # [ 108.836824] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 108.856380] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50592 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'... worker2 # [ 108.870756] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 108.886401] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 109.040841] nix-daemon[855]: accepted connection from pid 1316, user nix-grpc-daemon (trusted) worker2 # [ 109.064605] nix-daemon[855]: reaped child process 1319, status = succeeded worker2 # [ 109.161569] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted) worker2 # [ 109.177372] nix-daemon[855]: reaped child process 1324, status = succeeded lb # [ 109.163842] niks3-server[1138]: 2026/09/22 11:00:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 109.200302] nix-grpc-daemon[1281]: time=2026-09-22T11:00:14.798Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 109.201878] nix-grpc-daemon[1281]: time=2026-09-22T11:00:14.799Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)" lb # [ 109.211009] niks3-server[1138]: 2026/09/22 11:00:14 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst lb # [ 109.225922] niks3-server[1138]: 2026/09/22 11:00:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker2 # [ 109.254896] nix-grpc-daemon[1281]: time=2026-09-22T11:00:14.853Z level=INFO msg="Uploading 1 narinfos" lb # [ 109.236623] niks3-server[1138]: 2026/09/22 11:00:14 INFO Signed narinfos id=31 count=1 lb # [ 109.246114] niks3-server[1138]: 2026/09/22 11:00:14 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls lb # [ 109.253818] niks3-server[1138]: 2026/09/22 11:00:14 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 109.271641] niks3-server[1138]: 2026/09/22 11:00:14 INFO Completed upload id=31 worker2 # [ 109.293574] nix-grpc-daemon[1281]: time=2026-09-22T11:00:14.892Z level=INFO msg="Upload complete. (389ms)" worker2 # [ 109.304345] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50592 duration_s=0 paths=1 nar_bytes_in=544 worker2 # [ 109.316569] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 109.328784] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 109.339173] nix-daemon[855]: reaped child process 1314, status = succeeded client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051... client # farm-a> worker2: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker2 # [ 109.346897] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 110.244600] nix-daemon[855]: reaped child process 1328, status = succeeded worker2 # [ 110.316657] nix-daemon[855]: accepted connection from pid 1344, user nix-grpc-daemon (trusted) worker2 # [ 110.336110] nix-daemon[855]: reaped child process 1347, status = succeeded lb # [ 110.321994] niks3-server[1138]: 2026/09/22 11:00:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 110.356476] nix-grpc-daemon[1281]: time=2026-09-22T11:00:15.955Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 110.358245] nix-grpc-daemon[1281]: time=2026-09-22T11:00:15.955Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)" lb # [ 110.377911] niks3-server[1138]: 2026/09/22 11:00:15 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv lb # [ 110.388852] niks3-server[1138]: 2026/09/22 11:00:15 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 110.399668] niks3-server[1138]: 2026/09/22 11:00:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker2 # [ 110.422367] nix-grpc-daemon[1281]: time=2026-09-22T11:00:16.020Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.406092] niks3-server[1138]: 2026/09/22 11:00:16 INFO Signed narinfos id=32 count=1 lb # [ 110.410640] niks3-server[1138]: 2026/09/22 11:00:16 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls lb # [ 110.418288] niks3-server[1138]: 2026/09/22 11:00:16 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 110.424143] niks3-server[1138]: 2026/09/22 11:00:16 INFO Completed upload id=32 worker2 # [ 110.445201] nix-grpc-daemon[1281]: time=2026-09-22T11:00:16.044Z level=INFO msg="Upload complete. (288ms)" lb # [ 110.427474] niks3-server[1138]: 2026/09/22 11:00:16 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo worker2 # [ 110.469262] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50592 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=1 worker2 # [ 110.484321] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:16Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=0 worker2 # [ 110.489970] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:16Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 110.495220] nix-daemon[855]: reaped child process 1326, status = succeeded worker2 # [ 110.510915] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 110.525966] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 110.541162] nix-grpc-daemon[1281]: time=2026-09-22T11:00:16.140Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'... worker2 # [ 110.551262] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 110.566128] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 110.716569] nix-daemon[855]: accepted connection from pid 1353, user nix-grpc-daemon (trusted) worker2 # [ 110.734794] nix-daemon[855]: reaped child process 1356, status = succeeded worker2 # [ 110.837347] nix-daemon[855]: accepted connection from pid 1358, user nix-grpc-daemon (trusted) worker2 # [ 110.856775] nix-daemon[855]: reaped child process 1361, status = succeeded lb # [ 110.833113] niks3-server[1138]: 2026/09/22 11:00:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 110.865156] nix-grpc-daemon[1281]: time=2026-09-22T11:00:16.464Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 110.866648] nix-grpc-daemon[1281]: time=2026-09-22T11:00:16.464Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)" lb # [ 110.864200] niks3-server[1138]: 2026/09/22 11:00:16 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst worker2 # [ 110.897273] nix-grpc-daemon[1281]: time=2026-09-22T11:00:16.496Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.880469] niks3-server[1138]: 2026/09/22 11:00:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 110.890789] niks3-server[1138]: 2026/09/22 11:00:16 INFO Signed narinfos id=33 count=1 lb # [ 110.896148] niks3-server[1138]: 2026/09/22 11:00:16 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls lb # [ 110.905562] niks3-server[1138]: 2026/09/22 11:00:16 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete worker2 # [ 110.926634] nix-grpc-daemon[1281]: time=2026-09-22T11:00:16.525Z level=INFO msg="Upload complete. (344ms)" lb # [ 110.911273] niks3-server[1138]: 2026/09/22 11:00:16 INFO Completed upload id=33 worker2 # [ 110.934571] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50592 duration_s=0 paths=1 nar_bytes_in=656 lb # [ 110.914481] niks3-server[1138]: 2026/09/22 11:00:16 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo worker2 # [ 110.946147] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 110.951763] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 110.956212] nix-daemon[855]: reaped child process 1351, status = succeeded client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051... worker2 # [ 110.968990] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) client # farm-b> worker2: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 112.452876] nix-daemon[855]: reaped child process 1365, status = succeeded worker2 # [ 112.548577] nix-daemon[855]: accepted connection from pid 1381, user nix-grpc-daemon (trusted) worker2 # [ 112.569498] nix-daemon[855]: reaped child process 1384, status = succeeded lb # [ 112.554597] niks3-server[1138]: 2026/09/22 11:00:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 112.584774] nix-grpc-daemon[1281]: time=2026-09-22T11:00:18.183Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 112.586474] nix-grpc-daemon[1281]: time=2026-09-22T11:00:18.183Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)" lb # [ 112.595640] niks3-server[1138]: 2026/09/22 11:00:18 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst lb # [ 112.616189] niks3-server[1138]: 2026/09/22 11:00:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker2 # [ 112.647064] nix-grpc-daemon[1281]: time=2026-09-22T11:00:18.245Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.630672] niks3-server[1138]: 2026/09/22 11:00:18 INFO Signed narinfos id=34 count=1 lb # [ 112.645933] niks3-server[1138]: 2026/09/22 11:00:18 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls lb # [ 112.655918] niks3-server[1138]: 2026/09/22 11:00:18 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete worker2 # [ 112.682746] nix-grpc-daemon[1281]: time=2026-09-22T11:00:18.282Z level=INFO msg="Upload complete. (303ms)" lb # [ 112.664527] niks3-server[1138]: 2026/09/22 11:00:18 INFO Completed upload id=34 lb # [ 112.671028] niks3-server[1138]: 2026/09/22 11:00:18 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv lb # [ 112.677515] niks3-server[1138]: 2026/09/22 11:00:18 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo worker2 # [ 112.698639] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50592 duration_s=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=1 worker2 # [ 112.722744] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:18Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=0 worker2 # [ 112.727865] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:18Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 112.733665] nix-daemon[855]: reaped child process 1363, status = succeeded worker2 # [ 112.758184] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 112.773496] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 112.789539] nix-grpc-daemon[1281]: time=2026-09-22T11:00:18.388Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'... worker2 # [ 112.799729] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 112.814637] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 112.968144] nix-daemon[855]: accepted connection from pid 1390, user nix-grpc-daemon (trusted) worker2 # [ 112.987713] nix-daemon[855]: reaped child process 1393, status = succeeded worker2 # [ 113.089057] nix-daemon[855]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 113.107407] nix-daemon[855]: reaped child process 1398, status = succeeded lb # [ 113.089442] niks3-server[1138]: 2026/09/22 11:00:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 113.121174] nix-grpc-daemon[1281]: time=2026-09-22T11:00:18.720Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 113.122693] nix-grpc-daemon[1281]: time=2026-09-22T11:00:18.720Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)" lb # [ 113.122190] niks3-server[1138]: 2026/09/22 11:00:18 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst lb # [ 113.137188] niks3-server[1138]: 2026/09/22 11:00:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign worker2 # [ 113.166810] nix-grpc-daemon[1281]: time=2026-09-22T11:00:18.765Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.148939] niks3-server[1138]: 2026/09/22 11:00:18 INFO Signed narinfos id=35 count=1 lb # [ 113.151665] niks3-server[1138]: 2026/09/22 11:00:18 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls lb # [ 113.164609] niks3-server[1138]: 2026/09/22 11:00:18 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 113.179450] niks3-server[1138]: 2026/09/22 11:00:18 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo lb # [ 113.183939] niks3-server[1138]: 2026/09/22 11:00:18 INFO Completed upload id=35 worker2 # [ 113.205785] nix-grpc-daemon[1281]: time=2026-09-22T11:00:18.805Z level=INFO msg="Upload complete. (374ms)" worker2 # [ 113.214636] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50592 duration_s=0 paths=1 nar_bytes_in=784 worker2 # [ 113.231028] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50592 worker2 # [ 113.238362] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 113.243810] nix-daemon[855]: reaped child process 1388, status = succeeded client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051... worker2 # [ 113.256825] nix-daemon[855]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) client # farm-top> worker2: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 114.503814] nix-daemon[855]: reaped child process 1402, status = succeeded worker2 # [ 114.620253] nix-daemon[855]: accepted connection from pid 1418, user nix-grpc-daemon (trusted) worker2 # [ 114.638452] nix-daemon[855]: reaped child process 1421, status = succeeded lb # [ 114.622916] niks3-server[1138]: 2026/09/22 11:00:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 114.656473] nix-grpc-daemon[1281]: time=2026-09-22T11:00:20.254Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 114.658257] nix-grpc-daemon[1281]: time=2026-09-22T11:00:20.254Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)" lb # [ 114.652492] niks3-server[1138]: 2026/09/22 11:00:20 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv lb # [ 114.676065] niks3-server[1138]: 2026/09/22 11:00:20 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst worker2 # [ 114.719590] nix-grpc-daemon[1281]: time=2026-09-22T11:00:20.318Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.690107] niks3-server[1138]: 2026/09/22 11:00:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 114.703782] niks3-server[1138]: 2026/09/22 11:00:20 INFO Signed narinfos id=36 count=1 lb # [ 114.708766] niks3-server[1138]: 2026/09/22 11:00:20 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls lb # [ 114.719357] niks3-server[1138]: 2026/09/22 11:00:20 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete worker2 # [ 114.748449] nix-grpc-daemon[1281]: time=2026-09-22T11:00:20.347Z level=INFO msg="Upload complete. (279ms)" lb # [ 114.728840] niks3-server[1138]: 2026/09/22 11:00:20 INFO Completed upload id=36 lb # [ 114.731050] niks3-server[1138]: 2026/09/22 11:00:20 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo worker2 # [ 114.761183] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50592 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=1 worker2 # [ 114.781132] nix-daemon[855]: reaped child process 1400, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2, in 6.86 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath, in 0.18 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 7.54 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.13 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2 # [ 115.279465] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 115.654342] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:21Z level=info event=signal_exit lb # [ 116.553394] niks3-server[1138]: 2026/09/22 11:00:22 INFO lead: released remote=192.168.1.4:53870 worker1 # [ 117.533237] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:23Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 117.579810] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:23Z level=info event=scheduler_restarting worker2 # [ 117.584454] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:23Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 117.588989] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50576 worker2 # [ 117.594013] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:23Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 117.598713] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50576 worker2 # [ 117.603664] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:23Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 117.628685] nix-daemon[855]: reaped child process 1273, status = succeeded worker2 # [ 117.723103] nix-grpc-daemon[1221]: E0000 00:00:1790074823.322040 1266 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 117.729766] nix-grpc-daemon[1221]: E0000 00:00:1790074823.322350 1266 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 117.732961] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 117.738553] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.794835] nix-grpc-daemon[1221]: ts=2026-09-22T11:00:23Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 117.851027] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 117.858206] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 117.866551] systemd[1]: nix-grpc-daemon.service: Consumed 1.713s CPU time over 16.415s wall clock time, 38.3M memory peak, 45.6K incoming IP traffic, 76.1K outgoing IP traffic. worker2 # [ 117.880248] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 117.882207] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 117.883834] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 17.292s wall clock time, 256K memory peak, 38.7K incoming IP traffic, 28.9K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 117.939243] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 117.944325] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.144947] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 118.150205] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.351008] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 118.356454] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.527704] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:24Z level=info event=scheduler_take_over lb # [ 118.549470] niks3-server[1138]: 2026/09/22 11:00:24 INFO lead: acquired remote=192.168.1.3:36074 worker1 # [ 118.558951] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 118.563189] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.759815] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 118.765126] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 118.789863] envoy[898]: conn peer=[2001:db8:1::1]:59002 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9753 tx=4129 ms=6611 lb # [ 118.795719] envoy[898]: conn peer=[2001:db8:1::4]:58194 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1665 tx=425 ms=16065 worker1 # [ 118.965945] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 118.977324] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.17 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 119.173720] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.183260] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:24Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:38666 worker1 # [ 119.188873] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:24Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2 client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 120.349943] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 120.357529] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 120.382250] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:25Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 120.389494] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:25Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 120.426827] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 120.442507] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47014 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 120.461349] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 120.476542] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) worker1 # [ 120.505325] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:26Z level=info event=niks3_push_started pid=1308 worker1 # [ 120.662651] nix-grpc-daemon[1308]: time=2026-09-22T11:00:26.257Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca="" worker1 # [ 120.775012] nix-daemon[834]: accepted connection from pid 1321, user nix-grpc-daemon (trusted) worker1 # [ 120.793147] nix-daemon[834]: reaped child process 1324, status = succeeded worker1 # [ 120.898495] nix-daemon[834]: accepted connection from pid 1326, user nix-grpc-daemon (trusted) worker1 # [ 120.916372] nix-daemon[834]: reaped child process 1329, status = succeeded lb # [ 120.945015] niks3-server[1138]: 2026/09/22 11:00:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 120.934655] nix-grpc-daemon[1308]: time=2026-09-22T11:00:26.528Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 120.936525] nix-grpc-daemon[1308]: time=2026-09-22T11:00:26.528Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 120.980552] niks3-server[1138]: 2026/09/22 11:00:26 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst worker1 # [ 120.984636] nix-grpc-daemon[1308]: time=2026-09-22T11:00:26.579Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.006461] niks3-server[1138]: 2026/09/22 11:00:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 121.015722] niks3-server[1138]: 2026/09/22 11:00:26 INFO Signed narinfos id=37 count=1 lb # [ 121.028692] niks3-server[1138]: 2026/09/22 11:00:26 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete worker1 # [ 121.014254] nix-grpc-daemon[1308]: time=2026-09-22T11:00:26.609Z level=INFO msg="Upload complete. (347ms)" lb # [ 121.040314] niks3-server[1138]: 2026/09/22 11:00:26 INFO Completed upload id=37 worker1 # [ 121.025223] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47014 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 121.038571] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 121.045071] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) worker1 # [ 121.050207] nix-daemon[834]: reaped child process 1306, status = succeeded worker1 # [ 121.060179] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 121.960705] nix-daemon[834]: reaped child process 1333, status = succeeded worker1 # [ 122.039684] nix-daemon[834]: accepted connection from pid 1349, user nix-grpc-daemon (trusted) worker1 # [ 122.057488] nix-daemon[834]: reaped child process 1352, status = succeeded lb # [ 122.085395] niks3-server[1138]: 2026/09/22 11:00:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 122.080477] nix-grpc-daemon[1308]: time=2026-09-22T11:00:27.674Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 122.082427] nix-grpc-daemon[1308]: time=2026-09-22T11:00:27.674Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 122.147663] niks3-server[1138]: 2026/09/22 11:00:27 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 122.157561] niks3-server[1138]: 2026/09/22 11:00:27 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 122.168810] niks3-server[1138]: 2026/09/22 11:00:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker1 # [ 122.148117] nix-grpc-daemon[1308]: time=2026-09-22T11:00:27.741Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.171780] niks3-server[1138]: 2026/09/22 11:00:27 INFO Signed narinfos id=38 count=1 lb # [ 122.181195] niks3-server[1138]: 2026/09/22 11:00:27 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 122.190484] niks3-server[1138]: 2026/09/22 11:00:27 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls worker1 # [ 122.168395] nix-grpc-daemon[1308]: time=2026-09-22T11:00:27.763Z level=INFO msg="Upload complete. (297ms)" lb # [ 122.199833] niks3-server[1138]: 2026/09/22 11:00:27 INFO Completed upload id=38 lb # [ 122.202721] niks3-server[1138]: 2026/09/22 11:00:27 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker1 # [ 122.192951] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 122.207056] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:27Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 122.211301] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:27Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 122.215605] nix-daemon[834]: reaped child process 1331, status = succeeded worker1 # [ 122.235388] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 122.250850] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 122.267088] nix-grpc-daemon[1308]: time=2026-09-22T11:00:27.862Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 122.277333] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 122.290889] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) worker1 # [ 122.441469] nix-daemon[834]: accepted connection from pid 1358, user nix-grpc-daemon (trusted) worker1 # [ 122.461238] nix-daemon[834]: reaped child process 1361, status = succeeded worker1 # [ 122.567077] nix-daemon[834]: accepted connection from pid 1363, user nix-grpc-daemon (trusted) worker1 # [ 122.585198] nix-daemon[834]: reaped child process 1366, status = succeeded lb # [ 122.609808] niks3-server[1138]: 2026/09/22 11:00:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 122.601957] nix-grpc-daemon[1308]: time=2026-09-22T11:00:28.196Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 122.603461] nix-grpc-daemon[1308]: time=2026-09-22T11:00:28.196Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 122.643930] niks3-server[1138]: 2026/09/22 11:00:28 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst worker1 # [ 122.636153] nix-grpc-daemon[1308]: time=2026-09-22T11:00:28.231Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.660244] niks3-server[1138]: 2026/09/22 11:00:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 122.673864] niks3-server[1138]: 2026/09/22 11:00:28 INFO Signed narinfos id=39 count=1 lb # [ 122.682465] niks3-server[1138]: 2026/09/22 11:00:28 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 122.695041] niks3-server[1138]: 2026/09/22 11:00:28 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 122.700770] niks3-server[1138]: 2026/09/22 11:00:28 INFO Completed upload id=39 worker1 # [ 122.678008] nix-grpc-daemon[1308]: time=2026-09-22T11:00:28.273Z level=INFO msg="Upload complete. (370ms)" lb # [ 122.702841] niks3-server[1138]: 2026/09/22 11:00:28 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker1 # [ 122.688268] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47014 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 122.703454] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 122.713323] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) worker1 # [ 122.716382] nix-daemon[834]: reaped child process 1356, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker1 # [ 122.732421] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 123.984361] nix-daemon[834]: reaped child process 1370, status = succeeded worker1 # [ 124.106328] nix-daemon[834]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker1 # [ 124.123284] nix-daemon[834]: reaped child process 1389, status = succeeded lb # [ 124.151659] niks3-server[1138]: 2026/09/22 11:00:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 124.141765] nix-grpc-daemon[1308]: time=2026-09-22T11:00:29.736Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 124.143306] nix-grpc-daemon[1308]: time=2026-09-22T11:00:29.736Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 124.185601] niks3-server[1138]: 2026/09/22 11:00:29 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst worker1 # [ 124.181905] nix-grpc-daemon[1308]: time=2026-09-22T11:00:29.776Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.203132] niks3-server[1138]: 2026/09/22 11:00:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 124.215016] niks3-server[1138]: 2026/09/22 11:00:29 INFO Signed narinfos id=40 count=1 lb # [ 124.221282] niks3-server[1138]: 2026/09/22 11:00:29 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 124.227944] niks3-server[1138]: 2026/09/22 11:00:29 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 124.236996] niks3-server[1138]: 2026/09/22 11:00:29 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete worker1 # [ 124.216113] nix-grpc-daemon[1308]: time=2026-09-22T11:00:29.811Z level=INFO msg="Upload complete. (272ms)" lb # [ 124.239655] niks3-server[1138]: 2026/09/22 11:00:29 INFO Completed upload id=40 lb # [ 124.243611] niks3-server[1138]: 2026/09/22 11:00:29 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker1 # [ 124.235104] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 124.251764] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:29Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 124.255829] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:29Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 124.260191] nix-daemon[834]: reaped child process 1368, status = succeeded worker1 # [ 124.279298] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 124.294385] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 124.308640] nix-grpc-daemon[1308]: time=2026-09-22T11:00:29.903Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 124.319052] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 124.333006] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) worker1 # [ 124.487862] nix-daemon[834]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker1 # [ 124.511689] nix-daemon[834]: reaped child process 1398, status = succeeded worker1 # [ 124.608115] nix-daemon[834]: accepted connection from pid 1400, user nix-grpc-daemon (trusted) worker1 # [ 124.628923] nix-daemon[834]: reaped child process 1403, status = succeeded lb # [ 124.651143] niks3-server[1138]: 2026/09/22 11:00:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 124.639757] nix-grpc-daemon[1308]: time=2026-09-22T11:00:30.234Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 124.641417] nix-grpc-daemon[1308]: time=2026-09-22T11:00:30.234Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 124.679241] niks3-server[1138]: 2026/09/22 11:00:30 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst lb # [ 124.694913] niks3-server[1138]: 2026/09/22 11:00:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker1 # [ 124.679661] nix-grpc-daemon[1308]: time=2026-09-22T11:00:30.274Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.707798] niks3-server[1138]: 2026/09/22 11:00:30 INFO Signed narinfos id=41 count=1 lb # [ 124.713467] niks3-server[1138]: 2026/09/22 11:00:30 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls worker1 # [ 124.702519] nix-grpc-daemon[1308]: time=2026-09-22T11:00:30.297Z level=INFO msg="Upload complete. (353ms)" lb # [ 124.724779] niks3-server[1138]: 2026/09/22 11:00:30 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 124.733735] niks3-server[1138]: 2026/09/22 11:00:30 INFO Completed upload id=41 worker1 # [ 124.713004] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47014 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 124.736345] niks3-server[1138]: 2026/09/22 11:00:30 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker1 # [ 124.722488] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 124.728794] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) worker1 # [ 124.733479] nix-daemon[834]: reaped child process 1393, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... worker1 # [ 124.746354] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 125.655778] nix-daemon[834]: reaped child process 1407, status = succeeded worker1 # [ 125.725155] nix-daemon[834]: accepted connection from pid 1423, user nix-grpc-daemon (trusted) worker1 # [ 125.747802] nix-daemon[834]: reaped child process 1426, status = succeeded lb # [ 125.770025] niks3-server[1138]: 2026/09/22 11:00:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 125.758557] nix-grpc-daemon[1308]: time=2026-09-22T11:00:31.352Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 125.760148] nix-grpc-daemon[1308]: time=2026-09-22T11:00:31.352Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 125.814435] niks3-server[1138]: 2026/09/22 11:00:31 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 125.823514] niks3-server[1138]: 2026/09/22 11:00:31 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 125.810780] nix-grpc-daemon[1308]: time=2026-09-22T11:00:31.405Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.834064] niks3-server[1138]: 2026/09/22 11:00:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 125.843451] niks3-server[1138]: 2026/09/22 11:00:31 INFO Signed narinfos id=42 count=1 lb # [ 125.852887] niks3-server[1138]: 2026/09/22 11:00:31 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls worker1 # [ 125.837584] nix-grpc-daemon[1308]: time=2026-09-22T11:00:31.432Z level=INFO msg="Upload complete. (280ms)" lb # [ 125.862355] niks3-server[1138]: 2026/09/22 11:00:31 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 125.867828] niks3-server[1138]: 2026/09/22 11:00:31 INFO Completed upload id=42 lb # [ 125.871294] niks3-server[1138]: 2026/09/22 11:00:31 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker1 # [ 125.849210] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 125.869852] nix-daemon[834]: reaped child process 1405, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2, in 5.78 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath, in 0.18 seconds) worker2 # [ 126.203184] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 126.212427] systemd[1]: Starting scheduler-token.service... worker2 # [ 126.286001] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 126.292182] systemd[1]: Finished scheduler-token.service. worker2 # [ 126.293743] systemd[1]: scheduler-token.service: Consumed 43ms CPU time over 77ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 126.301569] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 126.426431] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:32Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 126.428729] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:32Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 126.432544] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:32Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 126.439080] nix-grpc-daemon[1442]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 126.456191] nix-grpc-daemon[1442]: E0000 00:00:1790074832.036152 1442 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 126.458563] nix-grpc-daemon[1442]: E0000 00:00:1790074832.038246 1442 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 126.487173] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:32Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 126.489493] nix-grpc-daemon[1442]: E0000 00:00:1790074832.046325 1481 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 126.491950] nix-grpc-daemon[1442]: E0000 00:00:1790074832.069582 1481 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 126.494421] nix-grpc-daemon[1442]: E0000 00:00:1790074832.069741 1481 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 126.496783] nix-grpc-daemon[1442]: E0000 00:00:1790074832.085574 1481 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 126.502178] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 126.504766] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 126.472195] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:32Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 126.477376] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:32Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:38666 worker1 # [ 126.482792] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.81 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs client # [ 126.818862] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 10b6ad9f9e2e468b99d5e8565db7938f client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs, in 0.09 seconds) client # [ 127.028354] nix[1339]: don't know how to build these paths: client # [ 127.029434] nix[1339]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 127.028999] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 127.042475] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:32Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 127.049778] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:32Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 127.087234] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 127.102944] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47014 client # [ 127.112845] nix[1339]: copying 1 paths to 'lb:50051'... client # [ 127.117444] nix[1339]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 127.120493] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 127.135815] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) worker1 # [ 127.295498] nix-daemon[834]: accepted connection from pid 1439, user nix-grpc-daemon (trusted) worker1 # [ 127.317516] nix-daemon[834]: reaped child process 1442, status = succeeded worker1 # [ 127.421521] nix-daemon[834]: accepted connection from pid 1444, user nix-grpc-daemon (trusted) worker1 # [ 127.441141] nix-daemon[834]: reaped child process 1447, status = succeeded lb # [ 127.466908] niks3-server[1138]: 2026/09/22 11:00:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 127.457632] nix-grpc-daemon[1308]: time=2026-09-22T11:00:33.052Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 127.459148] nix-grpc-daemon[1308]: time=2026-09-22T11:00:33.052Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 127.495661] niks3-server[1138]: 2026/09/22 11:00:33 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 127.509562] niks3-server[1138]: 2026/09/22 11:00:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker1 # [ 127.494011] nix-grpc-daemon[1308]: time=2026-09-22T11:00:33.089Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.519047] niks3-server[1138]: 2026/09/22 11:00:33 INFO Signed narinfos id=43 count=1 lb # [ 127.525303] niks3-server[1138]: 2026/09/22 11:00:33 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 127.535485] niks3-server[1138]: 2026/09/22 11:00:33 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 127.541973] niks3-server[1138]: 2026/09/22 11:00:33 INFO Completed upload id=43 worker1 # [ 127.518134] nix-grpc-daemon[1308]: time=2026-09-22T11:00:33.113Z level=INFO msg="Upload complete. (365ms)" lb # [ 127.547776] niks3-server[1138]: 2026/09/22 11:00:33 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker1 # [ 127.524377] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47014 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 127.538914] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 worker1 # [ 127.544679] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) worker1 # [ 127.549408] nix-daemon[834]: reaped child process 1437, status = succeeded client # [ 127.556962] nix[1339]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker1 # [ 127.561656] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted) lb # [ 128.789335] envoy[898]: conn peer=[2001:db8:1::1]:53310 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9550 tx=4083 ms=5527 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 129.683815] systemd-journald[269]: Received client request to rotate journal, rotating. worker2 # [ 129.704452] systemd-journald[269]: Vacuuming done, freed 0B of archived journals from /var/log/journal/4bc15a8868284ebaa5af924a396283cb. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.08 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 129.702180] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds) client: must succeed: sleep 5.0 worker1 # [ 130.227512] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:35Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.05 seconds) worker1 # [ 134.990128] nix-daemon[834]: reaped child process 1451, status = succeeded worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 135.088592] nix-daemon[834]: accepted connection from pid 1492, user nix-grpc-daemon (trusted) worker1 # [ 135.111703] nix-daemon[834]: reaped child process 1495, status = succeeded lb # [ 135.134318] niks3-server[1138]: 2026/09/22 11:00:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.124187] nix-grpc-daemon[1308]: time=2026-09-22T11:00:40.716Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 135.125686] nix-grpc-daemon[1308]: time=2026-09-22T11:00:40.716Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 135.177310] niks3-server[1138]: 2026/09/22 11:00:40 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 135.189706] niks3-server[1138]: 2026/09/22 11:00:40 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 135.203382] niks3-server[1138]: 2026/09/22 11:00:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 135.182837] nix-grpc-daemon[1308]: time=2026-09-22T11:00:40.777Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.211038] niks3-server[1138]: 2026/09/22 11:00:40 INFO Signed narinfos id=44 count=1 lb # [ 135.218044] niks3-server[1138]: 2026/09/22 11:00:40 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 135.227315] niks3-server[1138]: 2026/09/22 11:00:40 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 135.233800] niks3-server[1138]: 2026/09/22 11:00:40 INFO Completed upload id=44 worker1 # [ 135.212107] nix-grpc-daemon[1308]: time=2026-09-22T11:00:40.807Z level=INFO msg="Upload complete. (235ms)" lb # [ 135.238364] niks3-server[1138]: 2026/09/22 11:00:40 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 135.227282] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47014 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 135.244589] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:40Z level=info event=signal_exit worker1 # [ 135.248792] nix-daemon[834]: reaped child process 1449, status = succeeded client # [ 135.259820] systemd[1]: rs.service: Deactivated successfully. client # [ 135.264276] systemd[1]: rs.service: Consumed 195ms CPU time over 8.444s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. lb # [ 135.552238] niks3-server[1138]: 2026/09/22 11:00:41 INFO lead: released remote=192.168.1.3:36074 lb # [ 136.427492] niks3-server[1138]: 2026/09/22 11:00:42 INFO lead: acquired remote=192.168.1.4:42128 worker2 # [ 136.449486] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:42Z level=info event=scheduler_take_over worker2 # [ 136.574404] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:42Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 136.536836] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:42Z level=info event=scheduler_restarting worker1 # [ 136.542167] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:42Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 136.547109] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38666 worker1 # [ 136.552207] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:42Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 136.557125] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38666 worker1 # [ 136.562418] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:42Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 136.587787] nix-daemon[834]: reaped child process 1278, status = succeeded worker2 # [ 136.776242] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 136.781684] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 136.755085] nix-grpc-daemon[1226]: ts=2026-09-22T11:00:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 136.982766] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 136.988111] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 137.089051] nix-grpc-daemon[1226]: E0000 00:00:1790074842.683901 1271 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker1 # [ 137.096064] nix-grpc-daemon[1226]: E0000 00:00:1790074842.684172 1271 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 137.189643] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 137.199722] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.19 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 137.398148] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 137.403500] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2 # [ 137.606609] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 137.610824] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 137.807518] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 137.812819] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 138.013855] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 138.031795] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:43Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 138.036382] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:43Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53444 worker2 # [ 138.041645] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker1 # [ 138.623494] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 138.630379] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 138.635949] systemd[1]: nix-grpc-daemon.service: Consumed 1.950s CPU time over 32.566s wall clock time, 38.7M memory peak, 47.4K incoming IP traffic, 93.2K outgoing IP traffic. worker1 # [ 138.652190] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 138.792628] envoy[898]: conn peer=[2001:db8:1::1]:52380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1427 ms=8214 worker1 # [ 138.794415] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:44Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 138.796741] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 138.800528] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 138.807054] nix-grpc-daemon[1502]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 138.820288] nix-grpc-daemon[1502]: E0000 00:00:1790074844.400123 1502 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 138.847664] nix-grpc-daemon[1502]: E0000 00:00:1790074844.402138 1502 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 138.851036] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 138.853311] nix-grpc-daemon[1502]: E0000 00:00:1790074844.410069 1541 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 138.856249] nix-grpc-daemon[1502]: E0000 00:00:1790074844.428183 1541 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 138.862097] nix-grpc-daemon[1502]: E0000 00:00:1790074844.428349 1541 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 138.866921] nix-grpc-daemon[1502]: E0000 00:00:1790074844.442791 1541 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 138.869872] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 138.870739] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 138.912638] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:44Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53444 worker2 # [ 138.917560] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:44Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 138.797635] envoy[898]: conn peer=[2001:db8:1::3]:41884 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2413 tx=836 ms=30473 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.99 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid client # [ 139.808784] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 5a0f2b633e43426d9afabde0c9048a0c client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid, in 0.09 seconds) worker1 # [ 140.010918] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 140.025626] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) client # [ 140.041929] nix[1375]: don't know how to build these paths: client # [ 140.043890] nix[1375]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 140.103963] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:45Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 140.109343] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:45Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 140.163322] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53454 worker2 # [ 140.177948] nix-daemon[855]: accepted connection from pid 1442, user nix-grpc-daemon (trusted) worker2 # [ 140.200790] nix-grpc-daemon[1442]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5) worker2 # [ 140.269541] nix-grpc-daemon[1442]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 187 ms (attempt 2/5) worker2 # [ 140.458596] nix-grpc-daemon[1442]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 3/5) worker2 # [ 140.476239] nix-grpc-daemon[1442]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 727 ms (attempt 4/5) worker2 # [ 141.213603] nix-grpc-daemon[1442]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 141.219195] nix-grpc-daemon[1442]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 141.239357] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53454 client # [ 141.208627] nix[1375]: copying 1 paths to 'lb:50051'... worker2 # [ 141.256432] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53454 client # [ 141.214420] nix[1375]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 141.271727] nix-daemon[855]: accepted connection from pid 1442, user nix-grpc-daemon (trusted) worker2 # [ 141.298372] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:46Z level=info event=niks3_push_started pid=1571 worker2 # [ 141.445194] nix-grpc-daemon[1571]: time=2026-09-22T11:00:47.043Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 141.551258] nix-daemon[855]: accepted connection from pid 1584, user nix-grpc-daemon (trusted) worker2 # [ 141.570465] nix-daemon[855]: reaped child process 1587, status = succeeded worker2 # [ 141.672214] nix-daemon[855]: accepted connection from pid 1589, user nix-grpc-daemon (trusted) worker2 # [ 141.689518] nix-daemon[855]: reaped child process 1592, status = succeeded lb # [ 141.673005] niks3-server[1138]: 2026/09/22 11:00:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 141.704094] nix-grpc-daemon[1571]: time=2026-09-22T11:00:47.302Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 141.705551] nix-grpc-daemon[1571]: time=2026-09-22T11:00:47.302Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 141.710387] niks3-server[1138]: 2026/09/22 11:00:47 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 141.753076] nix-grpc-daemon[1571]: time=2026-09-22T11:00:47.351Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.730845] niks3-server[1138]: 2026/09/22 11:00:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 141.743787] niks3-server[1138]: 2026/09/22 11:00:47 INFO Signed narinfos id=45 count=1 lb # [ 141.756260] niks3-server[1138]: 2026/09/22 11:00:47 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 141.765872] niks3-server[1138]: 2026/09/22 11:00:47 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 141.777095] niks3-server[1138]: 2026/09/22 11:00:47 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo lb # [ 141.785519] niks3-server[1138]: 2026/09/22 11:00:47 INFO Completed upload id=45 worker2 # [ 141.805651] nix-grpc-daemon[1571]: time=2026-09-22T11:00:47.404Z level=INFO msg="Upload complete. (356ms)" worker2 # [ 141.820339] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53454 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 141.832518] nix-grpc-daemon[1442]: ts=2026-09-22T11:00:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53454 worker2 # [ 141.841860] nix-daemon[855]: accepted connection from pid 1442, user nix-grpc-daemon (trusted) worker2 # [ 141.847365] nix-daemon[855]: reaped child process 1569, status = succeeded client # [ 141.812581] nix[1375]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 141.860415] nix-daemon[855]: accepted connection from pid 1442, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 143.720809] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1442 (nix-grpc-daemon) on client request. worker2 # [ 143.722404] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 143.720842] niks3-server[1138]: 2026/09/22 11:00:49 INFO lead: released remote=192.168.1.4:42128 worker2 # [ 143.749613] systemd[1]: Starting scheduler-token.service... worker2 # [ 143.750453] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 143.751869] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. client # [ 143.705253] nix[1375]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 143.707022] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 143.711922] nix[1375]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 143.769851] systemd[1]: nix-grpc-daemon.service: Consumed 594ms CPU time over 17.448s wall clock time, 34.3M memory peak, 16.6K incoming IP traffic, 31.6K outgoing IP traffic. worker2 # [ 143.805671] nix-daemon[855]: reaped child process 1559, status = succeeded worker2 # [ 143.808759] nix-daemon[855]: reaped child process 1594, status = succeeded worker2 # [ 143.817721] nix-daemon[1596]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 143.825869] nix-daemon[855]: reaped child process 1596, status = failed with exit code 1 worker2 # [ 143.842304] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 143.843297] systemd[1]: Finished scheduler-token.service. worker2 # [ 143.845788] systemd[1]: scheduler-token.service: Consumed 25ms CPU time over 90ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 143.851950] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 143.853664] systemd[1]: Starting scheduler-token.service... lb # [ 143.838468] niks3-server[1138]: 2026/09/22 11:00:49 INFO lead: acquired remote=192.168.1.3:52798 worker1 # [ 143.821687] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:49Z level=info event=scheduler_take_over worker2 # [ 143.896807] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 143.899210] systemd[1]: Finished scheduler-token.service. worker2 # [ 143.900003] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 52ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 143.905217] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 143.907200] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.005789] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 144.007956] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 144.011833] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 144.017330] nix-grpc-daemon[1639]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 144.018761] nix-grpc-daemon[1639]: E0000 00:00:1790074849.615834 1639 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 143.998357] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.37 seconds) client: must succeed: sleep 5.0 worker2 # [ 144.064191] nix-grpc-daemon[1639]: E0000 00:00:1790074849.621827 1639 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 144.073969] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 144.076136] nix-grpc-daemon[1639]: E0000 00:00:1790074849.631717 1678 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 144.078626] nix-grpc-daemon[1639]: E0000 00:00:1790074849.654318 1678 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 144.083579] nix-grpc-daemon[1639]: E0000 00:00:1790074849.654658 1678 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 144.088485] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 144.089330] nix-grpc-daemon[1639]: E0000 00:00:1790074849.672595 1678 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 144.091645] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.093000] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 144.199258] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 144.204675] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 144.208463] nix[1375]: scheduler at lb:50051: no healthy upstream, reconnecting worker2 # [ 144.290076] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.295018] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 144.405581] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 144.410845] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 144.496337] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.501587] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 144.611666] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 144.617021] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 144.702732] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.708282] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 144.819514] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 144.823958] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 144.909476] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.914733] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 145.020126] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.025236] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 145.118135] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 145.122447] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 145.212219] nix[1375]: scheduler at lb:50051: no healthy upstream, reconnecting worker1 # [ 145.226292] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.231455] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 145.318633] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 145.324249] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 145.432472] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.437741] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 145.525554] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 145.530993] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 145.638504] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.643839] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 145.732171] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.711676] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:51Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 145.716381] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:51Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:52042 worker1 # [ 145.721663] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 145.847321] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.851534] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:52042 worker1 # [ 145.856512] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 147.225465] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:52Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 147.225854] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:52Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 147.320881] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43404 worker2 # [ 147.336216] nix-daemon[855]: accepted connection from pid 1639, user nix-grpc-daemon (trusted) worker2 # [ 147.359994] nix-daemon[855]: accepted connection from pid 1639, user nix-grpc-daemon (trusted) worker2 # [ 147.376351] nix-daemon[855]: accepted connection from pid 1639, user nix-grpc-daemon (trusted) client # [ 147.330911] nix[1375]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb # [ 148.792966] envoy[898]: conn peer=[2001:db8:1::4]:40216 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=6484 tx=562 ms=17257 client: (finished: must succeed: sleep 5.0, in 5.05 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 149.401922] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:54Z level=info event=niks3_push_started pid=1720 worker2 # [ 149.449400] nix-daemon[855]: reaped child process 1695, status = succeeded worker2 # [ 149.519533] nix-grpc-daemon[1720]: time=2026-09-22T11:00:55.117Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 149.630493] nix-daemon[855]: accepted connection from pid 1733, user nix-grpc-daemon (trusted) worker2 # [ 149.649665] nix-daemon[855]: reaped child process 1736, status = succeeded lb # [ 149.633741] niks3-server[1138]: 2026/09/22 11:00:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 149.666380] nix-grpc-daemon[1720]: time=2026-09-22T11:00:55.263Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 149.667866] nix-grpc-daemon[1720]: time=2026-09-22T11:00:55.263Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 149.676316] niks3-server[1138]: 2026/09/22 11:00:55 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 149.693037] niks3-server[1138]: 2026/09/22 11:00:55 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst worker2 # [ 149.730241] nix-grpc-daemon[1720]: time=2026-09-22T11:00:55.328Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.707240] niks3-server[1138]: 2026/09/22 11:00:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 149.714219] niks3-server[1138]: 2026/09/22 11:00:55 INFO Signed narinfos id=46 count=1 lb # [ 149.724482] niks3-server[1138]: 2026/09/22 11:00:55 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 149.735169] niks3-server[1138]: 2026/09/22 11:00:55 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete worker2 # [ 149.763096] nix-grpc-daemon[1720]: time=2026-09-22T11:00:55.362Z level=INFO msg="Upload complete. (240ms)" lb # [ 149.744176] niks3-server[1138]: 2026/09/22 11:00:55 INFO Completed upload id=46 worker2 # [ 149.776347] nix-grpc-daemon[1639]: ts=2026-09-22T11:00:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43404 duration_s=2 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 149.792370] nix-daemon[855]: reaped child process 1693, status = succeeded client # [ 149.764776] systemd[1]: mid.service: Deactivated successfully. client # [ 149.769749] systemd[1]: mid.service: Consumed 205ms CPU time over 9.957s wall clock time, 39.2M memory peak, 9.1K incoming IP traffic, 11.3K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.76 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr client # [ 150.539067] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: e6d7d442468541668474c2b2717972e9 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr, in 0.05 seconds) client # [ 150.719716] nix[1411]: don't know how to build these paths: client # [ 150.720896] nix[1411]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker1 # [ 150.721493] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 150.735293] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:56Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker1 # [ 150.742169] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:56Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.783467] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 150.798941] nix-grpc-daemon[1502]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) worker1 # [ 150.893479] nix-grpc-daemon[1502]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 2/5) worker1 # [ 151.026628] nix-grpc-daemon[1502]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 257 ms (attempt 3/5) worker1 # [ 151.285749] nix-grpc-daemon[1502]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 652 ms (attempt 4/5) worker1 # [ 151.941223] nix-grpc-daemon[1502]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 151.946733] nix-grpc-daemon[1502]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 151.960995] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 client # [ 151.978512] nix[1411]: copying 1 paths to 'lb:50051'... worker1 # [ 151.983705] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 client # [ 151.984149] nix[1411]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker1 # [ 152.001959] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 152.029923] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:57Z level=info event=niks3_push_started pid=1602 worker1 # [ 152.178342] nix-grpc-daemon[1602]: time=2026-09-22T11:00:57.772Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca="" worker1 # [ 152.284906] nix-daemon[834]: accepted connection from pid 1615, user nix-grpc-daemon (trusted) worker1 # [ 152.307241] nix-daemon[834]: reaped child process 1618, status = succeeded worker1 # [ 152.408110] nix-daemon[834]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker1 # [ 152.425439] nix-daemon[834]: reaped child process 1623, status = succeeded lb # [ 152.452344] niks3-server[1138]: 2026/09/22 11:00:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.446061] nix-grpc-daemon[1602]: time=2026-09-22T11:00:58.040Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.447557] nix-grpc-daemon[1602]: time=2026-09-22T11:00:58.040Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 152.501867] niks3-server[1138]: 2026/09/22 11:00:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 152.488505] nix-grpc-daemon[1602]: time=2026-09-22T11:00:58.083Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.517235] niks3-server[1138]: 2026/09/22 11:00:58 INFO Signed narinfos id=47 count=1 lb # [ 152.519871] niks3-server[1138]: 2026/09/22 11:00:58 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 152.531925] niks3-server[1138]: 2026/09/22 11:00:58 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 152.540598] niks3-server[1138]: 2026/09/22 11:00:58 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 152.547232] niks3-server[1138]: 2026/09/22 11:00:58 INFO Completed upload id=47 worker1 # [ 152.526506] nix-grpc-daemon[1602]: time=2026-09-22T11:00:58.121Z level=INFO msg="Upload complete. (345ms)" lb # [ 152.549932] niks3-server[1138]: 2026/09/22 11:00:58 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker1 # [ 152.540435] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 152.551216] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 152.560634] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 152.568396] nix-daemon[834]: reaped child process 1600, status = succeeded client # [ 152.570234] nix[1411]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker1 # [ 152.574881] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr worker1 # [ 154.183116] nix-grpc-daemon[1502]: ts=2026-09-22T11:00:59Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 154.181220] nix[1411]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 154.182153] systemd[1]: intr.service: Sent signal SIGINT to main process 1411 (nix) on client request. worker1 # [ 154.201129] nix-daemon[834]: reaped child process 1625, status = succeeded client # [ 154.200243] nix[1411]: error: interrupted by the user worker1 # [ 154.203515] nix-daemon[1627]: unexpected Nix daemon error: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) worker1 # [ 154.212692] nix-daemon[834]: reaped child process 1627, status = failed with exit code 1 client # [ 154.231845] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 154.237151] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 154.239645] systemd[1]: intr.service: Consumed 174ms CPU time over 3.696s wall clock time, 41.4M memory peak, 6.5K incoming IP traffic, 8.3K outgoing IP traffic. (finished: subtest: interrupting the client stops the build on the worker, in 3.81 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw client # [ 154.372099] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: f694eca68945446d98ab0c24acb806c1 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw, in 0.08 seconds) client # [ 154.564212] nix[1432]: don't know how to build these paths: client # [ 154.565174] nix[1432]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker1 # [ 154.564325] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 154.577736] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:00Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker1 # [ 154.583864] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:00Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 154.667678] nix-grpc-daemon[1639]: ts=2026-09-22T11:01:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43404 worker2 # [ 154.685046] nix-grpc-daemon[1639]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 1/5) worker2 # [ 154.701067] nix-grpc-daemon[1639]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 2/5) worker2 # [ 154.756963] nix-grpc-daemon[1639]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 125 ms (attempt 3/5) worker2 # [ 154.883950] nix-grpc-daemon[1639]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 791 ms (attempt 4/5) worker2 # [ 155.681464] nix-grpc-daemon[1639]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 155.685683] nix-grpc-daemon[1639]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 155.706107] nix-grpc-daemon[1639]: ts=2026-09-22T11:01:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43404 client # [ 155.677148] nix[1432]: copying 1 paths to 'lb:50051'... worker2 # [ 155.722055] nix-grpc-daemon[1639]: ts=2026-09-22T11:01:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43404 client # [ 155.681634] nix[1432]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker2 # [ 155.742998] nix-daemon[855]: accepted connection from pid 1639, user nix-grpc-daemon (trusted) worker2 # [ 155.891883] nix-daemon[855]: accepted connection from pid 1772, user nix-grpc-daemon (trusted) worker2 # [ 155.911727] nix-daemon[855]: reaped child process 1775, status = succeeded worker2 # [ 156.013888] nix-daemon[855]: accepted connection from pid 1777, user nix-grpc-daemon (trusted) worker2 # [ 156.031170] nix-daemon[855]: reaped child process 1780, status = succeeded lb # [ 156.017743] niks3-server[1138]: 2026/09/22 11:01:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 156.052152] nix-grpc-daemon[1720]: time=2026-09-22T11:01:01.650Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 156.053610] nix-grpc-daemon[1720]: time=2026-09-22T11:01:01.650Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 156.056497] niks3-server[1138]: 2026/09/22 11:01:01 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst lb # [ 156.069658] niks3-server[1138]: 2026/09/22 11:01:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker2 # [ 156.096111] nix-grpc-daemon[1720]: time=2026-09-22T11:01:01.695Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.080220] niks3-server[1138]: 2026/09/22 11:01:01 INFO Signed narinfos id=48 count=1 lb # [ 156.082263] niks3-server[1138]: 2026/09/22 11:01:01 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 156.094110] niks3-server[1138]: 2026/09/22 11:01:01 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 156.100179] niks3-server[1138]: 2026/09/22 11:01:01 INFO Completed upload id=48 lb # [ 156.102740] niks3-server[1138]: 2026/09/22 11:01:01 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker2 # [ 156.121115] nix-grpc-daemon[1720]: time=2026-09-22T11:01:01.720Z level=INFO msg="Upload complete. (352ms)" worker2 # [ 156.131833] nix-grpc-daemon[1639]: ts=2026-09-22T11:01:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43404 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 156.143429] nix-grpc-daemon[1639]: ts=2026-09-22T11:01:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43404 worker2 # [ 156.150312] nix-daemon[855]: accepted connection from pid 1639, user nix-grpc-daemon (trusted) worker2 # [ 156.154967] nix-daemon[855]: reaped child process 1770, status = succeeded worker2 # [ 156.165965] nix-daemon[855]: accepted connection from pid 1639, user nix-grpc-daemon (trusted) client # [ 156.120160] nix[1432]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # [ 157.518071] nixos[1812]: switching to system configuration /nix/store/qrk4msql1qyv8s1y26xr9w72x0zgq22p-nixos-system-worker2-test worker2 # activating the configuration... worker2 # [ 157.525090] systemd[1]: Stopped target Remote File Systems. worker2 # [ 157.525966] systemd[1]: Stopped target Local File Systems. worker2 # setting up /etc... worker2 # [ 158.089430] systemd[1]: Reload requested from client PID 1812 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 158.091515] systemd[1]: Reloading... lb # [ 158.790849] envoy[898]: conn peer=[2001:db8:1::1]:34752 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4301 tx=1976 ms=9743 lb # [ 158.795948] envoy[898]: conn peer=[2001:db8:1::1]:52174 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3013 tx=849 ms=3494 worker2 # [ 163.004821] systemd[1]: Reloading finished in 4912 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 163.123265] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 163.243725] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 163.245346] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 163.249140] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 163.250311] dbus-broker-launch[491]: Caught SIGHUP, trigger reload. worker2 # [ 163.262312] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 163.271436] dbus-broker-launch[491]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 163.277303] dbus-broker-launch[491]: NSS returned no entry for 'systemd-timesync' worker2 # [ 163.291393] dbus-broker-launch[491]: Invalid user-name in /nix/store/ng2ydfkv03gvmdws4f4mjf9wj6qj3kq6-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 163.303960] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 163.311317] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 163.319148] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 163.324207] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 163.325487] systemd[1]: Reached target Remote File Systems. worker2 # [ 163.336361] systemd[1]: Starting linger-users.service... worker2 # [ 163.341716] systemd[1]: Reached target Local File Systems. worker2 # [ 163.342581] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 163.356552] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 163.357417] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 163.358613] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 163.370435] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 163.380199] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 163.384758] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 163.407347] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 163.408442] systemd[1]: Finished linger-users.service. worker2 # [ 163.698823] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 163.699947] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 163.956699] nixos[1812]: finished switching to system configuration /nix/store/qrk4msql1qyv8s1y26xr9w72x0zgq22p-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 6.89 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2 worker2 # [ 164.037160] nix-grpc-daemon[1639]: ts=2026-09-22T11:01:09Z level=info event=draining client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 164.205498] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 164.209918] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 164.229629] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:09Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker1 # [ 164.232802] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:09Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.280670] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 164.297255] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 client # copying 1 paths to 'lb:50051'... worker1 # [ 164.315059] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker1 # [ 164.338282] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 164.511934] nix-daemon[834]: accepted connection from pid 1678, user nix-grpc-daemon (trusted) worker1 # [ 164.536640] nix-daemon[834]: reaped child process 1681, status = succeeded worker1 # [ 164.642462] nix-daemon[834]: accepted connection from pid 1683, user nix-grpc-daemon (trusted) worker1 # [ 164.663743] nix-daemon[834]: reaped child process 1686, status = succeeded lb # [ 164.689051] niks3-server[1138]: 2026/09/22 11:01:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.678274] nix-grpc-daemon[1602]: time=2026-09-22T11:01:10.272Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 164.679773] nix-grpc-daemon[1602]: time=2026-09-22T11:01:10.272Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 164.719465] niks3-server[1138]: 2026/09/22 11:01:10 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst lb # [ 164.734542] niks3-server[1138]: 2026/09/22 11:01:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 164.720298] nix-grpc-daemon[1602]: time=2026-09-22T11:01:10.315Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.746491] niks3-server[1138]: 2026/09/22 11:01:10 INFO Signed narinfos id=49 count=1 lb # [ 164.752393] niks3-server[1138]: 2026/09/22 11:01:10 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 164.762624] niks3-server[1138]: 2026/09/22 11:01:10 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete worker1 # [ 164.749956] nix-grpc-daemon[1602]: time=2026-09-22T11:01:10.343Z level=INFO msg="Upload complete. (392ms)" lb # [ 164.773190] niks3-server[1138]: 2026/09/22 11:01:10 INFO Completed upload id=49 lb # [ 164.778044] niks3-server[1138]: 2026/09/22 11:01:10 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker1 # [ 164.755697] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 164.770715] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 164.777683] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 164.782677] nix-daemon[834]: reaped child process 1676, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... worker1 # [ 164.793468] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker1 # [ 166.068729] nix-daemon[834]: reaped child process 1690, status = succeeded worker1 # [ 166.175519] nix-daemon[834]: accepted connection from pid 1706, user nix-grpc-daemon (trusted) worker1 # [ 166.194511] nix-daemon[834]: reaped child process 1709, status = succeeded lb # [ 166.224564] niks3-server[1138]: 2026/09/22 11:01:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.215615] nix-grpc-daemon[1602]: time=2026-09-22T11:01:11.807Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 166.218825] nix-grpc-daemon[1602]: time=2026-09-22T11:01:11.807Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 166.267754] niks3-server[1138]: 2026/09/22 11:01:11 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 166.278884] niks3-server[1138]: 2026/09/22 11:01:11 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst worker1 # [ 166.271921] nix-grpc-daemon[1602]: time=2026-09-22T11:01:11.865Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.292623] niks3-server[1138]: 2026/09/22 11:01:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 166.302150] niks3-server[1138]: 2026/09/22 11:01:11 INFO Signed narinfos id=50 count=1 lb # [ 166.308226] niks3-server[1138]: 2026/09/22 11:01:11 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 166.318607] niks3-server[1138]: 2026/09/22 11:01:11 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 166.323729] niks3-server[1138]: 2026/09/22 11:01:11 INFO Completed upload id=50 worker1 # [ 166.302185] nix-grpc-daemon[1602]: time=2026-09-22T11:01:11.897Z level=INFO msg="Upload complete. (296ms)" lb # [ 166.328559] niks3-server[1138]: 2026/09/22 11:01:11 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker1 # [ 166.321603] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker1 # [ 166.338804] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:11Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker1 # [ 166.343319] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:11Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 166.347823] nix-daemon[834]: reaped child process 1688, status = succeeded worker1 # [ 166.374537] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 166.390124] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 166.406063] nix-grpc-daemon[1602]: time=2026-09-22T11:01:12.001Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 166.416779] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker1 # [ 166.439868] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 166.598718] nix-daemon[834]: accepted connection from pid 1715, user nix-grpc-daemon (trusted) worker1 # [ 166.620948] nix-daemon[834]: reaped child process 1718, status = succeeded worker1 # [ 166.723276] nix-daemon[834]: accepted connection from pid 1720, user nix-grpc-daemon (trusted) worker1 # [ 166.740385] nix-daemon[834]: reaped child process 1723, status = succeeded lb # [ 166.766527] niks3-server[1138]: 2026/09/22 11:01:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.754854] nix-grpc-daemon[1602]: time=2026-09-22T11:01:12.349Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 166.756438] nix-grpc-daemon[1602]: time=2026-09-22T11:01:12.349Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 166.796063] niks3-server[1138]: 2026/09/22 11:01:12 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 166.811186] niks3-server[1138]: 2026/09/22 11:01:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 166.798473] nix-grpc-daemon[1602]: time=2026-09-22T11:01:12.393Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.824997] niks3-server[1138]: 2026/09/22 11:01:12 INFO Signed narinfos id=51 count=1 lb # [ 166.827792] niks3-server[1138]: 2026/09/22 11:01:12 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 166.842210] niks3-server[1138]: 2026/09/22 11:01:12 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 166.848931] niks3-server[1138]: 2026/09/22 11:01:12 INFO Completed upload id=51 worker1 # [ 166.827546] nix-grpc-daemon[1602]: time=2026-09-22T11:01:12.422Z level=INFO msg="Upload complete. (370ms)" lb # [ 166.852570] niks3-server[1138]: 2026/09/22 11:01:12 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker1 # [ 166.836342] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 166.851736] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 166.861760] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 166.864861] nix-daemon[834]: reaped child process 1713, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker1 # [ 166.879022] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker1 # [ 167.790308] nix-daemon[834]: reaped child process 1727, status = succeeded worker1 # [ 167.865745] nix-daemon[834]: accepted connection from pid 1743, user nix-grpc-daemon (trusted) worker1 # [ 167.887594] nix-daemon[834]: reaped child process 1746, status = succeeded lb # [ 167.910145] niks3-server[1138]: 2026/09/22 11:01:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.899509] nix-grpc-daemon[1602]: time=2026-09-22T11:01:13.493Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 167.901659] nix-grpc-daemon[1602]: time=2026-09-22T11:01:13.493Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 167.955476] niks3-server[1138]: 2026/09/22 11:01:13 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 167.967345] niks3-server[1138]: 2026/09/22 11:01:13 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker1 # [ 167.952875] nix-grpc-daemon[1602]: time=2026-09-22T11:01:13.547Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.975644] niks3-server[1138]: 2026/09/22 11:01:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 167.984983] niks3-server[1138]: 2026/09/22 11:01:13 INFO Signed narinfos id=52 count=1 lb # [ 167.990623] niks3-server[1138]: 2026/09/22 11:01:13 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 167.997728] niks3-server[1138]: 2026/09/22 11:01:13 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete worker1 # [ 167.982860] nix-grpc-daemon[1602]: time=2026-09-22T11:01:13.578Z level=INFO msg="Upload complete. (293ms)" lb # [ 168.006948] niks3-server[1138]: 2026/09/22 11:01:13 INFO Completed upload id=52 lb # [ 168.009329] niks3-server[1138]: 2026/09/22 11:01:13 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker1 # [ 167.998863] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker1 # [ 168.020644] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:13Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker1 # [ 168.025307] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:13Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 168.030538] nix-daemon[834]: reaped child process 1725, status = succeeded worker1 # [ 168.059546] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 168.081443] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 168.095839] nix-grpc-daemon[1602]: time=2026-09-22T11:01:13.690Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 168.106298] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker1 # [ 168.129431] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 168.294593] nix-daemon[834]: accepted connection from pid 1752, user nix-grpc-daemon (trusted) worker1 # [ 168.321478] nix-daemon[834]: reaped child process 1755, status = succeeded worker1 # [ 168.419574] nix-daemon[834]: accepted connection from pid 1757, user nix-grpc-daemon (trusted) worker1 # [ 168.436102] nix-daemon[834]: reaped child process 1760, status = succeeded lb # [ 168.464917] niks3-server[1138]: 2026/09/22 11:01:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.452233] nix-grpc-daemon[1602]: time=2026-09-22T11:01:14.047Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.455172] nix-grpc-daemon[1602]: time=2026-09-22T11:01:14.047Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 168.493380] niks3-server[1138]: 2026/09/22 11:01:14 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker1 # [ 168.485579] nix-grpc-daemon[1602]: time=2026-09-22T11:01:14.080Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.508081] niks3-server[1138]: 2026/09/22 11:01:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 168.519428] niks3-server[1138]: 2026/09/22 11:01:14 INFO Signed narinfos id=53 count=1 lb # [ 168.526477] niks3-server[1138]: 2026/09/22 11:01:14 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls worker1 # [ 168.516969] nix-grpc-daemon[1602]: time=2026-09-22T11:01:14.112Z level=INFO msg="Upload complete. (369ms)" lb # [ 168.538278] niks3-server[1138]: 2026/09/22 11:01:14 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 168.544219] niks3-server[1138]: 2026/09/22 11:01:14 INFO Completed upload id=53 worker1 # [ 168.524094] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 168.550366] niks3-server[1138]: 2026/09/22 11:01:14 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker1 # [ 168.535754] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 168.542089] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 168.546622] nix-daemon[834]: reaped child process 1750, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker1 # [ 168.559471] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker1 # [ 169.463772] nix-daemon[834]: reaped child process 1764, status = succeeded worker1 # [ 169.534279] nix-daemon[834]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker1 # [ 169.557789] nix-daemon[834]: reaped child process 1783, status = succeeded lb # [ 169.578583] niks3-server[1138]: 2026/09/22 11:01:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 169.570216] nix-grpc-daemon[1602]: time=2026-09-22T11:01:15.163Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 169.571765] nix-grpc-daemon[1602]: time=2026-09-22T11:01:15.163Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 169.619727] niks3-server[1138]: 2026/09/22 11:01:15 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 169.633374] niks3-server[1138]: 2026/09/22 11:01:15 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 169.643922] niks3-server[1138]: 2026/09/22 11:01:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 169.628531] nix-grpc-daemon[1602]: time=2026-09-22T11:01:15.223Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.653205] niks3-server[1138]: 2026/09/22 11:01:15 INFO Signed narinfos id=54 count=1 lb # [ 169.659510] niks3-server[1138]: 2026/09/22 11:01:15 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 169.668596] niks3-server[1138]: 2026/09/22 11:01:15 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 169.676558] niks3-server[1138]: 2026/09/22 11:01:15 INFO Completed upload id=54 worker1 # [ 169.655458] nix-grpc-daemon[1602]: time=2026-09-22T11:01:15.250Z level=INFO msg="Upload complete. (286ms)" lb # [ 169.681832] niks3-server[1138]: 2026/09/22 11:01:15 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker1 # [ 169.668973] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker1 # [ 169.689917] nix-daemon[834]: reaped child process 1762, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2, in 5.75 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath, in 0.21 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 170.260751] nix-daemon[855]: reaped child process 1784, status = succeeded worker2 # [ 170.368645] nix-daemon[855]: accepted connection from pid 1952, user nix-grpc-daemon (trusted) worker2 # [ 170.389759] nix-daemon[855]: reaped child process 1955, status = succeeded lb # [ 170.371775] niks3-server[1138]: 2026/09/22 11:01:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 170.403604] nix-grpc-daemon[1720]: time=2026-09-22T11:01:16.001Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 170.405427] nix-grpc-daemon[1720]: time=2026-09-22T11:01:16.001Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 170.405164] niks3-server[1138]: 2026/09/22 11:01:16 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 170.424145] niks3-server[1138]: 2026/09/22 11:01:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker2 # [ 170.453941] nix-grpc-daemon[1720]: time=2026-09-22T11:01:16.052Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.440655] niks3-server[1138]: 2026/09/22 11:01:16 INFO Signed narinfos id=55 count=1 lb # [ 170.443502] niks3-server[1138]: 2026/09/22 11:01:16 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 170.457239] niks3-server[1138]: 2026/09/22 11:01:16 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 170.486364] nix-grpc-daemon[1720]: time=2026-09-22T11:01:16.085Z level=INFO msg="Upload complete. (290ms)" lb # [ 170.466715] niks3-server[1138]: 2026/09/22 11:01:16 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 170.474565] niks3-server[1138]: 2026/09/22 11:01:16 INFO Completed upload id=55 lb # [ 170.478502] niks3-server[1138]: 2026/09/22 11:01:16 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker2 # [ 170.501243] nix-grpc-daemon[1639]: ts=2026-09-22T11:01:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43404 duration_s=14 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker2 # [ 170.519578] nix-daemon[855]: reaped child process 1782, status = succeeded client # [ 170.496447] systemd[1]: sw.service: Deactivated successfully. client # [ 170.501968] systemd[1]: sw.service: Consumed 196ms CPU time over 16.128s wall clock time, 43.4M memory peak, 7.3K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 171.039243] nix-grpc-daemon[1639]: ts=2026-09-22T11:01:16Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.10 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 171.261149] systemd[1]: Starting scheduler-token.service... worker2 # [ 171.335611] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 171.341006] systemd[1]: Finished scheduler-token.service. worker2 # [ 171.342633] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 78ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker1 # [ 173.003152] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:52042 worker2 # [ 173.047519] nix-grpc-daemon[1639]: ts=2026-09-22T11:01:18Z level=info event=scheduler_restarting worker1 # [ 173.007905] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:18Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 173.069653] nix-grpc-daemon[1639]: ts=2026-09-22T11:01:18Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 173.095366] nix-daemon[855]: reaped child process 1691, status = succeeded worker2 # [ 173.102264] nix-grpc-daemon[1639]: E0000 00:00:1790074878.701263 1684 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 173.109044] nix-grpc-daemon[1639]: E0000 00:00:1790074878.701514 1684 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 174.059613] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 174.059823] systemd[1]: nix-grpc-daemon.service: Consumed 844ms CPU time over 30.304s wall clock time, 35.3M memory peak, 21.5K incoming IP traffic, 35.3K outgoing IP traffic. worker2 # [ 174.072276] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 174.198038] nix-grpc-daemon[1972]: ts=2026-09-22T11:01:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 174.200757] nix-grpc-daemon[1972]: ts=2026-09-22T11:01:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 174.205027] nix-grpc-daemon[1972]: ts=2026-09-22T11:01:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 174.212316] nix-grpc-daemon[1972]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 174.244232] nix-grpc-daemon[1972]: E0000 00:00:1790074879.809231 1972 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 174.246761] nix-grpc-daemon[1972]: E0000 00:00:1790074879.815348 1972 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.09 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 174.269223] nix-grpc-daemon[1972]: ts=2026-09-22T11:01:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 174.274466] nix-grpc-daemon[1972]: E0000 00:00:1790074879.823304 2011 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 174.279799] nix-grpc-daemon[1972]: E0000 00:00:1790074879.843240 2011 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 174.282680] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 174.239468] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:19Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:52042 worker2 # [ 174.283521] nix-grpc-daemon[1972]: E0000 00:00:1790074879.848761 2011 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 174.286097] nix-grpc-daemon[1972]: E0000 00:00:1790074879.865201 2011 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 174.288418] nix-grpc-daemon[1972]: ts=2026-09-22T11:01:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 174.243757] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 21.14 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 175.682852] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 175.693534] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 175.741877] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker1 # [ 175.749327] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 175.755553] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker1 # [ 175.761161] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 175.787904] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 175.804361] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 175.818995] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 175.834631] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 175.987302] nix-daemon[834]: accepted connection from pid 1792, user nix-grpc-daemon (trusted) worker1 # [ 176.017528] nix-daemon[834]: reaped child process 1795, status = succeeded worker1 # [ 176.117533] nix-daemon[834]: accepted connection from pid 1797, user nix-grpc-daemon (trusted) worker1 # [ 176.139176] nix-daemon[834]: reaped child process 1800, status = succeeded lb # [ 176.159071] niks3-server[1138]: 2026/09/22 11:01:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 176.148506] nix-grpc-daemon[1602]: time=2026-09-22T11:01:21.743Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 176.150018] nix-grpc-daemon[1602]: time=2026-09-22T11:01:21.743Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 176.192470] niks3-server[1138]: 2026/09/22 11:01:21 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 176.187075] nix-grpc-daemon[1602]: time=2026-09-22T11:01:21.782Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.208205] niks3-server[1138]: 2026/09/22 11:01:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 176.219519] niks3-server[1138]: 2026/09/22 11:01:21 INFO Signed narinfos id=56 count=1 lb # [ 176.227765] niks3-server[1138]: 2026/09/22 11:01:21 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 176.242234] niks3-server[1138]: 2026/09/22 11:01:21 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete worker1 # [ 176.225464] nix-grpc-daemon[1602]: time=2026-09-22T11:01:21.820Z level=INFO msg="Upload complete. (375ms)" lb # [ 176.250739] niks3-server[1138]: 2026/09/22 11:01:21 INFO Completed upload id=56 lb # [ 176.254088] niks3-server[1138]: 2026/09/22 11:01:21 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 176.236326] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 176.244414] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 176.257824] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 176.263171] nix-daemon[834]: reaped child process 1790, status = succeeded worker1 # [ 176.277398] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 177.986633] nix-daemon[834]: reaped child process 1804, status = succeeded worker1 # [ 178.061788] nix-daemon[834]: accepted connection from pid 1820, user nix-grpc-daemon (trusted) lb # [ 178.104433] niks3-server[1138]: 2026/09/22 11:01:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 178.086571] nix-daemon[834]: reaped child process 1823, status = succeeded worker1 # [ 178.091807] nix-grpc-daemon[1602]: time=2026-09-22T11:01:23.684Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 178.093762] nix-grpc-daemon[1602]: time=2026-09-22T11:01:23.684Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 178.131751] niks3-server[1138]: 2026/09/22 11:01:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 178.118090] nix-grpc-daemon[1602]: time=2026-09-22T11:01:23.713Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.141378] niks3-server[1138]: 2026/09/22 11:01:23 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 178.152182] niks3-server[1138]: 2026/09/22 11:01:23 INFO Signed narinfos id=57 count=1 lb # [ 178.156365] niks3-server[1138]: 2026/09/22 11:01:23 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker1 # [ 178.143235] nix-grpc-daemon[1602]: time=2026-09-22T11:01:23.738Z level=INFO msg="Upload complete. (253ms)" lb # [ 178.166525] niks3-server[1138]: 2026/09/22 11:01:23 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete worker1 # [ 178.151585] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=1 lb # [ 178.175894] niks3-server[1138]: 2026/09/22 11:01:23 INFO Completed upload id=57 lb # [ 178.177891] niks3-server[1138]: 2026/09/22 11:01:23 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 178.160349] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:23Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 178.168755] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 178.170662] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:23Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 178.174212] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 178.177602] nix-daemon[834]: reaped child process 1802, status = succeeded worker1 # [ 178.180566] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 178.187629] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 178.316373] nix-daemon[834]: accepted connection from pid 1829, user nix-grpc-daemon (trusted) worker1 # [ 178.340811] nix-daemon[834]: reaped child process 1832, status = succeeded worker1 # [ 178.459966] nix-daemon[834]: accepted connection from pid 1834, user nix-grpc-daemon (trusted) worker1 # [ 178.482971] nix-daemon[834]: reaped child process 1837, status = succeeded lb # [ 178.510975] niks3-server[1138]: 2026/09/22 11:01:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 178.499509] nix-grpc-daemon[1602]: time=2026-09-22T11:01:24.094Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 178.501339] nix-grpc-daemon[1602]: time=2026-09-22T11:01:24.094Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" worker1 # [ 178.526156] nix-grpc-daemon[1602]: time=2026-09-22T11:01:24.121Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.546882] niks3-server[1138]: 2026/09/22 11:01:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 178.557847] niks3-server[1138]: 2026/09/22 11:01:24 INFO Signed narinfos id=58 count=1 lb # [ 178.563413] niks3-server[1138]: 2026/09/22 11:01:24 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst lb # [ 178.576898] niks3-server[1138]: 2026/09/22 11:01:24 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 178.579656] niks3-server[1138]: 2026/09/22 11:01:24 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 178.591015] niks3-server[1138]: 2026/09/22 11:01:24 INFO Completed upload id=58 worker1 # [ 178.570235] nix-grpc-daemon[1602]: time=2026-09-22T11:01:24.165Z level=INFO msg="Upload complete. (374ms)" lb # [ 178.594403] niks3-server[1138]: 2026/09/22 11:01:24 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 178.576400] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 178.592500] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 178.598154] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 178.601882] nix-daemon[834]: reaped child process 1827, status = succeeded worker1 # [ 178.610909] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) lb # [ 178.796611] envoy[898]: conn peer=[2001:db8:1::1]:44244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9582 tx=4084 ms=5478 lb # [ 178.799892] envoy[898]: conn peer=[2001:db8:1::1]:42424 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1455 ms=15913 lb # [ 178.803128] envoy[898]: conn peer=[2001:db8:1::4]:54032 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7565 tx=616 ms=28977 worker1 # [ 179.240866] nix-daemon[834]: reaped child process 1841, status = succeeded worker1 # [ 179.349927] nix-daemon[834]: accepted connection from pid 1857, user nix-grpc-daemon (trusted) lb # [ 179.393559] niks3-server[1138]: 2026/09/22 11:01:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 179.376062] nix-daemon[834]: reaped child process 1860, status = succeeded worker1 # [ 179.382067] nix-grpc-daemon[1602]: time=2026-09-22T11:01:24.973Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 179.383593] nix-grpc-daemon[1602]: time=2026-09-22T11:01:24.973Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 179.420104] niks3-server[1138]: 2026/09/22 11:01:25 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 179.427413] niks3-server[1138]: 2026/09/22 11:01:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 179.432313] niks3-server[1138]: 2026/09/22 11:01:25 INFO Signed narinfos id=59 count=1 worker1 # [ 179.411523] nix-grpc-daemon[1602]: time=2026-09-22T11:01:25.006Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.441151] niks3-server[1138]: 2026/09/22 11:01:25 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 179.447031] niks3-server[1138]: 2026/09/22 11:01:25 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 179.455989] niks3-server[1138]: 2026/09/22 11:01:25 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 179.461176] niks3-server[1138]: 2026/09/22 11:01:25 INFO Completed upload id=59 worker1 # [ 179.440487] nix-grpc-daemon[1602]: time=2026-09-22T11:01:25.035Z level=INFO msg="Upload complete. (218ms)" lb # [ 179.465690] niks3-server[1138]: 2026/09/22 11:01:25 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker1 # [ 179.448712] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=1 worker1 # [ 179.457515] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:25Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 179.467077] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 179.470066] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:25Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 179.474329] nix-daemon[834]: reaped child process 1839, status = succeeded worker1 # [ 179.500232] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 179.513982] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 179.521334] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 179.674599] nix-daemon[834]: accepted connection from pid 1866, user nix-grpc-daemon (trusted) worker1 # [ 179.701595] nix-daemon[834]: reaped child process 1869, status = succeeded worker1 # [ 179.825372] nix-daemon[834]: accepted connection from pid 1871, user nix-grpc-daemon (trusted) lb # [ 179.876956] niks3-server[1138]: 2026/09/22 11:01:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 179.863823] nix-daemon[834]: reaped child process 1874, status = succeeded worker1 # [ 179.867318] nix-grpc-daemon[1602]: time=2026-09-22T11:01:25.461Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 179.869034] nix-grpc-daemon[1602]: time=2026-09-22T11:01:25.461Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 179.907690] niks3-server[1138]: 2026/09/22 11:01:25 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst worker1 # [ 179.897669] nix-grpc-daemon[1602]: time=2026-09-22T11:01:25.492Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.918187] niks3-server[1138]: 2026/09/22 11:01:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 179.923717] niks3-server[1138]: 2026/09/22 11:01:25 INFO Signed narinfos id=60 count=1 lb # [ 179.927560] niks3-server[1138]: 2026/09/22 11:01:25 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 179.939162] niks3-server[1138]: 2026/09/22 11:01:25 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 179.946149] niks3-server[1138]: 2026/09/22 11:01:25 INFO Completed upload id=60 worker1 # [ 179.925571] nix-grpc-daemon[1602]: time=2026-09-22T11:01:25.520Z level=INFO msg="Upload complete. (393ms)" lb # [ 179.949136] niks3-server[1138]: 2026/09/22 11:01:25 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 179.932159] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 179.935298] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 179.944480] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 179.948113] nix-daemon[834]: reaped child process 1864, status = succeeded worker1 # [ 179.959456] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 181.401818] nix-daemon[834]: reaped child process 1878, status = succeeded worker1 # [ 181.509385] nix-daemon[834]: accepted connection from pid 1894, user nix-grpc-daemon (trusted) worker1 # [ 181.533381] nix-daemon[834]: reaped child process 1897, status = succeeded lb # [ 181.557763] niks3-server[1138]: 2026/09/22 11:01:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 181.548409] nix-grpc-daemon[1602]: time=2026-09-22T11:01:27.142Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 181.550059] nix-grpc-daemon[1602]: time=2026-09-22T11:01:27.142Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 181.596932] niks3-server[1138]: 2026/09/22 11:01:27 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 181.610916] niks3-server[1138]: 2026/09/22 11:01:27 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 181.622616] niks3-server[1138]: 2026/09/22 11:01:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 181.608240] nix-grpc-daemon[1602]: time=2026-09-22T11:01:27.203Z level=INFO msg="Uploading 1 narinfos" lb # [ 181.632894] niks3-server[1138]: 2026/09/22 11:01:27 INFO Signed narinfos id=61 count=1 lb # [ 181.638519] niks3-server[1138]: 2026/09/22 11:01:27 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 181.649267] niks3-server[1138]: 2026/09/22 11:01:27 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 181.657596] niks3-server[1138]: 2026/09/22 11:01:27 INFO Completed upload id=61 worker1 # [ 181.636810] nix-grpc-daemon[1602]: time=2026-09-22T11:01:27.231Z level=INFO msg="Upload complete. (267ms)" lb # [ 181.662139] niks3-server[1138]: 2026/09/22 11:01:27 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker1 # [ 181.654320] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=1 worker1 # [ 181.672333] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:27Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 181.684604] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 181.689254] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:27Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 181.700157] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 181.703214] nix-daemon[834]: reaped child process 1876, status = succeeded worker1 # [ 181.711010] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 181.715519] nix-grpc-daemon[1602]: time=2026-09-22T11:01:27.283Z level=INFO msg="All 1 paths already cached" worker1 # [ 181.721732] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 181.849148] nix-daemon[834]: accepted connection from pid 1903, user nix-grpc-daemon (trusted) worker1 # [ 181.869283] nix-daemon[834]: reaped child process 1906, status = succeeded worker1 # [ 181.978962] nix-daemon[834]: accepted connection from pid 1908, user nix-grpc-daemon (trusted) worker1 # [ 182.001126] nix-daemon[834]: reaped child process 1911, status = succeeded lb # [ 182.019818] niks3-server[1138]: 2026/09/22 11:01:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 182.008212] nix-grpc-daemon[1602]: time=2026-09-22T11:01:27.603Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 182.009722] nix-grpc-daemon[1602]: time=2026-09-22T11:01:27.603Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 182.052794] niks3-server[1138]: 2026/09/22 11:01:27 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst lb # [ 182.069622] niks3-server[1138]: 2026/09/22 11:01:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 182.056035] nix-grpc-daemon[1602]: time=2026-09-22T11:01:27.650Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.082834] niks3-server[1138]: 2026/09/22 11:01:27 INFO Signed narinfos id=62 count=1 lb # [ 182.091044] niks3-server[1138]: 2026/09/22 11:01:27 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 182.102864] niks3-server[1138]: 2026/09/22 11:01:27 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete worker1 # [ 182.089009] nix-grpc-daemon[1602]: time=2026-09-22T11:01:27.684Z level=INFO msg="Upload complete. (374ms)" lb # [ 182.112219] niks3-server[1138]: 2026/09/22 11:01:27 INFO Completed upload id=62 lb # [ 182.115738] niks3-server[1138]: 2026/09/22 11:01:27 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 182.100694] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 182.115039] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 182.122028] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 182.128764] nix-daemon[834]: reaped child process 1901, status = succeeded worker1 # [ 182.140726] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 183.212156] nix-daemon[834]: reaped child process 1915, status = succeeded worker1 # [ 183.339139] nix-daemon[834]: accepted connection from pid 1931, user nix-grpc-daemon (trusted) worker1 # [ 183.363564] nix-daemon[834]: reaped child process 1934, status = succeeded lb # [ 183.383368] niks3-server[1138]: 2026/09/22 11:01:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 183.376555] nix-grpc-daemon[1602]: time=2026-09-22T11:01:28.968Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 183.378169] nix-grpc-daemon[1602]: time=2026-09-22T11:01:28.968Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 183.425513] niks3-server[1138]: 2026/09/22 11:01:29 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 183.437985] niks3-server[1138]: 2026/09/22 11:01:29 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst worker1 # [ 183.429474] nix-grpc-daemon[1602]: time=2026-09-22T11:01:29.024Z level=INFO msg="Uploading 1 narinfos" lb # [ 183.450462] niks3-server[1138]: 2026/09/22 11:01:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 183.459476] niks3-server[1138]: 2026/09/22 11:01:29 INFO Signed narinfos id=63 count=1 lb # [ 183.465060] niks3-server[1138]: 2026/09/22 11:01:29 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 183.474932] niks3-server[1138]: 2026/09/22 11:01:29 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete worker1 # [ 183.460405] nix-grpc-daemon[1602]: time=2026-09-22T11:01:29.055Z level=INFO msg="Upload complete. (304ms)" lb # [ 183.484481] niks3-server[1138]: 2026/09/22 11:01:29 INFO Completed upload id=63 lb # [ 183.490514] niks3-server[1138]: 2026/09/22 11:01:29 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker1 # [ 183.474637] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=1 worker1 # [ 183.486022] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:29Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 183.494911] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 183.499836] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:29Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 183.505376] nix-daemon[834]: reaped child process 1913, status = succeeded worker1 # [ 183.509420] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 183.523411] nix-grpc-daemon[1602]: time=2026-09-22T11:01:29.118Z level=INFO msg="All 1 paths already cached" worker1 # [ 183.529842] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 183.536873] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 183.656886] nix-daemon[834]: accepted connection from pid 1940, user nix-grpc-daemon (trusted) worker1 # [ 183.682559] nix-daemon[834]: reaped child process 1943, status = succeeded worker1 # [ 183.794860] nix-daemon[834]: accepted connection from pid 1945, user nix-grpc-daemon (trusted) worker1 # [ 183.818516] nix-daemon[834]: reaped child process 1948, status = succeeded lb # [ 183.842252] niks3-server[1138]: 2026/09/22 11:01:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 183.831962] nix-grpc-daemon[1602]: time=2026-09-22T11:01:29.426Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 183.834075] nix-grpc-daemon[1602]: time=2026-09-22T11:01:29.426Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 183.874192] niks3-server[1138]: 2026/09/22 11:01:29 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 183.890180] niks3-server[1138]: 2026/09/22 11:01:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker1 # [ 183.875285] nix-grpc-daemon[1602]: time=2026-09-22T11:01:29.470Z level=INFO msg="Uploading 1 narinfos" lb # [ 183.904986] niks3-server[1138]: 2026/09/22 11:01:29 INFO Signed narinfos id=64 count=1 lb # [ 183.911143] niks3-server[1138]: 2026/09/22 11:01:29 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 183.925736] niks3-server[1138]: 2026/09/22 11:01:29 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 183.938311] niks3-server[1138]: 2026/09/22 11:01:29 INFO Completed upload id=64 worker1 # [ 183.917608] nix-grpc-daemon[1602]: time=2026-09-22T11:01:29.512Z level=INFO msg="Upload complete. (371ms)" lb # [ 183.941910] niks3-server[1138]: 2026/09/22 11:01:29 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 183.928402] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 183.944552] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 183.953674] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 183.960475] nix-daemon[834]: reaped child process 1938, status = succeeded worker1 # [ 183.977602] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 185.046309] nix-daemon[834]: reaped child process 1952, status = succeeded worker1 # [ 185.110404] nix-daemon[834]: accepted connection from pid 1968, user nix-grpc-daemon (trusted) worker1 # [ 185.133926] nix-daemon[834]: reaped child process 1971, status = succeeded lb # [ 185.154007] niks3-server[1138]: 2026/09/22 11:01:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 185.148347] nix-grpc-daemon[1602]: time=2026-09-22T11:01:30.742Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 185.150366] nix-grpc-daemon[1602]: time=2026-09-22T11:01:30.742Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 185.180979] niks3-server[1138]: 2026/09/22 11:01:30 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 185.192822] niks3-server[1138]: 2026/09/22 11:01:30 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst worker1 # [ 185.176950] nix-grpc-daemon[1602]: time=2026-09-22T11:01:30.771Z level=INFO msg="Uploading 1 narinfos" lb # [ 185.198735] niks3-server[1138]: 2026/09/22 11:01:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 185.202762] niks3-server[1138]: 2026/09/22 11:01:30 INFO Signed narinfos id=65 count=1 lb # [ 185.207854] niks3-server[1138]: 2026/09/22 11:01:30 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 185.212542] niks3-server[1138]: 2026/09/22 11:01:30 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 185.218441] niks3-server[1138]: 2026/09/22 11:01:30 INFO Completed upload id=65 worker1 # [ 185.195886] nix-grpc-daemon[1602]: time=2026-09-22T11:01:30.791Z level=INFO msg="Upload complete. (206ms)" lb # [ 185.219674] niks3-server[1138]: 2026/09/22 11:01:30 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 185.204837] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=1 worker1 # [ 185.217076] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:30Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 185.220109] nix-daemon[834]: reaped child process 1950, status = succeeded worker1 # [ 185.247546] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 185.253108] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:30Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 185.260507] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 185.269210] nix-grpc-daemon[1602]: time=2026-09-22T11:01:30.864Z level=INFO msg="All 1 paths already cached" worker1 # [ 185.277017] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 185.283523] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 185.402864] nix-daemon[834]: accepted connection from pid 1977, user nix-grpc-daemon (trusted) worker1 # [ 185.425906] nix-daemon[834]: reaped child process 1980, status = succeeded worker1 # [ 185.549282] nix-daemon[834]: accepted connection from pid 1982, user nix-grpc-daemon (trusted) lb # [ 185.592766] niks3-server[1138]: 2026/09/22 11:01:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 185.574281] nix-daemon[834]: reaped child process 1985, status = succeeded worker1 # [ 185.579462] nix-grpc-daemon[1602]: time=2026-09-22T11:01:31.174Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 185.581427] nix-grpc-daemon[1602]: time=2026-09-22T11:01:31.174Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 185.622037] niks3-server[1138]: 2026/09/22 11:01:31 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 185.629346] niks3-server[1138]: 2026/09/22 11:01:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 185.634065] niks3-server[1138]: 2026/09/22 11:01:31 INFO Signed narinfos id=66 count=1 worker1 # [ 185.613398] nix-grpc-daemon[1602]: time=2026-09-22T11:01:31.208Z level=INFO msg="Uploading 1 narinfos" lb # [ 185.636943] niks3-server[1138]: 2026/09/22 11:01:31 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 185.647195] niks3-server[1138]: 2026/09/22 11:01:31 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 185.652874] niks3-server[1138]: 2026/09/22 11:01:31 INFO Completed upload id=66 worker1 # [ 185.632309] nix-grpc-daemon[1602]: time=2026-09-22T11:01:31.227Z level=INFO msg="Upload complete. (341ms)" lb # [ 185.659038] niks3-server[1138]: 2026/09/22 11:01:31 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 185.638185] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 185.642998] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 185.655791] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 185.660212] nix-daemon[834]: reaped child process 1975, status = succeeded worker1 # [ 185.669387] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 186.753111] nix-daemon[834]: reaped child process 1989, status = succeeded worker1 # [ 186.851245] nix-daemon[834]: accepted connection from pid 2005, user nix-grpc-daemon (trusted) worker1 # [ 186.872418] nix-daemon[834]: reaped child process 2008, status = succeeded lb # [ 186.897773] niks3-server[1138]: 2026/09/22 11:01:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 186.890290] nix-grpc-daemon[1602]: time=2026-09-22T11:01:32.483Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 186.891779] nix-grpc-daemon[1602]: time=2026-09-22T11:01:32.483Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 186.936299] niks3-server[1138]: 2026/09/22 11:01:32 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 186.951200] niks3-server[1138]: 2026/09/22 11:01:32 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst worker1 # [ 186.945339] nix-grpc-daemon[1602]: time=2026-09-22T11:01:32.540Z level=INFO msg="Uploading 1 narinfos" lb # [ 186.966722] niks3-server[1138]: 2026/09/22 11:01:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 186.972663] niks3-server[1138]: 2026/09/22 11:01:32 INFO Signed narinfos id=67 count=1 lb # [ 186.979195] niks3-server[1138]: 2026/09/22 11:01:32 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 186.991821] niks3-server[1138]: 2026/09/22 11:01:32 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete worker1 # [ 186.976610] nix-grpc-daemon[1602]: time=2026-09-22T11:01:32.571Z level=INFO msg="Upload complete. (295ms)" lb # [ 186.999442] niks3-server[1138]: 2026/09/22 11:01:32 INFO Completed upload id=67 worker1 # [ 186.993431] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=1 worker1 # [ 187.008433] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:32Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 187.014254] nix-daemon[834]: reaped child process 1987, status = succeeded worker1 # [ 187.030794] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 187.039471] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:32Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 187.050981] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 187.066509] nix-grpc-daemon[1602]: time=2026-09-22T11:01:32.661Z level=INFO msg="All 2 paths already cached" worker1 # [ 187.076118] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 187.090176] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 187.239973] nix-daemon[834]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker1 # [ 187.267375] nix-daemon[834]: reaped child process 2017, status = succeeded worker1 # [ 187.371634] nix-daemon[834]: accepted connection from pid 2019, user nix-grpc-daemon (trusted) worker1 # [ 187.393736] nix-daemon[834]: reaped child process 2022, status = succeeded lb # [ 187.416269] niks3-server[1138]: 2026/09/22 11:01:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 187.406181] nix-grpc-daemon[1602]: time=2026-09-22T11:01:33.001Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 187.407905] nix-grpc-daemon[1602]: time=2026-09-22T11:01:33.001Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 187.449122] niks3-server[1138]: 2026/09/22 11:01:33 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 187.446339] nix-grpc-daemon[1602]: time=2026-09-22T11:01:33.041Z level=INFO msg="Uploading 1 narinfos" lb # [ 187.468091] niks3-server[1138]: 2026/09/22 11:01:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 187.478189] niks3-server[1138]: 2026/09/22 11:01:33 INFO Signed narinfos id=68 count=1 lb # [ 187.485752] niks3-server[1138]: 2026/09/22 11:01:33 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 187.497992] niks3-server[1138]: 2026/09/22 11:01:33 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 187.505503] niks3-server[1138]: 2026/09/22 11:01:33 INFO Completed upload id=68 worker1 # [ 187.483528] nix-grpc-daemon[1602]: time=2026-09-22T11:01:33.078Z level=INFO msg="Upload complete. (378ms)" lb # [ 187.509729] niks3-server[1138]: 2026/09/22 11:01:33 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 187.492360] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 187.508585] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 187.515189] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 187.521962] nix-daemon[834]: reaped child process 2012, status = succeeded worker1 # [ 187.534322] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 188.644431] nix-daemon[834]: reaped child process 2026, status = succeeded worker1 # [ 188.719026] nix-daemon[834]: accepted connection from pid 2042, user nix-grpc-daemon (trusted) worker1 # [ 188.742746] nix-daemon[834]: reaped child process 2045, status = succeeded lb # [ 188.769522] niks3-server[1138]: 2026/09/22 11:01:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 188.764478] nix-grpc-daemon[1602]: time=2026-09-22T11:01:34.358Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 188.766252] nix-grpc-daemon[1602]: time=2026-09-22T11:01:34.358Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 188.806258] niks3-server[1138]: 2026/09/22 11:01:34 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 188.826879] niks3-server[1138]: 2026/09/22 11:01:34 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 188.840570] niks3-server[1138]: 2026/09/22 11:01:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker1 # [ 188.824127] nix-grpc-daemon[1602]: time=2026-09-22T11:01:34.418Z level=INFO msg="Uploading 1 narinfos" lb # [ 188.847449] niks3-server[1138]: 2026/09/22 11:01:34 INFO Signed narinfos id=69 count=1 lb # [ 188.854291] niks3-server[1138]: 2026/09/22 11:01:34 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 188.863619] niks3-server[1138]: 2026/09/22 11:01:34 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 188.870889] niks3-server[1138]: 2026/09/22 11:01:34 INFO Completed upload id=69 worker1 # [ 188.847286] nix-grpc-daemon[1602]: time=2026-09-22T11:01:34.442Z level=INFO msg="Upload complete. (302ms)" lb # [ 188.873019] niks3-server[1138]: 2026/09/22 11:01:34 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker1 # [ 188.865248] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=1 worker1 # [ 188.878418] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:34Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 188.882797] nix-daemon[834]: reaped child process 2024, status = succeeded worker1 # [ 188.903855] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 188.918144] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 188.934091] nix-grpc-daemon[1602]: time=2026-09-22T11:01:34.529Z level=INFO msg="All 2 paths already cached" worker1 # [ 188.943435] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 188.958138] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 189.107839] nix-daemon[834]: accepted connection from pid 2049, user nix-grpc-daemon (trusted) worker1 # [ 189.125775] nix-daemon[834]: reaped child process 2052, status = succeeded worker1 # [ 189.238345] nix-daemon[834]: accepted connection from pid 2054, user nix-grpc-daemon (trusted) lb # [ 189.276979] niks3-server[1138]: 2026/09/22 11:01:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 189.260292] nix-daemon[834]: reaped child process 2057, status = succeeded worker1 # [ 189.283442] nix-grpc-daemon[1602]: time=2026-09-22T11:01:34.878Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 189.285124] nix-grpc-daemon[1602]: time=2026-09-22T11:01:34.878Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" worker1 # [ 189.318628] nix-grpc-daemon[1602]: time=2026-09-22T11:01:34.913Z level=INFO msg="Uploading 1 narinfos" lb # [ 189.333545] niks3-server[1138]: 2026/09/22 11:01:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign lb # [ 189.347870] niks3-server[1138]: 2026/09/22 11:01:34 INFO Signed narinfos id=70 count=1 lb # [ 189.355912] niks3-server[1138]: 2026/09/22 11:01:34 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 189.350498] nix-grpc-daemon[1602]: time=2026-09-22T11:01:34.945Z level=INFO msg="Upload complete. (377ms)" lb # [ 189.373370] niks3-server[1138]: 2026/09/22 11:01:34 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls worker1 # [ 189.360355] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 189.382844] niks3-server[1138]: 2026/09/22 11:01:34 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 189.387592] niks3-server[1138]: 2026/09/22 11:01:34 INFO Completed upload id=70 lb # [ 189.390922] niks3-server[1138]: 2026/09/22 11:01:34 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 189.376344] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 189.384849] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 189.390308] nix-daemon[834]: reaped child process 2047, status = succeeded worker1 # [ 189.405837] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 190.275025] nix-daemon[834]: reaped child process 2061, status = succeeded worker1 # [ 190.396142] nix-daemon[834]: accepted connection from pid 2077, user nix-grpc-daemon (trusted) worker1 # [ 190.417143] nix-daemon[834]: reaped child process 2080, status = succeeded lb # [ 190.443054] niks3-server[1138]: 2026/09/22 11:01:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 190.434403] nix-grpc-daemon[1602]: time=2026-09-22T11:01:36.027Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 190.436500] nix-grpc-daemon[1602]: time=2026-09-22T11:01:36.027Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 190.485265] niks3-server[1138]: 2026/09/22 11:01:36 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 190.500125] niks3-server[1138]: 2026/09/22 11:01:36 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker1 # [ 190.489891] nix-grpc-daemon[1602]: time=2026-09-22T11:01:36.084Z level=INFO msg="Uploading 1 narinfos" lb # [ 190.512398] niks3-server[1138]: 2026/09/22 11:01:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 190.520960] niks3-server[1138]: 2026/09/22 11:01:36 INFO Signed narinfos id=71 count=1 lb # [ 190.523650] niks3-server[1138]: 2026/09/22 11:01:36 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 190.533930] niks3-server[1138]: 2026/09/22 11:01:36 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 190.543061] niks3-server[1138]: 2026/09/22 11:01:36 INFO Completed upload id=71 worker1 # [ 190.521500] nix-grpc-daemon[1602]: time=2026-09-22T11:01:36.116Z level=INFO msg="Upload complete. (304ms)" lb # [ 190.546163] niks3-server[1138]: 2026/09/22 11:01:36 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker1 # [ 190.537419] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=1 worker1 # [ 190.555878] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:36Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 190.561026] nix-daemon[834]: reaped child process 2059, status = succeeded worker1 # [ 190.579400] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 190.595815] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 190.611270] nix-grpc-daemon[1602]: time=2026-09-22T11:01:36.206Z level=INFO msg="All 2 paths already cached" worker1 # [ 190.621461] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 190.637216] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 190.797572] nix-daemon[834]: accepted connection from pid 2084, user nix-grpc-daemon (trusted) worker1 # [ 190.817200] nix-daemon[834]: reaped child process 2087, status = succeeded worker1 # [ 190.933486] nix-daemon[834]: accepted connection from pid 2089, user nix-grpc-daemon (trusted) worker1 # [ 190.956825] nix-daemon[834]: reaped child process 2092, status = succeeded lb # [ 190.979147] niks3-server[1138]: 2026/09/22 11:01:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 190.967633] nix-grpc-daemon[1602]: time=2026-09-22T11:01:36.562Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 190.969408] nix-grpc-daemon[1602]: time=2026-09-22T11:01:36.562Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 191.007774] niks3-server[1138]: 2026/09/22 11:01:36 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 191.008047] nix-grpc-daemon[1602]: time=2026-09-22T11:01:36.602Z level=INFO msg="Uploading 1 narinfos" lb # [ 191.021858] niks3-server[1138]: 2026/09/22 11:01:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 191.035439] niks3-server[1138]: 2026/09/22 11:01:36 INFO Signed narinfos id=72 count=1 lb # [ 191.043484] niks3-server[1138]: 2026/09/22 11:01:36 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls worker1 # [ 191.034113] nix-grpc-daemon[1602]: time=2026-09-22T11:01:36.629Z level=INFO msg="Upload complete. (380ms)" lb # [ 191.055976] niks3-server[1138]: 2026/09/22 11:01:36 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 191.061908] niks3-server[1138]: 2026/09/22 11:01:36 INFO Completed upload id=72 lb # [ 191.066790] niks3-server[1138]: 2026/09/22 11:01:36 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 191.045347] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 191.052331] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 191.063860] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 191.069315] nix-daemon[834]: reaped child process 2082, status = succeeded worker1 # [ 191.080203] nix-daemon[834]: accepted connection from pid 1502, user nix-grpc-daemon (trusted) worker1 # [ 192.195300] nix-daemon[834]: reaped child process 2096, status = succeeded worker1 # [ 192.268307] nix-daemon[834]: accepted connection from pid 2112, user nix-grpc-daemon (trusted) worker1 # [ 192.289629] nix-daemon[834]: reaped child process 2115, status = succeeded lb # [ 192.317339] niks3-server[1138]: 2026/09/22 11:01:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 192.312489] nix-grpc-daemon[1602]: time=2026-09-22T11:01:37.906Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 192.314417] nix-grpc-daemon[1602]: time=2026-09-22T11:01:37.906Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 192.362288] niks3-server[1138]: 2026/09/22 11:01:37 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 192.377814] niks3-server[1138]: 2026/09/22 11:01:37 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker1 # [ 192.365065] nix-grpc-daemon[1602]: time=2026-09-22T11:01:37.959Z level=INFO msg="Uploading 1 narinfos" lb # [ 192.390034] niks3-server[1138]: 2026/09/22 11:01:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 192.398069] niks3-server[1138]: 2026/09/22 11:01:37 INFO Signed narinfos id=73 count=1 lb # [ 192.404561] niks3-server[1138]: 2026/09/22 11:01:38 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 192.413877] niks3-server[1138]: 2026/09/22 11:01:38 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete worker1 # [ 192.398101] nix-grpc-daemon[1602]: time=2026-09-22T11:01:37.993Z level=INFO msg="Upload complete. (304ms)" lb # [ 192.421477] niks3-server[1138]: 2026/09/22 11:01:38 INFO Completed upload id=73 lb # [ 192.424634] niks3-server[1138]: 2026/09/22 11:01:38 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 192.411665] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34882 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=1 worker1 # [ 192.433601] nix-daemon[834]: reaped child process 2094, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 192.606667] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 4e43eb2270f541f5b638954c19343b61 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2 # [ 192.863546] nix-grpc-daemon[1972]: ts=2026-09-22T11:01:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 192.878277] nix-daemon[855]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) client # [ 192.851797] nix[1511]: don't know how to build these paths: client # [ 192.853519] nix[1511]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker1 # [ 192.861067] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34882 worker1 # [ 192.885013] nix-grpc-daemon[1502]: ts=2026-09-22T11:01:38Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 client # [ 192.884354] nix[1511]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 198.800932] envoy[898]: conn peer=[2001:db8:1::1]:39410 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27127 tx=11375 ms=16743 client # [ 222.887236] nix[1511]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 222.900486] nix[1511]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 222.947007] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 222.954154] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 222.959045] systemd[1]: gpu.service: Consumed 209ms CPU time over 30.339s wall clock time, 35.4M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.13 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 47.88 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.18 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 224.856346] nix-grpc-daemon[1502]: ts=2026-09-22T11:02:10Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2 worker2 # [ 225.887441] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33364 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 225.898043] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 225.914733] nix-grpc-daemon[1972]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 1/5) worker2 # [ 225.968400] nix-grpc-daemon[1972]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 2/5) worker2 # [ 226.049538] nix-grpc-daemon[1972]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 117 ms (attempt 3/5) worker2 # [ 226.168661] nix-grpc-daemon[1972]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 548 ms (attempt 4/5) worker2 # [ 226.719249] nix-grpc-daemon[1972]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 226.727155] nix-grpc-daemon[1972]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 226.718213] nix-grpc-daemon[1502]: ts=2026-09-22T11:02:12Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker1 # [ 226.724367] nix-grpc-daemon[1502]: ts=2026-09-22T11:02:12Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 226.808967] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 226.826277] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33364 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 226.842431] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 226.859925] nix-daemon[855]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) worker2 # [ 226.890003] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:12Z level=info event=niks3_push_started pid=2032 worker2 # [ 227.036853] nix-grpc-daemon[2032]: time=2026-09-22T11:02:12.634Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 227.148114] nix-daemon[855]: accepted connection from pid 2045, user nix-grpc-daemon (trusted) worker2 # [ 227.171296] nix-daemon[855]: reaped child process 2048, status = succeeded worker2 # [ 227.273935] nix-daemon[855]: accepted connection from pid 2050, user nix-grpc-daemon (trusted) worker2 # [ 227.293902] nix-daemon[855]: reaped child process 2053, status = succeeded lb # [ 227.271825] niks3-server[1138]: 2026/09/22 11:02:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 227.306572] nix-grpc-daemon[2032]: time=2026-09-22T11:02:12.904Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 227.308505] nix-grpc-daemon[2032]: time=2026-09-22T11:02:12.904Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 227.311086] niks3-server[1138]: 2026/09/22 11:02:12 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst worker2 # [ 227.347970] nix-grpc-daemon[2032]: time=2026-09-22T11:02:12.946Z level=INFO msg="Uploading 1 narinfos" lb # [ 227.325964] niks3-server[1138]: 2026/09/22 11:02:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign lb # [ 227.336659] niks3-server[1138]: 2026/09/22 11:02:12 INFO Signed narinfos id=74 count=1 lb # [ 227.344731] niks3-server[1138]: 2026/09/22 11:02:12 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 227.357759] niks3-server[1138]: 2026/09/22 11:02:12 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 227.368901] niks3-server[1138]: 2026/09/22 11:02:12 INFO Completed upload id=74 worker2 # [ 227.390412] nix-grpc-daemon[2032]: time=2026-09-22T11:02:12.989Z level=INFO msg="Upload complete. (353ms)" lb # [ 227.372341] niks3-server[1138]: 2026/09/22 11:02:12 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 227.400257] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33364 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 227.412357] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 227.424150] nix-daemon[855]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) worker2 # [ 227.427396] nix-daemon[855]: reaped child process 2030, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 227.439176] nix-daemon[855]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 228.804762] envoy[898]: conn peer=[2001:db8:1::1]:41584 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=500 ms=30103 client # farm-a> LOG-farm-a-drain worker2 # [ 229.116748] nix-daemon[855]: reaped child process 2057, status = succeeded worker2 # [ 229.229964] nix-daemon[855]: accepted connection from pid 2073, user nix-grpc-daemon (trusted) worker2 # [ 229.249494] nix-daemon[855]: reaped child process 2076, status = succeeded lb # [ 229.234267] niks3-server[1138]: 2026/09/22 11:02:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 229.272488] nix-grpc-daemon[2032]: time=2026-09-22T11:02:14.868Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 229.274388] nix-grpc-daemon[2032]: time=2026-09-22T11:02:14.868Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 229.275007] niks3-server[1138]: 2026/09/22 11:02:14 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 229.289008] niks3-server[1138]: 2026/09/22 11:02:14 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 229.303446] niks3-server[1138]: 2026/09/22 11:02:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign worker2 # [ 229.332115] nix-grpc-daemon[2032]: time=2026-09-22T11:02:14.930Z level=INFO msg="Uploading 1 narinfos" lb # [ 229.314275] niks3-server[1138]: 2026/09/22 11:02:14 INFO Signed narinfos id=75 count=1 lb # [ 229.319828] niks3-server[1138]: 2026/09/22 11:02:14 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 229.329579] niks3-server[1138]: 2026/09/22 11:02:14 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 229.339275] niks3-server[1138]: 2026/09/22 11:02:14 INFO Completed upload id=75 worker2 # [ 229.361299] nix-grpc-daemon[2032]: time=2026-09-22T11:02:14.960Z level=INFO msg="Upload complete. (307ms)" lb # [ 229.343212] niks3-server[1138]: 2026/09/22 11:02:14 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 229.373196] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33364 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=1 worker1 # [ 229.338356] nix-grpc-daemon[1502]: ts=2026-09-22T11:02:14Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker1 # [ 229.344539] nix-grpc-daemon[1502]: ts=2026-09-22T11:02:14Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 229.395075] nix-daemon[855]: reaped child process 2055, status = succeeded worker2 # [ 229.426811] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 229.443301] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 229.459764] nix-grpc-daemon[2032]: time=2026-09-22T11:02:15.058Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 229.470143] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 229.483700] nix-daemon[855]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) worker2 # [ 229.640833] nix-daemon[855]: accepted connection from pid 2080, user nix-grpc-daemon (trusted) worker2 # [ 229.658649] nix-daemon[855]: reaped child process 2083, status = succeeded worker2 # [ 229.765773] nix-daemon[855]: accepted connection from pid 2085, user nix-grpc-daemon (trusted) worker2 # [ 229.783199] nix-daemon[855]: reaped child process 2088, status = succeeded lb # [ 229.767230] niks3-server[1138]: 2026/09/22 11:02:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 229.798621] nix-grpc-daemon[2032]: time=2026-09-22T11:02:15.397Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 229.800225] nix-grpc-daemon[2032]: time=2026-09-22T11:02:15.397Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 229.796704] niks3-server[1138]: 2026/09/22 11:02:15 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 229.830737] nix-grpc-daemon[2032]: time=2026-09-22T11:02:15.429Z level=INFO msg="Uploading 1 narinfos" lb # [ 229.810890] niks3-server[1138]: 2026/09/22 11:02:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign lb # [ 229.823049] niks3-server[1138]: 2026/09/22 11:02:15 INFO Signed narinfos id=76 count=1 lb # [ 229.829225] niks3-server[1138]: 2026/09/22 11:02:15 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 229.839286] niks3-server[1138]: 2026/09/22 11:02:15 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete lb # [ 229.846757] niks3-server[1138]: 2026/09/22 11:02:15 INFO Completed upload id=76 worker2 # [ 229.868303] nix-grpc-daemon[2032]: time=2026-09-22T11:02:15.467Z level=INFO msg="Upload complete. (367ms)" lb # [ 229.852151] niks3-server[1138]: 2026/09/22 11:02:15 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 229.876136] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33364 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 229.889722] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 229.895919] nix-daemon[855]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) worker2 # [ 229.901421] nix-daemon[855]: reaped child process 2078, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... worker2 # [ 229.913222] nix-daemon[855]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 231.623615] nix-daemon[855]: reaped child process 2092, status = succeeded worker2 # [ 231.698407] nix-daemon[855]: accepted connection from pid 2108, user nix-grpc-daemon (trusted) worker2 # [ 231.719656] nix-daemon[855]: reaped child process 2111, status = succeeded lb # [ 231.701642] niks3-server[1138]: 2026/09/22 11:02:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 231.733877] nix-grpc-daemon[2032]: time=2026-09-22T11:02:17.332Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 231.735557] nix-grpc-daemon[2032]: time=2026-09-22T11:02:17.332Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 231.742171] niks3-server[1138]: 2026/09/22 11:02:17 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 231.756360] niks3-server[1138]: 2026/09/22 11:02:17 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 231.788641] nix-grpc-daemon[2032]: time=2026-09-22T11:02:17.387Z level=INFO msg="Uploading 1 narinfos" lb # [ 231.768748] niks3-server[1138]: 2026/09/22 11:02:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 231.771926] niks3-server[1138]: 2026/09/22 11:02:17 INFO Signed narinfos id=77 count=1 lb # [ 231.780797] niks3-server[1138]: 2026/09/22 11:02:17 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 231.787759] niks3-server[1138]: 2026/09/22 11:02:17 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete worker2 # [ 231.813989] nix-grpc-daemon[2032]: time=2026-09-22T11:02:17.413Z level=INFO msg="Upload complete. (287ms)" lb # [ 231.794220] niks3-server[1138]: 2026/09/22 11:02:17 INFO Completed upload id=77 lb # [ 231.797510] niks3-server[1138]: 2026/09/22 11:02:17 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 231.825151] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33364 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=1 worker1 # [ 231.790345] nix-grpc-daemon[1502]: ts=2026-09-22T11:02:17Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker1 # [ 231.796570] nix-grpc-daemon[1502]: ts=2026-09-22T11:02:17Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 231.847375] nix-daemon[855]: reaped child process 2090, status = succeeded worker2 # [ 231.878381] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 231.895180] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33364 client # copying 1 paths to 'lb:50051'... worker2 # [ 231.909830] nix-grpc-daemon[2032]: time=2026-09-22T11:02:17.509Z level=INFO msg="All 2 paths already cached" client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 231.916878] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 231.930609] nix-daemon[855]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) worker2 # [ 232.090281] nix-daemon[855]: accepted connection from pid 2115, user nix-grpc-daemon (trusted) worker2 # [ 232.110174] nix-daemon[855]: reaped child process 2118, status = succeeded worker2 # [ 232.219748] nix-daemon[855]: accepted connection from pid 2120, user nix-grpc-daemon (trusted) worker2 # [ 232.239543] nix-daemon[855]: reaped child process 2123, status = succeeded lb # [ 232.226220] niks3-server[1138]: 2026/09/22 11:02:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 232.257210] nix-grpc-daemon[2032]: time=2026-09-22T11:02:17.856Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 232.258765] nix-grpc-daemon[2032]: time=2026-09-22T11:02:17.856Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 232.253926] niks3-server[1138]: 2026/09/22 11:02:17 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 232.289669] nix-grpc-daemon[2032]: time=2026-09-22T11:02:17.888Z level=INFO msg="Uploading 1 narinfos" lb # [ 232.268887] niks3-server[1138]: 2026/09/22 11:02:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign lb # [ 232.281777] niks3-server[1138]: 2026/09/22 11:02:17 INFO Signed narinfos id=78 count=1 lb # [ 232.287743] niks3-server[1138]: 2026/09/22 11:02:17 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 232.295205] niks3-server[1138]: 2026/09/22 11:02:17 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete lb # [ 232.301676] niks3-server[1138]: 2026/09/22 11:02:17 INFO Completed upload id=78 worker2 # [ 232.323218] nix-grpc-daemon[2032]: time=2026-09-22T11:02:17.922Z level=INFO msg="Upload complete. (376ms)" lb # [ 232.307269] niks3-server[1138]: 2026/09/22 11:02:17 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 232.332560] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33364 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 232.346736] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33364 worker2 # [ 232.353643] nix-daemon[855]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) worker2 # [ 232.359498] nix-daemon[855]: reaped child process 2113, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... worker2 # [ 232.372909] nix-daemon[855]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 233.267714] nix-daemon[855]: reaped child process 2127, status = succeeded worker2 # [ 233.354413] nix-daemon[855]: accepted connection from pid 2143, user nix-grpc-daemon (trusted) worker2 # [ 233.377971] nix-daemon[855]: reaped child process 2146, status = succeeded lb # [ 233.361293] niks3-server[1138]: 2026/09/22 11:02:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 233.394610] nix-grpc-daemon[2032]: time=2026-09-22T11:02:18.991Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 233.396598] nix-grpc-daemon[2032]: time=2026-09-22T11:02:18.991Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 233.400889] niks3-server[1138]: 2026/09/22 11:02:19 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst worker2 # [ 233.437672] nix-grpc-daemon[2032]: time=2026-09-22T11:02:19.036Z level=INFO msg="Uploading 1 narinfos" lb # [ 233.417103] niks3-server[1138]: 2026/09/22 11:02:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign lb # [ 233.425387] niks3-server[1138]: 2026/09/22 11:02:19 INFO Signed narinfos id=79 count=1 lb # [ 233.433029] niks3-server[1138]: 2026/09/22 11:02:19 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 233.444181] niks3-server[1138]: 2026/09/22 11:02:19 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 233.447932] niks3-server[1138]: 2026/09/22 11:02:19 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 233.456674] niks3-server[1138]: 2026/09/22 11:02:19 INFO Completed upload id=79 worker2 # [ 233.476432] nix-grpc-daemon[2032]: time=2026-09-22T11:02:19.075Z level=INFO msg="Upload complete. (290ms)" lb # [ 233.458855] niks3-server[1138]: 2026/09/22 11:02:19 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 233.489257] nix-grpc-daemon[1972]: ts=2026-09-22T11:02:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33364 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=1 worker2 # [ 233.508473] nix-daemon[855]: reaped child process 2125, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2, in 7.88 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath, in 0.19 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 234.863566] nix-grpc-daemon[1502]: ts=2026-09-22T11:02:20Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 11.70 seconds) (finished: run the VM test script, in 235.97 seconds) test script finished in 236.16s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) client # [2026-09-22T11:02:20Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T11:02:20Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T11:02:20Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) lb # [2026-09-22T11:02:20Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T11:02:20Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T11:02:20Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) worker1 # [2026-09-22T11:02:21Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T11:02:21Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T11:02:21Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) worker2 # [2026-09-22T11:02:21Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T11:02:21Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T11:02:21Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.19 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh