tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker1 # Disk image does not exist, creating the virtualisation disk image... lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 49) worker2 # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 50) worker1: QEMU running (pid 51) worker1 # Formatting '/build/vm-state-worker1/tmp.YLpvwU6C8k', fmt=raw size=1073741824 client # Disk image does not exist, creating the virtualisation disk image... lb # Formatting '/build/vm-state-lb/tmp.1lmkEyTzZS', fmt=raw size=1073741824 worker2: QEMU running (pid 52) worker2 # Formatting '/build/vm-state-worker2/tmp.lKNr6oDX3m', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) client # Formatting '/build/vm-state-client/tmp.xxKtQNXkIu', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done worker1 # Discarding device blocks: 0/262144 done worker2 # Discarding device blocks: 0/262144 done lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: 3ce0c967-ba8e-44be-822a-4cd33d5382f1 worker1 # Filesystem UUID: d8719de8-9303-447a-92f1-443ba59ec9e6 worker2 # Filesystem UUID: 4679f22f-08ba-435b-9f4a-daa35ddbe0e5 lb # Superblock backups stored on blocks: worker1 # Superblock backups stored on blocks: worker2 # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 worker1 # 32768, 98304, 163840, 229376 worker2 # 32768, 98304, 163840, 229376 lb # worker1 # worker2 # lb # Allocating group tables: 0/8 done worker1 # Allocating group tables: 0/8 done worker2 # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker2 # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done worker1 # Creating journal (8192 blocks): done worker2 # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done lb # worker1 # worker2 # lb # Virtualisation disk image created. worker1 # Virtualisation disk image created. worker2 # Virtualisation disk image created. (finished: start all VMs, in 0.47 seconds) client # mke2fs 1.47.4 (6-Mar-2025) client: waiting for unit network-addresses-eth1.service client: waiting for the VM to finish booting client # Discarding device blocks: 0/262144 done client # Creating filesystem with 262144 4k blocks and 65536 inodes client # Filesystem UUID: fa70b7c7-7f78-4bc7-8d21-bd9d2ca7957e client # Superblock backups stored on blocks: client # 32768, 98304, 163840, 229376 client # client # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done client # Writing superblocks and filesystem accounting information: 0/8 done client # client # Virtualisation disk image created. worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] KASLR enabled worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] random: crng init done lb # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] Normal empty worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Device empty worker1 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] random: crng init done lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Zone ranges: worker2 # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] Normal empty worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Device empty worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] DMA32 empty lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] Normal empty lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] Device empty worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] Movable zone start for each node lb # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] KASLR enabled worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] random: crng init done lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] Zone ranges: lb # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] DMA32 empty lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] Normal empty client # [ 0.000000] Device empty worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] Early memory node ranges lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w0djksilfhz0x4sfhpdpmkf3iy7y39rh-nixos-system-worker2-test/init regInfo=/nix/store/nqjf3pq8l58q3rgaldbcq08a2kda91gi-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/nqjf3pq8l58q3rgaldbcq08a2kda91gi-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/sy3pchz5vg22ylc3whvkp4s8qngi8wmd-nixos-system-lb-test/init regInfo=/nix/store/4q693lxjjy3z9gghvdrv4s7qcr63j8a1-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/4q693lxjjy3z9gghvdrv4s7qcr63j8a1-closure-info/registration", will be passed to user space. client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/v0lyrrn8c44dmsycpizv4zk1h70zydxf-nixos-system-worker1-test/init regInfo=/nix/store/xi2sa5r0rxp25jn6mwpjlq1r7pww37n0-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/xi2sa5r0rxp25jn6mwpjlq1r7pww37n0-closure-info/registration", will be passed to user space. lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1riwj2yl1fyad56y7izqz2z8iyxylapg-nixos-system-client-test/init regInfo=/nix/store/qj3vdfrkilk0aca7lsjqss7zd6k5k971-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qj3vdfrkilk0aca7lsjqss7zd6k5k971-closure-info/registration", will be passed to user space. lb # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000030] arm-pv: using stolen time PV lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000439] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000614] Console: colour dummy device 80x25 client # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000623] printk: legacy console [tty0] enabled worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000031] arm-pv: using stolen time PV worker2 # [ 0.000825] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000833] pid_max: default: 32768 minimum: 301 lb # [ 0.000456] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000927] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000608] Console: colour dummy device 80x25 client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.001065] landlock: Up and running. worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.001068] Yama: becoming mindful. lb # [ 0.000616] printk: legacy console [tty0] enabled worker1 # [ 0.000030] arm-pv: using stolen time PV worker2 # [ 0.001555] LSM support for eBPF active client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000808] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.001727] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000436] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000815] pid_max: default: 32768 minimum: 301 client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000582] Console: colour dummy device 80x25 worker2 # [ 0.001764] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000884] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000590] printk: legacy console [tty0] enabled lb # [ 0.001034] landlock: Up and running. worker2 # [ 0.002896] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.001037] Yama: becoming mindful. worker2 # [ 0.003653] rcu: Hierarchical SRCU implementation. lb # [ 0.001535] LSM support for eBPF active worker1 # [ 0.000787] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.003658] rcu: Max phase no-delay instances is 1000. client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000793] pid_max: default: 32768 minimum: 301 lb # [ 0.001673] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.004886] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.000869] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.004979] EFI services will not be available. lb # [ 0.001707] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.001038] landlock: Up and running. worker2 # [ 0.005090] smp: Bringing up secondary CPUs ... worker1 # [ 0.001041] Yama: becoming mindful. client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.005098] smp: Brought up 1 node, 1 CPU lb # [ 0.002828] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.001454] LSM support for eBPF active worker2 # [ 0.005101] SMP: Total of 1 processors activated. lb # [ 0.003551] rcu: Hierarchical SRCU implementation. client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.005107] CPU: All CPU(s) started at EL1 worker1 # [ 0.001592] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.003555] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.005118] CPU features: detected: Branch Target Identification lb # [ 0.004758] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.001624] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.004856] EFI services will not be available. client # [ 0.000028] arm-pv: using stolen time PV worker2 # [ 0.005123] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.002735] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.004968] smp: Bringing up secondary CPUs ... worker1 # [ 0.003449] rcu: Hierarchical SRCU implementation. lb # [ 0.004977] smp: Brought up 1 node, 1 CPU worker2 # [ 0.005127] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.000386] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.003454] rcu: Max phase no-delay instances is 1000. lb # [ 0.004980] SMP: Total of 1 processors activated. client # [ 0.000550] Console: colour dummy device 80x25 worker1 # [ 0.004662] fsl-mc MSI: its@8080000 domain created lb # [ 0.004985] CPU: All CPU(s) started at EL1 worker2 # [ 0.005130] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.000557] printk: legacy console [tty0] enabled worker1 # [ 0.004752] EFI services will not be available. lb # [ 0.004996] CPU features: detected: Branch Target Identification worker2 # [ 0.005134] CPU features: detected: Common not Private translations worker1 # [ 0.004816] smp: Bringing up secondary CPUs ... worker2 # [ 0.005137] CPU features: detected: CRC32 instructions client # [ 0.000773] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.005001] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.004824] smp: Brought up 1 node, 1 CPU worker1 # [ 0.004827] SMP: Total of 1 processors activated. client # [ 0.000780] pid_max: default: 32768 minimum: 301 worker2 # [ 0.005140] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.005004] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.004833] CPU: All CPU(s) started at EL1 client # [ 0.000858] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.005144] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.001032] landlock: Up and running. worker1 # [ 0.004843] CPU features: detected: Branch Target Identification lb # [ 0.005007] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.001035] Yama: becoming mindful. worker2 # [ 0.005147] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.004848] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.001507] LSM support for eBPF active lb # [ 0.005011] CPU features: detected: Common not Private translations worker2 # [ 0.005150] CPU features: detected: E0PD lb # [ 0.005014] CPU features: detected: CRC32 instructions client # [ 0.001636] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.004851] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.005152] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.005017] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.001667] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.005155] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.004855] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.002779] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.005158] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.005021] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.004858] CPU features: detected: Common not Private translations worker2 # [ 0.005162] CPU features: detected: Fine Grained Traps client # [ 0.003478] rcu: Hierarchical SRCU implementation. worker1 # [ 0.004861] CPU features: detected: CRC32 instructions lb # [ 0.005024] CPU features: detected: Data independent timing control (DIT) client # [ 0.003482] rcu: Max phase no-delay instances is 1000. lb # [ 0.005027] CPU features: detected: E0PD worker2 # [ 0.005165] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.004864] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.004671] fsl-mc MSI: its@8080000 domain created lb # [ 0.005030] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.005170] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004761] EFI services will not be available. worker1 # [ 0.004868] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.004840] smp: Bringing up secondary CPUs ... worker2 # [ 0.005173] CPU features: detected: LSE atomic instructions lb # [ 0.005033] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.004848] smp: Brought up 1 node, 1 CPU worker1 # [ 0.004871] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.005176] CPU features: detected: Privileged Access Never client # [ 0.004851] SMP: Total of 1 processors activated. lb # [ 0.005036] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.004874] CPU features: detected: E0PD worker2 # [ 0.005178] CPU features: detected: PMUv3 client # [ 0.004856] CPU: All CPU(s) started at EL1 lb # [ 0.005039] CPU features: detected: Fine Grained Traps worker1 # [ 0.004876] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.005181] CPU features: detected: RAS Extension Support client # [ 0.004867] CPU features: detected: Branch Target Identification lb # [ 0.005042] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.004879] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.005184] CPU features: detected: RASv1p1 Extension Support client # [ 0.004872] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.004883] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.005047] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.005187] CPU features: detected: Random Number Generator worker1 # [ 0.004886] CPU features: detected: Fine Grained Traps client # [ 0.004875] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.005050] CPU features: detected: LSE atomic instructions worker2 # [ 0.005189] CPU features: detected: Speculation barrier (SB) lb # [ 0.005053] CPU features: detected: Privileged Access Never worker2 # [ 0.005192] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.004889] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.004879] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.005056] CPU features: detected: PMUv3 worker2 # [ 0.005195] CPU features: detected: TLB range maintenance instructions client # [ 0.004883] CPU features: detected: Common not Private translations worker1 # [ 0.004893] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.005059] CPU features: detected: RAS Extension Support worker1 # [ 0.004896] CPU features: detected: LSE atomic instructions client # [ 0.004886] CPU features: detected: CRC32 instructions lb # [ 0.005061] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.005199] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.005239] alternatives: applying system-wide alternatives lb # [ 0.005064] CPU features: detected: Random Number Generator worker1 # [ 0.004899] CPU features: detected: Privileged Access Never client # [ 0.004888] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.004902] CPU features: detected: PMUv3 lb # [ 0.005066] CPU features: detected: Speculation barrier (SB) client # [ 0.004892] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.008197] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.004904] CPU features: detected: RAS Extension Support lb # [ 0.005069] CPU features: detected: Stage-2 Force Write-Back client # [ 0.004895] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.004907] CPU features: detected: RASv1p1 Extension Support client # [ 0.004898] CPU features: detected: E0PD lb # [ 0.005072] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.004909] CPU features: detected: Random Number Generator worker2 # [ 0.008387] Memory: 1406564K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker2 # [ 0.008774] devtmpfs: initialized client # [ 0.004901] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.004912] CPU features: detected: Speculation barrier (SB) lb # [ 0.005077] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.004915] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.010542] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.005115] alternatives: applying system-wide alternatives client # [ 0.004904] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.004917] CPU features: detected: TLB range maintenance instructions client # [ 0.004907] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.008159] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.004910] CPU features: detected: Fine Grained Traps worker1 # [ 0.004921] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.004957] alternatives: applying system-wide alternatives client # [ 0.004914] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.008408] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) lb # [ 0.008772] devtmpfs: initialized worker1 # [ 0.007939] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.004920] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004923] CPU features: detected: LSE atomic instructions lb # [ 0.010666] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.004926] CPU features: detected: Privileged Access Never worker1 # [ 0.008144] Memory: 1406512K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) client # [ 0.004929] CPU features: detected: PMUv3 lb # [ 0.010687] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.008502] devtmpfs: initialized client # [ 0.004931] CPU features: detected: RAS Extension Support lb # [ 0.010871] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.010308] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.004934] CPU features: detected: RASv1p1 Extension Support client # [ 0.004936] CPU features: detected: Random Number Generator worker1 # [ 0.010330] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.004939] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.010528] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.004942] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.010533] 0 pages in range for non-PLT usage worker1 # [ 0.010534] 508288 pages in range for PLT usage client # [ 0.004945] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.010563] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.010647] pinctrl core: initialized pinctrl subsystem client # [ 0.004950] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.010747] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.011449] DMI not present or invalid. worker2 # [ 0.010752] 0 pages in range for non-PLT usage client # [ 0.004985] alternatives: applying system-wide alternatives worker1 # [ 0.014594] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.010753] 508288 pages in range for PLT usage client # [ 0.007862] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.016765] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.010854] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.011642] DMI not present or invalid. worker2 # [ 0.014702] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.007997] Memory: 1406504K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) client # [ 0.008384] devtmpfs: initialized worker2 # [ 0.016939] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.010876] 0 pages in range for non-PLT usage client # [ 0.010178] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.017141] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.010876] 508288 pages in range for PLT usage client # [ 0.010202] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.017348] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.010970] pinctrl core: initialized pinctrl subsystem lb # [ 0.011706] DMI not present or invalid. worker2 # [ 0.017372] audit: initializing netlink subsys (disabled) client # [ 0.010378] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.015072] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.010382] 0 pages in range for non-PLT usage worker2 # [ 0.017977] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.010383] 508288 pages in range for PLT usage lb # [ 0.017266] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.017979] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.010487] pinctrl core: initialized pinctrl subsystem client # [ 0.011223] DMI not present or invalid. worker2 # [ 0.017982] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.017455] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.014359] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.017987] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.017655] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.017990] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.016556] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.017676] audit: initializing netlink subsys (disabled) worker1 # [ 0.016955] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.018014] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.018246] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.016757] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.018023] cpuidle: using governor ladder lb # [ 0.018248] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.017151] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.018029] cpuidle: using governor menu lb # [ 0.018252] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.017172] audit: initializing netlink subsys (disabled) client # [ 0.016950] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.018214] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.018257] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.017707] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.016971] audit: initializing netlink subsys (disabled) worker2 # [ 0.018229] ASID allocator initialised with 65536 entries worker1 # [ 0.017709] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.018260] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.019472] Serial: AMBA PL011 UART driver client # [ 0.017527] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.017713] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.017529] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.018292] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.024863] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.018301] cpuidle: using governor ladder worker1 # [ 0.017718] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.025027] printk: console [ttyAMA0] enabled client # [ 0.017533] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.018307] cpuidle: using governor menu worker1 # [ 0.017721] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.017541] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.018502] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.144748] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.017742] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.017543] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.018518] ASID allocator initialised with 65536 entries worker1 # [ 0.017752] cpuidle: using governor ladder worker2 # [ 0.144769] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.019714] Serial: AMBA PL011 UART driver client # [ 0.017567] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.017757] cpuidle: using governor menu client # [ 0.017577] cpuidle: using governor ladder worker2 # [ 0.144774] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.024941] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.017953] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.017583] cpuidle: using governor menu worker2 # [ 0.144778] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.025086] printk: console [ttyAMA0] enabled worker1 # [ 0.017967] ASID allocator initialised with 65536 entries client # [ 0.017764] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.019179] Serial: AMBA PL011 UART driver worker2 # [ 0.144788] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.017779] ASID allocator initialised with 65536 entries lb # [ 0.145892] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.144793] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.018925] Serial: AMBA PL011 UART driver worker1 # [ 0.024370] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.024489] printk: console [ttyAMA0] enabled lb # [ 0.145910] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.144797] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.023999] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.144801] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.145915] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.024129] printk: console [ttyAMA0] enabled worker1 # [ 0.143933] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.145920] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.143953] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.145924] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.143958] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.145928] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.152015] fbcon: Taking over console worker1 # [ 0.143963] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.152030] ACPI: Interpreter disabled. lb # [ 0.145933] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.153883] iommu: Default domain type: Translated worker1 # [ 0.143967] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.145937] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.153893] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.143972] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.155573] SCSI subsystem initialized worker1 # [ 0.143976] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.143980] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.153234] fbcon: Taking over console lb # [ 0.153247] ACPI: Interpreter disabled. client # [ 0.140715] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.155117] iommu: Default domain type: Translated client # [ 0.140731] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.155127] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.151348] fbcon: Taking over console client # [ 0.140737] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.151363] ACPI: Interpreter disabled. lb # [ 0.156849] SCSI subsystem initialized client # [ 0.140741] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.153206] iommu: Default domain type: Translated client # [ 0.140745] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.153216] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.140750] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.154947] SCSI subsystem initialized client # [ 0.140754] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.140758] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.163233] usbcore: registered new interface driver usbfs worker2 # [ 0.163280] usbcore: registered new interface driver hub client # [ 0.148215] fbcon: Taking over console worker2 # [ 0.163300] usbcore: registered new device driver usb client # [ 0.148230] ACPI: Interpreter disabled. worker2 # [ 0.163573] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.163579] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.163590] PTP clock support registered lb # [ 0.164301] usbcore: registered new interface driver usbfs worker2 # [ 0.163630] EDAC MC: Ver: 3.0.0 lb # [ 0.164332] usbcore: registered new interface driver hub worker2 # [ 0.168279] scmi_core: SCMI protocol bus registered lb # [ 0.164351] usbcore: registered new device driver usb lb # [ 0.164642] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.162358] usbcore: registered new interface driver usbfs worker2 # [ 0.169267] FPGA manager framework worker2 # [ 0.170281] vgaarb: loaded worker1 # [ 0.162391] usbcore: registered new interface driver hub lb # [ 0.164648] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.162409] usbcore: registered new device driver usb lb # [ 0.164658] PTP clock support registered lb # [ 0.164708] EDAC MC: Ver: 3.0.0 worker1 # [ 0.162686] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.170918] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.169356] scmi_core: SCMI protocol bus registered worker2 # [ 0.172278] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.162692] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.162702] PTP clock support registered worker2 # [ 0.172309] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.162743] EDAC MC: Ver: 3.0.0 lb # [ 0.170350] FPGA manager framework lb # [ 0.171313] vgaarb: loaded client # [ 0.157262] iommu: Default domain type: Translated worker2 # [ 0.173901] netfs: FS-Cache loaded worker1 # [ 0.167340] scmi_core: SCMI protocol bus registered worker2 # [ 0.174028] pnp: PnP ACPI: disabled client # [ 0.157272] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.157612] SCSI subsystem initialized worker1 # [ 0.168285] FPGA manager framework lb # [ 0.171956] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.169281] vgaarb: loaded lb # [ 0.172548] VFS: Disk quotas dquot_6.6.0 client # [ 0.159571] usbcore: registered new interface driver usbfs lb # [ 0.172575] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.159602] usbcore: registered new interface driver hub worker1 # [ 0.169914] clocksource: Switched to clocksource arch_sys_counter client # [ 0.159620] usbcore: registered new device driver usb lb # [ 0.174976] netfs: FS-Cache loaded worker1 # [ 0.170560] VFS: Disk quotas dquot_6.6.0 lb # [ 0.175112] pnp: PnP ACPI: disabled client # [ 0.159885] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.170587] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.159891] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.172906] netfs: FS-Cache loaded client # [ 0.159901] PTP clock support registered worker1 # [ 0.173017] pnp: PnP ACPI: disabled client # [ 0.159949] EDAC MC: Ver: 3.0.0 client # [ 0.164568] scmi_core: SCMI protocol bus registered client # [ 0.165560] FPGA manager framework client # [ 0.166492] vgaarb: loaded worker2 # [ 0.180101] NET: Registered PF_INET protocol family client # [ 0.167113] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.180377] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.180959] NET: Registered PF_INET protocol family client # [ 0.171059] VFS: Disk quotas dquot_6.6.0 lb # [ 0.181234] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.171093] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.178876] NET: Registered PF_INET protocol family worker1 # [ 0.179150] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.174681] netfs: FS-Cache loaded client # [ 0.174808] pnp: PnP ACPI: disabled client # [ 0.178668] NET: Registered PF_INET protocol family client # [ 0.178945] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.209337] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.209385] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.209411] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.209485] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.209629] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.210492] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.209713] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.210544] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.209748] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.210573] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.208296] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.209784] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.210650] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.208343] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.209881] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.210793] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.209904] NET: Registered PF_XDP protocol family worker1 # [ 0.208372] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.209923] PCI: CLS 0 bytes, default 64 lb # [ 0.210881] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.208444] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.210160] Trying to unpack rootfs image as initramfs... lb # [ 0.210917] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.208589] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.210967] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.208674] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.211057] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.208712] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211081] NET: Registered PF_XDP protocol family worker1 # [ 0.208747] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211099] PCI: CLS 0 bytes, default 64 worker1 # [ 0.208835] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.211350] Trying to unpack rootfs image as initramfs... worker1 # [ 0.208861] NET: Registered PF_XDP protocol family worker1 # [ 0.208880] PCI: CLS 0 bytes, default 64 worker1 # [ 0.209118] Trying to unpack rootfs image as initramfs... worker2 # [ 0.224554] kvm [1]: HYP mode not available client # [ 0.207649] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.207696] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.207726] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.207800] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.225751] kvm [1]: HYP mode not available client # [ 0.207943] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.208025] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.223355] kvm [1]: HYP mode not available client # [ 0.208060] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.208096] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.208215] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.208238] NET: Registered PF_XDP protocol family client # [ 0.208257] PCI: CLS 0 bytes, default 64 client # [ 0.208507] Trying to unpack rootfs image as initramfs... client # [ 0.224747] kvm [1]: HYP mode not available worker2 # [ 0.315495] Initialise system trusted keyrings worker2 # [ 0.316241] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.317500] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.318266] 9p: Installing v9fs 9p2000 file system support lb # [ 0.320545] Initialise system trusted keyrings lb # [ 0.321294] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.318582] Initialise system trusted keyrings lb # [ 0.322595] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.319338] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.323371] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.320656] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.321419] 9p: Installing v9fs 9p2000 file system support client # [ 0.315995] Initialise system trusted keyrings client # [ 0.316752] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.317994] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.318757] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.338874] Key type asymmetric registered worker2 # [ 0.338901] Asymmetric key parser 'x509' registered worker2 # [ 0.347016] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.348092] io scheduler mq-deadline registered worker2 # [ 0.348103] io scheduler kyber registered lb # [ 0.352041] Key type asymmetric registered lb # [ 0.352073] Asymmetric key parser 'x509' registered lb # [ 0.352159] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.350134] Key type asymmetric registered lb # [ 0.354344] io scheduler mq-deadline registered worker1 # [ 0.350164] Asymmetric key parser 'x509' registered lb # [ 0.354354] io scheduler kyber registered worker1 # [ 0.350254] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.352375] io scheduler mq-deadline registered worker1 # [ 0.352385] io scheduler kyber registered worker2 # [ 0.359056] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.360455] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.347395] Key type asymmetric registered worker2 # [ 0.360991] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.347424] Asymmetric key parser 'x509' registered worker2 # [ 0.361012] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.347491] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.349645] io scheduler mq-deadline registered worker2 # [ 0.361025] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.349656] io scheduler kyber registered worker2 # [ 0.361033] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.364094] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.361058] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.361083] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.362059] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.361163] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.365490] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.361173] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.365901] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.361179] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.361185] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.363472] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.365918] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.361190] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.363863] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.365931] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.361246] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.363880] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.365939] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.361668] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.363906] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.365966] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.361855] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.359249] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.361872] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.363915] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.365989] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.361901] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.363934] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.366064] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.361917] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.366074] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.363957] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.362372] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.366080] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.360562] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.364049] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.362557] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.366085] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.364058] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.360964] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.362575] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.366090] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.364064] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.362604] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.360981] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.364069] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.366147] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.360993] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.364074] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.366601] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.381908] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.366798] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.361001] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.364162] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.382096] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.366814] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.361029] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.364599] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.382112] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.366844] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.364787] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.382143] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.361052] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.366860] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.364803] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.361128] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.382600] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.364833] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.367319] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.361137] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.382788] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.367505] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.364849] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.361144] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.382804] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.367521] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.365308] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.361149] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.382836] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.367550] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.365491] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.361154] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.365507] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.361212] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.365536] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.386610] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.361647] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.386801] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.361835] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.386817] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.361852] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.384389] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.386849] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.361881] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.384575] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.387318] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.361897] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.384591] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.387505] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.384621] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.362348] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.387520] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.362535] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.385302] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.387553] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.362550] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.385484] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.362580] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.385500] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.385532] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.363034] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.382760] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.382779] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.382808] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.395384] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.385442] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.395581] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.385625] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.395597] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.385640] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.395627] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.385671] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.396087] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.386124] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.396270] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.386306] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.396285] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.386321] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.396314] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.386349] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.396761] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.386798] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.396951] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.386981] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.396967] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.400052] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.386997] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.400248] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.396996] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.387025] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.400264] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.397012] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.398036] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.400294] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.397461] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.398239] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.397646] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.400778] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.398255] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.400964] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.397675] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.398285] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.400980] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.398121] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.398759] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.401009] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.398308] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.398941] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.401474] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.398337] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.398957] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.401664] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.398729] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.398986] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.401680] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.398909] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.399445] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.401712] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.399628] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.399171] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.401728] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.399460] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.399643] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.402191] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.399477] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.399672] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.402390] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.399506] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.399688] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.402420] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.399962] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.400180] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.402876] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.400141] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.400366] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.403066] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.400157] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.400396] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.403096] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.400186] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.400850] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.400752] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.403485] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.401035] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.403668] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.400763] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.401065] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.403539] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.403911] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.400770] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.403737] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.401454] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.404207] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.400820] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.403753] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.401637] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.404224] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.403782] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.400867] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.404253] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.401883] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.403798] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.402170] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.400914] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.404725] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.402187] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.404261] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.404909] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.400960] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.402217] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.404449] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.404924] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.401005] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.404479] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.402695] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.404953] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.401051] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.402878] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.405542] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.404935] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.402894] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.401097] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.405123] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.405553] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.402923] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.405152] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.401143] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.405559] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.403498] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.401189] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.405536] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.405604] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.403509] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.405720] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.401260] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.405652] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.403515] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.401305] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.405966] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.405700] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.406246] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.403558] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.401327] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.406263] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.405747] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.401348] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.403605] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.406292] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.401370] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.405794] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.403652] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.406755] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.401394] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.405840] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.403698] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.406940] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.401416] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.405888] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.406956] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.403743] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.401437] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.405934] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.406986] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.403789] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.401459] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.407576] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.405981] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.401481] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.403835] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.407587] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.406041] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.401503] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.403881] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.407593] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.406087] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.401525] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.403927] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.407637] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.406108] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.401548] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.403987] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.401569] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.406130] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.407684] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.401591] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.404033] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.406151] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.407732] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.401612] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.404054] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.406176] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.401634] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.407779] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.406198] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.404076] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.401655] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.407826] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.404098] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.406230] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.401677] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.404122] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.406252] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.407873] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.401698] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.406274] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.404143] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.401720] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.407920] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.404165] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.406296] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.401742] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.407966] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.401769] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.406318] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.404187] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.408013] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.401778] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.404209] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.406340] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.408074] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.401784] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.406362] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.404234] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.408122] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.406383] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.404257] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.408151] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.406404] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.404282] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.406425] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.408173] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.404304] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.406446] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.408194] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.404326] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.406468] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.404349] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.408218] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.406489] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.404370] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.408240] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.406511] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.404392] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.408262] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.458944] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.406533] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.404413] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.408284] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.459482] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 55239 usecs lb # [ 0.406560] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.404434] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.408306] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.406569] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.404456] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.408327] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.406573] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.404479] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.408350] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.407737] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.404504] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.408372] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.404514] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.408393] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.404519] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.408415] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.405688] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.408436] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.408457] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.408479] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.408500] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.408522] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.408544] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.408565] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.408591] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.468071] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58925 usecs client # [ 0.408600] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.408605] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.466035] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58938 usecs client # [ 0.409764] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.485774] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.488711] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.490796] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.488531] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.490725] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.486374] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.488555] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.481625] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.500320] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.502491] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.501769] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.503759] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.498481] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 0.500382] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.491734] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.513115] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.495987] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.497894] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.514804] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.510084] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.512031] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.519123] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.521259] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.520966] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.507683] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.510593] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.523263] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.531818] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.533688] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.522131] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.524276] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.526317] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.533489] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.522002] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.535756] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.528149] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.524955] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.527019] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.544021] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.538507] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.549920] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.546816] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.550276] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.536584] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.539106] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.556175] msm_serial: driver initialized worker2 # [ 0.556319] SuperH (H)SCI(F) driver initialized worker2 # [ 0.556373] STM32 USART driver initialized worker1 # [ 0.554595] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.557236] msm_serial: driver initialized worker1 # [ 0.557372] SuperH (H)SCI(F) driver initialized worker1 # [ 0.557425] STM32 USART driver initialized lb # [ 0.563190] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.565839] msm_serial: driver initialized lb # [ 0.565973] SuperH (H)SCI(F) driver initialized lb # [ 0.566028] STM32 USART driver initialized client # [ 0.560302] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.562868] msm_serial: driver initialized client # [ 0.563003] SuperH (H)SCI(F) driver initialized client # [ 0.563056] STM32 USART driver initialized worker2 # [ 0.587600] loop: module loaded worker2 # [ 0.587772] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.588459] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.587193] loop: module loaded worker1 # [ 0.587377] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.588135] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.598765] loop: module loaded lb # [ 0.598957] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.599680] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.594591] megasas: 07.734.00.00-rc1 worker1 # [ 0.595316] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.597502] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.599580] megasas: 07.734.00.00-rc1 worker1 # [ 0.597526] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.600305] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.602509] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.602567] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.604225] Using buffer write method lb # [ 0.604522] megasas: 07.734.00.00-rc1 worker2 # [ 0.604291] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.593999] loop: module loaded lb # [ 0.605209] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.594171] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.594877] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.605922] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.605945] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.606943] Using buffer write method worker1 # [ 0.607013] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.609409] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.609431] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.599683] megasas: 07.734.00.00-rc1 client # [ 0.600412] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.602271] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.602296] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.615996] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.616023] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.617708] Using buffer write method lb # [ 0.617770] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.625404] Using buffer write method worker2 # [ 0.625441] Concatenating MTD devices: worker2 # [ 0.625446] (0): "0.flash" worker2 # [ 0.625450] (1): "0.flash" worker2 # [ 0.625454] into device "0.flash" worker1 # [ 0.623028] Using buffer write method worker1 # [ 0.623067] Concatenating MTD devices: worker1 # [ 0.623071] (0): "0.flash" worker1 # [ 0.623075] (1): "0.flash" worker1 # [ 0.623079] into device "0.flash" client # [ 0.611915] Using buffer write method client # [ 0.611981] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.613579] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.628596] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.613607] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.628619] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.629945] Using buffer write method lb # [ 0.629970] Concatenating MTD devices: lb # [ 0.629974] (0): "0.flash" lb # [ 0.629978] (1): "0.flash" lb # [ 0.629982] into device "0.flash" client # [ 0.627159] Using buffer write method client # [ 0.627184] Concatenating MTD devices: client # [ 0.627188] (0): "0.flash" client # [ 0.627192] (1): "0.flash" client # [ 0.627195] into device "0.flash" worker2 # [ 0.856997] Freeing initrd memory: 26148K worker2 # [ 0.863124] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.866843] thunder_xcv, ver 1.0 worker1 # [ 0.858859] Freeing initrd memory: 26148K worker2 # [ 0.866889] thunder_bgx, ver 1.0 worker2 # [ 0.866914] nicpf, ver 1.0 client # [ 0.851525] Freeing initrd memory: 26160K worker1 # [ 0.864839] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.868657] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.868668] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.868692] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.869550] Freeing initrd memory: 26140K client # [ 0.857506] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.868700] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.868731] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.868737] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 0.868627] thunder_xcv, ver 1.0 worker2 # [ 0.868761] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.868671] thunder_bgx, ver 1.0 worker1 # [ 0.868694] nicpf, ver 1.0 worker2 # [ 0.868767] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.868917] sky2: driver version 1.30 worker1 # [ 0.869245] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.870529] usbcore: registered new interface driver usb-storage worker1 # [ 0.869253] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.875622] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.869279] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.861226] thunder_xcv, ver 1.0 worker2 # [ 0.870587] usbcore: registered new interface driver usbserial_generic client # [ 0.861273] thunder_bgx, ver 1.0 worker1 # [ 0.869288] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.861295] nicpf, ver 1.0 worker2 # [ 0.870605] usbserial: USB Serial support registered for generic worker1 # [ 0.869320] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.861846] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.871827] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.869326] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.861853] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.871859] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.861878] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.869351] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.872095] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.869357] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.861886] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.879453] thunder_xcv, ver 1.0 lb # [ 0.879498] thunder_bgx, ver 1.0 worker1 # [ 0.869488] sky2: driver version 1.30 client # [ 0.861916] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.879521] nicpf, ver 1.0 client # [ 0.861922] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.883028] hv_vmbus: registering driver hyperv_keyboard client # [ 0.861944] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.884353] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.861950] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.885394] hub 1-0:1.0: USB hub found client # [ 0.862087] sky2: driver version 1.30 worker1 # [ 0.878679] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.885941] hub 1-0:1.0: 6 ports detected worker1 # [ 0.878708] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.878973] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.870705] usbcore: registered new interface driver usb-storage lb # [ 0.881285] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.870784] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.887054] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.881294] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.881372] usbcore: registered new interface driver usb-storage client # [ 0.870798] usbserial: USB Serial support registered for generic lb # [ 0.881319] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.887080] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:27:28 UTC (1789982848) worker1 # [ 0.881477] usbcore: registered new interface driver usbserial_generic lb # [ 0.881328] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.887416] i2c_dev: i2c /dev entries driver worker1 # [ 0.881493] usbserial: USB Serial support registered for generic lb # [ 0.881356] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.873911] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.881362] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.873938] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.884304] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.881384] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.874143] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.881390] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.885760] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.881530] sky2: driver version 1.30 lb # [ 0.883183] usbcore: registered new interface driver usb-storage worker1 # [ 0.885786] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:27:28 UTC (1789982848) client # [ 0.876786] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.883257] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.887825] i2c_dev: i2c /dev entries driver worker2 # [ 0.892285] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.883272] usbserial: USB Serial support registered for generic client # [ 0.878311] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.892296] sdhci: Copyright(c) Pierre Ossman lb # [ 0.883864] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.884674] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.892567] Synopsys Designware Multimedia Card Interface Driver client # [ 0.878340] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:27:28 UTC (1789982848) client # [ 0.878629] i2c_dev: i2c /dev entries driver worker2 # [ 0.892952] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.884701] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.894585] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.884925] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.894840] usbcore: registered new interface driver usbhid worker2 # [ 0.894847] usbhid: USB HID core driver lb # [ 0.896513] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.896845] hub 1-0:1.0: USB hub found worker1 # [ 0.891023] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.896867] hub 1-0:1.0: 6 ports detected worker1 # [ 0.891032] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.891301] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.899080] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.891683] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.900425] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.893271] hid: raw HID events driver (C) Jiri Kosina client # [ 0.883481] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.901958] drop_monitor: Initializing network drop monitor service lb # [ 0.899109] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:27:28 UTC (1789982848) worker1 # [ 0.893522] usbcore: registered new interface driver usbhid client # [ 0.883491] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.902133] NET: Registered PF_INET6 protocol family lb # [ 0.899424] i2c_dev: i2c /dev entries driver worker1 # [ 0.893529] usbhid: USB HID core driver client # [ 0.883749] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.898370] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.905130] Segment Routing with IPv6 client # [ 0.884113] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.905163] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.899374] hub 1-0:1.0: USB hub found client # [ 0.885762] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.905192] NET: Registered PF_PACKET protocol family worker1 # [ 0.899842] hub 1-0:1.0: 6 ports detected client # [ 0.886025] usbcore: registered new interface driver usbhid client # [ 0.886031] usbhid: USB HID core driver worker2 # [ 0.906787] 9pnet: Installing 9P2000 support client # [ 0.891446] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.892494] hub 1-0:1.0: USB hub found worker1 # [ 0.901387] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.892996] hub 1-0:1.0: 6 ports detected lb # [ 0.904307] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.909644] Key type dns_resolver registered worker1 # [ 0.903999] drop_monitor: Initializing network drop monitor service lb # [ 0.904317] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.904131] NET: Registered PF_INET6 protocol family client # [ 0.893935] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.904587] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.906021] Segment Routing with IPv6 lb # [ 0.904956] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.906041] In-situ OAM (IOAM) with IPv6 client # [ 0.896522] drop_monitor: Initializing network drop monitor service lb # [ 0.906655] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.906070] NET: Registered PF_PACKET protocol family client # [ 0.896669] NET: Registered PF_INET6 protocol family lb # [ 0.906892] usbcore: registered new interface driver usbhid lb # [ 0.906898] usbhid: USB HID core driver client # [ 0.898500] Segment Routing with IPv6 client # [ 0.898519] In-situ OAM (IOAM) with IPv6 client # [ 0.898548] NET: Registered PF_PACKET protocol family worker1 # [ 0.907731] 9pnet: Installing 9P2000 support worker1 # [ 0.909786] Key type dns_resolver registered lb # [ 0.912531] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.914054] drop_monitor: Initializing network drop monitor service lb # [ 0.914233] NET: Registered PF_INET6 protocol family worker2 # [ 0.916035] registered taskstats version 1 client # [ 0.900216] 9pnet: Installing 9P2000 support worker2 # [ 0.916177] Loading compiled-in X.509 certificates client # [ 0.902325] Key type dns_resolver registered lb # [ 0.917244] Segment Routing with IPv6 lb # [ 0.917270] In-situ OAM (IOAM) with IPv6 lb # [ 0.917310] NET: Registered PF_PACKET protocol family lb # [ 0.918959] 9pnet: Installing 9P2000 support worker1 # [ 0.916616] registered taskstats version 1 worker1 # [ 0.916774] Loading compiled-in X.509 certificates worker2 # [ 0.924723] Demotion targets for Node 0: null worker2 # [ 0.924844] Key type .fscrypt registered worker2 # [ 0.924851] Key type fscrypt-provisioning registered lb # [ 0.921836] Key type dns_resolver registered worker2 # [ 0.924943] ima: No TPM chip found, activating TPM-bypass! client # [ 0.908977] registered taskstats version 1 worker2 # [ 0.924962] ima: Allocated hash algorithm: sha1 client # [ 0.909118] Loading compiled-in X.509 certificates worker2 # [ 0.924981] ima: No architecture policies found worker2 # [ 0.929015] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.925443] Demotion targets for Node 0: null worker1 # [ 0.925557] Key type .fscrypt registered worker1 # [ 0.925563] Key type fscrypt-provisioning registered worker1 # [ 0.925657] ima: No TPM chip found, activating TPM-bypass! client # [ 0.917749] Demotion targets for Node 0: null lb # [ 0.928280] registered taskstats version 1 client # [ 0.917857] Key type .fscrypt registered worker1 # [ 0.925676] ima: Allocated hash algorithm: sha1 lb # [ 0.928438] Loading compiled-in X.509 certificates worker1 # [ 0.925700] ima: No architecture policies found client # [ 0.917863] Key type fscrypt-provisioning registered client # [ 0.917958] ima: No TPM chip found, activating TPM-bypass! client # [ 0.917977] ima: Allocated hash algorithm: sha1 worker1 # [ 0.929826] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.917996] ima: No architecture policies found client # [ 0.921917] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.937010] Demotion targets for Node 0: null lb # [ 0.937114] Key type .fscrypt registered lb # [ 0.937121] Key type fscrypt-provisioning registered lb # [ 0.937219] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.937240] ima: Allocated hash algorithm: sha1 lb # [ 0.937261] ima: No architecture policies found lb # [ 0.941261] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.946567] clk: Disabling unused clocks worker2 # [ 0.946592] PM: genpd: Disabling unused power domains worker2 # [ 0.950751] Freeing unused kernel memory: 4736K worker2 # [ 0.951634] Run /init as init process worker1 # [ 0.947953] clk: Disabling unused clocks worker1 # [ 0.947983] PM: genpd: Disabling unused power domains client # [ 0.939291] clk: Disabling unused clocks client # [ 0.939317] PM: genpd: Disabling unused power domains worker1 # [ 0.952232] Freeing unused kernel memory: 4736K worker1 # [ 0.952438] Run /init as init process client # [ 0.943528] Freeing unused kernel memory: 4736K client # [ 0.943734] Run /init as init process lb # [ 0.959184] clk: Disabling unused clocks lb # [ 0.959220] PM: genpd: Disabling unused power domains worker2 # [ 0.965256] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.963513] Freeing unused kernel memory: 4736K lb # [ 0.963872] Run /init as init process worker1 # [ 0.968256] systemd[1]: Successfully made /usr/ read-only. client # [ 0.961402] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.978193] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.131018] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.144043] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.146005] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.139198] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.281015] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.296265] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.300018] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.298295] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.309799] systemd[1]: Detected virtualization qemu. worker2 # [ 1.311373] systemd[1]: Detected architecture arm64. client # [ 1.291613] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.312915] systemd[1]: Running in initrd. worker2 # [ 1.314966] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.317119] systemd[1]: Hostname set to . worker1 # [ 1.304463] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.304528] systemd[1]: Detected virtualization qemu. client # [ 1.297701] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.313013] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.304613] systemd[1]: Detected architecture arm64. client # [ 1.297757] systemd[1]: Detected virtualization qemu. lb # [ 1.325338] systemd[1]: Detected virtualization qemu. worker1 # [ 1.304638] systemd[1]: Running in initrd. client # [ 1.297829] systemd[1]: Detected architecture arm64. lb # [ 1.327326] systemd[1]: Detected architecture arm64. worker1 # [ 1.305622] systemd[1]: Initializing machine ID from random generator. client # [ 1.297852] systemd[1]: Running in initrd. lb # [ 1.329315] systemd[1]: Running in initrd. worker1 # [ 1.305908] systemd[1]: Hostname set to . client # [ 1.298758] systemd[1]: Initializing machine ID from random generator. lb # [ 1.331895] systemd[1]: Initializing machine ID from random generator. client # [ 1.299026] systemd[1]: Hostname set to . lb # [ 1.334921] systemd[1]: Hostname set to . worker2 # [ 1.367219] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.384258] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.379388] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.394174] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.487017] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.504011] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.499166] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.514015] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.593517] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.632285] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.641745] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.643906] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.635442] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.656227] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.663423] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.662001] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.673126] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.674180] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.675389] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.676316] systemd[1]: Reached target Path Units. worker2 # [ 1.677049] systemd[1]: Reached target Slice Units. worker2 # [ 1.677754] systemd[1]: Reached target Swaps. worker2 # [ 1.678468] systemd[1]: Reached target Timer Units. worker2 # [ 1.679417] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.659679] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.680468] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.681471] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.682341] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.673231] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.683344] systemd[1]: Listening on udev Kernel Socket. client # [ 1.664517] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.684123] systemd[1]: Reached target Socket Units. worker2 # [ 1.686257] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.682258] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.694578] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.695680] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.708215] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.721616] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.727077] systemd[1]: Starting Journal Service... worker2 # [ 1.729167] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.729934] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.742721] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.746539] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.759099] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.759928] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.756372] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.760216] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.760462] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.757586] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.759023] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.760091] systemd[1]: Reached target Path Units. client # [ 1.750442] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.760915] systemd[1]: Reached target Slice Units. worker1 # [ 1.761745] systemd[1]: Reached target Swaps. worker1 # [ 1.762644] systemd[1]: Reached target Timer Units. worker1 # [ 1.763647] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.764879] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.766044] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.767048] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.768079] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.769000] systemd[1]: Reached target Socket Units. client # [ 1.761501] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.771552] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.762702] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.778094] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.764130] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.775398] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.764167] systemd[1]: Reached target Path Units. client # [ 1.764187] systemd[1]: Reached target Slice Units. client # [ 1.764208] systemd[1]: Reached target Swaps. client # [ 1.764228] systemd[1]: Reached target Timer Units. client # [ 1.764415] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.764560] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.785818] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.764714] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.782091] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.764850] systemd[1]: Listening on udev Control Socket. lb # [ 1.786752] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.764969] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.787735] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.783243] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.764990] systemd[1]: Reached target Socket Units. lb # [ 1.788606] systemd[1]: Reached target Path Units. lb # [ 1.789295] systemd[1]: Reached target Slice Units. lb # [ 1.789925] systemd[1]: Reached target Swaps. client # [ 1.775888] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.790521] systemd[1]: Reached target Timer Units. worker1 # [ 1.786603] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.791291] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.792262] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.793137] systemd[1]: Listening on Journal Sockets. lb # [ 1.793894] systemd[1]: Listening on udev Control Socket. lb # [ 1.794699] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.795391] systemd[1]: Reached target Socket Units. worker2 # [ 1.798224] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.783277] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.797342] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.784422] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.798501] systemd[1]: Starting Journal Service... lb # [ 1.803836] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.791268] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.807418] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.813267] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.811432] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.819612] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.811552] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.823014] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.825307] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.821326] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.810060] systemd[1]: Starting Journal Service... worker1 # [ 1.828114] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.819743] systemd[1]: Starting Load Kernel Modules... client # [ 1.820615] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.836178] systemd[1]: Starting Journal Service... lb # [ 1.838342] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.838699] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.839126] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.827342] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.848161] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.850987] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.851004] [drm] features: -context_init worker2 # [ 1.851763] [drm] number of scanouts: 1 worker2 # [ 1.851783] [drm] number of cap sets: 0 worker1 # [ 1.846198] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.847118] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.847419] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.847646] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.847312] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.862508] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.848317] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.859741] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 1.863328] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.848598] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.859765] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 1.858455] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.872271] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.872764] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.859593] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.859849] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.880435] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.883639] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.884839] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.885737] systemd[1]: Reached target Local File Systems. worker1 # [ 1.891145] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.891185] Console: switching to colour frame buffer device 160x50 worker2 # [ 1.897786] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.901946] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.894348] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.890362] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.907421] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 1.904520] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.907313] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.916879] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.903798] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.908665] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.911081] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.927165] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.917990] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.922635] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 1.930468] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.922872] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.922882] [drm] features: -context_init worker1 # [ 1.923607] [drm] number of scanouts: 1 worker1 # [ 1.923625] [drm] number of cap sets: 0 lb # [ 1.932706] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.915267] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.934973] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.920006] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.920246] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.920256] [drm] features: -context_init client # [ 1.920988] [drm] number of scanouts: 1 client # [ 1.921011] [drm] number of cap sets: 0 lb # [ 1.937455] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.938384] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 1.944835] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.945081] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.938407] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.945091] [drm] features: -context_init lb # [ 1.945807] [drm] number of scanouts: 1 lb # [ 1.945825] [drm] number of cap sets: 0 client # [ 1.939578] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.939599] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.960445] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 1.960468] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 1.966371] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.966731] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.966761] systemd[1]: Reached target Local File Systems. worker1 # [ 1.974390] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.987674] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.990666] systemd[1]: Started Journal Service. worker1 # [ 1.982177] Console: switching to colour frame buffer device 160x50 worker1 # [ 1.988649] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 1.981739] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.984413] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 1.981934] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.996633] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.981956] systemd[1]: Reached target Local File Systems. lb # [ 1.996831] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.996859] systemd[1]: Reached target Local File Systems. worker2 # [ 1.988292] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 1.985857] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.989387] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 1.990454] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 1.991422] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.000826] Console: switching to colour frame buffer device 160x50 lb # [ 2.007505] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 2.010932] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.998851] Console: switching to colour frame buffer device 160x50 client # [ 2.001641] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.014670] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.009593] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.010994] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker1 # [ 2.022302] systemd[1]: Starting Apply Kernel Variables... client # [ 2.019402] systemd[1]: Finished Load Kernel Modules. client # [ 2.022513] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.029350] systemd[1]: Finished Create System Files and Directories. lb # [ 2.044217] systemd[1]: Finished Load Kernel Modules. lb # [ 2.047585] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.046716] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.077664] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.080624] systemd[1]: Started Journal Service. worker1 # [ 2.068506] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.078543] systemd[1]: Finished Apply Kernel Variables. client # [ 2.065977] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.082138] systemd[1]: Started Journal Service. lb # [ 2.096633] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.076462] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.077587] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.078647] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.079678] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.076123] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.080313] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.082402] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.089909] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.093530] systemd-udevd[79]: Using default interface naming scheme 'v261'. client # [ 2.088323] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.117320] systemd[1]: Started Journal Service. client # [ 2.091442] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.108112] systemd[1]: Starting Virtual Console Setup... client # [ 2.094529] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.108389] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.112401] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.113532] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.114601] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.115603] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.122694] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 2.125230] systemd[1]: Finished Create System Files and Directories. lb # [ 2.133008] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.127521] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.125648] systemd[1]: Finished Create System Files and Directories. client # [ 2.136459] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.156500] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.153688] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.159951] systemd[1]: Finished Virtual Console Setup. lb # [ 2.164947] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.196238] systemd[1]: Starting Virtual Console Setup... client # [ 2.192120] systemd[1]: Starting Virtual Console Setup... lb # [ 2.217604] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.240503] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.244033] systemd[1]: Finished Virtual Console Setup. client # [ 2.244496] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.247785] systemd[1]: Finished Virtual Console Setup. lb # [ 2.268479] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.271761] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.768795] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.769743] systemd[1]: Reached target System Initialization. worker2 # [ 2.770575] systemd[1]: Reached target Basic System. client # [ 2.840346] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.841579] systemd[1]: Reached target System Initialization. client # [ 2.844516] systemd[1]: Reached target Basic System. worker1 # [ 2.851597] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.852715] systemd[1]: Reached target System Initialization. worker1 # [ 2.853557] systemd[1]: Reached target Basic System. lb # [ 2.884658] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.886430] systemd[1]: Reached target System Initialization. lb # [ 2.888661] systemd[1]: Reached target Basic System. worker2 # [ 2.908225] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.943822] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.951593] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.979950] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.000158] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.002178] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.005038] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.999906] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.016420] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.020552] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.029826] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.039196] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.027688] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.053068] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.055310] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.061121] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.060527] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.068308] systemd[1]: Mounting /sysroot... worker1 # [ 3.084919] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.087459] systemd[1]: Reached target Initrd Root Device. client # [ 3.082382] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.085047] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.092279] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.115292] EXT4-fs (vda): mounted filesystem 4679f22f-08ba-435b-9f4a-daa35ddbe0e5 r/w with ordered data mode. Quota mode: none. client # [ 3.088574] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.106218] systemd[1]: Mounted /sysroot. worker2 # [ 3.108638] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.110931] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.120177] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.122388] systemd[1]: Reached target Initrd Root Device. lb # [ 3.126107] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.135770] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.140440] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.144825] systemd[1]: Reloading... worker1 # [ 3.141839] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.141042] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.148695] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.145786] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.153500] systemd[1]: Mounting /sysroot... client # [ 3.151863] systemd[1]: Mounting /sysroot... lb # [ 3.176633] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.182745] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.196207] systemd[1]: Mounting /sysroot... worker1 # [ 3.206292] EXT4-fs (vda): mounted filesystem d8719de8-9303-447a-92f1-443ba59ec9e6 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.194603] systemd[1]: Mounted /sysroot. worker1 # [ 3.197501] systemd[1]: Reached target Initrd Root File System. client # [ 3.208754] EXT4-fs (vda): mounted filesystem fa70b7c7-7f78-4bc7-8d21-bd9d2ca7957e r/w with ordered data mode. Quota mode: none. worker1 # [ 3.204108] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.198222] systemd[1]: Mounted /sysroot. client # [ 3.199277] systemd[1]: Reached target Initrd Root File System. client # [ 3.208160] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.236360] EXT4-fs (vda): mounted filesystem 3ce0c967-ba8e-44be-822a-4cd33d5382f1 r/w with ordered data mode. Quota mode: none. lb # [ 3.226117] systemd[1]: Mounted /sysroot. lb # [ 3.228083] systemd[1]: Reached target Initrd Root File System. lb # [ 3.229335] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.228368] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.234391] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.239034] systemd[1]: Reloading... client # [ 3.232207] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.238003] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.240680] systemd[1]: Reloading... lb # [ 3.255590] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.262140] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.266780] systemd[1]: Reloading... worker2 # [ 3.355309] systemd[1]: Reloading finished in 211 ms. worker2 # [ 3.373755] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.377912] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... worker2 # [ 3.385246] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.388951] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.391601] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.394498] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.416094] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.417732] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.448111] systemd[1]: Reloading finished in 210 ms. client # [ 3.444179] systemd[1]: Reloading finished in 204 ms. lb # [ 3.472101] systemd[1]: Reloading finished in 206 ms. worker1 # [ 3.480755] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... client # [ 3.478309] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.486916] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... client # [ 3.480960] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.497399] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.491634] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.492109] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.493091] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.499985] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.508326] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.503285] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.509313] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.497955] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.498967] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.506110] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.520548] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.525572] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.519730] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.527014] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.533568] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.521291] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.534605] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.540800] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.543383] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.744771] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.757519] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.771261] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.797466] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.822479] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.833562] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.827456] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.837700] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.839906] systemd[1]: Mounted /sysroot/run. client # [ 3.829310] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.840119] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.850489] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.847080] systemd[1]: Mounting /sysroot/run... client # [ 3.847417] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.864811] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.851685] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.861928] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.867970] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.872109] systemd[1]: Mounting /sysroot/run... client # [ 3.865573] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.882829] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.890207] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.891964] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.888461] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.899658] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.901078] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.890041] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.915074] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.940982] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.931540] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.942165] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.943901] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.946509] systemd[1]: Mounted /sysroot/run. client # [ 3.941096] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.951727] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.959526] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.965229] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.958506] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.974259] systemd[1]: Mounted /sysroot/run. client # [ 3.963907] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.970865] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.981998] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.972164] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.986879] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.974971] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.999010] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.992388] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.993751] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.001926] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.003328] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.021497] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.022866] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.269090] (udev-worker)[95]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker2 # [ 4.276176] (udev-worker)[95]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.303317] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.305090] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.308324] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.309138] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.322257] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.323367] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.325739] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.346883] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.350519] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.358718] (udev-worker)[105]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.372295] (udev-worker)[105]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.369389] (udev-worker)[99]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.377652] (udev-worker)[99]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory lb # [ 4.397376] (udev-worker)[100]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.394059] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.397242] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.402325] (udev-worker)[100]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.399740] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.404235] systemd[1]: Starting Virtual Console Setup... client # [ 4.400791] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.403016] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.410739] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.412427] systemd[1]: Stopped Virtual Console Setup. client # [ 4.407894] systemd[1]: Stopping Virtual Console Setup... client # [ 4.410251] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.419352] systemd[1]: Starting Virtual Console Setup... lb # [ 4.428202] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.431184] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.432600] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.436447] systemd[1]: Starting Virtual Console Setup... client # [ 4.424386] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.426239] systemd[1]: Stopped Virtual Console Setup. client # [ 4.429410] systemd[1]: Starting Virtual Console Setup... lb # [ 4.445301] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.448164] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.451829] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.449128] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.452530] systemd[1]: Finished Virtual Console Setup. client # [ 4.456529] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.459857] systemd[1]: Finished Virtual Console Setup. lb # [ 4.480457] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.483676] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.747598] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.814244] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.817512] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.824140] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.829946] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.830838] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.832494] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.851587] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.868836] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.870932] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.883770] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.886612] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.891821] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.889867] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.895641] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.907272] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.908547] systemd[1]: Stopped target Basic System. worker1 # [ 4.898751] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.912426] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.913315] systemd[1]: Stopped target Path Units. worker2 # [ 4.914021] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.897887] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.915592] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.901254] systemd[1]: Reached target Initrd File Systems. lb # [ 4.915649] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.920278] systemd[1]: Stopped target Slice Units. worker2 # [ 4.921009] systemd[1]: Stopped target Socket Units. worker2 # [ 4.921702] systemd[1]: Stopped target System Initialization. worker2 # [ 4.922510] systemd[1]: Stopped target Swaps. worker2 # [ 4.923137] systemd[1]: Stopped target Timer Units. worker1 # [ 4.912506] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.923836] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.920411] systemd[1]: Reached target Initrd File Systems. client # [ 4.908153] systemd[1]: Starting Find NixOS closure... lb # [ 4.923088] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.928406] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.929267] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.913435] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.931742] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.934284] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 4.935518] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.938752] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.936629] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.950652] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.952749] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.957780] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.962760] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.956599] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.969013] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.955332] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.972312] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.973946] systemd[1]: Stopped Create System Files and Directories. client # [ 4.957573] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.964317] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.975903] systemd[1]: Stopped target Local File Systems. lb # [ 4.974475] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.978934] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.981138] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 4.983705] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.968480] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.975125] systemd[1]: Finished Find NixOS closure. lb # [ 4.980340] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.985499] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 4.971036] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.978013] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.988243] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.979685] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.991524] systemd[1]: Stopped Virtual Console Setup. client # [ 4.976306] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.992740] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.989185] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.993742] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.994699] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 4.995663] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 4.992197] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.996658] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.997626] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.994169] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.998438] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.999332] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.004244] systemd[1]: systemd-udevd.service: Consumed 1.386s CPU time over 3.093s wall clock time, 22.5M memory peak. worker2 # [ 5.008305] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 5.009502] systemd[1]: Closed udev Control Socket. worker2 # [ 5.010400] systemd[1]: Starting Cleanup udev Database... client # [ 4.995053] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 5.012218] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 4.996821] systemd[1]: Stopped target Basic System. worker1 # [ 5.005115] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.006410] systemd[1]: Stopped target Basic System. worker2 # [ 5.016142] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.000438] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.017161] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.001266] systemd[1]: Stopped target Path Units. worker1 # [ 5.008306] systemd[1]: Stopped target Initrd Root Device. client # [ 5.002047] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.009745] systemd[1]: Stopped target Path Units. worker2 # [ 5.020139] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.003683] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.021143] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.012263] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.006287] systemd[1]: Stopped target Slice Units. lb # [ 5.019020] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.013840] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.024288] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.008168] systemd[1]: Stopped target Socket Units. lb # [ 5.021632] systemd[1]: Stopped target Basic System. client # [ 5.009201] systemd[1]: Stopped target System Initialization. worker1 # [ 5.016146] systemd[1]: Stopped target Slice Units. lb # [ 5.023018] systemd[1]: Stopped target Initrd Root Device. client # [ 5.012136] systemd[1]: Stopped target Swaps. client # [ 5.012832] systemd[1]: Stopped target Timer Units. worker1 # [ 5.020157] systemd[1]: Stopped target Socket Units. client # [ 5.013744] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.020966] systemd[1]: Stopped target System Initialization. worker1 # [ 5.021796] systemd[1]: Stopped target Swaps. worker1 # [ 5.022442] systemd[1]: Stopped target Timer Units. lb # [ 5.028486] systemd[1]: Stopped target Path Units. client # [ 5.016924] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.023848] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.029479] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 5.030902] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.026379] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.033081] systemd[1]: Stopped target Slice Units. worker1 # [ 5.027246] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.020383] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.035370] systemd[1]: Stopped target Socket Units. client # [ 5.027172] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.034007] systemd[1]: Stopped Find NixOS closure. lb # [ 5.040240] systemd[1]: Stopped target System Initialization. worker1 # [ 5.034748] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.041255] systemd[1]: Stopped target Swaps. worker1 # [ 5.035619] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.042042] systemd[1]: Stopped target Timer Units. lb # [ 5.042896] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.030456] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.043854] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 5.049768] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.034131] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 5.050912] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.042593] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.035906] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.043578] systemd[1]: Stopped Apply Kernel Variables. lb # [ 5.050030] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.039253] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.056576] systemd[1]: Reached target Switch Root. worker2 # [ 5.057352] systemd[1]: Starting NixOS Activation... lb # [ 5.054329] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.048256] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.049292] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.049997] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 5.056009] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.051090] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 5.060292] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.048242] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.051132] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.064174] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.058313] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.059446] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.066287] systemd[1]: Stopped Apply Kernel Variables. lb # [ 5.067158] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.057904] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 5.071378] systemd[1]: Stopped Load Kernel Modules. client # [ 5.060334] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.062330] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.071519] systemd[1]: Stopped target Local File Systems. client # [ 5.065532] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.078931] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.066701] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.074718] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.069237] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.075842] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 5.070502] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.085772] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.081921] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.075885] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.082786] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.076922] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.090158] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.077969] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.078960] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.092394] systemd[1]: Stopped Create System Files and Directories. client # [ 5.079669] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.086643] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.087726] systemd[1]: Stopped Virtual Console Setup. client # [ 5.080991] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.094293] systemd[1]: Stopped target Local File Systems. client # [ 5.081928] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.089586] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.082851] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.083845] systemd[1]: systemd-udevd.service: Consumed 1.409s CPU time over 3.084s wall clock time, 22.3M memory peak. worker1 # [ 5.091452] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.085406] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.098736] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.086413] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.093514] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.087250] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.100545] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.094719] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.095743] systemd[1]: systemd-udevd.service: Consumed 1.386s CPU time over 3.112s wall clock time, 22.4M memory peak. worker1 # [ 5.097512] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.098516] systemd[1]: Closed udev Control Socket. lb # [ 5.104415] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.099281] systemd[1]: Starting Cleanup udev Database... lb # [ 5.105312] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.106361] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 5.108676] systemd[1]: Stopped Virtual Console Setup. client # [ 5.096198] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.097081] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.110039] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.103987] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.098379] systemd[1]: Closed udev Control Socket. client # [ 5.099107] systemd[1]: Starting Cleanup udev Database... lb # [ 5.112219] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.100199] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.108228] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.114339] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.109343] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.115387] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.110632] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.104159] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.116539] systemd[1]: systemd-udevd.service: Consumed 1.392s CPU time over 3.092s wall clock time, 22.5M memory peak. client # [ 5.105041] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.117933] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.118941] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.106172] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.119757] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.116171] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.117230] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.118100] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.119087] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.112307] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.113315] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.128324] systemd[1]: Closed udev Control Socket. lb # [ 5.129086] systemd[1]: Starting Cleanup udev Database... lb # [ 5.130120] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.124414] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.125467] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.132195] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.136186] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.137322] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.138320] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 5.140188] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.144352] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.145367] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.134511] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.137707] systemd[1]: Finished Cleanup udev Database. client # [ 5.139011] systemd[1]: Reached target Switch Root. client # [ 5.140351] systemd[1]: Starting NixOS Activation... worker1 # [ 5.147377] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.150455] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.151231] systemd[1]: Reached target Switch Root. worker1 # [ 5.152877] systemd[1]: Starting NixOS Activation... lb # [ 5.169756] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.172536] systemd[1]: Finished Cleanup udev Database. lb # [ 5.173352] systemd[1]: Reached target Switch Root. lb # [ 5.176600] systemd[1]: Starting NixOS Activation... worker2 # [ 5.220284] initrd-nixos-activation-start[180]: booting system configuration /nix/store/w0djksilfhz0x4sfhpdpmkf3iy7y39rh-nixos-system-worker2-test worker2 # [ 5.282519] initrd-nixos-activation-start[180]: running activation script... client # [ 5.306339] initrd-nixos-activation-start[181]: booting system configuration /nix/store/1riwj2yl1fyad56y7izqz2z8iyxylapg-nixos-system-client-test worker1 # [ 5.319064] initrd-nixos-activation-start[181]: booting system configuration /nix/store/v0lyrrn8c44dmsycpizv4zk1h70zydxf-nixos-system-worker1-test lb # [ 5.337596] initrd-nixos-activation-start[182]: booting system configuration /nix/store/sy3pchz5vg22ylc3whvkp4s8qngi8wmd-nixos-system-lb-test client # [ 5.370051] initrd-nixos-activation-start[181]: running activation script... worker1 # [ 5.384493] initrd-nixos-activation-start[181]: running activation script... lb # [ 5.400366] initrd-nixos-activation-start[182]: running activation script... worker2 # [ 5.679084] initrd-nixos-activation-start[203]: setting up /etc... client # [ 5.781287] initrd-nixos-activation-start[204]: setting up /etc... worker1 # [ 5.800170] initrd-nixos-activation-start[204]: setting up /etc... lb # [ 5.810868] initrd-nixos-activation-start[205]: setting up /etc... worker2 # [ 5.927361] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.930259] systemd[1]: Finished NixOS Activation. worker2 # [ 5.931361] systemd[1]: Starting Switch Root... worker2 # [ 5.955584] systemd[1]: Switching root. client # [ 6.033240] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.035987] systemd[1]: Finished NixOS Activation. client # [ 6.040205] systemd[1]: Starting Switch Root... client # [ 6.059873] systemd[1]: Switching root. worker1 # [ 6.068718] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.071497] systemd[1]: Finished NixOS Activation. lb # [ 6.078290] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.072787] systemd[1]: Starting Switch Root... lb # [ 6.081072] systemd[1]: Finished NixOS Activation. lb # [ 6.082234] systemd[1]: Starting Switch Root... worker1 # [ 6.095622] systemd[1]: Switching root. lb # [ 6.103635] systemd[1]: Switching root. worker2 # [ 6.132924] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.250707] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.286748] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.300175] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.687273] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.699285] systemd[1]: Detected virtualization qemu. worker2 # [ 6.702175] systemd[1]: Detected architecture arm64. worker2 # [ 6.705875] systemd[1]: Detected first boot. worker2 # [ 6.712867] systemd[1]: Initializing machine ID from random generator. client # [ 6.851414] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.859454] systemd[1]: Detected virtualization qemu. client # [ 6.861577] systemd[1]: Detected architecture arm64. client # [ 6.864523] systemd[1]: Detected first boot. client # [ 6.869795] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.876189] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.889414] systemd[1]: Detected virtualization qemu. worker1 # [ 6.892373] systemd[1]: Detected architecture arm64. worker1 # [ 6.894689] systemd[1]: Detected first boot. lb # [ 6.888641] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.901499] systemd[1]: Detected virtualization qemu. lb # [ 6.901606] systemd[1]: Detected architecture arm64. lb # [ 6.901819] systemd[1]: Detected first boot. worker1 # [ 6.901985] systemd[1]: Initializing machine ID from random generator. lb # [ 6.914114] systemd[1]: Initializing machine ID from random generator. worker2 # [ 7.041294] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.165746] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 7.219330] systemd[1]: Applying preset policy. worker1 # [ 7.219198] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.226013] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.353615] systemd[1]: Applying preset policy. worker1 # [ 7.365605] systemd[1]: Applying preset policy. lb # [ 7.390919] systemd[1]: Applying preset policy. worker2 # [ 7.703191] systemd[1]: Populated /etc with preset unit settings. client # [ 7.803401] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.820823] systemd[1]: Populated /etc with preset unit settings. lb # [ 7.868769] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 8.190702] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.192279] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.193679] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.198028] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.199792] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.201495] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.203595] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.205680] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.207452] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 8.209164] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.211004] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.212681] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 8.214471] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.216378] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 8.218452] systemd[1]: Reached target Path Units. worker2 # [ 8.220154] systemd[1]: Reached target Remote File Systems. worker2 # [ 8.221862] systemd[1]: Reached target Slice Units. worker2 # [ 8.223534] systemd[1]: Reached target Swaps. worker2 # [ 8.227151] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.231586] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 8.235188] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.239100] systemd[1]: Listening on Factory Reset Management. worker2 # [ 8.241315] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 8.247432] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 8.249866] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 8.254274] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 8.256832] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 8.259502] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.262067] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.273724] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 8.275158] systemd[1]: Listening on udev Control Socket. worker2 # [ 8.276753] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.281206] systemd[1]: Mounting Huge Pages File System... client # [ 8.266326] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.267890] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.269288] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.285393] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.273888] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.290153] systemd[1]: Mounting Kernel Debug File System... client # [ 8.275940] systemd[1]: Created slice User and Session Slice. client # [ 8.278041] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.280415] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.282561] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.299860] systemd[1]: Mounting Kernel Trace File System... client # [ 8.284482] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.286312] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.288307] systemd[1]: Stopped target initrd-fs.target. client # [ 8.290193] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.292173] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.294082] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.296132] systemd[1]: Reached target Path Units. client # [ 8.297878] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.310338] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.299830] systemd[1]: Reached target Slice Units. worker2 # [ 8.314857] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.311638] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.302020] systemd[1]: Reached target Swaps. worker1 # [ 8.315211] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.306065] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.323263] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 8.323622] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.319071] systemd[1]: Created slice Slice /system/getty. client # [ 8.311143] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.321553] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.323534] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.315283] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 8.325447] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.327347] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 8.329107] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.319389] systemd[1]: Listening on Factory Reset Management. worker2 # [ 8.336141] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 8.331074] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.321610] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.332213] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.333433] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 8.339591] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.334813] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.326837] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.336563] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.338523] systemd[1]: Reached target Path Units. worker2 # [ 8.343357] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.339499] systemd[1]: Reached target Remote File Systems. client # [ 8.329570] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.340882] systemd[1]: Reached target Slice Units. worker1 # [ 8.342981] systemd[1]: Reached target Swaps. client # [ 8.333640] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.335960] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.346739] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.338253] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.351322] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.341110] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.359559] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.355109] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 8.358825] systemd[1]: Listening on Factory Reset Management. worker2 # [ 8.364103] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.360059] systemd[1]: Listening on Hostname Service Socket. client # [ 8.351951] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.353296] systemd[1]: Listening on udev Control Socket. client # [ 8.354970] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.365565] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.367780] systemd[1]: Listening on Journal Audit Socket. client # [ 8.359297] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.371921] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.363370] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 8.374608] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 8.382429] systemd[1]: Starting Journal Service... worker1 # [ 8.377189] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.379788] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.387324] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.372917] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.388952] systemd[1]: Stopped initrd-switch-root.service. lb # [ 8.390866] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 8.395783] systemd[1]: Created slice Slice /system/getty. worker1 # [ 8.391113] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.393446] systemd[1]: Listening on udev Control Socket. lb # [ 8.397635] systemd[1]: Created slice User and Session Slice. client # [ 8.384357] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.399631] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.395658] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.400910] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 8.402734] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.404297] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.400599] systemd[1]: Mounting Huge Pages File System... lb # [ 8.406726] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.407848] systemd[1]: Stopped target initrd-fs.target. client # [ 8.395425] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.405728] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.409412] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.411079] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 8.412867] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.414621] systemd[1]: Reached target Path Units. worker1 # [ 8.410436] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.416023] systemd[1]: Reached target Remote File Systems. lb # [ 8.417442] systemd[1]: Reached target Slice Units. lb # [ 8.418859] systemd[1]: Reached target Swaps. client # [ 8.408120] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.423247] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.409437] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.422298] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.428172] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.432100] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 8.435885] systemd[1]: Listening on Factory Reset Management. lb # [ 8.437150] systemd[1]: Listening on Hostname Service Socket. client # [ 8.426190] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.442693] systemd[1]: Starting Journal Log Access Socket... client # [ 8.428364] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.438281] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.444856] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 8.449913] systemd[1]: Starting Load Kernel Modules... client # [ 8.434083] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.449390] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.451096] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.449491] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.452933] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.455701] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 8.451909] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.466413] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.467742] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.463963] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.469324] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.472743] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 8.467531] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.473630] systemd[1]: Mounting Huge Pages File System... client # [ 8.460995] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.470847] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.477767] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.466659] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 8.489022] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 8.492097] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.486120] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.486577] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.495004] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.500110] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 8.503517] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.508102] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.509655] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.515261] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.517562] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 8.512644] systemd[1]: Starting Journal Service... worker2 # [ 8.519934] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.522985] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 8.525257] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.525042] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.526613] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.522699] systemd[1]: Starting Journal Service... lb # [ 8.541911] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.543871] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.548666] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.560659] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 8.559119] systemd[1]: Starting Load Kernel Modules... client # [ 8.553441] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.570056] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 8.577367] fuse: init (API version 7.45) worker1 # [ 8.587031] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 8.591834] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.593269] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.592107] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 8.610104] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.618900] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.615279] systemd[1]: Listening on Journal Log Access Socket. client # [ 8.607976] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 8.623182] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.626290] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 8.621800] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.629274] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.613946] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.624065] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 8.624520] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 8.624910] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 8.625290] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 8.645684] systemd[1]: Finished Load Kernel Modules. worker2 # [ 8.651460] systemd[1]: Starting Firewall... lb # [ 8.648842] systemd[1]: Starting Journal Service... client # [ 8.636215] systemd[1]: Starting Coldplug All udev Devices... client # [ 8.643528] systemd-journald[275]: Collecting audit messages is enabled. worker2 # [ 8.663529] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.675169] EXT4-fs (vda): re-mounted 4679f22f-08ba-435b-9f4a-daa35ddbe0e5. client # [ 8.645198] systemd[1]: Queued start job for default target Multi-User System. lb # [ 8.672932] systemd[1]: Starting Load Kernel Modules... client # [ 8.647864] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 8.674723] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 8.689556] fuse: init (API version 7.45) worker1 # [ 8.684431] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 8.677707] systemd[1]: Started Journal Service. client # [ 8.664847] systemd-modules-load[276]: Module 'atkbd' is built in worker2 # [ 8.703715] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 8.674408] systemd-modules-load[276]: Module 'loop' is built in client # [ 8.675477] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.706142] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 8.678253] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.708538] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.684228] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.714611] fuse: init (API version 7.45) worker2 # [ 8.717824] systemd[1]: Starting Load/Save OS Random Seed... client # [ 8.688381] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.720345] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.724158] systemd-journald[274]: Collecting audit messages is enabled. lb # [ 8.723656] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 8.695217] systemd[1]: Mounted Kernel Trace File System. client # [ 8.702632] systemd[1]: Finished Create List of Static Device Nodes. client # [ 8.705948] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 8.711135] systemd[1]: Finished Load Kernel Module 9pnet_virtio.[ 8.728305] EXT4-fs (vda): re-mounted fa70b7c7-7f78-4bc7-8d21-bd9d2ca7957e. lb # [ 8.742630] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.747103] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 8.740913] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.746398] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # worker2 # [ 8.749915] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 8.743917] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.720643] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.721580] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.722482] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.723222] systemd[1]: Finished Load Kernel Modules. worker1 # [ 8.746751] EXT4-fs (vda): re-mounted d8719de8-9303-447a-92f1-443ba59ec9e6. worker1 # [ 8.753884] systemd[1]: Finished Load Kernel Modules. client # [ 8.735196] systemd[1]: Mounting FUSE Control File System... lb # [ 8.764819] systemd-journald[276]: Collecting audit messages is enabled. worker2 # [ 8.769867] systemd[1]: Started Journal Service. worker1 # [ 8.766864] systemd[1]: Starting Firewall... lb # [ 8.759239] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.763368] systemd[1]: Queued start job for default target Multi-User System. lb # [ 8.779498] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 8.772111] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.767871] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 8.782990] systemd[1]: Starting Apply Kernel Variables... client # [ 8.759725] systemd[1]: Starting Apply Kernel Variables... lb # [ 8.791669] systemd[1]: Started Journal Service. worker2 # [ 8.781510] systemd-modules-load[275]: Module 'atkbd' is built in lb # [ 8.778222] systemd-modules-load[277]: Module 'atkbd' is built in client # [ 8.765250] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 8.786650] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 8.787304] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.787606] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 8.782153] systemd-modules-load[277]: Module 'loop' is built in worker1 # [ 8.802771] systemd[1]: Starting Load/Save OS Random Seed... client # [ 8.781226] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.797735] systemd-modules-load[275]: Module 'loop' is built in worker1 # [ 8.805292] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.787925] systemd-oomd[278]: No swap; memory pressure usage will be degraded lb # [ 8.803417] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.815053] systemd-journald[275]: Collecting audit messages is enabled. worker2 # [ 8.808109] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.805426] systemd[1]: Mounted Huge Pages File System. client # [ 8.795919] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 8.809611] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.800171] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.814317] systemd-oomd[276]: No swap; memory pressure usage will be degraded lb # [ 8.817931] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.823216] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 8.831752] fuse: init (API version 7.45) lb # [ 8.820792] systemd[1]: Mounted Kernel Trace File System. client # [ 8.811896] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.826677] systemd[1]: Finished Create List of Static Device Nodes. client # [ 8.814384] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 8.831851] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.840308] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.830261] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 8.843277] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.846962] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.836284] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.867711] EXT4-fs (vda): re-mounted 3ce0c967-ba8e-44be-822a-4cd33d5382f1. worker1 # [ 8.848706] systemd[1]: Queued start job for default target Multi-User System. lb # [ 8.854930] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 8.867760] systemd[1]: Started Journal Service. lb # [ 8.858037] systemd[1]: Finished Load Kernel Modules. worker2 # [ 8.863971] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 8.855588] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.866898] systemd[1]: Reached target First Boot Complete. worker2 # [ 8.868687] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.871529] systemd[1]: Mounting FUSE Control File System... lb # [ 8.874754] systemd[1]: Starting Firewall... worker1 # [ 8.869251] systemd-modules-load[276]: Module 'atkbd' is built in worker2 # [ 8.887105] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 8.905454] systemd-journald[274]: Received client request to flush runtime journal. lb # [ 8.891766] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 8.890350] systemd-modules-load[276]: Module 'loop' is built in worker1 # [ 8.895962] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.906289] systemd-oomd[279]: No swap; memory pressure usage will be degraded worker1 # [ 8.905120] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.911380] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.922670] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 8.910178] systemd[1]: Mounted FUSE Control File System. worker1 # [ 8.918797] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.930156] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 8.925377] systemd-oomd[277]: No swap; memory pressure usage will be degraded client # [ 8.923063] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.940136] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.936347] systemd[1]: Finished Load/Save OS Random Seed. client # [ 8.951109] systemd-journald[275]: Received client request to flush runtime journal. worker1 # [ 8.943339] systemd[1]: Reached target First Boot Complete. worker2 # [ 8.958394] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 8.958122] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.959653] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 8.955004] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.973223] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.999413] systemd-journald[275]: Received client request to flush runtime journal. lb # [ 8.990982] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 8.997006] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.988830] systemd[1]: Finished Load/Save OS Random Seed. client # [ 8.989775] systemd[1]: Reached target First Boot Complete. client # [ 8.990557] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 8.991526] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 9.000920] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 9.031152] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.032899] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 9.035608] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.044762] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.068540] systemd-journald[276]: Received client request to flush runtime journal. worker1 # [ 9.050287] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 9.058026] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.068300] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.074398] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.075414] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.077751] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.133923] systemd[1]: Mounted FUSE Control File System. lb # [ 9.144193] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.146488] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 9.144183] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 9.150474] systemd[1]: Reached target First Boot Complete. worker1 # [ 9.146220] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 9.157003] systemd-udevd[313]: Using default interface naming scheme 'v261'. worker1 # [ 9.148971] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.153669] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.166761] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.177238] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 9.183425] systemd[1]: Mounting /run/wrappers... worker2 # [ 9.192367] systemd[1]: Mounting FUSE Control File System... client # [ 9.182915] systemd-udevd[307]: Using default interface naming scheme 'v261'. worker2 # [ 9.222611] systemd[1]: Mounted FUSE Control File System. worker2 # [ 9.260379] systemd[1]: Mounted /run/wrappers. worker2 # [ 9.263074] systemd[1]: Reached target Local File Systems. worker2 # [ 9.268670] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.256084] systemd[1]: Mounting /run/wrappers... lb # [ 9.269403] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.274208] systemd[1]: Starting register-nix-paths.service... lb # [ 9.272897] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 9.267674] systemd-udevd[316]: Using default interface naming scheme 'v261'. worker2 # [ 9.284424] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.281013] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 9.290745] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 9.304914] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.299012] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.304698] systemd[1]: Mounting FUSE Control File System... worker2 # [ 9.310767] systemd[1]: Starting Create System Files and Directories... client # [ 9.309879] systemd[1]: Mounted /run/wrappers. client # [ 9.311886] systemd[1]: Reached target Local File Systems. client # [ 9.316202] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.320212] systemd[1]: Starting register-nix-paths.service... client # [ 9.324079] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.325946] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.351989] systemd[1]: Mounted FUSE Control File System. client # [ 9.352475] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 9.362607] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.370913] systemd[1]: Mounted /run/wrappers. worker1 # [ 9.372373] systemd[1]: Reached target Local File Systems. lb # [ 9.384873] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.380594] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.383567] systemd[1]: Starting register-nix-paths.service... client # [ 9.379546] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 9.388149] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 9.400097] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 9.406967] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.398032] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 9.405900] systemd-udevd[319]: Using default interface naming scheme 'v261'. worker1 # [ 9.412588] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.415733] systemd[1]: Starting Create System Files and Directories... lb # [ 9.441106] systemd[1]: Mounted /run/wrappers. lb # [ 9.443998] systemd[1]: Reached target Local File Systems. lb # [ 9.452279] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.458284] systemd[1]: Starting register-nix-paths.service... worker2 # [ 9.464946] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.462604] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.466488] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.465693] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.481815] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 9.474503] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 9.530162] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.521729] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.527232] systemd[1]: Starting Create System Files and Directories... worker2 # [ 9.540634] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.532701] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 9.548496] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.542763] systemd[1]: Finished Create System Files and Directories. client # [ 9.555061] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.558138] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.596789] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.637756] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 9.642322] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.652463] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.653040] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.661969] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.655052] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.670478] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.694562] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.699174] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.707103] systemd[1]: Starting Update is Completed... worker2 # [ 9.730018] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 9.733309] systemd[1]: Starting Update is Completed... lb # [ 9.770095] systemd[1]: Finished Create System Files and Directories. lb # [ 9.776858] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.770194] systemd[1]: Finished Update is Completed. worker1 # [ 9.787888] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 9.811880] systemd[1]: Finished Update is Completed. lb # [ 9.811899] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.841593] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 9.844757] systemd[1]: Starting Update is Completed... worker1 # [ 9.919836] systemd[1]: Finished Update is Completed. lb # [ 9.927653] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.971051] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.984717] systemd[1]: Starting Update is Completed... lb # [ 10.077774] systemd[1]: Finished Update is Completed. worker2 # [ 10.249976] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 10.252916] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.266572] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.268725] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 10.380855] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.384604] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.422859] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.479103] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 10.502137] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.506613] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.655555] systemd[1]: Finished Firewall. client # [ 10.662416] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 10.715447] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 10.822990] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.831751] systemd[1]: Finished Firewall. worker2 # [ 10.870460] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 10.939482] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 10.977972] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.995788] systemd[1]: Finished register-nix-paths.service. client # [ 10.997053] systemd[1]: Reached target System Initialization. client # [ 10.999847] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 11.014132] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.015383] systemd[1]: Reached target System Initialization. client # [ 11.002784] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.016575] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 11.018754] systemd[1]: Started niks3 garbage collection timer. client # [ 11.006979] systemd[1]: Reached target Timer Units. client # [ 11.010516] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.013778] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.023300] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.028926] systemd[1]: Reached target Timer Units. client # [ 11.016181] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 11.029716] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.019936] systemd[1]: Reached target Socket Units. client # [ 11.024244] systemd[1]: Reached target Basic System. client # [ 11.026071] systemd[1]: Started backdoor.service. lb # [ 11.039474] systemd[1]: Listening on niks3 server socket. client # [ 11.028727] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.043898] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.044974] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.032492] (udev-worker)[317]: Network interface NamePolicy= disabled on kernel command line. lb # [ 11.046220] systemd[1]: Reached target Socket Units. client # [ 11.036666] systemd[1]: Starting nftables firewall... lb # [ 11.047314] systemd[1]: Reached target Basic System. client # [ 11.039527] (udev-worker)[320]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 11.055025] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.048765] (udev-worker)[320]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 11.055739] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 11.049979] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.059239] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.069401] systemd[1]: Starting Post-Boot Actions... client # [ 11.073548] systemd[1]: Starting Post-Boot Actions... lb # [ 11.097263] systemd[1]: Started Reset console on configuration changes. client # [ 11.105496] systemd[1]: Started Reset console on configuration changes. lb # [ 11.127170] systemd[1]: Starting resolvconf update... worker2 # [ 11.132976] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 11.131588] systemd[1]: Starting resolvconf update... worker2 # [ 11.152108] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 11.149296] systemd[1]: Started rustfs.service. worker2 # [ 11.175563] systemd[1]: Finished register-nix-paths.service. worker2 # [ 11.179495] systemd[1]: Reached target System Initialization. worker2 # [ 11.181932] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 11.183555] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 11.186563] systemd[1]: Reached target Timer Units. worker2 # [ 11.190434] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.195014] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.199425] systemd[1]: Listening on Nix worker-protocol over gRPC. lb # [ 11.196991] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 11.205013] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 11.212677] systemd[1]: Reached target Socket Units. client # [ 11.201964] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.223909] systemd[1]: Reached target Basic System. client # [ 11.209087] nsncd[398]: Sep 21 09:27:38.834 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.228908] systemd[1]: Started backdoor.service. client # connecting to host... worker2 # [ 11.236262] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.222574] systemd[1]: Finished Post-Boot Actions. lb # [ 11.239876] nsncd[493]: Sep 21 09:27:38.854 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.246562] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.252823] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.257262] systemd[1]: Starting Post-Boot Actions... lb # [ 11.257848] systemd[1]: Finished Post-Boot Actions. worker1 # [ 11.252997] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 11.263918] systemd[1]: Started Reset console on configuration changes. lb # [ 11.268497] systemd[1]: Finished Firewall. client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 11.276167] systemd[1]: Starting resolvconf update... client # [ 11.273582] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.282750] systemd[1]: Starting D-Bus System Message Bus... client # [ 11.281117] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.301481] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.314557] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 11.308293] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.353170] systemd[1]: Finished Post-Boot Actions. lb # [ 11.320846] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 11.354469] systemd[1]: Finished register-nix-paths.service. client: connected to guest root shell client # [ 11.293677] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.323407] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 11.357184] systemd[1]: Reached target System Initialization. client: (connecting took 11.80 seconds) client # [ 11.324133] systemd[1]: Starting User Login Management... worker1 # [ 11.359352] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 11.338614] systemd[1]: Starting User Login Management... client: (finished: waiting for the VM to finish booting, in 11.80 seconds) client # [ 11.331211] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 11.361772] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.359149] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 11.364171] systemd[1]: Reached target Timer Units. worker1 # [ 11.367917] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 11.370735] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 11.376405] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 11.386259] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.389076] systemd[1]: Reached target Socket Units. worker2 # connecting to host... worker1 # [ 11.401176] systemd[1]: Reached target Basic System. worker2 # [ 11.412634] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.417885] nsncd[497]: Sep 21 09:27:39.039 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.419838] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.407578] systemd[1]: Started backdoor.service. worker1 # [ 11.416668] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 11.436163] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.429408] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.440868] systemd[1]: Starting User Login Management... worker1 # [ 11.438020] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.452825] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 11.448172] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.456843] systemd[1]: Starting resolvconf update... worker1 # [ 11.466942] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.520116] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 11.540917] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.532404] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.545709] dbus-broker-launch[501]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.542049] dbus-broker-launch[429]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.566999] dbus-broker-launch[429]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.585753] systemd[1]: Started D-Bus System Message Bus. worker1 # connecting to host... client # [ 11.574300] dbus-broker-launch[429]: Invalid user-name in /nix/store/ydh4ywywm30g15n5m6x5vfz42682s2cc-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.602970] dbus-broker-launch[527]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.595436] nsncd[498]: Sep 21 09:27:39.224 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.609419] systemd-logind[512]: New seat seat0. client # [ 11.597667] systemd-logind[433]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 11.610832] dbus-broker-launch[527]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.610021] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.610946] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.615425] systemd[1]: Started User Login Management. worker1 # [ 11.611833] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.605232] systemd-logind[433]: New seat seat0. lb # [ 11.616880] dbus-broker-launch[527]: Invalid user-name in /nix/store/kxmx3smba321l9v2dpmh9zahhsbc77yh-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 11.624687] systemd[1]: Starting linger-users.service... client # [ 11.610475] systemd[1]: Started User Login Management. client # [ 11.614863] systemd[1]: Starting linger-users.service... worker1 # [ 11.623460] systemd[1]: Starting User Login Management... lb # [ 11.635064] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.624785] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.645662] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.629946] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 11.637073] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.642439] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.650823] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 11.654495] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.638402] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.639284] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.644331] systemd[1]: Stopping User and Group Name Lookups... lb # [ 11.656349] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.663560] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.650652] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.664636] systemd-logind[529]: New seat seat0. worker2 # [ 11.669500] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.655851] systemd[1]: nscd.service: Deactivated successfully. client # [ 11.660982] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.671080] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 11.674822] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.677934] systemd[1]: Started User Login Management. worker2 # [ 11.684433] dbus-broker-launch[501]: Ready worker2 # [ 11.685104] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.685914] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 11.686727] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.686284] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.695399] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.702281] systemd[1]: Started D-Bus System Message Bus. client # [ 11.693052] dbus-broker-launch[429]: Ready worker1 # [ 11.701666] dbus-broker-launch[502]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.698323] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 11.714557] systemd[1]: Starting linger-users.service... lb # [ 11.724801] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.721790] dbus-broker-launch[502]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.732498] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.736770] systemd[1]: Finished linger-users.service. worker1 # [ 11.727143] dbus-broker-launch[502]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.746534] dbus-broker-launch[527]: Ready client # [ 11.735598] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.761843] mousedev: PS/2 mouse device common for all mice client # [ 11.760552] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.764586] systemd[1]: Finished linger-users.service. worker1 # [ 11.772531] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.781948] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.788574] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.789856] nsncd[570]: Sep 21 09:27:39.412 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.791708] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.811788] systemd[1]: Finished resolvconf update. worker2 # [ 11.813628] systemd[1]: Reached target Preparation for Network. worker1 # [ 11.808225] systemd-logind[513]: New seat seat0. worker2 # [ 11.818776] systemd[1]: Starting DHCP Client... worker2 # [ 11.825129] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.817118] systemd[1]: Started User Login Management. worker1 # [ 11.822176] systemd[1]: Starting linger-users.service... worker1 # [ 11.828932] dbus-broker-launch[502]: Ready worker2 # [ 11.851336] (udev-worker)[370]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 11.840469] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.853614] systemd[1]: Finished resolvconf update. worker1 # [ 11.848794] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 11.849796] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 11.850635] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 11.851480] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.861024] (udev-worker)[359]: Network interface NamePolicy= disabled on kernel command line. client # [ 11.845473] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.858940] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.846755] nsncd[499]: Sep 21 09:27:39.476 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.865478] (udev-worker)[370]: Network interface NamePolicy= disabled on kernel command line. lb # [ 11.865550] systemd[1]: Finished linger-users.service. client # [ 11.857122] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.858087] systemd[1]: Finished resolvconf update. worker1 # [ 11.864503] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.873177] systemd[1]: Reached target Preparation for Network. client # [ 11.864984] systemd[1]: Starting DHCP Client... worker1 # [ 11.875516] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.887773] systemd[1]: Starting DHCP Client... worker1 # [ 11.881752] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 11.882723] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.876763] systemd-logind[433]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 11.893028] nsncd[587]: Sep 21 09:27:39.501 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 11.907587] systemd[1]: Starting Extra networking commands.... lb # [ 11.909486] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.932333] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 11.938460] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 11.940965] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.936784] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 11.937797] systemd[1]: Finished linger-users.service. lb # [ 11.945371] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.959773] systemd[1]: Started backdoor.service. worker1 # [ 11.959940] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.965052] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.968909] nsncd[570]: Sep 21 09:27:39.594 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.974983] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.978374] (udev-worker)[491]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 11.979793] (udev-worker)[363]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 11.988759] (udev-worker)[363]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.017755] systemd[1]: Finished resolvconf update. worker1 # [ 12.018548] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.025981] systemd[1]: Starting DHCP Client... worker1 # [ 12.029332] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.059897] dhcpcd[604]: dhcpcd-10.3.2 starting worker2 # [ 12.079151] dhcpcd[644]: dev: loaded udev client # [ 12.079710] dhcpcd[534]: dhcpcd-10.3.2 starting worker1 # [ 12.098607] systemd-logind[513]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # connecting to host... client # [ 12.096974] dhcpcd[544]: dev: loaded udev worker2 # [ 12.132596] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.129548] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.132740] systemd[1]: Reached target Network. worker2 # [ 12.136133] systemd[1]: Starting Permit User Sessions... client # [ 12.123916] systemd[1]: Finished nftables firewall. client # [ 12.128260] systemd[1]: Reached target Preparation for Network. client # [ 12.137753] systemd[1]: Starting Address configuration of eth1... worker2 # [ 12.155469] systemd-logind[512]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 12.144111] systemd[1]: Starting Extra networking commands.... client # [ 12.162008] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.180319] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.190197] systemd[1]: Starting Address configuration of eth1... worker2 # [ 12.237869] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 12.240538] systemd[1]: Finished Permit User Sessions. worker2 # [ 12.246279] systemd[1]: Started Getty on tty1. worker2 # [ 12.249634] systemd[1]: Reached target Login Prompts. worker2 # [ 12.272188] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.272746] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.277447] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.277779] cfg80211: failed to load regulatory.db worker1 # [ 12.266362] dhcpcd[605]: dhcpcd-10.3.2 starting client # [ 12.284759] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.280479] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.286484] systemd[1]: Starting Address configuration of eth1... lb # [ 12.296847] dhcpcd[623]: dhcpcd-10.3.2 starting worker1 # [ 12.295811] dhcpcd[644]: dev: loaded udev client # [ 12.311111] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 12.312433] dhcpcd[670]: dev: loaded udev client # [ 12.333979] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.334466] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.353391] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.325480] network-addresses-eth1-start[548]: adding address 192.168.1.1/24... done client # [ 12.342140] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.342459] cfg80211: failed to load regulatory.db worker2 # [ 12.368555] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 12.363284] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.355145] dhcpcd[644]: eth0: waiting for carrier worker2 # [ 12.360303] dhcpcd[644]: eth0: waiting for carrier worker2 # [ 12.361055] dhcpcd[644]: eth0: carrier acquired worker2 # [ 12.368453] network-addresses-eth1-start[659]: adding address 192.168.1.4/24... done lb # [ 12.380069] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.366925] systemd[1]: Finished Extra networking commands.. client # [ 12.356808] network-addresses-eth1-start[548]: adding address 2001:db8:1::1/64... done lb # [ 12.372470] systemd[1]: Reached target Network. worker1 # [ 12.371376] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.379430] dhcpcd[644]: DUID 00:01:00:01:32:43:b5:0c:52:54:00:12:34:56 worker2 # [ 12.383368] dhcpcd[644]: eth0: IAID 00:12:34:56 lb # [ 12.380110] systemd[1]: Starting PostgreSQL Server... worker2 # [ 12.384357] dhcpcd[644]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 12.373552] systemd[1]: Reached target Network. worker2 # [ 12.388631] network-addresses-eth1-start[659]: adding address 2001:db8:1::4/64... done worker1 # [ 12.381356] systemd[1]: Starting Permit User Sessions... lb # [ 12.394569] systemd[1]: Starting Permit User Sessions... client # [ 12.391022] systemd[1]: Finished Address configuration of eth1. worker2 # [ 12.410265] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.448023] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.428377] dhcpcd[598]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (551) - Operation not permitted client # [ 12.434989] dhcpcd[598]: .resolvconf-wrapped: clearing stale lock pid 551 lb # [ 12.447754] (udev-worker)[362]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 12.464351] (udev-worker)[362]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.460469] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.465468] systemd[1]: Started Getty on tty1. worker1 # [ 12.469644] systemd[1]: Reached target Login Prompts. worker1 # [ 12.490211] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 12.495058] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.495542] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.505376] mousedev: PS/2 mouse device common for all mice worker1 # [ 12.501037] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.501376] cfg80211: failed to load regulatory.db client # [ 12.493482] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 12.492432] (udev-worker)[373]: Network interface NamePolicy= disabled on kernel command line. client # [ 12.481927] dhcpcd[544]: eth0: waiting for carrier client # [ 12.485712] dhcpcd[544]: libudev: received NULL device client # [ 12.486543] dhcpcd[544]: libudev: received NULL device client # [ 12.487372] dhcpcd[544]: eth0: carrier acquired worker2 # [ 12.506513] dhcpcd[644]: eth0: soliciting a DHCP lease worker2 # [ 12.512542] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 12.497084] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.516185] dhcpcd[644]: eth0: probing address 10.0.2.15/24 client # [ 12.500616] systemd[1]: Reached target Network. worker1 # [ 12.513724] network-addresses-eth1-start[646]: adding address 192.168.1.3/24... done worker2 # [ 12.523182] systemd-logind[512]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 12.507891] systemd[1]: Starting Permit User Sessions... client # [ 12.510900] dhcpcd[544]: DUID 00:01:00:01:32:43:b5:0c:52:54:00:12:34:56 client # [ 12.512989] dhcpcd[544]: eth0: IAID 00:12:34:56 client # [ 12.516224] dhcpcd[544]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 12.537823] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.536609] network-addresses-eth1-start[646]: adding address 2001:db8:1::3/64... done lb # [ 12.565769] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 12.561430] systemd[1]: Started Getty on tty1. lb # [ 12.562183] systemd[1]: Reached target Login Prompts. worker1 # [ 12.562905] systemd[1]: Finished Address configuration of eth1. client # [ 12.559141] systemd[1]: Finished Permit User Sessions. client # [ 12.566799] systemd[1]: Started Getty on tty1. client # [ 12.569520] systemd[1]: Reached target Login Prompts. worker1 # [ 12.607376] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 12.591821] dhcpcd[644]: eth0: waiting for carrier worker1 # [ 12.594977] dhcpcd[644]: eth0: carrier acquired lb # [ 12.627338] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 12.627853] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.609113] dhcpcd[644]: DUID 00:01:00:01:32:43:b5:0c:52:54:00:12:34:56 worker1 # [ 12.610108] dhcpcd[644]: eth0: IAID 00:12:34:56 worker1 # [ 12.610776] dhcpcd[644]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 12.634425] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 12.634757] cfg80211: failed to load regulatory.db worker1 # [ 12.644221] mousedev: PS/2 mouse device common for all mice lb # [ 12.668953] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.663215] systemd-logind[513]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 12.679778] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.703227] dhcpcd[644]: eth0: soliciting a DHCP lease worker1 # [ 12.708533] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 12.716239] dhcpcd[644]: eth0: probing address 10.0.2.15/24 lb # [ 12.756708] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 12.744655] dhcpcd[670]: eth0: waiting for carrier lb # [ 12.749028] dhcpcd[670]: eth0: waiting for carrier lb # [ 12.755180] dhcpcd[670]: eth0: carrier acquired lb # [ 12.774637] dhcpcd[670]: DUID 00:01:00:01:32:43:b5:0c:52:54:00:12:34:56 lb # [ 12.777078] dhcpcd[670]: eth0: IAID 00:12:34:56 lb # [ 12.779869] dhcpcd[670]: eth0: adding address fe80::5054:ff:fe12:3456 client: (finished: waiting for unit network-addresses-eth1.service, in 13.24 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 12.857109] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 12.867693] network-addresses-eth1-start[706]: adding address 192.168.1.2/24... done client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 12.892663] network-addresses-eth1-start[706]: adding address 2001:db8:1::2/64... done lb # [ 12.903156] postgresql-pre-start[703]: The files belonging to this database system will be owned by user "postgres". lb # [ 12.909225] postgresql-pre-start[703]: This user must also own the server process. lb # [ 12.922671] postgresql-pre-start[703]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 12.928430] postgresql-pre-start[703]: The default database encoding has accordingly been set to "UTF8". lb # [ 12.936172] postgresql-pre-start[703]: The default text search configuration will be set to "english". lb # [ 12.943973] postgresql-pre-start[703]: Data page checksums are enabled. lb # [ 12.949567] postgresql-pre-start[703]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.950866] postgresql-pre-start[703]: creating subdirectories ... ok lb # [ 12.951692] postgresql-pre-start[703]: selecting dynamic shared memory implementation ... posix lb # [ 12.964317] systemd[1]: Finished Address configuration of eth1. lb: (finished: waiting for unit network-addresses-eth1.service, in 0.17 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.09 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) client # [ 13.148962] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.160683] postgresql-pre-start[703]: selecting default "max_connections" ... 100 worker2 # [ 13.213492] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.206456] systemd-logind[529]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 13.345130] postgresql-pre-start[703]: selecting default "shared_buffers" ... 128MB worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } lb # [ 13.428744] mousedev: PS/2 mouse device common for all mice worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit niks3.service worker1 # [ 13.470451] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 13.458685] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.468753] systemd[1]: Starting Virtual Console Setup... client # [ 13.493052] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 13.495515] systemd[1]: Stopped Virtual Console Setup. client # [ 13.501582] systemd[1]: Starting Virtual Console Setup... client # [ 13.534319] systemd-logind[433]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 13.561247] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 13.569456] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.595879] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.599707] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.604647] systemd[1]: Starting Virtual Console Setup... lb # [ 13.636124] systemd-logind[529]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 13.659010] systemd-logind[512]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 13.748483] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 13.751442] dhcpcd[644]: eth0: soliciting an IPv6 router worker1 # [ 13.755072] dhcpcd[644]: eth0: Router Advertisement from fe80::2 worker1 # [ 13.755934] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 13.761050] dhcpcd[644]: eth0: adding route to fec0::/64 worker1 # [ 13.761827] dhcpcd[644]: eth0: adding default route via fe80::2 worker1 # [ 13.773323] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.798020] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.801633] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.804544] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.862882] systemd-logind[513]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 13.883155] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 13.887008] systemd[1]: Finished Virtual Console Setup. worker2 # [ 13.980528] systemd-vconsole-setup[709]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 13.984442] systemd[1]: Finished Virtual Console Setup. client # [ 13.982786] dhcpcd[544]: eth0: soliciting an IPv6 router client # [ 13.986237] dhcpcd[544]: eth0: Router Advertisement from fe80::2 client # [ 13.988569] dhcpcd[544]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 13.991063] dhcpcd[544]: eth0: adding route to fec0::/64 client # [ 13.993159] dhcpcd[544]: eth0: adding default route via fe80::2 client # [ 14.086659] dhcpcd[544]: eth0: soliciting a DHCP lease client # [ 14.092891] dhcpcd[544]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 14.100449] dhcpcd[544]: eth0: probing address 10.0.2.15/24 worker1 # [ 14.234129] systemd-vconsole-setup[710]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.239006] systemd[1]: Finished Virtual Console Setup. lb # [ 14.260605] dhcpcd[670]: eth0: soliciting a DHCP lease lb # [ 14.264505] dhcpcd[670]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 14.272247] dhcpcd[670]: eth0: probing address 10.0.2.15/24 lb # [ 14.575018] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker2 # [ 14.579340] dhcpcd[644]: eth0: soliciting an IPv6 router worker2 # [ 14.583084] dhcpcd[644]: eth0: Router Advertisement from fe80::2 worker2 # [ 14.585702] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 14.588508] dhcpcd[644]: eth0: adding route to fec0::/64 worker2 # [ 14.590709] dhcpcd[644]: eth0: adding default route via fe80::2 lb # [ 14.931859] dhcpcd[670]: eth0: soliciting an IPv6 router lb # [ 14.933360] dhcpcd[670]: eth0: Router Advertisement from fe80::2 lb # [ 14.934230] dhcpcd[670]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 14.935106] dhcpcd[670]: eth0: adding route to fec0::/64 lb # [ 14.935866] dhcpcd[670]: eth0: adding default route via fe80::2 lb # [ 15.072382] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 15.094972] systemd[1]: Starting Virtual Console Setup... lb # [ 15.132078] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.133176] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.152133] systemd[1]: Starting Virtual Console Setup... lb # [ 15.204265] systemd-logind[529]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 15.578527] systemd-vconsole-setup[775]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 15.581900] systemd[1]: Finished Virtual Console Setup. lb # [ 15.887540] postgresql-pre-start[703]: selecting default time zone ... UTC lb # [ 15.892667] postgresql-pre-start[703]: creating configuration files ... ok lb # [ 16.175013] postgresql-pre-start[703]: running bootstrap script ... ok lb # [ 16.781286] postgresql-pre-start[703]: performing post-bootstrap initialization ... ok lb # [ 16.959388] postgresql-pre-start[703]: syncing data to disk ... ok lb # [ 16.961526] postgresql-pre-start[703]: initdb: warning: enabling "trust" authentication for local connections lb # [ 16.962810] postgresql-pre-start[703]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 16.964877] postgresql-pre-start[703]: Success. You can now start the database server using: lb # [ 16.966105] postgresql-pre-start[703]: pg_ctl -D /var/lib/postgresql/18 -l logfile start worker2 # [ 16.986525] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 16.989691] dhcpcd[644]: eth0: adding route to 10.0.2.0/24 worker2 # [ 16.992678] dhcpcd[644]: eth0: adding default route via 10.0.2.2 lb # [ 17.086018] postgres[809]: [809] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.090437] postgres[809]: [809] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.091628] postgres[809]: [809] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.094865] postgres[809]: [809] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.108458] postgres[818]: [818] LOG: database system was shut down at 2026-09-21 09:27:44 GMT lb # [ 17.114814] postgres[809]: [809] LOG: database system is ready to accept connections lb # [ 17.119084] systemd[1]: Started PostgreSQL Server. lb # [ 17.124715] systemd[1]: Starting PostgreSQL Setup Scripts... worker2 # [ 17.147485] systemd[1]: Started DHCP Client. worker2 # [ 17.149159] systemd[1]: Reached target Multi-User System. worker2 # [ 17.149957] systemd[1]: Startup finished in 940ms (kernel) + 5.264s (initrd) + 10.943s (userspace) = 17.148s. lb # [ 17.342121] postgresql-setup-start[829]: CREATE DATABASE lb # [ 17.394787] postgresql-setup-start[834]: CREATE ROLE lb # [ 17.419464] postgresql-setup-start[836]: ALTER DATABASE lb # [ 17.426050] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 17.427832] systemd[1]: Reached target PostgreSQL. worker1 # [ 17.841892] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 17.842084] dhcpcd[644]: eth0: adding route to 10.0.2.0/24 worker1 # [ 17.842200] dhcpcd[644]: eth0: adding default route via 10.0.2.2 worker1 # [ 17.984802] systemd[1]: Started DHCP Client. worker1 # [ 17.986656] systemd[1]: Reached target Multi-User System. worker1 # [ 17.987465] systemd[1]: Startup finished in 939ms (kernel) + 5.444s (initrd) + 11.603s (userspace) = 17.986s. client # [ 18.757176] dhcpcd[544]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 18.760454] dhcpcd[544]: eth0: adding route to 10.0.2.0/24 client # [ 18.760672] dhcpcd[544]: eth0: adding default route via 10.0.2.2 client # [ 18.911398] systemd[1]: Started DHCP Client. client # [ 18.917425] systemd[1]: Reached target Multi-User System. client # [ 18.918254] systemd[1]: Startup finished in 933ms (kernel) + 5.425s (initrd) + 12.557s (userspace) = 18.915s. lb # [ 19.492667] dhcpcd[670]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 19.496694] dhcpcd[670]: eth0: adding route to 10.0.2.0/24 lb # [ 19.499027] dhcpcd[670]: eth0: adding default route via 10.0.2.2 lb # [ 19.652889] systemd[1]: Started DHCP Client. lb # [ 19.654866] systemd[1]: Reached target Network is Online. lb # [ 19.661519] systemd[1]: Started Envoy reverse proxy. lb # [ 19.664499] systemd[1]: Started mock-oidc.service. lb # [ 19.765701] mock-oidc-server[914]: Mock OIDC Server running lb # [ 19.766591] mock-oidc-server[914]: OIDC Address: 192.168.1.2:8080 lb # [ 19.767417] mock-oidc-server[914]: Issue Address: 0.0.0.0:8081 lb # [ 19.768536] mock-oidc-server[914]: Issuer: http://192.168.1.2:8080/oidc lb # [ 19.769801] mock-oidc-server[914]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 19.771367] mock-oidc-server[914]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 19.773348] mock-oidc-server[914]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 20.387519] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 20.389538] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 20.391312] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 20.393486] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 20.395888] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 20.401686] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 20.417943] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 20.420722] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.422946] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 20.426007] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 20.428057] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 20.430701] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 20.433054] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 20.435667] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 20.439022] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 20.441575] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 20.444695] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 20.446524] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 20.453858] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 20.455982] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 20.460747] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 20.463809] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 20.466560] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 20.471760] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 20.475095] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 20.478878] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 20.480762] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 20.483819] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 20.486045] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 20.488417] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 20.490502] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 20.492409] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 20.495358] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 20.499919] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 20.504901] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 20.511098] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 20.513256] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 20.515062] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 20.522142] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 20.524423] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 20.527910] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 20.529881] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 20.532741] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 20.566754] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 20.578224] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 20.580322] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 20.583195] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 20.585388] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 20.588068] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 20.590458] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 20.593322] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 20.596450] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 20.598551] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 20.600707] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 20.602313] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 20.604304] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 20.608226] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 20.611033] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 20.617469] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 20.619185] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.622221] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 20.633567] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 20.635540] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 20.638519] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 20.640804] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 20.644094] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 20.646607] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 20.652082] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 20.656820] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 20.664474] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 20.666382] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 20.668578] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 20.670781] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 20.673182] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 20.675112] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 20.677499] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 20.679275] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 20.682510] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 20.685711] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 20.687482] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 20.690718] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 20.693369] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 20.698694] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 20.712426] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 20.714353] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 20.716060] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 20.718359] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 20.721145] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 20.723233] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 20.725434] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.728369] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 20.735363] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 20.737936] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 20.739927] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 20.742122] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 20.744304] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 20.746509] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 20.748938] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 20.752520] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.754886] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 20.758394] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 20.761200] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 20.763898] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 20.766702] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 20.772260] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 20.774590] envoy[913]: [2026-09-21 09:27:48.003][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 20.779635] envoy[913]: [2026-09-21 09:27:48.032][913][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 20.781200] envoy[913]: [2026-09-21 09:27:48.037][913][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 20.796800] envoy[913]: [2026-09-21 09:27:48.037][913][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 20.798491] envoy[913]: [2026-09-21 09:27:48.037][913][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 20.807504] envoy[913]: [2026-09-21 09:27:48.037][913][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 20.809570] envoy[913]: [2026-09-21 09:27:48.293][913][info][main] [source/server/server.cc:968] runtime: {} lb # [ 20.811233] envoy[913]: [2026-09-21 09:27:48.309][913][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 20.813353] envoy[913]: [2026-09-21 09:27:48.309][913][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 20.815053] envoy[913]: [2026-09-21 09:27:48.309][913][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 20.816779] envoy[913]: [2026-09-21 09:27:48.329][913][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 20.818556] envoy[913]: [2026-09-21 09:27:48.329][913][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 20.820302] envoy[913]: [2026-09-21 09:27:48.329][913][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 20.846288] envoy[913]: [2026-09-21 09:27:48.463][913][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 20.847478] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 20.854613] envoy[913]: [2026-09-21 09:27:48.471][913][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker2 # [ 20.855892] systemd[1]: Reached target Network is Online. lb # [ 20.857284] envoy[913]: [2026-09-21 09:27:48.473][913][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 20.860526] envoy[913]: [2026-09-21 09:27:48.473][913][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 20.868837] systemd[1]: Starting scheduler-token.service... worker2 # [ 20.991037] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 20.995536] systemd[1]: Finished scheduler-token.service. worker2 # [ 21.000536] systemd[1]: scheduler-token.service: Consumed 52ms CPU time over 125ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 21.006794] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 21.069875] nix-grpc-daemon[775]: ts=2026-09-21T09:27:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 21.082840] nix-grpc-daemon[775]: ts=2026-09-21T09:27:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 21.085223] nix-grpc-daemon[775]: ts=2026-09-21T09:27:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 21.122641] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 21.124378] nix-grpc-daemon[775]: E0000 00:00:1789982868.754447 775 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 21.137541] nix-grpc-daemon[775]: E0000 00:00:1789982868.769452 775 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 21.141065] nix-grpc-daemon[775]: ts=2026-09-21T09:27:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 21.142781] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 21.179114] nix-grpc-daemon[775]: E0000 00:00:1789982868.809997 816 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 21.183206] envoy[913]: [2026-09-21 09:27:48.799][913][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 21.188917] envoy[913]: [2026-09-21 09:27:48.799][913][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 21.195956] envoy[913]: [2026-09-21 09:27:48.799][913][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker1 # [ 21.197633] nix-grpc-daemon[775]: E0000 00:00:1789982868.829500 816 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 21.205601] envoy[913]: [2026-09-21 09:27:48.822][913][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 21.204082] nix-grpc-daemon[775]: E0000 00:00:1789982868.832726 816 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 21.219796] nix-grpc-daemon[775]: E0000 00:00:1789982868.850756 816 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 21.230490] nix-grpc-daemon[777]: ts=2026-09-21T09:27:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 21.242918] nix-grpc-daemon[777]: ts=2026-09-21T09:27:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 21.235098] nix-grpc-daemon[775]: ts=2026-09-21T09:27:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.245245] nix-grpc-daemon[777]: ts=2026-09-21T09:27:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 21.238930] nix-grpc-daemon[775]: ts=2026-09-21T09:27:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.284283] nix-grpc-daemon[777]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 21.285961] nix-grpc-daemon[777]: E0000 00:00:1789982868.911842 777 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 21.298980] nix-grpc-daemon[777]: E0000 00:00:1789982868.926645 777 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 21.302646] nix-grpc-daemon[777]: ts=2026-09-21T09:27:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 21.307762] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 21.338205] nix-grpc-daemon[777]: E0000 00:00:1789982868.964850 818 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 21.356161] nix-grpc-daemon[777]: E0000 00:00:1789982868.983738 818 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 21.360062] nix-grpc-daemon[777]: E0000 00:00:1789982868.986922 818 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 21.378428] nix-grpc-daemon[777]: E0000 00:00:1789982869.005340 818 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 21.388707] nix-grpc-daemon[777]: ts=2026-09-21T09:27:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.390514] nix-grpc-daemon[777]: ts=2026-09-21T09:27:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.440362] nix-grpc-daemon[775]: ts=2026-09-21T09:27:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.445373] nix-grpc-daemon[775]: ts=2026-09-21T09:27:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.592150] nix-grpc-daemon[777]: ts=2026-09-21T09:27:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.597263] nix-grpc-daemon[777]: ts=2026-09-21T09:27:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.646181] nix-grpc-daemon[775]: ts=2026-09-21T09:27:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.651498] nix-grpc-daemon[775]: ts=2026-09-21T09:27:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.798517] nix-grpc-daemon[777]: ts=2026-09-21T09:27:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.803596] nix-grpc-daemon[777]: ts=2026-09-21T09:27:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.852276] nix-grpc-daemon[775]: ts=2026-09-21T09:27:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.856980] nix-grpc-daemon[775]: ts=2026-09-21T09:27:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.004937] nix-grpc-daemon[777]: ts=2026-09-21T09:27:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.010506] nix-grpc-daemon[777]: ts=2026-09-21T09:27:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.057833] nix-grpc-daemon[775]: ts=2026-09-21T09:27:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.062913] nix-grpc-daemon[775]: ts=2026-09-21T09:27:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.211735] nix-grpc-daemon[777]: ts=2026-09-21T09:27:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.216998] nix-grpc-daemon[777]: ts=2026-09-21T09:27:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.265111] nix-grpc-daemon[775]: ts=2026-09-21T09:27:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.269805] nix-grpc-daemon[775]: ts=2026-09-21T09:27:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.419915] nix-grpc-daemon[777]: ts=2026-09-21T09:27:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.424141] nix-grpc-daemon[777]: ts=2026-09-21T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.470510] nix-grpc-daemon[775]: ts=2026-09-21T09:27:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.475738] nix-grpc-daemon[775]: ts=2026-09-21T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.620607] nix-grpc-daemon[777]: ts=2026-09-21T09:27:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.625718] nix-grpc-daemon[777]: ts=2026-09-21T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.676566] nix-grpc-daemon[775]: ts=2026-09-21T09:27:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.681754] nix-grpc-daemon[775]: ts=2026-09-21T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.826996] nix-grpc-daemon[777]: ts=2026-09-21T09:27:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.832169] nix-grpc-daemon[777]: ts=2026-09-21T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.882606] nix-grpc-daemon[775]: ts=2026-09-21T09:27:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.887839] nix-grpc-daemon[775]: ts=2026-09-21T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.033388] nix-grpc-daemon[777]: ts=2026-09-21T09:27:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.038388] nix-grpc-daemon[777]: ts=2026-09-21T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.088838] nix-grpc-daemon[775]: ts=2026-09-21T09:27:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.093902] nix-grpc-daemon[775]: ts=2026-09-21T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.239639] nix-grpc-daemon[777]: ts=2026-09-21T09:27:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.244606] nix-grpc-daemon[777]: ts=2026-09-21T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.296639] nix-grpc-daemon[775]: ts=2026-09-21T09:27:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.300956] nix-grpc-daemon[775]: ts=2026-09-21T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.449242] nix-grpc-daemon[777]: ts=2026-09-21T09:27:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.453879] nix-grpc-daemon[777]: ts=2026-09-21T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.498399] nix-grpc-daemon[775]: ts=2026-09-21T09:27:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.504556] nix-grpc-daemon[775]: ts=2026-09-21T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.650155] nix-grpc-daemon[777]: ts=2026-09-21T09:27:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.655528] nix-grpc-daemon[777]: ts=2026-09-21T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.705670] nix-grpc-daemon[775]: ts=2026-09-21T09:27:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.711234] nix-grpc-daemon[775]: ts=2026-09-21T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.857167] nix-grpc-daemon[777]: ts=2026-09-21T09:27:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.862427] nix-grpc-daemon[777]: ts=2026-09-21T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.912148] nix-grpc-daemon[775]: ts=2026-09-21T09:27:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.917739] nix-grpc-daemon[775]: ts=2026-09-21T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.064602] nix-grpc-daemon[777]: ts=2026-09-21T09:27:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.070116] nix-grpc-daemon[777]: ts=2026-09-21T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.118995] nix-grpc-daemon[775]: ts=2026-09-21T09:27:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.125038] nix-grpc-daemon[775]: ts=2026-09-21T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.272060] nix-grpc-daemon[777]: ts=2026-09-21T09:27:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.277944] nix-grpc-daemon[777]: ts=2026-09-21T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.329283] nix-grpc-daemon[775]: ts=2026-09-21T09:27:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.333669] nix-grpc-daemon[775]: ts=2026-09-21T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.482456] nix-grpc-daemon[777]: ts=2026-09-21T09:27:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.487676] nix-grpc-daemon[777]: ts=2026-09-21T09:27:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.530437] nix-grpc-daemon[775]: ts=2026-09-21T09:27:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.536123] nix-grpc-daemon[775]: ts=2026-09-21T09:27:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.689751] nix-grpc-daemon[777]: ts=2026-09-21T09:27:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.695512] nix-grpc-daemon[777]: ts=2026-09-21T09:27:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.737687] nix-grpc-daemon[775]: ts=2026-09-21T09:27:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.743303] nix-grpc-daemon[775]: ts=2026-09-21T09:27:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.897949] nix-grpc-daemon[777]: ts=2026-09-21T09:27:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.903542] nix-grpc-daemon[777]: ts=2026-09-21T09:27:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.944795] nix-grpc-daemon[775]: ts=2026-09-21T09:27:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.950487] nix-grpc-daemon[775]: ts=2026-09-21T09:27:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.105828] nix-grpc-daemon[777]: ts=2026-09-21T09:27:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.111677] nix-grpc-daemon[777]: ts=2026-09-21T09:27:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.151793] nix-grpc-daemon[775]: ts=2026-09-21T09:27:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.157427] nix-grpc-daemon[775]: ts=2026-09-21T09:27:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.313879] nix-grpc-daemon[777]: ts=2026-09-21T09:27:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.319869] nix-grpc-daemon[777]: ts=2026-09-21T09:27:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.361302] nix-grpc-daemon[775]: ts=2026-09-21T09:27:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.366084] nix-grpc-daemon[775]: ts=2026-09-21T09:27:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.525463] nix-grpc-daemon[777]: ts=2026-09-21T09:27:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.530113] nix-grpc-daemon[777]: ts=2026-09-21T09:27:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.561744] nix-grpc-daemon[775]: ts=2026-09-21T09:27:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.567429] nix-grpc-daemon[775]: ts=2026-09-21T09:27:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.726401] nix-grpc-daemon[777]: ts=2026-09-21T09:27:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.730108] nix-grpc-daemon[777]: ts=2026-09-21T09:27:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.768608] nix-grpc-daemon[775]: ts=2026-09-21T09:27:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.774710] nix-grpc-daemon[775]: ts=2026-09-21T09:27:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.931964] nix-grpc-daemon[777]: ts=2026-09-21T09:27:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.938024] nix-grpc-daemon[777]: ts=2026-09-21T09:27:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.975731] nix-grpc-daemon[775]: ts=2026-09-21T09:27:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.979110] nix-grpc-daemon[775]: ts=2026-09-21T09:27:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.140443] nix-grpc-daemon[777]: ts=2026-09-21T09:27:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.146483] nix-grpc-daemon[777]: ts=2026-09-21T09:27:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.180985] nix-grpc-daemon[775]: ts=2026-09-21T09:27:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.189015] nix-grpc-daemon[775]: ts=2026-09-21T09:27:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.348509] nix-grpc-daemon[777]: ts=2026-09-21T09:27:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.354701] nix-grpc-daemon[777]: ts=2026-09-21T09:27:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.391889] nix-grpc-daemon[775]: ts=2026-09-21T09:27:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.396428] nix-grpc-daemon[775]: ts=2026-09-21T09:27:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.559320] nix-grpc-daemon[777]: ts=2026-09-21T09:27:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.564146] nix-grpc-daemon[777]: ts=2026-09-21T09:27:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.593168] nix-grpc-daemon[775]: ts=2026-09-21T09:27:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.599040] nix-grpc-daemon[775]: ts=2026-09-21T09:27:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.761422] nix-grpc-daemon[777]: ts=2026-09-21T09:27:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.767432] nix-grpc-daemon[777]: ts=2026-09-21T09:27:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.800321] nix-grpc-daemon[775]: ts=2026-09-21T09:27:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.806167] nix-grpc-daemon[775]: ts=2026-09-21T09:27:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.970787] nix-grpc-daemon[777]: ts=2026-09-21T09:27:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.976609] nix-grpc-daemon[777]: ts=2026-09-21T09:27:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.007850] nix-grpc-daemon[775]: ts=2026-09-21T09:27:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.013797] nix-grpc-daemon[775]: ts=2026-09-21T09:27:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.178431] nix-grpc-daemon[777]: ts=2026-09-21T09:27:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.184204] nix-grpc-daemon[777]: ts=2026-09-21T09:27:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.215244] nix-grpc-daemon[775]: ts=2026-09-21T09:27:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.221045] nix-grpc-daemon[775]: ts=2026-09-21T09:27:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.385902] nix-grpc-daemon[777]: ts=2026-09-21T09:27:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.391515] nix-grpc-daemon[777]: ts=2026-09-21T09:27:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.420983] nix-grpc-daemon[775]: ts=2026-09-21T09:27:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.425314] nix-grpc-daemon[775]: ts=2026-09-21T09:27:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.595922] nix-grpc-daemon[777]: ts=2026-09-21T09:27:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.600231] nix-grpc-daemon[777]: ts=2026-09-21T09:27:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.621993] nix-grpc-daemon[775]: ts=2026-09-21T09:27:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.627968] nix-grpc-daemon[775]: ts=2026-09-21T09:27:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.798005] nix-grpc-daemon[777]: ts=2026-09-21T09:27:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.803652] nix-grpc-daemon[777]: ts=2026-09-21T09:27:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.829311] nix-grpc-daemon[775]: ts=2026-09-21T09:27:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.835261] nix-grpc-daemon[775]: ts=2026-09-21T09:27:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.005475] nix-grpc-daemon[777]: ts=2026-09-21T09:27:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.011168] nix-grpc-daemon[777]: ts=2026-09-21T09:27:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.036465] nix-grpc-daemon[775]: ts=2026-09-21T09:27:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.042332] nix-grpc-daemon[775]: ts=2026-09-21T09:27:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.212978] nix-grpc-daemon[777]: ts=2026-09-21T09:27:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.218342] nix-grpc-daemon[777]: ts=2026-09-21T09:27:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.242954] nix-grpc-daemon[775]: ts=2026-09-21T09:27:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.248792] nix-grpc-daemon[775]: ts=2026-09-21T09:27:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.420608] nix-grpc-daemon[777]: ts=2026-09-21T09:27:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.426708] nix-grpc-daemon[777]: ts=2026-09-21T09:27:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.453128] nix-grpc-daemon[775]: ts=2026-09-21T09:27:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.457608] nix-grpc-daemon[775]: ts=2026-09-21T09:27:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.632312] nix-grpc-daemon[777]: ts=2026-09-21T09:27:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.636574] nix-grpc-daemon[777]: ts=2026-09-21T09:27:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.653981] nix-grpc-daemon[775]: ts=2026-09-21T09:27:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.659559] nix-grpc-daemon[775]: ts=2026-09-21T09:27:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.833141] nix-grpc-daemon[777]: ts=2026-09-21T09:27:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.838847] nix-grpc-daemon[777]: ts=2026-09-21T09:27:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.861744] nix-grpc-daemon[775]: ts=2026-09-21T09:27:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.868134] nix-grpc-daemon[775]: ts=2026-09-21T09:27:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.040156] nix-grpc-daemon[777]: ts=2026-09-21T09:27:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.044768] nix-grpc-daemon[777]: ts=2026-09-21T09:27:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.069395] nix-grpc-daemon[775]: ts=2026-09-21T09:27:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.075076] nix-grpc-daemon[775]: ts=2026-09-21T09:27:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.245350] nix-grpc-daemon[777]: ts=2026-09-21T09:27:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.250487] nix-grpc-daemon[777]: ts=2026-09-21T09:27:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.275480] nix-grpc-daemon[775]: ts=2026-09-21T09:27:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.278133] nix-grpc-daemon[775]: ts=2026-09-21T09:27:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.451577] nix-grpc-daemon[777]: ts=2026-09-21T09:27:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.457076] nix-grpc-daemon[777]: ts=2026-09-21T09:27:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.481080] nix-grpc-daemon[775]: ts=2026-09-21T09:27:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.485159] nix-grpc-daemon[775]: ts=2026-09-21T09:27:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.659966] nix-grpc-daemon[777]: ts=2026-09-21T09:27:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.663967] nix-grpc-daemon[777]: ts=2026-09-21T09:27:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.681475] nix-grpc-daemon[775]: ts=2026-09-21T09:27:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.686733] nix-grpc-daemon[775]: ts=2026-09-21T09:27:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.860805] nix-grpc-daemon[777]: ts=2026-09-21T09:27:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.865948] nix-grpc-daemon[777]: ts=2026-09-21T09:27:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.887572] nix-grpc-daemon[775]: ts=2026-09-21T09:27:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.893172] nix-grpc-daemon[775]: ts=2026-09-21T09:27:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.040086] rustfs-bucket-start[1013]: mb s3://farm lb # [ 30.048827] systemd[1]: Finished rustfs-bucket.service. lb # [ 30.064081] systemd[1]: Starting niks3 server... worker2 # [ 30.067122] nix-grpc-daemon[777]: ts=2026-09-21T09:27:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.072340] nix-grpc-daemon[777]: ts=2026-09-21T09:27:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.094040] nix-grpc-daemon[775]: ts=2026-09-21T09:27:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.099095] nix-grpc-daemon[775]: ts=2026-09-21T09:27:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.273572] nix-grpc-daemon[777]: ts=2026-09-21T09:27:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.278774] nix-grpc-daemon[777]: ts=2026-09-21T09:27:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.286525] postgres[1029]: [1029] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 30.287844] postgres[1029]: [1029] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker1 # [ 30.299793] nix-grpc-daemon[775]: ts=2026-09-21T09:27:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.305108] nix-grpc-daemon[775]: ts=2026-09-21T09:27:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.325808] niks3-server[1023]: 2026/09/21 09:27:57 OK 20241026095416_initial_model.sql (21.68ms) lb # [ 30.329656] niks3-server[1023]: 2026/09/21 09:27:57 OK 20251210153512_drop_unused_gin_index.sql (4.27ms) lb # [ 30.335261] niks3-server[1023]: 2026/09/21 09:27:57 OK 20251218171726_add_pins.sql (5.55ms) lb # [ 30.339889] niks3-server[1023]: 2026/09/21 09:27:57 OK 20260628120000_add_object_size_and_stats.sql (4.56ms) lb # [ 30.345075] niks3-server[1023]: 2026/09/21 09:27:57 OK 20260905000000_add_claims.sql (5.19ms) lb # [ 30.349793] niks3-server[1023]: 2026/09/21 09:27:57 OK 20260920000000_drop_claims.sql (4.36ms) lb # [ 30.352234] niks3-server[1023]: 2026/09/21 09:27:57 goose: successfully migrated database to version: 20260920000000 lb # [ 30.358521] niks3-server[1023]: 2026/09/21 09:27:57 OK 1_commit_pending_closure.sql (8.94ms) lb # [ 30.361565] niks3-server[1023]: 2026/09/21 09:27:57 OK 2_object_stats_trigger.sql (2.93ms) lb # [ 30.363021] niks3-server[1023]: 2026/09/21 09:27:57 goose: up to current file version: 2 lb # [ 30.368497] niks3-server[1023]: 2026/09/21 09:27:57 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 30.426614] niks3-server[1023]: 2026/09/21 09:27:58 INFO Read proxy enabled — serving cache objects from S3 lb # [ 30.428415] niks3-server[1023]: 2026/09/21 09:27:58 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 30.431835] niks3-server[1023]: 2026/09/21 09:27:58 INFO systemd watchdog enabled interval=15s lb # [ 30.435705] niks3-server[1023]: 2026/09/21 09:27:58 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 30.437562] systemd[1]: Started niks3 server. lb # [ 30.440283] systemd[1]: Reached target Multi-User System. lb # [ 30.444117] niks3-server[1023]: 2026/09/21 09:27:58 INFO lead: acquired remote=192.168.1.4:56844 lb # [ 30.445291] systemd[1]: Startup finished in 952ms (kernel) + 5.455s (initrd) + 24.027s (userspace) = 30.434s. worker2 # [ 30.447721] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_take_over worker2 # [ 30.479836] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.485098] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.507677] nix-grpc-daemon[775]: ts=2026-09-21T09:27:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.511885] nix-grpc-daemon[775]: ts=2026-09-21T09:27:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.688311] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.692345] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.707840] nix-grpc-daemon[775]: ts=2026-09-21T09:27:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.713099] nix-grpc-daemon[775]: ts=2026-09-21T09:27:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.889150] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.894549] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.913794] nix-grpc-daemon[775]: ts=2026-09-21T09:27:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.918990] nix-grpc-daemon[775]: ts=2026-09-21T09:27:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.095866] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.101207] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.119785] nix-grpc-daemon[775]: ts=2026-09-21T09:27:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.125154] nix-grpc-daemon[775]: ts=2026-09-21T09:27:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.302052] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.307450] nix-grpc-daemon[777]: ts=2026-09-21T09:27:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.325772] nix-grpc-daemon[775]: ts=2026-09-21T09:27:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.330938] nix-grpc-daemon[775]: ts=2026-09-21T09:27:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.508653] nix-grpc-daemon[777]: ts=2026-09-21T09:27:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.537982] nix-grpc-daemon[777]: ts=2026-09-21T09:27:59Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 31.533033] nix-grpc-daemon[775]: ts=2026-09-21T09:27:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.544885] nix-grpc-daemon[777]: ts=2026-09-21T09:27:59Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40286 lb: (finished: waiting for unit niks3.service, in 18.11 seconds) lb: waiting for TCP port 5751 on localhost worker2 # [ 31.549607] nix-grpc-daemon[777]: ts=2026-09-21T09:27:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 31.554877] nix-grpc-daemon[777]: ts=2026-09-21T09:27:59Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:40286 worker2 # [ 31.560197] nix-grpc-daemon[777]: ts=2026-09-21T09:27:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.07 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 31.750766] envoy[913]: conn peer=[::1]:39060 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) worker2 # [ 31.946606] systemd[1]: Starting scheduler-token.service... worker2 # [ 32.030839] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 32.035836] systemd[1]: Finished scheduler-token.service. worker2 # [ 32.037443] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 87ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.90 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 33.417788] nix-grpc-daemon[775]: ts=2026-09-21T09:28:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 33.437483] systemd[1]: Started Nix Daemon. worker1 # [ 33.707702] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 33.734910] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 1/5) worker1 # [ 33.739921] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 2/5) worker1 # [ 33.883295] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 3/5) worker1 # [ 34.026613] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 299 ms (attempt 4/5) worker1 # [ 34.335065] nix-grpc-daemon[775]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 34.341166] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 34.384848] nix-grpc-daemon[777]: ts=2026-09-21T09:28:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 34.401934] systemd[1]: Started Nix Daemon. worker2 # [ 34.700139] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 34.724436] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5) worker2 # [ 34.821820] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 2/5) worker2 # [ 34.843005] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 361 ms (attempt 3/5) worker2 # [ 35.211416] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 543 ms (attempt 4/5) worker2 # [ 35.757709] nix-grpc-daemon[777]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 35.763406] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 35.776140] nix-grpc-daemon[777]: ts=2026-09-21T09:28:03Z level=debug event=path_info_miss path=1riwj2yl1fyad56y7izqz2z8iyxylapg-nixos-system-client-test error="error: path '/nix/store/1riwj2yl1fyad56y7izqz2z8iyxylapg-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 35.799993] nix-grpc-daemon[777]: ts=2026-09-21T09:28:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 35.811924] nix-grpc-daemon[777]: ts=2026-09-21T09:28:03Z level=debug event=path_info_miss path=1riwj2yl1fyad56y7izqz2z8iyxylapg-nixos-system-client-test error="error: path '/nix/store/1riwj2yl1fyad56y7izqz2z8iyxylapg-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds) client: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds) worker1 # [ 36.246018] nix-grpc-daemon[775]: ts=2026-09-21T09:28:03Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 36.250761] nix-grpc-daemon[775]: ts=2026-09-21T09:28:03Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:37656 worker2 # [ 36.272672] nix-grpc-daemon[777]: ts=2026-09-21T09:28:03Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:40298 worker2 # [ 36.283578] nix-grpc-daemon[777]: ts=2026-09-21T09:28:03Z level=debug event=path_info_miss path=1riwj2yl1fyad56y7izqz2z8iyxylapg-nixos-system-client-test error="error: path '/nix/store/1riwj2yl1fyad56y7izqz2z8iyxylapg-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 36.297196] nix-grpc-daemon[777]: ts=2026-09-21T09:28:03Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:40298 worker2 # [ 36.304800] nix-grpc-daemon[777]: ts=2026-09-21T09:28:03Z level=debug event=path_info_miss path=1riwj2yl1fyad56y7izqz2z8iyxylapg-nixos-system-client-test error="error: path '/nix/store/1riwj2yl1fyad56y7izqz2z8iyxylapg-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds) worker2 # [ 38.637324] nix-grpc-daemon[777]: ts=2026-09-21T09:28:06Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 38.889487] nix-grpc-daemon[777]: ts=2026-09-21T09:28:06Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.89 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 39.159409] nix-grpc-daemon[775]: ts=2026-09-21T09:28:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37656 worker2 # [ 39.174720] nix-grpc-daemon[777]: ts=2026-09-21T09:28:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 39.216944] nix-grpc-daemon[777]: ts=2026-09-21T09:28:06Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 39.222755] nix-grpc-daemon[777]: ts=2026-09-21T09:28:06Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 39.257893] nix-grpc-daemon[775]: ts=2026-09-21T09:28:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 39.274165] nix-grpc-daemon[775]: ts=2026-09-21T09:28:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 client # copying 1 paths to 'lb:50051'... worker1 # [ 39.284185] nix-grpc-daemon[775]: ts=2026-09-21T09:28:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 39.311337] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 39.331531] nix-grpc-daemon[775]: ts=2026-09-21T09:28:06Z level=info event=niks3_push_started pid=853 worker1 # [ 39.602763] nix-grpc-daemon[853]: time=2026-09-21T09:28:07.233Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 39.795448] nix-daemon[839]: accepted connection from pid 866, user nix-grpc-daemon (trusted) worker1 # [ 39.813762] nix-daemon[839]: reaped child process 869, status = succeeded worker1 # [ 39.986559] nix-daemon[839]: accepted connection from pid 871, user nix-grpc-daemon (trusted) worker1 # [ 40.002621] nix-daemon[839]: reaped child process 874, status = succeeded lb # [ 40.021067] niks3-server[1023]: 2026/09/21 09:28:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.039857] nix-grpc-daemon[853]: time=2026-09-21T09:28:07.671Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 40.043638] nix-grpc-daemon[853]: time=2026-09-21T09:28:07.673Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 40.092519] niks3-server[1023]: 2026/09/21 09:28:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 40.108508] niks3-server[1023]: 2026/09/21 09:28:07 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 40.145312] niks3-server[1023]: 2026/09/21 09:28:07 INFO Signed narinfos id=1 count=1 worker1 # [ 40.142778] nix-grpc-daemon[853]: time=2026-09-21T09:28:07.773Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.156339] niks3-server[1023]: 2026/09/21 09:28:07 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 40.167447] niks3-server[1023]: 2026/09/21 09:28:07 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 40.181086] niks3-server[1023]: 2026/09/21 09:28:07 INFO Completed upload id=1 worker1 # [ 40.175721] nix-grpc-daemon[853]: time=2026-09-21T09:28:07.807Z level=INFO msg="Upload complete. (564ms)" lb # [ 40.192805] niks3-server[1023]: 2026/09/21 09:28:07 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker1 # [ 40.189426] nix-grpc-daemon[775]: ts=2026-09-21T09:28:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 40.208062] nix-grpc-daemon[775]: ts=2026-09-21T09:28:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 40.217738] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 40.224193] nix-daemon[839]: reaped child process 851, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker1 # [ 40.234449] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) lb # [ 40.853434] envoy[913]: conn peer=[2001:db8:1::1]:32868 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2441 lb # [ 40.858534] envoy[913]: conn peer=[2001:db8:1::1]:32880 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=77 lb # [ 40.863775] envoy[913]: conn peer=[2001:db8:1::1]:32886 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=13 lb # [ 40.869459] envoy[913]: conn peer=[2001:db8:1::1]:32890 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=13 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 41.483680] nix-daemon[839]: reaped child process 878, status = succeeded worker1 # [ 41.672380] nix-daemon[839]: accepted connection from pid 894, user nix-grpc-daemon (trusted) worker1 # [ 41.689576] nix-daemon[839]: reaped child process 897, status = succeeded lb # [ 41.710101] niks3-server[1023]: 2026/09/21 09:28:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.720844] nix-grpc-daemon[853]: time=2026-09-21T09:28:09.350Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 41.723373] nix-grpc-daemon[853]: time=2026-09-21T09:28:09.351Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 41.770554] niks3-server[1023]: 2026/09/21 09:28:09 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker1 # [ 41.778302] nix-grpc-daemon[853]: time=2026-09-21T09:28:09.410Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.786262] niks3-server[1023]: 2026/09/21 09:28:09 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 41.794019] niks3-server[1023]: 2026/09/21 09:28:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 41.802262] niks3-server[1023]: 2026/09/21 09:28:09 INFO Signed narinfos id=2 count=1 lb # [ 41.806311] niks3-server[1023]: 2026/09/21 09:28:09 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 41.817589] niks3-server[1023]: 2026/09/21 09:28:09 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 41.823970] niks3-server[1023]: 2026/09/21 09:28:09 INFO Completed upload id=2 worker1 # [ 41.818422] nix-grpc-daemon[853]: time=2026-09-21T09:28:09.450Z level=INFO msg="Upload complete. (365ms)" lb # [ 41.827542] niks3-server[1023]: 2026/09/21 09:28:09 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 41.831160] nix-grpc-daemon[775]: ts=2026-09-21T09:28:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 41.853287] nix-grpc-daemon[777]: ts=2026-09-21T09:28:09Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker1 # [ 41.850941] nix-daemon[839]: reaped child process 876, status = succeeded worker2 # [ 41.858962] nix-grpc-daemon[777]: ts=2026-09-21T09:28:09Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 41.890622] nix-grpc-daemon[775]: ts=2026-09-21T09:28:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 41.905658] nix-grpc-daemon[775]: ts=2026-09-21T09:28:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 client # copying 1 paths to 'lb:50051'... worker1 # [ 41.920315] nix-grpc-daemon[853]: time=2026-09-21T09:28:09.552Z level=INFO msg="All 1 paths already cached" worker1 # [ 41.926319] nix-grpc-daemon[775]: ts=2026-09-21T09:28:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 41.948491] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 42.153247] nix-daemon[839]: accepted connection from pid 901, user nix-grpc-daemon (trusted) worker1 # [ 42.173363] nix-daemon[839]: reaped child process 904, status = succeeded worker1 # [ 42.347099] nix-daemon[839]: accepted connection from pid 906, user nix-grpc-daemon (trusted) worker1 # [ 42.363980] nix-daemon[839]: reaped child process 909, status = succeeded lb # [ 42.382061] niks3-server[1023]: 2026/09/21 09:28:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.387843] nix-grpc-daemon[853]: time=2026-09-21T09:28:10.019Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 42.390180] nix-grpc-daemon[853]: time=2026-09-21T09:28:10.021Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 42.417122] niks3-server[1023]: 2026/09/21 09:28:10 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 42.431986] niks3-server[1023]: 2026/09/21 09:28:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker1 # [ 42.432732] nix-grpc-daemon[853]: time=2026-09-21T09:28:10.064Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.444206] niks3-server[1023]: 2026/09/21 09:28:10 INFO Signed narinfos id=3 count=1 lb # [ 42.450348] niks3-server[1023]: 2026/09/21 09:28:10 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 42.460058] niks3-server[1023]: 2026/09/21 09:28:10 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete worker1 # [ 42.453674] nix-grpc-daemon[853]: time=2026-09-21T09:28:10.085Z level=INFO msg="Upload complete. (487ms)" lb # [ 42.466094] niks3-server[1023]: 2026/09/21 09:28:10 INFO Completed upload id=3 lb # [ 42.469735] niks3-server[1023]: 2026/09/21 09:28:10 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker1 # [ 42.460687] nix-grpc-daemon[775]: ts=2026-09-21T09:28:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 42.473444] nix-grpc-daemon[775]: ts=2026-09-21T09:28:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 42.485691] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 42.495984] nix-daemon[839]: reaped child process 899, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker1 # [ 42.512946] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 43.739135] nix-daemon[839]: reaped child process 913, status = succeeded worker1 # [ 43.894484] nix-daemon[839]: accepted connection from pid 930, user nix-grpc-daemon (trusted) worker1 # [ 43.912244] nix-daemon[839]: reaped child process 933, status = succeeded lb # [ 43.933168] niks3-server[1023]: 2026/09/21 09:28:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.937106] nix-grpc-daemon[853]: time=2026-09-21T09:28:11.568Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 43.939455] nix-grpc-daemon[853]: time=2026-09-21T09:28:11.570Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 43.965303] niks3-server[1023]: 2026/09/21 09:28:11 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker1 # [ 43.980966] nix-grpc-daemon[853]: time=2026-09-21T09:28:11.612Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.981544] niks3-server[1023]: 2026/09/21 09:28:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 43.995511] niks3-server[1023]: 2026/09/21 09:28:11 INFO Signed narinfos id=4 count=1 lb # [ 44.001024] niks3-server[1023]: 2026/09/21 09:28:11 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 44.006341] niks3-server[1023]: 2026/09/21 09:28:11 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 44.013803] niks3-server[1023]: 2026/09/21 09:28:11 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 44.017810] niks3-server[1023]: 2026/09/21 09:28:11 INFO Completed upload id=4 worker1 # [ 44.011642] nix-grpc-daemon[853]: time=2026-09-21T09:28:11.643Z level=INFO msg="Upload complete. (285ms)" lb # [ 44.020223] niks3-server[1023]: 2026/09/21 09:28:11 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 44.020980] nix-grpc-daemon[775]: ts=2026-09-21T09:28:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 44.039447] nix-grpc-daemon[777]: ts=2026-09-21T09:28:11Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker1 # [ 44.037589] nix-daemon[839]: reaped child process 911, status = succeeded worker2 # [ 44.045034] nix-grpc-daemon[777]: ts=2026-09-21T09:28:11Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 44.075098] nix-grpc-daemon[775]: ts=2026-09-21T09:28:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 44.090061] nix-grpc-daemon[775]: ts=2026-09-21T09:28:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 44.105214] nix-grpc-daemon[853]: time=2026-09-21T09:28:11.737Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 44.115282] nix-grpc-daemon[775]: ts=2026-09-21T09:28:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 44.138259] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 44.349069] nix-daemon[839]: accepted connection from pid 937, user nix-grpc-daemon (trusted) worker1 # [ 44.368984] nix-daemon[839]: reaped child process 940, status = succeeded worker1 # [ 44.543286] nix-daemon[839]: accepted connection from pid 942, user nix-grpc-daemon (trusted) worker1 # [ 44.558803] nix-daemon[839]: reaped child process 945, status = succeeded lb # [ 44.580142] niks3-server[1023]: 2026/09/21 09:28:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 44.584091] nix-grpc-daemon[853]: time=2026-09-21T09:28:12.215Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 44.585601] nix-grpc-daemon[853]: time=2026-09-21T09:28:12.215Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 44.612142] niks3-server[1023]: 2026/09/21 09:28:12 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 44.623176] niks3-server[1023]: 2026/09/21 09:28:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 44.623396] nix-grpc-daemon[853]: time=2026-09-21T09:28:12.255Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.632813] niks3-server[1023]: 2026/09/21 09:28:12 INFO Signed narinfos id=5 count=1 lb # [ 44.642159] niks3-server[1023]: 2026/09/21 09:28:12 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 44.651057] niks3-server[1023]: 2026/09/21 09:28:12 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete worker1 # [ 44.651883] nix-grpc-daemon[853]: time=2026-09-21T09:28:12.283Z level=INFO msg="Upload complete. (495ms)" lb # [ 44.660291] niks3-server[1023]: 2026/09/21 09:28:12 INFO Completed upload id=5 lb # [ 44.664513] niks3-server[1023]: 2026/09/21 09:28:12 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 44.660297] nix-grpc-daemon[775]: ts=2026-09-21T09:28:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 44.674500] nix-grpc-daemon[775]: ts=2026-09-21T09:28:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 44.681193] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 44.686297] nix-daemon[839]: reaped child process 935, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... worker1 # [ 44.697797] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 46.128986] nix-daemon[839]: reaped child process 949, status = succeeded worker1 # [ 46.290521] nix-daemon[839]: accepted connection from pid 966, user nix-grpc-daemon (trusted) worker1 # [ 46.308577] nix-daemon[839]: reaped child process 969, status = succeeded lb # [ 46.329774] niks3-server[1023]: 2026/09/21 09:28:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 46.335245] nix-grpc-daemon[853]: time=2026-09-21T09:28:13.965Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 46.336999] nix-grpc-daemon[853]: time=2026-09-21T09:28:13.965Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 46.368838] niks3-server[1023]: 2026/09/21 09:28:13 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 46.381000] niks3-server[1023]: 2026/09/21 09:28:13 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 46.391531] niks3-server[1023]: 2026/09/21 09:28:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 46.391309] nix-grpc-daemon[853]: time=2026-09-21T09:28:14.023Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.400291] niks3-server[1023]: 2026/09/21 09:28:14 INFO Signed narinfos id=6 count=1 lb # [ 46.402735] niks3-server[1023]: 2026/09/21 09:28:14 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 46.413583] niks3-server[1023]: 2026/09/21 09:28:14 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 46.421428] niks3-server[1023]: 2026/09/21 09:28:14 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 46.426211] niks3-server[1023]: 2026/09/21 09:28:14 INFO Completed upload id=6 worker1 # [ 46.420220] nix-grpc-daemon[853]: time=2026-09-21T09:28:14.052Z level=INFO msg="Upload complete. (310ms)" worker1 # [ 46.433133] nix-grpc-daemon[775]: ts=2026-09-21T09:28:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker1 # [ 46.449949] nix-daemon[839]: reaped child process 947, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.57 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.24 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.27 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 47.961447] nix-grpc-daemon[775]: ts=2026-09-21T09:28:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37656 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # [ 47.979873] nix-grpc-daemon[775]: ts=2026-09-21T09:28:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 47.991129] nix-grpc-daemon[853]: time=2026-09-21T09:28:15.622Z level=INFO msg="All 2 paths already cached" worker2 # [ 48.021149] nix-grpc-daemon[777]: ts=2026-09-21T09:28:15Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.35 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.42 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 worker1 # [ 49.038007] nix-grpc-daemon[775]: ts=2026-09-21T09:28:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37656 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 49.061622] nix-grpc-daemon[777]: ts=2026-09-21T09:28:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 49.087496] nix-grpc-daemon[777]: ts=2026-09-21T09:28:16Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 49.093616] nix-grpc-daemon[777]: ts=2026-09-21T09:28:16Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 49.123706] nix-grpc-daemon[775]: ts=2026-09-21T09:28:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 49.138488] nix-grpc-daemon[775]: ts=2026-09-21T09:28:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 client # copying 1 paths to 'lb:50051'... worker1 # [ 49.155962] nix-grpc-daemon[853]: time=2026-09-21T09:28:16.787Z level=INFO msg="All 2 paths already cached" client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 49.162126] nix-grpc-daemon[775]: ts=2026-09-21T09:28:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 49.177380] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 49.386153] nix-daemon[839]: accepted connection from pid 986, user nix-grpc-daemon (trusted) worker1 # [ 49.403756] nix-daemon[839]: reaped child process 989, status = succeeded worker1 # [ 49.583184] nix-daemon[839]: accepted connection from pid 991, user nix-grpc-daemon (trusted) worker1 # [ 49.599114] nix-daemon[839]: reaped child process 994, status = succeeded lb # [ 49.616819] niks3-server[1023]: 2026/09/21 09:28:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.620131] nix-grpc-daemon[853]: time=2026-09-21T09:28:17.252Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 49.621986] nix-grpc-daemon[853]: time=2026-09-21T09:28:17.253Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 49.646699] niks3-server[1023]: 2026/09/21 09:28:17 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst worker1 # [ 49.652415] nix-grpc-daemon[853]: time=2026-09-21T09:28:17.284Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.660338] niks3-server[1023]: 2026/09/21 09:28:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 49.671273] niks3-server[1023]: 2026/09/21 09:28:17 INFO Signed narinfos id=7 count=1 lb # [ 49.681085] niks3-server[1023]: 2026/09/21 09:28:17 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls worker1 # [ 49.679124] nix-grpc-daemon[853]: time=2026-09-21T09:28:17.311Z level=INFO msg="Upload complete. (484ms)" lb # [ 49.685565] niks3-server[1023]: 2026/09/21 09:28:17 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 49.690270] niks3-server[1023]: 2026/09/21 09:28:17 INFO Completed upload id=7 lb # [ 49.693228] niks3-server[1023]: 2026/09/21 09:28:17 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker1 # [ 49.687961] nix-grpc-daemon[775]: ts=2026-09-21T09:28:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 49.691454] nix-grpc-daemon[775]: ts=2026-09-21T09:28:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 49.703485] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 49.706135] nix-daemon[839]: reaped child process 984, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker1 # [ 49.718227] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 50.857041] envoy[913]: conn peer=[2001:db8:1::1]:32900 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9605 tx=4083 ms=7297 lb # [ 50.862009] envoy[913]: conn peer=[2001:db8:1::1]:45518 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=476 ms=66 client # farm-top> LOG-farm-top-t1b worker1 # [ 50.941766] nix-daemon[839]: reaped child process 998, status = succeeded worker1 # [ 51.098855] nix-daemon[839]: accepted connection from pid 1014, user nix-grpc-daemon (trusted) worker1 # [ 51.115818] nix-daemon[839]: reaped child process 1017, status = succeeded lb # [ 51.136654] niks3-server[1023]: 2026/09/21 09:28:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 51.140537] nix-grpc-daemon[853]: time=2026-09-21T09:28:18.771Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 51.144837] nix-grpc-daemon[853]: time=2026-09-21T09:28:18.771Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 51.171540] niks3-server[1023]: 2026/09/21 09:28:18 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 51.188880] niks3-server[1023]: 2026/09/21 09:28:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker1 # [ 51.191107] nix-grpc-daemon[853]: time=2026-09-21T09:28:18.822Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.202026] niks3-server[1023]: 2026/09/21 09:28:18 INFO Signed narinfos id=8 count=1 lb # [ 51.207986] niks3-server[1023]: 2026/09/21 09:28:18 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 51.214253] niks3-server[1023]: 2026/09/21 09:28:18 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 51.221898] niks3-server[1023]: 2026/09/21 09:28:18 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 51.226629] niks3-server[1023]: 2026/09/21 09:28:18 INFO Completed upload id=8 worker1 # [ 51.221010] nix-grpc-daemon[853]: time=2026-09-21T09:28:18.852Z level=INFO msg="Upload complete. (294ms)" lb # [ 51.229452] niks3-server[1023]: 2026/09/21 09:28:18 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker1 # [ 51.233132] nix-grpc-daemon[775]: ts=2026-09-21T09:28:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker1 # [ 51.246651] nix-daemon[839]: reaped child process 996, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.51 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.22 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.14 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 51.786825] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 9de2cbf73c4c494fb551edf10a7c5897 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup worker1 # [ 52.059662] nix-grpc-daemon[775]: ts=2026-09-21T09:28:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37656 client # [ 52.060054] nix[886]: don't know how to build these paths: client # [ 52.061174] nix[886]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 52.093623] nix-grpc-daemon[777]: ts=2026-09-21T09:28:19Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 52.099394] nix-grpc-daemon[777]: ts=2026-09-21T09:28:19Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 52.106069] nix-grpc-daemon[777]: ts=2026-09-21T09:28:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 52.122791] nix-grpc-daemon[777]: ts=2026-09-21T09:28:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40298 client # [ 52.120152] nix[886]: copying 1 paths to 'lb:50051'... client # [ 52.122002] nix[886]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 52.137228] nix-grpc-daemon[777]: ts=2026-09-21T09:28:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 52.152763] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 52.179886] nix-grpc-daemon[777]: ts=2026-09-21T09:28:19Z level=info event=niks3_push_started pid=915 worker2 # [ 52.444288] nix-grpc-daemon[915]: time=2026-09-21T09:28:20.070Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 52.637642] nix-daemon[861]: accepted connection from pid 928, user nix-grpc-daemon (trusted) worker2 # [ 52.655439] nix-daemon[861]: reaped child process 931, status = succeeded worker2 # [ 52.828470] nix-daemon[861]: accepted connection from pid 933, user nix-grpc-daemon (trusted) worker2 # [ 52.846081] nix-daemon[861]: reaped child process 936, status = succeeded lb # [ 52.854736] niks3-server[1023]: 2026/09/21 09:28:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 52.869040] nix-grpc-daemon[915]: time=2026-09-21T09:28:20.496Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 52.872331] nix-grpc-daemon[915]: time=2026-09-21T09:28:20.498Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 52.890442] niks3-server[1023]: 2026/09/21 09:28:20 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst worker2 # [ 52.915919] nix-grpc-daemon[915]: time=2026-09-21T09:28:20.543Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.905009] niks3-server[1023]: 2026/09/21 09:28:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 52.916651] niks3-server[1023]: 2026/09/21 09:28:20 INFO Signed narinfos id=9 count=1 client # [ 52.902500] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. lb # [ 52.924136] niks3-server[1023]: 2026/09/21 09:28:20 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 52.936661] niks3-server[1023]: 2026/09/21 09:28:20 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 52.942957] niks3-server[1023]: 2026/09/21 09:28:20 INFO Completed upload id=9 worker2 # [ 52.946248] nix-grpc-daemon[915]: time=2026-09-21T09:28:20.573Z level=INFO msg="Upload complete. (493ms)" client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds) lb # [ 52.945756] niks3-server[1023]: 2026/09/21 09:28:20 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 52.956766] nix-grpc-daemon[777]: ts=2026-09-21T09:28:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 52.966250] nix-grpc-daemon[777]: ts=2026-09-21T09:28:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 52.972972] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 52.978270] nix-daemon[861]: reaped child process 913, status = succeeded client # Running as unit: dedup2.service; invocation ID: f446fc22365042b583c425c90535c67f client # [ 52.971182] nix[886]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 52.991261] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # [ 53.261671] nix[902]: don't know how to build these paths: client # [ 53.262745] nix[902]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 53.267298] nix-grpc-daemon[775]: ts=2026-09-21T09:28:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37656 worker2 # [ 53.289147] nix-grpc-daemon[777]: ts=2026-09-21T09:28:20Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 client # [ 53.281216] nix[902]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 53.297058] nix-grpc-daemon[777]: ts=2026-09-21T09:28:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.06 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 56.629054] nix-daemon[861]: reaped child process 940, status = succeeded worker2 # [ 56.804627] nix-daemon[861]: accepted connection from pid 972, user nix-grpc-daemon (trusted) worker2 # [ 56.821636] nix-daemon[861]: reaped child process 975, status = succeeded lb # [ 56.830330] niks3-server[1023]: 2026/09/21 09:28:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 56.844427] nix-grpc-daemon[915]: time=2026-09-21T09:28:24.471Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 56.845912] nix-grpc-daemon[915]: time=2026-09-21T09:28:24.471Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 56.873437] niks3-server[1023]: 2026/09/21 09:28:24 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 56.885284] niks3-server[1023]: 2026/09/21 09:28:24 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 56.898295] nix-grpc-daemon[915]: time=2026-09-21T09:28:24.524Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.896100] niks3-server[1023]: 2026/09/21 09:28:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 56.902520] niks3-server[1023]: 2026/09/21 09:28:24 INFO Signed narinfos id=10 count=1 lb # [ 56.907646] niks3-server[1023]: 2026/09/21 09:28:24 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 56.915479] niks3-server[1023]: 2026/09/21 09:28:24 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 56.922002] niks3-server[1023]: 2026/09/21 09:28:24 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo lb # [ 56.927548] niks3-server[1023]: 2026/09/21 09:28:24 INFO Completed upload id=10 worker2 # [ 56.931493] nix-grpc-daemon[915]: time=2026-09-21T09:28:24.559Z level=INFO msg="Upload complete. (328ms)" worker2 # [ 56.945115] nix-grpc-daemon[777]: ts=2026-09-21T09:28:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 56.959010] nix-grpc-daemon[777]: ts=2026-09-21T09:28:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 56.966050] nix-daemon[861]: reaped child process 938, status = succeeded client # [ 56.966737] systemd[1]: dedup2.service: Deactivated successfully. client # [ 56.972756] systemd[1]: dedup2.service: Consumed 205ms CPU time over 4.068s wall clock time, 33.2M memory peak, 5.9K incoming IP traffic, 5.7K outgoing IP traffic. client # [ 57.021422] systemd[1]: dedup1.service: Deactivated successfully. client # [ 57.025069] systemd[1]: dedup1.service: Consumed 174ms CPU time over 5.237s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.5K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.28 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 58.218565] systemd[1]: Started Nix Daemon. client # [ 58.402119] nix-daemon[944]: accepted connection from pid 941, user root (trusted) worker1 # [ 58.624877] nix-grpc-daemon[775]: ts=2026-09-21T09:28:26Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37656 worker2 # [ 58.638727] nix-grpc-daemon[777]: ts=2026-09-21T09:28:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 58.657653] nix-grpc-daemon[777]: ts=2026-09-21T09:28:26Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 58.663534] nix-grpc-daemon[777]: ts=2026-09-21T09:28:26Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 58.694240] nix-grpc-daemon[775]: ts=2026-09-21T09:28:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 58.710040] nix-grpc-daemon[775]: ts=2026-09-21T09:28:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 58.725116] nix-grpc-daemon[775]: ts=2026-09-21T09:28:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 58.740249] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 58.955259] nix-daemon[839]: accepted connection from pid 1042, user nix-grpc-daemon (trusted) worker1 # [ 58.973127] nix-daemon[839]: reaped child process 1045, status = succeeded worker1 # [ 59.149126] nix-daemon[839]: accepted connection from pid 1047, user nix-grpc-daemon (trusted) worker1 # [ 59.165088] nix-daemon[839]: reaped child process 1050, status = succeeded lb # [ 59.182851] niks3-server[1023]: 2026/09/21 09:28:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.186597] nix-grpc-daemon[853]: time=2026-09-21T09:28:26.818Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 59.188185] nix-grpc-daemon[853]: time=2026-09-21T09:28:26.818Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 59.210987] niks3-server[1023]: 2026/09/21 09:28:26 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst worker1 # [ 59.218808] nix-grpc-daemon[853]: time=2026-09-21T09:28:26.850Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.224385] niks3-server[1023]: 2026/09/21 09:28:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 59.235384] niks3-server[1023]: 2026/09/21 09:28:26 INFO Signed narinfos id=11 count=1 lb # [ 59.242078] niks3-server[1023]: 2026/09/21 09:28:26 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 59.254717] niks3-server[1023]: 2026/09/21 09:28:26 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker1 # [ 59.253331] nix-grpc-daemon[853]: time=2026-09-21T09:28:26.885Z level=INFO msg="Upload complete. (495ms)" lb # [ 59.259733] niks3-server[1023]: 2026/09/21 09:28:26 INFO Completed upload id=11 lb # [ 59.263746] niks3-server[1023]: 2026/09/21 09:28:26 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 59.259354] nix-grpc-daemon[775]: ts=2026-09-21T09:28:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 59.272849] nix-grpc-daemon[775]: ts=2026-09-21T09:28:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 59.279051] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 59.283423] nix-daemon[839]: reaped child process 1040, status = succeeded worker1 # [ 59.296546] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 60.542448] nix-daemon[839]: reaped child process 1054, status = succeeded worker1 # [ 60.719402] nix-daemon[839]: accepted connection from pid 1070, user nix-grpc-daemon (trusted) worker1 # [ 60.737622] nix-daemon[839]: reaped child process 1073, status = succeeded lb # [ 60.756896] niks3-server[1023]: 2026/09/21 09:28:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.763724] nix-grpc-daemon[853]: time=2026-09-21T09:28:28.392Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 60.765427] nix-grpc-daemon[853]: time=2026-09-21T09:28:28.392Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 60.792936] niks3-server[1023]: 2026/09/21 09:28:28 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 60.805906] niks3-server[1023]: 2026/09/21 09:28:28 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 60.815324] niks3-server[1023]: 2026/09/21 09:28:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker1 # [ 60.815677] nix-grpc-daemon[853]: time=2026-09-21T09:28:28.447Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.821382] niks3-server[1023]: 2026/09/21 09:28:28 INFO Signed narinfos id=12 count=1 lb # [ 60.827632] niks3-server[1023]: 2026/09/21 09:28:28 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 60.834063] niks3-server[1023]: 2026/09/21 09:28:28 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 60.839854] niks3-server[1023]: 2026/09/21 09:28:28 INFO Completed upload id=12 worker1 # [ 60.833362] nix-grpc-daemon[853]: time=2026-09-21T09:28:28.465Z level=INFO msg="Upload complete. (326ms)" lb # [ 60.842347] niks3-server[1023]: 2026/09/21 09:28:28 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker1 # [ 60.844935] nix-grpc-daemon[775]: ts=2026-09-21T09:28:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 lb # [ 60.855324] envoy[913]: conn peer=[2001:db8:1::1]:45520 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4215 tx=1821 ms=2207 worker2 # [ 60.858058] nix-grpc-daemon[777]: ts=2026-09-21T09:28:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40298 worker1 # [ 60.858457] nix-daemon[839]: reaped child process 1052, status = succeeded lb # [ 60.859878] envoy[913]: conn peer=[2001:db8:1::1]:56412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=3683 lb # [ 60.867375] envoy[913]: conn peer=[2001:db8:1::1]:56396 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3005 tx=1452 ms=4938 worker2 # [ 60.880539] nix-grpc-daemon[777]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 60.915006] nix-grpc-daemon[775]: ts=2026-09-21T09:28:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 60.921981] nix-grpc-daemon[775]: ts=2026-09-21T09:28:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 61.188927] nix-grpc-daemon[775]: ts=2026-09-21T09:28:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37656 worker2 # [ 61.204430] nix-grpc-daemon[777]: ts=2026-09-21T09:28:28Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 61.218767] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 61.276064] nix-grpc-daemon[775]: ts=2026-09-21T09:28:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 61.286628] nix-grpc-daemon[853]: time=2026-09-21T09:28:28.918Z level=INFO msg="All 1 paths already cached" worker2 # [ 61.317044] nix-grpc-daemon[777]: ts=2026-09-21T09:28:28Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 61.323518] nix-grpc-daemon[777]: ts=2026-09-21T09:28:28Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 61.322639] nix-grpc-daemon[775]: ts=2026-09-21T09:28:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 61.338163] nix-grpc-daemon[775]: ts=2026-09-21T09:28:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 61.352354] nix-grpc-daemon[853]: time=2026-09-21T09:28:28.984Z level=INFO msg="All 1 paths already cached" worker1 # [ 61.361390] nix-grpc-daemon[775]: ts=2026-09-21T09:28:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 61.384886] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 61.595579] nix-daemon[839]: accepted connection from pid 1077, user nix-grpc-daemon (trusted) worker1 # [ 61.613256] nix-daemon[839]: reaped child process 1080, status = succeeded worker1 # [ 61.782487] nix-daemon[839]: accepted connection from pid 1082, user nix-grpc-daemon (trusted) worker1 # [ 61.798486] nix-daemon[839]: reaped child process 1085, status = succeeded lb # [ 61.817935] niks3-server[1023]: 2026/09/21 09:28:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 61.819905] nix-grpc-daemon[853]: time=2026-09-21T09:28:29.451Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 61.821536] nix-grpc-daemon[853]: time=2026-09-21T09:28:29.451Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 61.843210] niks3-server[1023]: 2026/09/21 09:28:29 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker1 # [ 61.849199] nix-grpc-daemon[853]: time=2026-09-21T09:28:29.481Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.858948] niks3-server[1023]: 2026/09/21 09:28:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 61.868848] niks3-server[1023]: 2026/09/21 09:28:29 INFO Signed narinfos id=13 count=1 lb # [ 61.873660] niks3-server[1023]: 2026/09/21 09:28:29 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 61.881873] niks3-server[1023]: 2026/09/21 09:28:29 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete worker1 # [ 61.880402] nix-grpc-daemon[853]: time=2026-09-21T09:28:29.512Z level=INFO msg="Upload complete. (478ms)" lb # [ 61.886729] niks3-server[1023]: 2026/09/21 09:28:29 INFO Completed upload id=13 lb # [ 61.890592] niks3-server[1023]: 2026/09/21 09:28:29 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker1 # [ 61.888624] nix-grpc-daemon[775]: ts=2026-09-21T09:28:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 61.898862] nix-grpc-daemon[775]: ts=2026-09-21T09:28:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 61.906578] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 61.908835] nix-daemon[839]: reaped child process 1075, status = succeeded worker1 # [ 61.918972] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 63.381936] nix-daemon[839]: reaped child process 1089, status = succeeded worker1 # [ 63.683338] nix-daemon[839]: accepted connection from pid 1105, user nix-grpc-daemon (trusted) worker1 # [ 63.710651] nix-daemon[839]: reaped child process 1108, status = succeeded lb # [ 63.734946] niks3-server[1023]: 2026/09/21 09:28:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 63.750661] nix-grpc-daemon[853]: time=2026-09-21T09:28:31.379Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 63.762920] nix-grpc-daemon[853]: time=2026-09-21T09:28:31.384Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 63.804831] niks3-server[1023]: 2026/09/21 09:28:31 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 63.825366] niks3-server[1023]: 2026/09/21 09:28:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker1 # [ 63.821232] nix-grpc-daemon[853]: time=2026-09-21T09:28:31.451Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.836176] niks3-server[1023]: 2026/09/21 09:28:31 INFO Signed narinfos id=14 count=1 lb # [ 63.847791] niks3-server[1023]: 2026/09/21 09:28:31 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 63.860848] niks3-server[1023]: 2026/09/21 09:28:31 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 63.870646] niks3-server[1023]: 2026/09/21 09:28:31 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 63.881077] niks3-server[1023]: 2026/09/21 09:28:31 INFO Completed upload id=14 lb # [ 63.884189] niks3-server[1023]: 2026/09/21 09:28:31 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker1 # [ 63.873333] nix-grpc-daemon[853]: time=2026-09-21T09:28:31.505Z level=INFO msg="Upload complete. (541ms)" worker1 # [ 63.891049] nix-grpc-daemon[775]: ts=2026-09-21T09:28:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker1 # [ 63.912603] nix-grpc-daemon[775]: ts=2026-09-21T09:28:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 63.929231] nix-daemon[839]: reaped child process 1087, status = succeeded worker1 # [ 63.956542] nix-grpc-daemon[775]: ts=2026-09-21T09:28:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 63.963462] nix-grpc-daemon[775]: ts=2026-09-21T09:28:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 64.035197] nix-grpc-daemon[777]: ts=2026-09-21T09:28:31Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=2 bytes_in=312 bytes_out=200 worker2 # [ 64.044788] nix-daemon[861]: reaped child process 990, status = succeeded worker1 # [ 64.342331] nix-grpc-daemon[775]: ts=2026-09-21T09:28:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37656 worker2 # [ 64.359957] nix-grpc-daemon[777]: ts=2026-09-21T09:28:31Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 64.373199] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 64.432634] nix-grpc-daemon[775]: ts=2026-09-21T09:28:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 64.442939] nix-grpc-daemon[853]: time=2026-09-21T09:28:32.074Z level=INFO msg="All 2 paths already cached" worker2 # [ 64.474448] nix-grpc-daemon[777]: ts=2026-09-21T09:28:32Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 64.480856] nix-grpc-daemon[777]: ts=2026-09-21T09:28:32Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 64.476097] nix-grpc-daemon[775]: ts=2026-09-21T09:28:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 64.492156] nix-grpc-daemon[775]: ts=2026-09-21T09:28:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 64.505932] nix-grpc-daemon[853]: time=2026-09-21T09:28:32.137Z level=INFO msg="All 2 paths already cached" worker1 # [ 64.515016] nix-grpc-daemon[775]: ts=2026-09-21T09:28:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 64.531428] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 64.746332] nix-daemon[839]: accepted connection from pid 1112, user nix-grpc-daemon (trusted) worker1 # [ 64.765782] nix-daemon[839]: reaped child process 1115, status = succeeded worker1 # [ 64.935313] nix-daemon[839]: accepted connection from pid 1117, user nix-grpc-daemon (trusted) worker1 # [ 64.952831] nix-daemon[839]: reaped child process 1120, status = succeeded lb # [ 64.971470] niks3-server[1023]: 2026/09/21 09:28:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 64.976211] nix-grpc-daemon[853]: time=2026-09-21T09:28:32.607Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 64.977665] nix-grpc-daemon[853]: time=2026-09-21T09:28:32.607Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 64.997073] niks3-server[1023]: 2026/09/21 09:28:32 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker1 # [ 65.001203] nix-grpc-daemon[853]: time=2026-09-21T09:28:32.633Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.006894] niks3-server[1023]: 2026/09/21 09:28:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 65.014547] niks3-server[1023]: 2026/09/21 09:28:32 INFO Signed narinfos id=15 count=1 lb # [ 65.018496] niks3-server[1023]: 2026/09/21 09:28:32 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls worker1 # [ 65.019807] nix-grpc-daemon[853]: time=2026-09-21T09:28:32.651Z level=INFO msg="Upload complete. (469ms)" lb # [ 65.026282] niks3-server[1023]: 2026/09/21 09:28:32 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 65.030851] niks3-server[1023]: 2026/09/21 09:28:32 INFO Completed upload id=15 worker1 # [ 65.025378] nix-grpc-daemon[775]: ts=2026-09-21T09:28:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 65.033605] niks3-server[1023]: 2026/09/21 09:28:32 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 65.035360] nix-grpc-daemon[775]: ts=2026-09-21T09:28:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 65.038161] nix-daemon[839]: reaped child process 1110, status = succeeded worker1 # [ 65.044106] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 65.055296] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 66.276253] nix-daemon[839]: reaped child process 1124, status = succeeded worker1 # [ 66.430169] nix-daemon[839]: accepted connection from pid 1140, user nix-grpc-daemon (trusted) worker1 # [ 66.448399] nix-daemon[839]: reaped child process 1143, status = succeeded lb # [ 66.467181] niks3-server[1023]: 2026/09/21 09:28:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 66.472676] nix-grpc-daemon[853]: time=2026-09-21T09:28:34.104Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 66.478876] nix-grpc-daemon[853]: time=2026-09-21T09:28:34.106Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 66.510261] niks3-server[1023]: 2026/09/21 09:28:34 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 66.523061] niks3-server[1023]: 2026/09/21 09:28:34 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker1 # [ 66.528862] nix-grpc-daemon[853]: time=2026-09-21T09:28:34.160Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.534348] niks3-server[1023]: 2026/09/21 09:28:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 66.542021] niks3-server[1023]: 2026/09/21 09:28:34 INFO Signed narinfos id=16 count=1 lb # [ 66.548280] niks3-server[1023]: 2026/09/21 09:28:34 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 66.557198] niks3-server[1023]: 2026/09/21 09:28:34 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 66.566834] niks3-server[1023]: 2026/09/21 09:28:34 INFO Completed upload id=16 worker1 # [ 66.561155] nix-grpc-daemon[853]: time=2026-09-21T09:28:34.193Z level=INFO msg="Upload complete. (297ms)" lb # [ 66.570113] niks3-server[1023]: 2026/09/21 09:28:34 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 66.571372] nix-grpc-daemon[775]: ts=2026-09-21T09:28:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker2 # [ 66.586526] nix-grpc-daemon[777]: ts=2026-09-21T09:28:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40298 worker1 # [ 66.587692] nix-daemon[839]: reaped child process 1122, status = succeeded worker2 # [ 66.608720] nix-grpc-daemon[777]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker2 # [ 66.626963] nix-grpc-daemon[777]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker2 # [ 66.668117] nix-grpc-daemon[777]: ts=2026-09-21T09:28:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 66.674647] nix-grpc-daemon[777]: ts=2026-09-21T09:28:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 66.738577] nix-grpc-daemon[777]: ts=2026-09-21T09:28:34Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=2 bytes_in=376 bytes_out=200 worker2 # [ 66.746106] nix-daemon[861]: reaped child process 995, status = succeeded client # [ 66.791808] nix-daemon[944]: reaped child process 946, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.83 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.96 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.24 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 68.084460] nix-daemon[944]: accepted connection from pid 1029, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 68.318747] nix-grpc-daemon[777]: ts=2026-09-21T09:28:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40298 client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 68.315240] nix-grpc-daemon[775]: ts=2026-09-21T09:28:35Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 68.329090] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 68.405918] nix-grpc-daemon[777]: ts=2026-09-21T09:28:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40298 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker2 # [ 68.423516] nix-grpc-daemon[777]: ts=2026-09-21T09:28:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 68.439833] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 68.654560] nix-daemon[861]: accepted connection from pid 1007, user nix-grpc-daemon (trusted) worker2 # [ 68.674301] nix-daemon[861]: reaped child process 1010, status = succeeded lb # [ 68.683940] niks3-server[1023]: 2026/09/21 09:28:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 68.697100] nix-grpc-daemon[915]: time=2026-09-21T09:28:36.324Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 68.698568] nix-grpc-daemon[915]: time=2026-09-21T09:28:36.324Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 68.712544] niks3-server[1023]: 2026/09/21 09:28:36 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker2 # [ 68.728421] nix-grpc-daemon[915]: time=2026-09-21T09:28:36.355Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.725046] niks3-server[1023]: 2026/09/21 09:28:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 68.735751] niks3-server[1023]: 2026/09/21 09:28:36 INFO Signed narinfos id=17 count=1 lb # [ 68.743457] niks3-server[1023]: 2026/09/21 09:28:36 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 68.751704] niks3-server[1023]: 2026/09/21 09:28:36 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 68.758673] niks3-server[1023]: 2026/09/21 09:28:36 INFO Completed upload id=17 worker2 # [ 68.762474] nix-grpc-daemon[915]: time=2026-09-21T09:28:36.390Z level=INFO msg="Upload complete. (306ms)" lb # [ 68.761707] niks3-server[1023]: 2026/09/21 09:28:36 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker2 # [ 68.772247] nix-grpc-daemon[777]: ts=2026-09-21T09:28:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=0 paths=1 nar_bytes_in=120 worker2 # [ 68.785181] nix-daemon[861]: reaped child process 1005, status = succeeded worker2 # [ 68.790446] nix-grpc-daemon[777]: ts=2026-09-21T09:28:36Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 68.794841] nix-grpc-daemon[777]: ts=2026-09-21T09:28:36Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 68.836277] nix-grpc-daemon[777]: ts=2026-09-21T09:28:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 68.850758] nix-grpc-daemon[777]: ts=2026-09-21T09:28:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40298 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 68.869194] nix-grpc-daemon[777]: ts=2026-09-21T09:28:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40298 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 68.883026] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 69.082063] nix-daemon[861]: accepted connection from pid 1016, user nix-grpc-daemon (trusted) worker2 # [ 69.098835] nix-daemon[861]: reaped child process 1019, status = succeeded worker2 # [ 69.269116] nix-daemon[861]: accepted connection from pid 1021, user nix-grpc-daemon (trusted) worker2 # [ 69.285401] nix-daemon[861]: reaped child process 1024, status = succeeded lb # [ 69.292538] niks3-server[1023]: 2026/09/21 09:28:36 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 69.302866] niks3-server[1023]: 2026/09/21 09:28:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 69.315708] nix-grpc-daemon[915]: time=2026-09-21T09:28:36.942Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 69.317372] nix-grpc-daemon[915]: time=2026-09-21T09:28:36.942Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker2 # [ 69.319221] nix-grpc-daemon[915]: time=2026-09-21T09:28:36.943Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 69.336819] niks3-server[1023]: 2026/09/21 09:28:36 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 69.350651] niks3-server[1023]: 2026/09/21 09:28:36 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 69.364284] niks3-server[1023]: 2026/09/21 09:28:36 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 69.370206] niks3-server[1023]: 2026/09/21 09:28:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign worker2 # [ 69.382776] nix-grpc-daemon[915]: time=2026-09-21T09:28:37.009Z level=INFO msg="Uploading 3 narinfos" lb # [ 69.380341] niks3-server[1023]: 2026/09/21 09:28:36 INFO Signed narinfos id=18 count=1 lb # [ 69.382644] niks3-server[1023]: 2026/09/21 09:28:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 69.393252] niks3-server[1023]: 2026/09/21 09:28:36 INFO Signed narinfos id=19 count=2 lb # [ 69.395404] niks3-server[1023]: 2026/09/21 09:28:36 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 69.406002] niks3-server[1023]: 2026/09/21 09:28:37 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 69.417277] niks3-server[1023]: 2026/09/21 09:28:37 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 69.424757] niks3-server[1023]: 2026/09/21 09:28:37 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 69.427573] niks3-server[1023]: 2026/09/21 09:28:37 INFO Completed upload id=18 lb # [ 69.431344] niks3-server[1023]: 2026/09/21 09:28:37 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete worker2 # [ 69.435236] nix-grpc-daemon[915]: time=2026-09-21T09:28:37.062Z level=INFO msg="Upload complete. (534ms)" lb # [ 69.434416] niks3-server[1023]: 2026/09/21 09:28:37 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 69.438026] niks3-server[1023]: 2026/09/21 09:28:37 INFO Completed upload id=19 worker2 # [ 69.449293] nix-grpc-daemon[777]: ts=2026-09-21T09:28:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 69.460940] nix-grpc-daemon[777]: ts=2026-09-21T09:28:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 69.475134] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 69.479941] nix-daemon[861]: reaped child process 1014, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 69.493567] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 70.857494] envoy[913]: conn peer=[2001:db8:1::1]:50574 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=29 lb # [ 70.862767] envoy[913]: conn peer=[2001:db8:1::1]:56428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3407 tx=1830 ms=2315 lb # [ 70.869182] envoy[913]: conn peer=[2001:db8:1::1]:50592 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=55 lb # [ 70.873906] envoy[913]: conn peer=[2001:db8:1::1]:50584 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4444 tx=2268 ms=2805 lb # [ 70.878997] envoy[913]: conn peer=[2001:db8:1::1]:50614 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=69 lb # [ 70.883380] envoy[913]: conn peer=[2001:db8:1::1]:50606 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4915 tx=2596 ms=2382 worker2 # [ 70.944287] nix-daemon[861]: reaped child process 1028, status = succeeded worker2 # [ 71.127456] nix-daemon[861]: accepted connection from pid 1044, user nix-grpc-daemon (trusted) worker2 # [ 71.143093] nix-daemon[861]: reaped child process 1047, status = succeeded lb # [ 71.155461] niks3-server[1023]: 2026/09/21 09:28:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.168437] nix-grpc-daemon[915]: time=2026-09-21T09:28:38.795Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 71.187025] niks3-server[1023]: 2026/09/21 09:28:38 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls worker2 # [ 71.204535] nix-grpc-daemon[915]: time=2026-09-21T09:28:38.831Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.201443] niks3-server[1023]: 2026/09/21 09:28:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 71.210059] niks3-server[1023]: 2026/09/21 09:28:38 INFO Signed narinfos id=20 count=1 lb # [ 71.214861] niks3-server[1023]: 2026/09/21 09:28:38 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 71.225723] niks3-server[1023]: 2026/09/21 09:28:38 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 71.230425] niks3-server[1023]: 2026/09/21 09:28:38 INFO Completed upload id=20 worker2 # [ 71.234123] nix-grpc-daemon[915]: time=2026-09-21T09:28:38.861Z level=INFO msg="Upload complete. (326ms)" lb # [ 71.232762] niks3-server[1023]: 2026/09/21 09:28:38 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo client # copying 1 paths... worker2 # [ 71.246228] nix-grpc-daemon[777]: ts=2026-09-21T09:28:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker1 # [ 71.241672] nix-grpc-daemon[775]: ts=2026-09-21T09:28:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37656 worker2 # [ 71.263425] nix-daemon[861]: reaped child process 1026, status = succeeded worker1 # [ 71.258011] nix-grpc-daemon[775]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 71.308111] nix-grpc-daemon[775]: ts=2026-09-21T09:28:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 71.313991] nix-grpc-daemon[775]: ts=2026-09-21T09:28:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_out=120 worker1 # [ 71.377101] nix-grpc-daemon[775]: ts=2026-09-21T09:28:39Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=3 bytes_in=320 bytes_out=200 worker1 # [ 71.384700] nix-daemon[839]: reaped child process 1151, status = succeeded client # [ 71.430731] nix-daemon[944]: reaped child process 1032, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.58 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 71.640937] nix-daemon[944]: accepted connection from pid 1053, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 71.865068] nix-grpc-daemon[777]: ts=2026-09-21T09:28:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40298 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 71.873412] nix-grpc-daemon[777]: ts=2026-09-21T09:28:39Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 71.885871] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 71.944519] nix-grpc-daemon[775]: ts=2026-09-21T09:28:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 71.955176] nix-grpc-daemon[853]: time=2026-09-21T09:28:39.586Z level=INFO msg="All 1 paths already cached" worker2 # [ 71.986267] nix-grpc-daemon[777]: ts=2026-09-21T09:28:39Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 71.993510] nix-grpc-daemon[777]: ts=2026-09-21T09:28:39Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 71.987095] nix-grpc-daemon[775]: ts=2026-09-21T09:28:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 72.002480] nix-grpc-daemon[775]: ts=2026-09-21T09:28:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 72.023878] nix-grpc-daemon[775]: ts=2026-09-21T09:28:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 72.037562] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 72.060133] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5) worker1 # [ 72.136775] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 2/5) worker1 # [ 72.186093] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 135 ms (attempt 3/5) worker1 # [ 72.329737] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 539 ms (attempt 4/5) worker1 # [ 72.876806] nix-grpc-daemon[775]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 72.884387] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 72.891665] nix-grpc-daemon[775]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 73.118471] nix-daemon[839]: accepted connection from pid 1162, user nix-grpc-daemon (trusted) worker1 # [ 73.135855] nix-daemon[839]: reaped child process 1165, status = succeeded worker1 # [ 73.306753] nix-daemon[839]: accepted connection from pid 1167, user nix-grpc-daemon (trusted) worker1 # [ 73.322739] nix-daemon[839]: reaped child process 1170, status = succeeded lb # [ 73.340242] niks3-server[1023]: 2026/09/21 09:28:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 73.345415] nix-grpc-daemon[853]: time=2026-09-21T09:28:40.976Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 73.346830] nix-grpc-daemon[853]: time=2026-09-21T09:28:40.976Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 73.367174] niks3-server[1023]: 2026/09/21 09:28:40 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst lb # [ 73.380764] niks3-server[1023]: 2026/09/21 09:28:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker1 # [ 73.380496] nix-grpc-daemon[853]: time=2026-09-21T09:28:41.012Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.392285] niks3-server[1023]: 2026/09/21 09:28:41 INFO Signed narinfos id=21 count=1 lb # [ 73.399140] niks3-server[1023]: 2026/09/21 09:28:41 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls worker1 # [ 73.406134] nix-grpc-daemon[853]: time=2026-09-21T09:28:41.038Z level=INFO msg="Upload complete. (494ms)" lb # [ 73.413734] niks3-server[1023]: 2026/09/21 09:28:41 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 73.420155] niks3-server[1023]: 2026/09/21 09:28:41 INFO Completed upload id=21 worker1 # [ 73.416064] nix-grpc-daemon[775]: ts=2026-09-21T09:28:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=1 paths=1 nar_bytes_in=568 lb # [ 73.424111] niks3-server[1023]: 2026/09/21 09:28:41 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker1 # [ 73.423251] nix-grpc-daemon[775]: ts=2026-09-21T09:28:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 73.434831] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 73.439415] nix-daemon[839]: reaped child process 1155, status = succeeded client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 73.451857] nix-daemon[839]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 74.886108] nix-daemon[839]: reaped child process 1174, status = succeeded worker1 # [ 75.048698] nix-daemon[839]: accepted connection from pid 1190, user nix-grpc-daemon (trusted) worker1 # [ 75.063775] nix-daemon[839]: reaped child process 1193, status = succeeded lb # [ 75.084696] niks3-server[1023]: 2026/09/21 09:28:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 75.090244] nix-grpc-daemon[853]: time=2026-09-21T09:28:42.720Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 75.114184] niks3-server[1023]: 2026/09/21 09:28:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker1 # [ 75.119098] nix-grpc-daemon[853]: time=2026-09-21T09:28:42.751Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.128430] niks3-server[1023]: 2026/09/21 09:28:42 INFO Signed narinfos id=22 count=1 lb # [ 75.131625] niks3-server[1023]: 2026/09/21 09:28:42 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 75.144075] niks3-server[1023]: 2026/09/21 09:28:42 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 75.152617] niks3-server[1023]: 2026/09/21 09:28:42 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 75.156218] niks3-server[1023]: 2026/09/21 09:28:42 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo lb # [ 75.160216] niks3-server[1023]: 2026/09/21 09:28:42 INFO Completed upload id=22 worker1 # [ 75.154495] nix-grpc-daemon[853]: time=2026-09-21T09:28:42.786Z level=INFO msg="Upload complete. (292ms)" client # copying 1 paths... worker1 # [ 75.164915] nix-grpc-daemon[775]: ts=2026-09-21T09:28:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker2 # [ 75.178679] nix-grpc-daemon[777]: ts=2026-09-21T09:28:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40298 worker1 # [ 75.177640] nix-daemon[839]: reaped child process 1172, status = succeeded worker2 # [ 75.194184] nix-grpc-daemon[777]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 75.231614] nix-grpc-daemon[775]: ts=2026-09-21T09:28:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 75.237159] nix-grpc-daemon[775]: ts=2026-09-21T09:28:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_out=120 worker2 # [ 75.262735] nix-grpc-daemon[777]: ts=2026-09-21T09:28:42Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=3 bytes_in=320 bytes_out=200 worker2 # [ 75.269811] nix-daemon[861]: reaped child process 1050, status = succeeded client # [ 75.311135] nix-daemon[944]: reaped child process 1056, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.88 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 75.520375] nix-daemon[944]: accepted connection from pid 1077, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 75.738194] nix-grpc-daemon[775]: ts=2026-09-21T09:28:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37656 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 75.752145] nix-grpc-daemon[777]: ts=2026-09-21T09:28:43Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 75.767808] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 75.824979] nix-grpc-daemon[775]: ts=2026-09-21T09:28:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 75.835035] nix-grpc-daemon[853]: time=2026-09-21T09:28:43.467Z level=INFO msg="All 1 paths already cached" worker2 # [ 75.866259] nix-grpc-daemon[777]: ts=2026-09-21T09:28:43Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 75.874125] nix-grpc-daemon[777]: ts=2026-09-21T09:28:43Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 75.883662] nix-grpc-daemon[777]: ts=2026-09-21T09:28:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 75.895035] nix-grpc-daemon[777]: ts=2026-09-21T09:28:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40298 client # copying 1 paths to 'lb:50051'... worker2 # [ 75.910495] nix-grpc-daemon[915]: time=2026-09-21T09:28:43.536Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 75.916206] nix-grpc-daemon[777]: ts=2026-09-21T09:28:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 75.930976] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 76.139212] nix-daemon[861]: accepted connection from pid 1064, user nix-grpc-daemon (trusted) worker2 # [ 76.159347] nix-daemon[861]: reaped child process 1067, status = succeeded worker2 # [ 76.331358] nix-daemon[861]: accepted connection from pid 1069, user nix-grpc-daemon (trusted) worker2 # [ 76.347652] nix-daemon[861]: reaped child process 1072, status = succeeded lb # [ 76.361349] niks3-server[1023]: 2026/09/21 09:28:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 76.375817] nix-grpc-daemon[915]: time=2026-09-21T09:28:44.003Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 76.377486] nix-grpc-daemon[915]: time=2026-09-21T09:28:44.003Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 76.389802] niks3-server[1023]: 2026/09/21 09:28:44 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 76.403013] niks3-server[1023]: 2026/09/21 09:28:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker2 # [ 76.412489] nix-grpc-daemon[915]: time=2026-09-21T09:28:44.040Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.415458] niks3-server[1023]: 2026/09/21 09:28:44 INFO Signed narinfos id=23 count=1 lb # [ 76.421237] niks3-server[1023]: 2026/09/21 09:28:44 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 76.430547] niks3-server[1023]: 2026/09/21 09:28:44 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 76.438849] niks3-server[1023]: 2026/09/21 09:28:44 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo lb # [ 76.443781] niks3-server[1023]: 2026/09/21 09:28:44 INFO Completed upload id=23 worker2 # [ 76.448183] nix-grpc-daemon[915]: time=2026-09-21T09:28:44.075Z level=INFO msg="Upload complete. (500ms)" worker2 # [ 76.456775] nix-grpc-daemon[777]: ts=2026-09-21T09:28:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 76.470160] nix-grpc-daemon[777]: ts=2026-09-21T09:28:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 worker2 # [ 76.478848] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 76.481461] nix-daemon[861]: reaped child process 1062, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker2 # [ 76.495176] nix-daemon[861]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 77.314204] nix-daemon[861]: reaped child process 1076, status = succeeded worker2 # [ 77.476493] nix-daemon[861]: accepted connection from pid 1092, user nix-grpc-daemon (trusted) worker2 # [ 77.494528] nix-daemon[861]: reaped child process 1095, status = succeeded lb # [ 77.505373] niks3-server[1023]: 2026/09/21 09:28:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 77.522216] nix-grpc-daemon[915]: time=2026-09-21T09:28:45.148Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 77.535323] niks3-server[1023]: 2026/09/21 09:28:45 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 77.549167] niks3-server[1023]: 2026/09/21 09:28:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker2 # [ 77.558783] nix-grpc-daemon[915]: time=2026-09-21T09:28:45.186Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.559611] niks3-server[1023]: 2026/09/21 09:28:45 INFO Signed narinfos id=24 count=1 lb # [ 77.565412] niks3-server[1023]: 2026/09/21 09:28:45 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 77.572513] niks3-server[1023]: 2026/09/21 09:28:45 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 77.580977] niks3-server[1023]: 2026/09/21 09:28:45 INFO Completed upload id=24 worker2 # [ 77.584355] nix-grpc-daemon[915]: time=2026-09-21T09:28:45.212Z level=INFO msg="Upload complete. (279ms)" lb # [ 77.583576] niks3-server[1023]: 2026/09/21 09:28:45 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker2 # [ 77.592425] nix-grpc-daemon[777]: ts=2026-09-21T09:28:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 77.604298] nix-daemon[861]: reaped child process 1074, status = succeeded client # copying 1 paths... worker1 # [ 77.632869] nix-grpc-daemon[775]: ts=2026-09-21T09:28:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 77.647495] nix-grpc-daemon[775]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 77.692111] nix-grpc-daemon[775]: ts=2026-09-21T09:28:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37656 worker1 # [ 77.697883] nix-grpc-daemon[775]: ts=2026-09-21T09:28:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37656 duration_s=0 paths=1 nar_bytes_out=120 worker2 # [ 77.769071] nix-grpc-daemon[777]: ts=2026-09-21T09:28:45Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:40298 duration_s=2 bytes_in=320 bytes_out=200 worker2 # [ 77.775721] nix-daemon[861]: reaped child process 1057, status = succeeded client # [ 77.817836] nix-daemon[944]: reaped child process 1080, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.51 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 10.88 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.44 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.42 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.19 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.24 seconds) worker2 # [ 79.227423] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 79.346977] nix-grpc-daemon[777]: ts=2026-09-21T09:28:46Z level=info event=signal_exit worker2 # [ 79.571685] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=scheduler_yield worker2 # [ 79.581786] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 79.578743] niks3-server[1023]: 2026/09/21 09:28:47 INFO lead: released remote=192.168.1.4:56844 worker2 # [ 79.587271] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40286 worker1 # [ 79.580446] nix-grpc-daemon[775]: ts=2026-09-21T09:28:47Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 79.593819] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 79.597998] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40286 worker2 # [ 79.602517] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 79.783319] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.788636] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.780253] nix-grpc-daemon[775]: ts=2026-09-21T09:28:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.785323] nix-grpc-daemon[775]: ts=2026-09-21T09:28:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 79.989964] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.986263] nix-grpc-daemon[775]: ts=2026-09-21T09:28:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.995487] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.991553] nix-grpc-daemon[775]: ts=2026-09-21T09:28:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.196811] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.192526] nix-grpc-daemon[775]: ts=2026-09-21T09:28:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.202196] nix-grpc-daemon[777]: ts=2026-09-21T09:28:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 80.197690] nix-grpc-daemon[775]: ts=2026-09-21T09:28:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.406194] nix-grpc-daemon[777]: ts=2026-09-21T09:28:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.398378] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.411014] nix-grpc-daemon[777]: ts=2026-09-21T09:28:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 80.403709] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 80.437230] niks3-server[1023]: 2026/09/21 09:28:48 INFO lead: acquired remote=192.168.1.3:35186 worker1 # [ 80.431845] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_take_over worker2 # [ 80.577223] nix-grpc-daemon[777]: ts=2026-09-21T09:28:48Z level=info event=scheduler_restarting worker1 # [ 80.606275] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.610444] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.634482] nix-daemon[861]: reaped child process 863, status = succeeded worker2 # [ 80.636870] nix-grpc-daemon[777]: ts=2026-09-21T09:28:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 80.806673] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.811992] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 80.856590] envoy[913]: conn peer=[2001:db8:1::1]:38316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=68 lb # [ 80.861492] envoy[913]: conn peer=[2001:db8:1::1]:50616 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4786 tx=2281 ms=3065 lb # [ 80.866457] envoy[913]: conn peer=[2001:db8:1::1]:38328 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=21 lb # [ 80.871930] envoy[913]: conn peer=[2001:db8:1::1]:38318 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4317 tx=2305 ms=3395 lb # [ 80.876812] envoy[913]: conn peer=[2001:db8:1::1]:38356 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=66 lb # [ 80.881320] envoy[913]: conn peer=[2001:db8:1::1]:38342 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4336 tx=2306 ms=2017 lb # [ 80.886025] envoy[913]: conn peer=[2001:db8:1::4]:58790 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=42118 tx=2265 ms=59228 worker1 # [ 81.012731] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.017723] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.218585] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.223569] nix-grpc-daemon[775]: ts=2026-09-21T09:28:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.424338] nix-grpc-daemon[775]: ts=2026-09-21T09:28:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.444113] nix-grpc-daemon[775]: ts=2026-09-21T09:28:49Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:38420 worker2 # [ 81.455309] nix-grpc-daemon[777]: E0000 00:00:1789982929.081544 822 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 81.449784] nix-grpc-daemon[775]: ts=2026-09-21T09:28:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 81.463287] nix-grpc-daemon[777]: E0000 00:00:1789982929.090915 822 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 82.068610] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 82.076844] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 82.079549] systemd[1]: nix-grpc-daemon.service: Consumed 2.015s CPU time over 1min 1.066s wall clock time, 56.3M memory peak, 58.2K incoming IP traffic, 157.2K outgoing IP traffic. worker2 # [ 82.098441] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 82.104392] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 82.107122] systemd[1]: nix-grpc-daemon.socket: Consumed 582us CPU time over 1min 10.918s wall clock time, 256K memory peak, 81K incoming IP traffic, 68K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 82.441492] nix-grpc-daemon[775]: ts=2026-09-21T09:28:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37656 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 82.448838] nix-grpc-daemon[775]: ts=2026-09-21T09:28:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37656 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 82.589835] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 82.658781] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 83.059315] systemd[1]: Starting scheduler-token.service... worker2 # [ 83.163389] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 83.168389] systemd[1]: Finished scheduler-token.service. worker2 # [ 83.170386] systemd[1]: scheduler-token.service: Consumed 52ms CPU time over 107ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 83.180983] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 83.184463] nix-grpc-daemon[775]: ts=2026-09-21T09:28:50Z level=info event=signal_exit worker2 # [ 83.364568] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 83.367386] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 83.371660] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 83.379512] nix-grpc-daemon[1119]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 83.391930] nix-grpc-daemon[1119]: E0000 00:00:1789982931.006426 1119 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 83.395123] nix-grpc-daemon[1119]: E0000 00:00:1789982931.010346 1119 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 83.399913] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 83.408202] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 83.409045] nix-grpc-daemon[1119]: E0000 00:00:1789982931.032133 1159 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 83.438652] nix-grpc-daemon[1119]: E0000 00:00:1789982931.050919 1159 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 83.441639] nix-grpc-daemon[1119]: E0000 00:00:1789982931.051068 1159 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 83.444395] nix-grpc-daemon[1119]: E0000 00:00:1789982931.065786 1159 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 83.452056] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.453483] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.443907] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=scheduler_yield lb # [ 83.451192] niks3-server[1023]: 2026/09/21 09:28:51 INFO lead: released remote=192.168.1.3:35186 worker1 # [ 83.449023] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 83.459045] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38420 worker1 # [ 83.463989] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 83.653615] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.649667] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.658622] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.654660] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.859982] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.855472] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.865234] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.860765] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.066421] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.061502] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.071725] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.066479] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.272947] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.267294] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.278183] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.270334] nix-grpc-daemon[775]: ts=2026-09-21T09:28:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.453990] nix-grpc-daemon[775]: ts=2026-09-21T09:28:52Z level=info event=scheduler_restarting worker2 # [ 84.481204] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.485501] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.502586] nix-grpc-daemon[775]: ts=2026-09-21T09:28:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 84.515984] nix-daemon[839]: reaped child process 841, status = succeeded worker2 # [ 84.681792] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.686988] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.888496] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.893710] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.095064] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.100322] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.274086] nix-grpc-daemon[775]: E0000 00:00:1789982932.905814 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 85.301431] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.306366] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.327137] nix-grpc-daemon[775]: E0000 00:00:1789982932.959029 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 85.508852] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.513521] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.714533] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.719223] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.920373] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.925451] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.983229] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 85.986661] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 85.994633] systemd[1]: nix-grpc-daemon.service: Consumed 3.617s CPU time over 1min 5.131s wall clock time, 63.5M memory peak, 86.3K incoming IP traffic, 160.2K outgoing IP traffic. worker1 # [ 86.007315] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 86.010190] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 86.011939] systemd[1]: nix-grpc-daemon.socket: Consumed 593us CPU time over 1min 14.651s wall clock time, 256K memory peak, 85.7K incoming IP traffic, 72.3K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 86.126602] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.131640] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.333022] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.338128] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.386926] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 86.402376] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 86.476418] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 86.490410] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 86.519791] nix-grpc-daemon[1119]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5) worker2 # [ 86.527764] nix-grpc-daemon[1119]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 2/5) worker2 # [ 86.539045] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.545106] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.550148] nix-grpc-daemon[1119]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 3/5) worker2 # [ 86.681084] nix-grpc-daemon[1119]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 550 ms (attempt 4/5) worker2 # [ 86.745127] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.750294] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.951418] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.956647] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.157599] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.162577] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.239026] nix-grpc-daemon[1119]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 87.244734] nix-grpc-daemon[1119]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 87.266528] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57292 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 87.285020] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 87.312785] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=niks3_push_started pid=1183 worker2 # [ 87.363472] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.367696] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.541127] nix-grpc-daemon[1183]: time=2026-09-21T09:28:55.168Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 87.568467] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.570384] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.719309] nix-daemon[861]: accepted connection from pid 1196, user nix-grpc-daemon (trusted) worker2 # [ 87.734682] nix-daemon[861]: reaped child process 1199, status = succeeded lb # [ 87.750117] niks3-server[1023]: 2026/09/21 09:28:55 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 87.758473] niks3-server[1023]: 2026/09/21 09:28:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 87.772079] nix-grpc-daemon[1183]: time=2026-09-21T09:28:55.398Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 87.773593] nix-grpc-daemon[1183]: time=2026-09-21T09:28:55.398Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" worker2 # [ 87.775263] nix-grpc-daemon[1183]: time=2026-09-21T09:28:55.398Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 87.779732] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.781529] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 87.824936] niks3-server[1023]: 2026/09/21 09:28:55 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 87.836413] niks3-server[1023]: 2026/09/21 09:28:55 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst worker2 # [ 87.851065] nix-grpc-daemon[1183]: time=2026-09-21T09:28:55.477Z level=INFO msg="Uploading 3 narinfos" lb # [ 87.847249] niks3-server[1023]: 2026/09/21 09:28:55 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 87.855653] niks3-server[1023]: 2026/09/21 09:28:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 87.863503] niks3-server[1023]: 2026/09/21 09:28:55 INFO Signed narinfos id=25 count=1 lb # [ 87.868407] niks3-server[1023]: 2026/09/21 09:28:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 87.871440] niks3-server[1023]: 2026/09/21 09:28:55 INFO Signed narinfos id=26 count=2 lb # [ 87.879959] niks3-server[1023]: 2026/09/21 09:28:55 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 87.887132] niks3-server[1023]: 2026/09/21 09:28:55 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 87.892786] niks3-server[1023]: 2026/09/21 09:28:55 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 87.897220] niks3-server[1023]: 2026/09/21 09:28:55 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 87.901294] niks3-server[1023]: 2026/09/21 09:28:55 INFO Completed upload id=25 lb # [ 87.902803] niks3-server[1023]: 2026/09/21 09:28:55 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 87.906596] niks3-server[1023]: 2026/09/21 09:28:55 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 87.909995] niks3-server[1023]: 2026/09/21 09:28:55 INFO Completed upload id=26 worker2 # [ 87.913889] nix-grpc-daemon[1183]: time=2026-09-21T09:28:55.541Z level=INFO msg="Upload complete. (369ms)" worker2 # [ 87.925609] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57292 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 87.955054] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:55Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:57292 duration_s=1 bytes_in=400 bytes_out=200 worker2 # [ 87.959809] nix-daemon[861]: reaped child process 1181, status = succeeded worker2 # [ 87.962084] nix-daemon[861]: reaped child process 1172, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.85 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2 # [ 87.980606] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.987210] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds) worker1 # [ 88.088882] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 88.096903] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 88.186697] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.191941] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.295500] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 88.298092] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 88.302314] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 88.310873] nix-grpc-daemon[1217]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 88.317811] nix-grpc-daemon[1217]: E0000 00:00:1789982935.940794 1217 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 88.322667] nix-grpc-daemon[1217]: E0000 00:00:1789982935.942778 1217 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 88.329823] niks3-server[1023]: 2026/09/21 09:28:55 INFO lead: acquired remote=192.168.1.3:34410 worker1 # [ 88.327010] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 88.329538] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:55Z level=info event=scheduler_take_over worker1 # [ 88.330932] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 88.352170] nix-grpc-daemon[1217]: E0000 00:00:1789982935.964929 1257 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 88.354526] nix-grpc-daemon[1217]: E0000 00:00:1789982935.980275 1257 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 88.368590] nix-grpc-daemon[1217]: E0000 00:00:1789982935.980435 1257 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 88.371413] nix-grpc-daemon[1217]: E0000 00:00:1789982935.999627 1257 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 88.392997] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.387607] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.389455] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.399139] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker1 # [ 88.590633] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.602363] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.596145] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.606582] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.803205] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.796910] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.808465] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.802171] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.009438] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.002816] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.010877] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:38492 worker1 # [ 89.016984] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 89.028167] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 89.033479] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:38492 worker1 # [ 89.038813] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:56Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.69 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 89.785881] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 90.316698] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:57Z level=info event=signal_exit worker1 # [ 90.521967] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=scheduler_yield lb # [ 90.537023] niks3-server[1023]: 2026/09/21 09:28:58 INFO lead: released remote=192.168.1.3:34410 worker2 # [ 90.542619] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:58Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 90.536799] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38492 worker1 # [ 90.543323] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 90.547520] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 90.551682] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38492 worker1 # [ 90.556310] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 90.742808] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.748156] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 90.743065] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.749343] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" lb # [ 90.852941] envoy[913]: conn peer=[2001:db8:1::1]:55126 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=22 lb # [ 90.857888] envoy[913]: conn peer=[2001:db8:1::3]:39888 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10561 tx=2995 ms=63250 lb # [ 90.862876] envoy[913]: conn peer=[2001:db8:1::1]:55128 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1611 tx=640 ms=1554 worker2 # [ 90.949225] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.954302] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 90.950166] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.956477] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 91.155341] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.160508] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.157407] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.162522] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.362358] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.367838] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.365087] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.369273] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.527083] nix-grpc-daemon[1217]: ts=2026-09-21T09:28:59Z level=info event=scheduler_restarting worker2 # [ 91.571057] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.575450] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.772122] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.777480] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.978774] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.984130] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.986376] nix-grpc-daemon[1217]: E0000 00:00:1789982939.618125 1262 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 91.993110] nix-grpc-daemon[1217]: E0000 00:00:1789982939.618330 1262 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 92.185150] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.190380] nix-grpc-daemon[1119]: ts=2026-09-21T09:28:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.341811] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 92.348460] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 92.355428] systemd[1]: nix-grpc-daemon.service: Consumed 231ms CPU time over 4.241s wall clock time, 13.3M memory peak, 9.8K incoming IP traffic, 9.1K outgoing IP traffic. worker1 # [ 92.371810] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 92.375430] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 92.391053] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.380465] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 4.294s wall clock time, 256K memory peak, 16.2K incoming IP traffic, 11.5K outgoing IP traffic. worker2 # [ 92.394139] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2 # [ 92.597216] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.601486] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.797971] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.803036] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.004393] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.009425] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.210650] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.215786] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.396054] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:01Z level=info event=scheduler_take_over lb # [ 93.392974] niks3-server[1023]: 2026/09/21 09:29:01 INFO lead: acquired remote=192.168.1.4:34476 worker2 # [ 93.416850] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.423445] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2 # [ 93.624427] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.652233] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:01Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 93.656648] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:01Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:60192 worker2 # [ 93.661920] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker2 # [ 94.915912] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57292 client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 94.925445] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 94.950679] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:02Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker2 # [ 94.957528] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:02Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 94.995348] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 95.010942] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57292 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker2 # [ 95.026262] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 95.041452] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 95.252887] nix-daemon[861]: accepted connection from pid 1223, user nix-grpc-daemon (trusted) worker2 # [ 95.268755] nix-daemon[861]: reaped child process 1226, status = succeeded worker2 # [ 95.443964] nix-daemon[861]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker2 # [ 95.460700] nix-daemon[861]: reaped child process 1231, status = succeeded lb # [ 95.469541] niks3-server[1023]: 2026/09/21 09:29:03 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.483006] nix-grpc-daemon[1183]: time=2026-09-21T09:29:03.110Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 95.484639] nix-grpc-daemon[1183]: time=2026-09-21T09:29:03.110Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 95.503801] niks3-server[1023]: 2026/09/21 09:29:03 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 95.515731] niks3-server[1023]: 2026/09/21 09:29:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 95.527565] niks3-server[1023]: 2026/09/21 09:29:03 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 95.539956] niks3-server[1023]: 2026/09/21 09:29:03 INFO Signed narinfos id=27 count=1 worker2 # [ 95.544189] nix-grpc-daemon[1183]: time=2026-09-21T09:29:03.171Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.549894] niks3-server[1023]: 2026/09/21 09:29:03 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 95.560564] niks3-server[1023]: 2026/09/21 09:29:03 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo lb # [ 95.571196] niks3-server[1023]: 2026/09/21 09:29:03 INFO Completed upload id=27 worker2 # [ 95.575205] nix-grpc-daemon[1183]: time=2026-09-21T09:29:03.202Z level=INFO msg="Upload complete. (517ms)" worker2 # [ 95.588611] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57292 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 95.602362] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 95.612864] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 95.621302] nix-daemon[861]: reaped child process 1221, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker2 # [ 95.628644] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 97.070731] nix-daemon[861]: reaped child process 1235, status = succeeded worker2 # [ 97.252487] nix-daemon[861]: accepted connection from pid 1251, user nix-grpc-daemon (trusted) worker2 # [ 97.270395] nix-daemon[861]: reaped child process 1254, status = succeeded lb # [ 97.282038] niks3-server[1023]: 2026/09/21 09:29:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.300441] nix-grpc-daemon[1183]: time=2026-09-21T09:29:04.926Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 97.302056] nix-grpc-daemon[1183]: time=2026-09-21T09:29:04.926Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 97.318884] niks3-server[1023]: 2026/09/21 09:29:04 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 97.335949] niks3-server[1023]: 2026/09/21 09:29:04 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 97.345014] niks3-server[1023]: 2026/09/21 09:29:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker2 # [ 97.354029] nix-grpc-daemon[1183]: time=2026-09-21T09:29:04.980Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.350112] niks3-server[1023]: 2026/09/21 09:29:04 INFO Signed narinfos id=28 count=1 lb # [ 97.353675] niks3-server[1023]: 2026/09/21 09:29:04 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 97.363784] niks3-server[1023]: 2026/09/21 09:29:04 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 97.371658] niks3-server[1023]: 2026/09/21 09:29:04 INFO Completed upload id=28 worker2 # [ 97.373844] nix-grpc-daemon[1183]: time=2026-09-21T09:29:05.001Z level=INFO msg="Upload complete. (335ms)" lb # [ 97.374453] niks3-server[1023]: 2026/09/21 09:29:04 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker2 # [ 97.394518] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker2 # [ 97.410220] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:05Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker2 # [ 97.413762] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:05Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 97.417474] nix-daemon[861]: reaped child process 1233, status = succeeded worker2 # [ 97.440869] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 97.456847] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 97.471642] nix-grpc-daemon[1183]: time=2026-09-21T09:29:05.099Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker2 # [ 97.482346] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 97.496404] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 97.712346] nix-daemon[861]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 97.732924] nix-daemon[861]: reaped child process 1263, status = succeeded worker2 # [ 97.916204] nix-daemon[861]: accepted connection from pid 1265, user nix-grpc-daemon (trusted) worker2 # [ 97.933443] nix-daemon[861]: reaped child process 1268, status = succeeded lb # [ 97.942673] niks3-server[1023]: 2026/09/21 09:29:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.956176] nix-grpc-daemon[1183]: time=2026-09-21T09:29:05.583Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 97.958255] nix-grpc-daemon[1183]: time=2026-09-21T09:29:05.585Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 97.976349] niks3-server[1023]: 2026/09/21 09:29:05 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst worker2 # [ 97.993171] nix-grpc-daemon[1183]: time=2026-09-21T09:29:05.620Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.993390] niks3-server[1023]: 2026/09/21 09:29:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 98.004325] niks3-server[1023]: 2026/09/21 09:29:05 INFO Signed narinfos id=29 count=1 lb # [ 98.008631] niks3-server[1023]: 2026/09/21 09:29:05 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 98.016526] niks3-server[1023]: 2026/09/21 09:29:05 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 98.022901] niks3-server[1023]: 2026/09/21 09:29:05 INFO Completed upload id=29 worker2 # [ 98.025956] nix-grpc-daemon[1183]: time=2026-09-21T09:29:05.653Z level=INFO msg="Upload complete. (512ms)" lb # [ 98.025865] niks3-server[1023]: 2026/09/21 09:29:05 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker2 # [ 98.036238] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57292 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 98.047032] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 98.054318] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 98.059047] nix-daemon[861]: reaped child process 1258, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker2 # [ 98.073186] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker2 # [ 99.121456] nix-daemon[861]: reaped child process 1272, status = succeeded worker2 # [ 99.297685] nix-daemon[861]: accepted connection from pid 1288, user nix-grpc-daemon (trusted) worker2 # [ 99.314075] nix-daemon[861]: reaped child process 1291, status = succeeded lb # [ 99.322905] niks3-server[1023]: 2026/09/21 09:29:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 99.341257] nix-grpc-daemon[1183]: time=2026-09-21T09:29:06.968Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 99.342897] nix-grpc-daemon[1183]: time=2026-09-21T09:29:06.968Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 99.360792] niks3-server[1023]: 2026/09/21 09:29:06 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 99.371195] niks3-server[1023]: 2026/09/21 09:29:06 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 99.381182] niks3-server[1023]: 2026/09/21 09:29:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 99.386747] niks3-server[1023]: 2026/09/21 09:29:07 INFO Signed narinfos id=30 count=1 worker2 # [ 99.390982] nix-grpc-daemon[1183]: time=2026-09-21T09:29:07.018Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.389700] niks3-server[1023]: 2026/09/21 09:29:07 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 99.399917] niks3-server[1023]: 2026/09/21 09:29:07 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete worker2 # [ 99.408439] nix-grpc-daemon[1183]: time=2026-09-21T09:29:07.036Z level=INFO msg="Upload complete. (325ms)" lb # [ 99.406253] niks3-server[1023]: 2026/09/21 09:29:07 INFO Completed upload id=30 lb # [ 99.408873] niks3-server[1023]: 2026/09/21 09:29:07 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker2 # [ 99.426437] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker2 # [ 99.441136] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:07Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker2 # [ 99.445389] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:07Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 99.449229] nix-daemon[861]: reaped child process 1270, status = succeeded worker2 # [ 99.471792] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 99.486639] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 99.500633] nix-grpc-daemon[1183]: time=2026-09-21T09:29:07.128Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker2 # [ 99.509232] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 99.522626] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 99.720908] nix-daemon[861]: accepted connection from pid 1297, user nix-grpc-daemon (trusted) worker2 # [ 99.737952] nix-daemon[861]: reaped child process 1300, status = succeeded worker2 # [ 99.913580] nix-daemon[861]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker2 # [ 99.930154] nix-daemon[861]: reaped child process 1305, status = succeeded lb # [ 99.937319] niks3-server[1023]: 2026/09/21 09:29:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 99.951012] nix-grpc-daemon[1183]: time=2026-09-21T09:29:07.578Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 99.952593] nix-grpc-daemon[1183]: time=2026-09-21T09:29:07.578Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 99.962421] niks3-server[1023]: 2026/09/21 09:29:07 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst lb # [ 99.977195] niks3-server[1023]: 2026/09/21 09:29:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker2 # [ 99.986850] nix-grpc-daemon[1183]: time=2026-09-21T09:29:07.614Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.989459] niks3-server[1023]: 2026/09/21 09:29:07 INFO Signed narinfos id=31 count=1 lb # [ 99.996463] niks3-server[1023]: 2026/09/21 09:29:07 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 100.006356] niks3-server[1023]: 2026/09/21 09:29:07 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 100.011431] niks3-server[1023]: 2026/09/21 09:29:07 INFO Completed upload id=31 worker2 # [ 100.015344] nix-grpc-daemon[1183]: time=2026-09-21T09:29:07.643Z level=INFO msg="Upload complete. (476ms)" lb # [ 100.014311] niks3-server[1023]: 2026/09/21 09:29:07 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker2 # [ 100.023667] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57292 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 100.037490] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 100.043403] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 100.048319] nix-daemon[861]: reaped child process 1295, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 100.062096] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 100.704380] nix-daemon[861]: reaped child process 1309, status = succeeded lb # [ 100.856935] envoy[913]: conn peer=[2001:db8:1::3]:35310 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1433 tx=485 ms=3194 worker2 # [ 100.877534] nix-daemon[861]: accepted connection from pid 1325, user nix-grpc-daemon (trusted) worker2 # [ 100.895316] nix-daemon[861]: reaped child process 1328, status = succeeded lb # [ 100.903684] niks3-server[1023]: 2026/09/21 09:29:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 100.919758] nix-grpc-daemon[1183]: time=2026-09-21T09:29:08.545Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 100.921627] nix-grpc-daemon[1183]: time=2026-09-21T09:29:08.545Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 100.938171] niks3-server[1023]: 2026/09/21 09:29:08 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 100.951816] niks3-server[1023]: 2026/09/21 09:29:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker2 # [ 100.962021] nix-grpc-daemon[1183]: time=2026-09-21T09:29:08.589Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.961920] niks3-server[1023]: 2026/09/21 09:29:08 INFO Signed narinfos id=32 count=1 lb # [ 100.967591] niks3-server[1023]: 2026/09/21 09:29:08 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 100.972440] niks3-server[1023]: 2026/09/21 09:29:08 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls worker2 # [ 100.983298] nix-grpc-daemon[1183]: time=2026-09-21T09:29:08.610Z level=INFO msg="Upload complete. (311ms)" lb # [ 100.979790] niks3-server[1023]: 2026/09/21 09:29:08 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 100.983673] niks3-server[1023]: 2026/09/21 09:29:08 INFO Completed upload id=32 lb # [ 100.986511] niks3-server[1023]: 2026/09/21 09:29:08 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker2 # [ 100.992971] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 duration_s=0 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker2 # [ 101.009174] nix-daemon[861]: reaped child process 1307, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.40 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds) worker1 # [ 101.385043] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 101.394411] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 101.589645] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:09Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 101.592240] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 101.596374] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 101.604068] nix-grpc-daemon[1284]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 101.605572] nix-grpc-daemon[1284]: E0000 00:00:1789982949.235634 1284 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 101.615716] nix-grpc-daemon[1284]: E0000 00:00:1789982949.241849 1284 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 101.620362] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 101.622589] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 101.628171] nix-grpc-daemon[1284]: E0000 00:00:1789982949.257876 1324 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 101.656125] nix-grpc-daemon[1284]: E0000 00:00:1789982949.276208 1324 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 101.658423] nix-grpc-daemon[1284]: E0000 00:00:1789982949.276368 1324 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 101.664896] nix-grpc-daemon[1284]: E0000 00:00:1789982949.295855 1324 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 101.679406] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 101.690756] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:09Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:60192 worker2 # [ 101.691219] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.49 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 102.074391] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: d88dc99db4764170bbf552daed435a79 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) client # [ 102.322981] nix[1185]: don't know how to build these paths: client # [ 102.324122] nix[1185]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 102.338968] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 102.352288] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:09Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker2 # [ 102.358169] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:09Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 102.403464] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 102.419056] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57292 client # [ 102.417452] nix[1185]: copying 1 paths to 'lb:50051'... client # [ 102.421248] nix[1185]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker2 # [ 102.438549] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 102.455426] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 102.654978] nix-daemon[861]: accepted connection from pid 1341, user nix-grpc-daemon (trusted) worker2 # [ 102.674254] nix-daemon[861]: reaped child process 1344, status = succeeded worker2 # [ 102.843998] nix-daemon[861]: accepted connection from pid 1346, user nix-grpc-daemon (trusted) worker2 # [ 102.861730] nix-daemon[861]: reaped child process 1349, status = succeeded lb # [ 102.871650] niks3-server[1023]: 2026/09/21 09:29:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 102.886372] nix-grpc-daemon[1183]: time=2026-09-21T09:29:10.513Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 102.887814] nix-grpc-daemon[1183]: time=2026-09-21T09:29:10.513Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 102.898408] niks3-server[1023]: 2026/09/21 09:29:10 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 102.913563] niks3-server[1023]: 2026/09/21 09:29:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker2 # [ 102.923234] nix-grpc-daemon[1183]: time=2026-09-21T09:29:10.550Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.925839] niks3-server[1023]: 2026/09/21 09:29:10 INFO Signed narinfos id=33 count=1 lb # [ 102.932676] niks3-server[1023]: 2026/09/21 09:29:10 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 102.942197] niks3-server[1023]: 2026/09/21 09:29:10 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 102.947755] niks3-server[1023]: 2026/09/21 09:29:10 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo lb # [ 102.952054] niks3-server[1023]: 2026/09/21 09:29:10 INFO Completed upload id=33 worker2 # [ 102.955637] nix-grpc-daemon[1183]: time=2026-09-21T09:29:10.583Z level=INFO msg="Upload complete. (482ms)" worker2 # [ 102.963759] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57292 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 102.978231] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 worker2 # [ 102.984942] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker2 # [ 102.989906] nix-daemon[861]: reaped child process 1339, status = succeeded client # [ 102.983108] nix[1185]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker2 # [ 103.003507] nix-daemon[861]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 105.020880] systemd-journald[275]: Received client request to rotate journal, rotating. worker1 # [ 105.040415] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/fc8e72aa0fd0405d859837f3842fb8c2. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 105.105039] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 worker2 # [ 105.398222] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:13Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 110.654680] nix-daemon[861]: reaped child process 1353, status = succeeded worker2 # [ 110.831395] nix-daemon[861]: accepted connection from pid 1394, user nix-grpc-daemon (trusted) worker2 # [ 110.846750] nix-daemon[861]: reaped child process 1397, status = succeeded lb # [ 110.856782] envoy[913]: conn peer=[2001:db8:1::1]:37180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9606 tx=4058 ms=6100 lb # [ 110.863571] niks3-server[1023]: 2026/09/21 09:29:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 110.880471] nix-grpc-daemon[1183]: time=2026-09-21T09:29:18.505Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 110.882375] nix-grpc-daemon[1183]: time=2026-09-21T09:29:18.505Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 110.906694] niks3-server[1023]: 2026/09/21 09:29:18 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 110.924738] niks3-server[1023]: 2026/09/21 09:29:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 110.934881] niks3-server[1023]: 2026/09/21 09:29:18 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 110.941274] niks3-server[1023]: 2026/09/21 09:29:18 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 110.945594] nix-grpc-daemon[1183]: time=2026-09-21T09:29:18.572Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.946963] niks3-server[1023]: 2026/09/21 09:29:18 INFO Signed narinfos id=34 count=1 lb # [ 110.953773] niks3-server[1023]: 2026/09/21 09:29:18 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 110.964516] niks3-server[1023]: 2026/09/21 09:29:18 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo lb # [ 110.974849] niks3-server[1023]: 2026/09/21 09:29:18 INFO Completed upload id=34 worker2 # [ 110.978842] nix-grpc-daemon[1183]: time=2026-09-21T09:29:18.606Z level=INFO msg="Upload complete. (359ms)" worker2 # [ 110.993234] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57292 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 111.011471] nix-daemon[861]: reaped child process 1351, status = succeeded client # [ 111.016283] systemd[1]: rs.service: Deactivated successfully. client # [ 111.020571] systemd[1]: rs.service: Consumed 175ms CPU time over 8.945s wall clock time, 41.2M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. worker2 # [ 111.399661] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=signal_exit worker2 # [ 111.623456] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=scheduler_yield worker1 # [ 111.623923] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:19Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 111.632936] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 111.627464] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:19Z level=info event=scheduler_take_over lb # [ 111.631307] niks3-server[1023]: 2026/09/21 09:29:19 INFO lead: released remote=192.168.1.4:34476 lb # [ 111.632386] niks3-server[1023]: 2026/09/21 09:29:19 INFO lead: acquired remote=192.168.1.3:38236 worker2 # [ 111.639175] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60192 worker2 # [ 111.644321] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 111.649157] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60192 worker2 # [ 111.653513] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 111.834172] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.824431] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.829416] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.839075] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.029909] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.041899] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.033420] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.046083] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.242755] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.234378] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.248103] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.240101] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.440782] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.450447] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.455420] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.446345] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.629397] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:20Z level=info event=scheduler_restarting worker1 # [ 112.649461] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.655966] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.674035] nix-grpc-daemon[1119]: ts=2026-09-21T09:29:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 112.690026] nix-daemon[861]: reaped child process 1175, status = succeeded worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.24 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker1 # [ 112.849509] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:20Z level=info event=scheduler_connected addr=lb:50051 client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 112.854681] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1 # [ 113.055517] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.060891] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 113.261685] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.266905] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.451991] nix-grpc-daemon[1119]: E0000 00:00:1789982961.078359 1164 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 113.452376] nix-grpc-daemon[1119]: E0000 00:00:1789982961.078643 1164 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 113.467567] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.476530] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:21Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42884 worker1 # [ 113.482473] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 113.870782] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 113.877214] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 113.879718] systemd[1]: nix-grpc-daemon.service: Consumed 2.054s CPU time over 30.686s wall clock time, 36.8M memory peak, 62.9K incoming IP traffic, 162.7K outgoing IP traffic. worker2 # [ 113.896899] systemd[1]: Starting scheduler-token.service... worker2 # [ 113.993535] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 113.995800] systemd[1]: Finished scheduler-token.service. worker2 # [ 114.000950] systemd[1]: scheduler-token.service: Consumed 42ms CPU time over 99ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 114.005540] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2 # [ 114.188230] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:21Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 114.190900] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 114.195023] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 114.202438] nix-grpc-daemon[1407]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 114.203916] nix-grpc-daemon[1407]: E0000 00:00:1789982961.829404 1407 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 114.211117] nix-grpc-daemon[1407]: E0000 00:00:1789982961.835412 1407 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 114.214861] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 114.217557] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 114.224063] nix-grpc-daemon[1407]: E0000 00:00:1789982961.848973 1447 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 114.252144] nix-grpc-daemon[1407]: E0000 00:00:1789982961.866561 1447 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 114.256679] nix-grpc-daemon[1407]: E0000 00:00:1789982961.866712 1447 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 114.259523] nix-grpc-daemon[1407]: E0000 00:00:1789982961.883607 1447 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 114.269418] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.269249] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:21Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 114.274737] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:21Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42884 worker1 # [ 114.280194] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.32 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 115.395815] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds) worker2 # [ 115.663856] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 115.678341] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # Running as unit: mid.service; invocation ID: 0c773a1a9c4b4b9b9299a8845ff365b2 client # [ 115.678935] nix[1221]: don't know how to build these paths: client # [ 115.682710] nix[1221]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 115.701489] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:23Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 115.701774] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:23Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 115.759523] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42886 worker1 # [ 115.773650] nix-daemon[839]: accepted connection from pid 1284, user nix-grpc-daemon (trusted) worker1 # [ 115.798320] nix-grpc-daemon[1284]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 1/5) worker1 # [ 115.807812] nix-grpc-daemon[1284]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 2/5) worker1 # [ 115.853568] nix-grpc-daemon[1284]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 207 ms (attempt 3/5) worker1 # [ 116.067778] nix-grpc-daemon[1284]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 720 ms (attempt 4/5) worker1 # [ 116.789821] nix-grpc-daemon[1284]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 116.790089] nix-grpc-daemon[1284]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 116.815435] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42886 client # [ 116.825319] nix[1221]: copying 1 paths to 'lb:50051'... worker1 # [ 116.830609] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42886 client # [ 116.825639] nix[1221]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker1 # [ 116.846137] nix-daemon[839]: accepted connection from pid 1284, user nix-grpc-daemon (trusted) worker1 # [ 116.874229] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:24Z level=info event=niks3_push_started pid=1413 worker1 # [ 117.085563] nix-grpc-daemon[1413]: time=2026-09-21T09:29:24.716Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 117.257923] nix-daemon[839]: accepted connection from pid 1426, user nix-grpc-daemon (trusted) worker1 # [ 117.274861] nix-daemon[839]: reaped child process 1429, status = succeeded worker1 # [ 117.448742] nix-daemon[839]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker1 # [ 117.466753] nix-daemon[839]: reaped child process 1434, status = succeeded lb # [ 117.484386] niks3-server[1023]: 2026/09/21 09:29:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 117.488104] nix-grpc-daemon[1413]: time=2026-09-21T09:29:25.119Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 117.489588] nix-grpc-daemon[1413]: time=2026-09-21T09:29:25.119Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 117.520642] niks3-server[1023]: 2026/09/21 09:29:25 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker1 # [ 117.528278] nix-grpc-daemon[1413]: time=2026-09-21T09:29:25.159Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.533514] niks3-server[1023]: 2026/09/21 09:29:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 117.545940] niks3-server[1023]: 2026/09/21 09:29:25 INFO Signed narinfos id=35 count=1 lb # [ 117.554615] niks3-server[1023]: 2026/09/21 09:29:25 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 117.565020] niks3-server[1023]: 2026/09/21 09:29:25 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete worker1 # [ 117.565742] nix-grpc-daemon[1413]: time=2026-09-21T09:29:25.197Z level=INFO msg="Upload complete. (476ms)" lb # [ 117.572278] niks3-server[1023]: 2026/09/21 09:29:25 INFO Completed upload id=35 lb # [ 117.576248] niks3-server[1023]: 2026/09/21 09:29:25 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker1 # [ 117.572277] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42886 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 117.587511] nix-grpc-daemon[1284]: ts=2026-09-21T09:29:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42886 worker1 # [ 117.593744] nix-daemon[839]: accepted connection from pid 1284, user nix-grpc-daemon (trusted) worker1 # [ 117.598766] nix-daemon[839]: reaped child process 1411, status = succeeded worker1 # [ 117.609575] nix-daemon[839]: accepted connection from pid 1284, user nix-grpc-daemon (trusted) client # [ 117.601293] nix[1221]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 119.415349] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1284 (nix-grpc-daemon) on client request. worker1 # [ 119.417018] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 119.438718] niks3-server[1023]: 2026/09/21 09:29:27 INFO lead: released remote=192.168.1.3:38236 client # [ 119.439675] nix[1221]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker2 # [ 119.455933] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds) client: must succeed: sleep 5.0 client # [ 119.446010] nix[1221]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 119.460530] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 119.462089] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 119.463321] systemd[1]: nix-grpc-daemon.service: Consumed 595ms CPU time over 18.065s wall clock time, 34.3M memory peak, 17.1K incoming IP traffic, 27.5K outgoing IP traffic. worker1 # [ 119.479021] nix-daemon[839]: reaped child process 1436, status = succeeded worker1 # [ 119.480659] nix-daemon[839]: reaped child process 1401, status = succeeded worker1 # [ 119.488608] nix-daemon[1438]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 119.496458] nix-daemon[839]: reaped child process 1438, status = failed with exit code 1 worker2 # [ 119.656467] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.649915] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker1 # [ 119.658656] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 119.859112] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 119.861751] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 119.865887] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 119.873266] nix-grpc-daemon[1475]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 119.874693] nix-grpc-daemon[1475]: E0000 00:00:1789982967.504436 1475 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 119.883162] nix-grpc-daemon[1475]: E0000 00:00:1789982967.510283 1475 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 119.889375] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 119.892142] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 119.896163] niks3-server[1023]: 2026/09/21 09:29:27 INFO lead: acquired remote=192.168.1.3:49794 worker1 # [ 119.895056] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=scheduler_take_over worker2 # [ 119.905171] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 119.900069] nix-grpc-daemon[1475]: E0000 00:00:1789982967.530633 1515 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 119.928053] nix-grpc-daemon[1475]: E0000 00:00:1789982967.548480 1515 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 119.930325] nix-grpc-daemon[1475]: E0000 00:00:1789982967.548632 1515 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 119.936722] nix-grpc-daemon[1475]: E0000 00:00:1789982967.567961 1515 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 119.948544] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.951048] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42894 worker1 # [ 119.953022] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 119.958133] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 119.960494] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 120.015851] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42908 worker1 # [ 120.024315] nix-daemon[839]: accepted connection from pid 1475, user nix-grpc-daemon (trusted) worker1 # [ 120.037159] nix-daemon[839]: accepted connection from pid 1475, user nix-grpc-daemon (trusted) client # [ 120.038743] nix[1221]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker1 # [ 120.048113] nix-daemon[839]: accepted connection from pid 1475, user nix-grpc-daemon (trusted) worker2 # [ 120.106517] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 120.104800] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 120.109690] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42894 worker1 # [ 120.114129] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 120.856936] envoy[913]: conn peer=[2001:db8:1::1]:50748 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1430 ms=8665 lb # [ 120.861831] envoy[913]: conn peer=[2001:db8:1::4]:34572 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=36957 tx=2136 ms=29214 lb # [ 120.866907] envoy[913]: conn peer=[2001:db8:1::3]:53010 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1746 tx=595 ms=17776 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 124.869886] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:32Z level=info event=niks3_push_started pid=1558 worker1 # [ 124.914070] nix-daemon[839]: reaped child process 1533, status = succeeded worker1 # [ 125.097440] nix-grpc-daemon[1558]: time=2026-09-21T09:29:32.729Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 125.270335] nix-daemon[839]: accepted connection from pid 1571, user nix-grpc-daemon (trusted) worker1 # [ 125.286810] nix-daemon[839]: reaped child process 1574, status = succeeded lb # [ 125.305774] niks3-server[1023]: 2026/09/21 09:29:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 125.311010] nix-grpc-daemon[1558]: time=2026-09-21T09:29:32.941Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 125.313764] nix-grpc-daemon[1558]: time=2026-09-21T09:29:32.941Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 125.348615] niks3-server[1023]: 2026/09/21 09:29:32 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 125.366001] niks3-server[1023]: 2026/09/21 09:29:32 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 125.368118] nix-grpc-daemon[1558]: time=2026-09-21T09:29:32.998Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.377829] niks3-server[1023]: 2026/09/21 09:29:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 125.393103] niks3-server[1023]: 2026/09/21 09:29:32 INFO Signed narinfos id=36 count=1 lb # [ 125.402385] niks3-server[1023]: 2026/09/21 09:29:33 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 125.413700] niks3-server[1023]: 2026/09/21 09:29:33 INFO Completed upload id=36 worker1 # [ 125.406899] nix-grpc-daemon[1558]: time=2026-09-21T09:29:33.038Z level=INFO msg="Upload complete. (305ms)" worker1 # [ 125.421709] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42908 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 125.440090] nix-grpc-daemon[1558]: time=2026-09-21T09:29:33.048Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls error="server returned 404: object is not pending upload\n" worker1 # [ 125.445550] nix-grpc-daemon[1558]: time=2026-09-21T09:29:33.051Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 125.450556] nix-daemon[839]: reaped child process 1531, status = succeeded client # [ 125.471257] systemd[1]: mid.service: Deactivated successfully. client # [ 125.476488] systemd[1]: mid.service: Consumed 184ms CPU time over 10.079s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 10.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.68 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 126.045896] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: e876ef6278bb4cd48efa9c7b63458375 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker1 # [ 126.285979] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42908 client # [ 126.286720] nix[1257]: don't know how to build these paths: client # [ 126.288414] nix[1257]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker1 # [ 126.306931] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:33Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker1 # [ 126.312640] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:33Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 126.365765] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 126.382844] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5) worker2 # [ 126.472542] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 2/5) worker2 # [ 126.484723] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 3/5) worker2 # [ 126.572947] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 235 ms (attempt 4/5) worker2 # [ 126.816064] nix-grpc-daemon[1407]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 126.819773] nix-grpc-daemon[1407]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 126.840863] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53824 client # [ 126.839803] nix[1257]: copying 1 paths to 'lb:50051'... worker2 # [ 126.855926] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 client # [ 126.842394] nix[1257]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 126.871588] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 126.901184] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:34Z level=info event=niks3_push_started pid=1499 worker2 # [ 127.117616] nix-grpc-daemon[1499]: time=2026-09-21T09:29:34.744Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 127.291719] nix-daemon[861]: accepted connection from pid 1512, user nix-grpc-daemon (trusted) worker2 # [ 127.307275] nix-daemon[861]: reaped child process 1515, status = succeeded worker2 # [ 127.497980] nix-daemon[861]: accepted connection from pid 1519, user nix-grpc-daemon (trusted) worker2 # [ 127.514157] nix-daemon[861]: reaped child process 1524, status = succeeded lb # [ 127.522899] niks3-server[1023]: 2026/09/21 09:29:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 127.541210] nix-grpc-daemon[1499]: time=2026-09-21T09:29:35.167Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 127.542706] nix-grpc-daemon[1499]: time=2026-09-21T09:29:35.167Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 127.572079] niks3-server[1023]: 2026/09/21 09:29:35 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 127.580272] niks3-server[1023]: 2026/09/21 09:29:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign worker2 # [ 127.592619] nix-grpc-daemon[1499]: time=2026-09-21T09:29:35.219Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.592941] niks3-server[1023]: 2026/09/21 09:29:35 INFO Signed narinfos id=37 count=1 lb # [ 127.614608] niks3-server[1023]: 2026/09/21 09:29:35 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 127.619477] niks3-server[1023]: 2026/09/21 09:29:35 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 127.624872] niks3-server[1023]: 2026/09/21 09:29:35 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo lb # [ 127.628204] niks3-server[1023]: 2026/09/21 09:29:35 INFO Completed upload id=37 worker2 # [ 127.632182] nix-grpc-daemon[1499]: time=2026-09-21T09:29:35.259Z level=INFO msg="Upload complete. (510ms)" worker2 # [ 127.645022] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 127.660219] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 127.669117] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 127.672686] nix-daemon[861]: reaped child process 1497, status = succeeded client # [ 127.665811] nix[1257]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker2 # [ 127.684528] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 128.575511] systemd[1]: intr.service: Sent signal SIGINT to main process 1257 (nix) on client request. worker2 # [ 128.594105] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:36Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 128.581436] nix[1257]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 128.587570] nix[1257]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) client # [ 128.633773] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 128.638721] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 128.641032] systemd[1]: intr.service: Consumed 157ms CPU time over 2.590s wall clock time, 41.4M memory peak, 6.3K incoming IP traffic, 8.1K outgoing IP traffic. worker2 # [ 128.722983] nix-daemon[861]: reaped child process 1526, status = succeeded worker2 # [ 128.725263] nix-daemon[1528]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 128.735686] nix-daemon[861]: reaped child process 1528, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 2.74 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 128.806856] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 49547860f51c4250904439e25c3fb2f8 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) worker1 # [ 129.066241] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42908 client # [ 129.066626] nix[1277]: don't know how to build these paths: client # [ 129.068283] nix[1277]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker1 # [ 129.084283] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:36Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker1 # [ 129.090148] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:36Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 129.134311] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42908 worker1 # [ 129.150781] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 1/5) worker1 # [ 129.217621] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 2/5) worker1 # [ 129.269112] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 215 ms (attempt 3/5) worker1 # [ 129.491812] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 329 ms (attempt 4/5) worker1 # [ 129.829059] nix-grpc-daemon[1475]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 129.834471] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 129.855125] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42908 client # [ 129.864181] nix[1277]: copying 1 paths to 'lb:50051'... worker1 # [ 129.870383] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42908 client # [ 129.864541] nix[1277]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 129.888403] nix-daemon[839]: accepted connection from pid 1475, user nix-grpc-daemon (trusted) worker1 # [ 130.104064] nix-daemon[839]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker1 # [ 130.120584] nix-daemon[839]: reaped child process 1613, status = succeeded worker1 # [ 130.297095] nix-daemon[839]: accepted connection from pid 1615, user nix-grpc-daemon (trusted) worker1 # [ 130.313637] nix-daemon[839]: reaped child process 1618, status = succeeded lb # [ 130.333043] niks3-server[1023]: 2026/09/21 09:29:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 130.339206] nix-grpc-daemon[1558]: time=2026-09-21T09:29:37.970Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 130.340888] nix-grpc-daemon[1558]: time=2026-09-21T09:29:37.970Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 130.363943] niks3-server[1023]: 2026/09/21 09:29:37 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker1 # [ 130.371970] nix-grpc-daemon[1558]: time=2026-09-21T09:29:38.003Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.378591] niks3-server[1023]: 2026/09/21 09:29:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 130.389740] niks3-server[1023]: 2026/09/21 09:29:37 INFO Signed narinfos id=38 count=1 worker1 # [ 130.394413] nix-grpc-daemon[1558]: time=2026-09-21T09:29:38.026Z level=INFO msg="Upload complete. (487ms)" lb # [ 130.400671] niks3-server[1023]: 2026/09/21 09:29:38 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 130.405462] niks3-server[1023]: 2026/09/21 09:29:38 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 130.410034] niks3-server[1023]: 2026/09/21 09:29:38 INFO Completed upload id=38 worker1 # [ 130.405469] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42908 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 130.412374] niks3-server[1023]: 2026/09/21 09:29:38 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 130.412857] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42908 worker1 # [ 130.420871] nix-daemon[839]: accepted connection from pid 1475, user nix-grpc-daemon (trusted) worker1 # [ 130.425162] nix-daemon[839]: reaped child process 1604, status = succeeded client # [ 130.428871] nix[1277]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1 # [ 130.437840] nix-daemon[839]: accepted connection from pid 1475, user nix-grpc-daemon (trusted) lb # [ 130.860327] envoy[913]: conn peer=[2001:db8:1::1]:44028 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3940 tx=1851 ms=9800 lb # [ 130.865245] envoy[913]: conn peer=[2001:db8:1::1]:57130 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=835 ms=2329 worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 132.650751] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 132.705301] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 worker1 # [ 132.890181] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:40Z level=info event=draining worker2 # [ 133.042666] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53824 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 133.053233] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53824 worker1 # [ 133.067469] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:40Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker1 # [ 133.069553] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:40Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 133.123815] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 133.139071] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53824 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 133.155789] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 133.170968] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 133.378320] nix-daemon[861]: accepted connection from pid 1575, user nix-grpc-daemon (trusted) worker2 # [ 133.395613] nix-daemon[861]: reaped child process 1578, status = succeeded worker2 # [ 133.567244] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted) worker2 # [ 133.583656] nix-daemon[861]: reaped child process 1583, status = succeeded lb # [ 133.594274] niks3-server[1023]: 2026/09/21 09:29:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 133.609189] nix-grpc-daemon[1499]: time=2026-09-21T09:29:41.236Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 133.610790] nix-grpc-daemon[1499]: time=2026-09-21T09:29:41.236Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 133.628576] niks3-server[1023]: 2026/09/21 09:29:41 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker2 # [ 133.644817] nix-grpc-daemon[1499]: time=2026-09-21T09:29:41.272Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.645228] niks3-server[1023]: 2026/09/21 09:29:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 133.655570] niks3-server[1023]: 2026/09/21 09:29:41 INFO Signed narinfos id=39 count=1 lb # [ 133.661993] niks3-server[1023]: 2026/09/21 09:29:41 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 133.670106] niks3-server[1023]: 2026/09/21 09:29:41 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 133.677380] niks3-server[1023]: 2026/09/21 09:29:41 INFO Completed upload id=39 worker2 # [ 133.680960] nix-grpc-daemon[1499]: time=2026-09-21T09:29:41.308Z level=INFO msg="Upload complete. (492ms)" lb # [ 133.680349] niks3-server[1023]: 2026/09/21 09:29:41 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker2 # [ 133.688217] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 133.702818] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 133.709979] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 133.714865] nix-daemon[861]: reaped child process 1573, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker2 # [ 133.726745] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 134.772918] nix-daemon[861]: reaped child process 1587, status = succeeded worker2 # [ 134.946976] nix-daemon[861]: accepted connection from pid 1603, user nix-grpc-daemon (trusted) worker2 # [ 134.963501] nix-daemon[861]: reaped child process 1606, status = succeeded lb # [ 134.971896] niks3-server[1023]: 2026/09/21 09:29:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 134.988140] nix-grpc-daemon[1499]: time=2026-09-21T09:29:42.612Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 134.989637] nix-grpc-daemon[1499]: time=2026-09-21T09:29:42.612Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 135.003761] niks3-server[1023]: 2026/09/21 09:29:42 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 135.016309] niks3-server[1023]: 2026/09/21 09:29:42 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 135.032827] niks3-server[1023]: 2026/09/21 09:29:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker2 # [ 135.043518] nix-grpc-daemon[1499]: time=2026-09-21T09:29:42.670Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.044951] niks3-server[1023]: 2026/09/21 09:29:42 INFO Signed narinfos id=40 count=1 lb # [ 135.051210] niks3-server[1023]: 2026/09/21 09:29:42 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 135.061286] niks3-server[1023]: 2026/09/21 09:29:42 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete worker2 # [ 135.071911] nix-grpc-daemon[1499]: time=2026-09-21T09:29:42.699Z level=INFO msg="Upload complete. (332ms)" lb # [ 135.071819] niks3-server[1023]: 2026/09/21 09:29:42 INFO Completed upload id=40 worker1 # [ 135.075186] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:42Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 lb # [ 135.079999] niks3-server[1023]: 2026/09/21 09:29:42 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker1 # [ 135.077136] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:42Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 135.085077] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker2 # [ 135.099931] nix-daemon[861]: reaped child process 1585, status = succeeded worker2 # [ 135.136613] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 135.151718] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 135.165945] nix-grpc-daemon[1499]: time=2026-09-21T09:29:42.793Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 135.176071] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 135.190076] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 135.403407] nix-daemon[861]: accepted connection from pid 1610, user nix-grpc-daemon (trusted) worker2 # [ 135.419994] nix-daemon[861]: reaped child process 1613, status = succeeded worker2 # [ 135.594237] nix-daemon[861]: accepted connection from pid 1615, user nix-grpc-daemon (trusted) worker2 # [ 135.610033] nix-daemon[861]: reaped child process 1618, status = succeeded lb # [ 135.617705] niks3-server[1023]: 2026/09/21 09:29:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 135.630837] nix-grpc-daemon[1499]: time=2026-09-21T09:29:43.258Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 135.632451] nix-grpc-daemon[1499]: time=2026-09-21T09:29:43.258Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 135.646299] niks3-server[1023]: 2026/09/21 09:29:43 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 135.659857] niks3-server[1023]: 2026/09/21 09:29:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker2 # [ 135.670371] nix-grpc-daemon[1499]: time=2026-09-21T09:29:43.297Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.670679] niks3-server[1023]: 2026/09/21 09:29:43 INFO Signed narinfos id=41 count=1 lb # [ 135.677237] niks3-server[1023]: 2026/09/21 09:29:43 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 135.684089] niks3-server[1023]: 2026/09/21 09:29:43 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 135.690553] niks3-server[1023]: 2026/09/21 09:29:43 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo lb # [ 135.694740] niks3-server[1023]: 2026/09/21 09:29:43 INFO Completed upload id=41 worker2 # [ 135.698681] nix-grpc-daemon[1499]: time=2026-09-21T09:29:43.326Z level=INFO msg="Upload complete. (492ms)" worker2 # [ 135.708395] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 135.719729] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 135.726495] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 135.731166] nix-daemon[861]: reaped child process 1608, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker2 # [ 135.745098] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 136.975641] nix-daemon[861]: reaped child process 1622, status = succeeded worker2 # [ 137.135221] nix-daemon[861]: accepted connection from pid 1638, user nix-grpc-daemon (trusted) worker2 # [ 137.152895] nix-daemon[861]: reaped child process 1641, status = succeeded lb # [ 137.162150] niks3-server[1023]: 2026/09/21 09:29:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 137.175759] nix-grpc-daemon[1499]: time=2026-09-21T09:29:44.802Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 137.177491] nix-grpc-daemon[1499]: time=2026-09-21T09:29:44.802Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 137.197240] niks3-server[1023]: 2026/09/21 09:29:44 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 137.211608] niks3-server[1023]: 2026/09/21 09:29:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker2 # [ 137.220380] nix-grpc-daemon[1499]: time=2026-09-21T09:29:44.847Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.222607] niks3-server[1023]: 2026/09/21 09:29:44 INFO Signed narinfos id=42 count=1 lb # [ 137.233357] niks3-server[1023]: 2026/09/21 09:29:44 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 137.242108] niks3-server[1023]: 2026/09/21 09:29:44 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls worker2 # [ 137.249981] nix-grpc-daemon[1499]: time=2026-09-21T09:29:44.877Z level=INFO msg="Upload complete. (295ms)" lb # [ 137.249804] niks3-server[1023]: 2026/09/21 09:29:44 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 137.256088] niks3-server[1023]: 2026/09/21 09:29:44 INFO Completed upload id=42 lb # [ 137.258155] niks3-server[1023]: 2026/09/21 09:29:44 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 137.261042] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker1 # [ 137.257292] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:44Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker1 # [ 137.260159] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:44Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 137.276416] nix-daemon[861]: reaped child process 1620, status = succeeded worker2 # [ 137.311542] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 137.327453] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 137.340898] nix-grpc-daemon[1499]: time=2026-09-21T09:29:44.968Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 137.350828] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 137.376190] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 137.580149] nix-daemon[861]: accepted connection from pid 1645, user nix-grpc-daemon (trusted) worker2 # [ 137.596272] nix-daemon[861]: reaped child process 1648, status = succeeded worker2 # [ 137.771908] nix-daemon[861]: accepted connection from pid 1650, user nix-grpc-daemon (trusted) worker2 # [ 137.787268] nix-daemon[861]: reaped child process 1653, status = succeeded lb # [ 137.798206] niks3-server[1023]: 2026/09/21 09:29:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 137.810829] nix-grpc-daemon[1499]: time=2026-09-21T09:29:45.438Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 137.812348] nix-grpc-daemon[1499]: time=2026-09-21T09:29:45.438Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 137.825878] niks3-server[1023]: 2026/09/21 09:29:45 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 137.838186] niks3-server[1023]: 2026/09/21 09:29:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker2 # [ 137.848438] nix-grpc-daemon[1499]: time=2026-09-21T09:29:45.475Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.849530] niks3-server[1023]: 2026/09/21 09:29:45 INFO Signed narinfos id=43 count=1 lb # [ 137.855039] niks3-server[1023]: 2026/09/21 09:29:45 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 137.863365] niks3-server[1023]: 2026/09/21 09:29:45 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete worker2 # [ 137.872291] nix-grpc-daemon[1499]: time=2026-09-21T09:29:45.500Z level=INFO msg="Upload complete. (475ms)" lb # [ 137.867987] niks3-server[1023]: 2026/09/21 09:29:45 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo lb # [ 137.871906] niks3-server[1023]: 2026/09/21 09:29:45 INFO Completed upload id=43 worker2 # [ 137.880125] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 137.890145] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 137.896933] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 137.901569] nix-daemon[861]: reaped child process 1643, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker2 # [ 137.914134] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 139.334846] nix-daemon[861]: reaped child process 1657, status = succeeded worker2 # [ 139.490816] nix-daemon[861]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker2 # [ 139.507035] nix-daemon[861]: reaped child process 1676, status = succeeded lb # [ 139.517931] niks3-server[1023]: 2026/09/21 09:29:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 139.534485] nix-grpc-daemon[1499]: time=2026-09-21T09:29:47.160Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 139.535936] nix-grpc-daemon[1499]: time=2026-09-21T09:29:47.160Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 139.555922] niks3-server[1023]: 2026/09/21 09:29:47 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 139.568504] niks3-server[1023]: 2026/09/21 09:29:47 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst worker2 # [ 139.585922] nix-grpc-daemon[1499]: time=2026-09-21T09:29:47.213Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.576984] niks3-server[1023]: 2026/09/21 09:29:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 139.585622] niks3-server[1023]: 2026/09/21 09:29:47 INFO Signed narinfos id=44 count=1 lb # [ 139.587865] niks3-server[1023]: 2026/09/21 09:29:47 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 139.597622] niks3-server[1023]: 2026/09/21 09:29:47 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 139.604464] niks3-server[1023]: 2026/09/21 09:29:47 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo lb # [ 139.608707] niks3-server[1023]: 2026/09/21 09:29:47 INFO Completed upload id=44 worker2 # [ 139.612444] nix-grpc-daemon[1499]: time=2026-09-21T09:29:47.240Z level=INFO msg="Upload complete. (288ms)" worker2 # [ 139.624940] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker2 # [ 139.637711] nix-daemon[861]: reaped child process 1655, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.89 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 140.073962] nix-daemon[839]: reaped child process 1622, status = succeeded worker1 # [ 140.243824] nix-daemon[839]: accepted connection from pid 1669, user nix-grpc-daemon (trusted) worker1 # [ 140.259298] nix-daemon[839]: reaped child process 1672, status = succeeded lb # [ 140.279675] niks3-server[1023]: 2026/09/21 09:29:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 140.283929] nix-grpc-daemon[1558]: time=2026-09-21T09:29:47.915Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 140.287182] nix-grpc-daemon[1558]: time=2026-09-21T09:29:47.918Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 140.319549] niks3-server[1023]: 2026/09/21 09:29:47 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 140.331226] niks3-server[1023]: 2026/09/21 09:29:47 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker1 # [ 140.333346] nix-grpc-daemon[1558]: time=2026-09-21T09:29:47.964Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.341066] niks3-server[1023]: 2026/09/21 09:29:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 140.349705] niks3-server[1023]: 2026/09/21 09:29:47 INFO Signed narinfos id=45 count=1 lb # [ 140.360676] niks3-server[1023]: 2026/09/21 09:29:47 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls worker1 # [ 140.354551] nix-grpc-daemon[1558]: time=2026-09-21T09:29:47.986Z level=INFO msg="Upload complete. (300ms)" lb # [ 140.364792] niks3-server[1023]: 2026/09/21 09:29:47 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 140.370075] niks3-server[1023]: 2026/09/21 09:29:47 INFO Completed upload id=45 lb # [ 140.373174] niks3-server[1023]: 2026/09/21 09:29:47 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker1 # [ 140.368793] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42908 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 140.384778] nix-daemon[839]: reaped child process 1620, status = succeeded client # [ 140.406672] systemd[1]: sw.service: Deactivated successfully. client # [ 140.411969] systemd[1]: sw.service: Consumed 177ms CPU time over 11.602s wall clock time, 39.2M memory peak, 7.5K incoming IP traffic, 8.5K outgoing IP traffic. lb # [ 140.858271] envoy[913]: conn peer=[2001:db8:1::1]:50176 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9651 tx=4135 ms=6592 lb # [ 140.863513] envoy[913]: conn peer=[2001:db8:1::1]:57136 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2982 tx=1447 ms=11319 worker1 # [ 140.892275] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:48Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } worker1 # [ 141.113104] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:48Z level=info event=scheduler_yield lb # [ 141.121374] niks3-server[1023]: 2026/09/21 09:29:48 INFO lead: released remote=192.168.1.3:49794 worker2 # [ 141.131405] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:48Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 141.126995] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42894 worker1 # [ 141.133514] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:48Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 141.137684] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:48Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 141.141678] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42894 client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker1 # [ 141.146072] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:48Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 141.331556] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 141.337340] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 141.333977] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.340876] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 141.537861] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 141.542952] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 141.543561] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.547736] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 141.744056] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 141.749057] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 141.744070] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.749090] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 141.950181] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 141.955224] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 141.949587] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.954656] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 142.114181] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:49Z level=info event=scheduler_restarting worker1 # [ 142.144409] nix-daemon[839]: reaped child process 1529, status = succeeded worker2 # [ 142.158056] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.161956] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 142.175280] nix-grpc-daemon[1475]: ts=2026-09-21T09:29:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 142.358927] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.363781] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 142.429215] nix-grpc-daemon[1475]: E0000 00:00:1789982990.060978 1520 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker1 # [ 142.450287] nix-grpc-daemon[1475]: E0000 00:00:1789982990.082197 1520 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 142.564765] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.569508] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 142.770448] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.775491] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 142.976325] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 142.981189] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 143.184139] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 143.187978] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 143.384970] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 143.389791] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 143.590828] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 143.595949] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 143.797078] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 143.802146] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 143.934556] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 143.940545] systemd[1]: nix-grpc-daemon.service: Consumed 893ms CPU time over 24.472s wall clock time, 35.1M memory peak, 26.2K incoming IP traffic, 33.1K outgoing IP traffic. worker1 # [ 143.959388] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 144.003280] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.008761] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 144.165482] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 144.168241] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 144.172572] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 144.180063] nix-grpc-daemon[1686]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 144.181535] nix-grpc-daemon[1686]: E0000 00:00:1789982991.811661 1686 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 144.192444] nix-grpc-daemon[1686]: E0000 00:00:1789982991.818190 1686 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 144.196214] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 144.202299] niks3-server[1023]: 2026/09/21 09:29:51 INFO lead: acquired remote=192.168.1.3:57524 worker1 # [ 144.199311] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 144.200722] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:51Z level=info event=scheduler_take_over worker2 # [ 144.211669] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 144.208126] nix-grpc-daemon[1686]: E0000 00:00:1789982991.836408 1726 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 144.215993] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.08 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 144.236056] nix-grpc-daemon[1686]: E0000 00:00:1789982991.854389 1726 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 144.241312] nix-grpc-daemon[1686]: E0000 00:00:1789982991.855297 1726 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 144.244278] nix-grpc-daemon[1686]: E0000 00:00:1789982991.872316 1726 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 144.260202] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 144.262972] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2 # [ 144.413262] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.419326] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 144.464214] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 144.469713] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 144.620514] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.625937] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 144.670608] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 144.676179] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 144.827108] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.832573] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 144.877024] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 144.882386] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 145.033682] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.036151] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 145.041496] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:58122 worker1 # [ 145.046835] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 145.083044] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.088497] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:58122 worker1 # [ 145.093303] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.16 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.78 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 145.810669] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 145.818737] nix-grpc-daemon[1407]: ts=2026-09-21T09:29:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53824 worker1 # [ 145.850336] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:53Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker1 # [ 145.856745] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:53Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 145.864324] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:53Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker1 # [ 145.869550] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:53Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 145.906802] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 145.921835] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 145.946030] nix-grpc-daemon[1686]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 1/5) worker1 # [ 146.043108] nix-grpc-daemon[1686]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 2/5) worker1 # [ 146.055583] nix-grpc-daemon[1686]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 117 ms (attempt 3/5) worker1 # [ 146.180329] nix-grpc-daemon[1686]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 4/5) worker1 # [ 146.286851] nix-grpc-daemon[1686]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 146.292569] nix-grpc-daemon[1686]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 146.310632] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 146.325986] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 146.340226] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 146.367484] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:53Z level=info event=niks3_push_started pid=1751 worker1 # [ 146.587876] nix-grpc-daemon[1751]: time=2026-09-21T09:29:54.219Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 146.760669] nix-daemon[839]: accepted connection from pid 1764, user nix-grpc-daemon (trusted) worker1 # [ 146.776791] nix-daemon[839]: reaped child process 1767, status = succeeded worker1 # [ 146.950886] nix-daemon[839]: accepted connection from pid 1769, user nix-grpc-daemon (trusted) worker1 # [ 146.966446] nix-daemon[839]: reaped child process 1772, status = succeeded lb # [ 146.984689] niks3-server[1023]: 2026/09/21 09:29:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.989652] nix-grpc-daemon[1751]: time=2026-09-21T09:29:54.620Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 146.991136] nix-grpc-daemon[1751]: time=2026-09-21T09:29:54.620Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 147.018595] niks3-server[1023]: 2026/09/21 09:29:54 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 147.025041] nix-grpc-daemon[1751]: time=2026-09-21T09:29:54.656Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.030693] niks3-server[1023]: 2026/09/21 09:29:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 147.039181] niks3-server[1023]: 2026/09/21 09:29:54 INFO Signed narinfos id=46 count=1 lb # [ 147.048629] niks3-server[1023]: 2026/09/21 09:29:54 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 147.058587] niks3-server[1023]: 2026/09/21 09:29:54 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 147.068097] niks3-server[1023]: 2026/09/21 09:29:54 INFO Completed upload id=46 worker1 # [ 147.062459] nix-grpc-daemon[1751]: time=2026-09-21T09:29:54.694Z level=INFO msg="Upload complete. (470ms)" lb # [ 147.071029] niks3-server[1023]: 2026/09/21 09:29:54 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 147.073274] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 147.082118] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 147.091084] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 147.093286] nix-daemon[839]: reaped child process 1749, status = succeeded worker1 # [ 147.105387] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 148.526137] nix-daemon[839]: reaped child process 1776, status = succeeded worker1 # [ 148.685703] nix-daemon[839]: accepted connection from pid 1792, user nix-grpc-daemon (trusted) worker1 # [ 148.703443] nix-daemon[839]: reaped child process 1795, status = succeeded lb # [ 148.721914] niks3-server[1023]: 2026/09/21 09:29:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.731620] nix-grpc-daemon[1751]: time=2026-09-21T09:29:56.360Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 148.733742] nix-grpc-daemon[1751]: time=2026-09-21T09:29:56.360Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 148.756090] niks3-server[1023]: 2026/09/21 09:29:56 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 148.771546] niks3-server[1023]: 2026/09/21 09:29:56 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 148.787397] niks3-server[1023]: 2026/09/21 09:29:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 148.787808] nix-grpc-daemon[1751]: time=2026-09-21T09:29:56.418Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.801293] niks3-server[1023]: 2026/09/21 09:29:56 INFO Signed narinfos id=47 count=1 lb # [ 148.807130] niks3-server[1023]: 2026/09/21 09:29:56 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 148.815884] niks3-server[1023]: 2026/09/21 09:29:56 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 148.821189] niks3-server[1023]: 2026/09/21 09:29:56 INFO Completed upload id=47 worker1 # [ 148.814802] nix-grpc-daemon[1751]: time=2026-09-21T09:29:56.446Z level=INFO msg="Upload complete. (300ms)" lb # [ 148.824181] niks3-server[1023]: 2026/09/21 09:29:56 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 148.830975] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=1 worker1 # [ 148.846981] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:56Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 148.851732] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:56Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 148.855493] nix-daemon[839]: reaped child process 1774, status = succeeded worker1 # [ 148.874484] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 148.889030] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 148.902378] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 148.915932] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 149.112592] nix-daemon[839]: accepted connection from pid 1801, user nix-grpc-daemon (trusted) worker1 # [ 149.128841] nix-daemon[839]: reaped child process 1804, status = succeeded worker1 # [ 149.303785] nix-daemon[839]: accepted connection from pid 1806, user nix-grpc-daemon (trusted) worker1 # [ 149.318575] nix-daemon[839]: reaped child process 1809, status = succeeded lb # [ 149.339445] niks3-server[1023]: 2026/09/21 09:29:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.343384] nix-grpc-daemon[1751]: time=2026-09-21T09:29:56.975Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 149.344999] nix-grpc-daemon[1751]: time=2026-09-21T09:29:56.975Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 149.367757] niks3-server[1023]: 2026/09/21 09:29:56 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst lb # [ 149.381049] niks3-server[1023]: 2026/09/21 09:29:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker1 # [ 149.382452] nix-grpc-daemon[1751]: time=2026-09-21T09:29:57.014Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.390364] niks3-server[1023]: 2026/09/21 09:29:57 INFO Signed narinfos id=48 count=1 lb # [ 149.396614] niks3-server[1023]: 2026/09/21 09:29:57 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls worker1 # [ 149.401090] nix-grpc-daemon[1751]: time=2026-09-21T09:29:57.033Z level=INFO msg="Upload complete. (471ms)" lb # [ 149.406990] niks3-server[1023]: 2026/09/21 09:29:57 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 149.411786] niks3-server[1023]: 2026/09/21 09:29:57 INFO Completed upload id=48 worker1 # [ 149.408147] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 149.415225] niks3-server[1023]: 2026/09/21 09:29:57 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 149.422429] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 149.425788] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 149.430713] nix-daemon[839]: reaped child process 1799, status = succeeded worker1 # [ 149.441149] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 150.267588] nix-daemon[839]: reaped child process 1813, status = succeeded worker1 # [ 150.427846] nix-daemon[839]: accepted connection from pid 1829, user nix-grpc-daemon (trusted) worker1 # [ 150.445873] nix-daemon[839]: reaped child process 1832, status = succeeded lb # [ 150.465476] niks3-server[1023]: 2026/09/21 09:29:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.468178] nix-grpc-daemon[1751]: time=2026-09-21T09:29:58.099Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.469616] nix-grpc-daemon[1751]: time=2026-09-21T09:29:58.099Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 150.496188] niks3-server[1023]: 2026/09/21 09:29:58 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 150.510203] niks3-server[1023]: 2026/09/21 09:29:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 150.511348] nix-grpc-daemon[1751]: time=2026-09-21T09:29:58.143Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.522218] niks3-server[1023]: 2026/09/21 09:29:58 INFO Signed narinfos id=49 count=1 lb # [ 150.530674] niks3-server[1023]: 2026/09/21 09:29:58 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 150.539266] niks3-server[1023]: 2026/09/21 09:29:58 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 150.550917] niks3-server[1023]: 2026/09/21 09:29:58 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 150.554895] niks3-server[1023]: 2026/09/21 09:29:58 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo lb # [ 150.559481] niks3-server[1023]: 2026/09/21 09:29:58 INFO Completed upload id=49 worker1 # [ 150.553490] nix-grpc-daemon[1751]: time=2026-09-21T09:29:58.185Z level=INFO msg="Upload complete. (304ms)" worker1 # [ 150.569363] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=1 worker1 # [ 150.584844] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:58Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.591856] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 150.595910] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:58Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 150.599652] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 150.603520] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 150.615250] nix-daemon[839]: reaped child process 1811, status = succeeded worker1 # [ 150.617742] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 150.788463] nix-daemon[839]: accepted connection from pid 1838, user nix-grpc-daemon (trusted) worker1 # [ 150.806285] nix-daemon[839]: reaped child process 1841, status = succeeded lb # [ 150.860445] envoy[913]: conn peer=[2001:db8:1::3]:48548 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1426 tx=568 ms=22216 worker1 # [ 150.978918] nix-daemon[839]: accepted connection from pid 1843, user nix-grpc-daemon (trusted) worker1 # [ 150.994753] nix-daemon[839]: reaped child process 1846, status = succeeded lb # [ 151.011890] niks3-server[1023]: 2026/09/21 09:29:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.015183] nix-grpc-daemon[1751]: time=2026-09-21T09:29:58.646Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.016760] nix-grpc-daemon[1751]: time=2026-09-21T09:29:58.647Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 151.038827] niks3-server[1023]: 2026/09/21 09:29:58 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst worker1 # [ 151.045656] nix-grpc-daemon[1751]: time=2026-09-21T09:29:58.677Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.053031] niks3-server[1023]: 2026/09/21 09:29:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 151.061586] niks3-server[1023]: 2026/09/21 09:29:58 INFO Signed narinfos id=50 count=1 lb # [ 151.067380] niks3-server[1023]: 2026/09/21 09:29:58 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 151.072971] niks3-server[1023]: 2026/09/21 09:29:58 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete worker1 # [ 151.072264] nix-grpc-daemon[1751]: time=2026-09-21T09:29:58.704Z level=INFO msg="Upload complete. (451ms)" lb # [ 151.079199] niks3-server[1023]: 2026/09/21 09:29:58 INFO Completed upload id=50 lb # [ 151.082530] niks3-server[1023]: 2026/09/21 09:29:58 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 151.080233] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 151.090441] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 151.096696] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 151.101455] nix-daemon[839]: reaped child process 1836, status = succeeded worker1 # [ 151.114770] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 151.962538] nix-daemon[839]: reaped child process 1850, status = succeeded worker1 # [ 152.137952] nix-daemon[839]: accepted connection from pid 1866, user nix-grpc-daemon (trusted) worker1 # [ 152.158056] nix-daemon[839]: reaped child process 1869, status = succeeded lb # [ 152.178134] niks3-server[1023]: 2026/09/21 09:29:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.181993] nix-grpc-daemon[1751]: time=2026-09-21T09:29:59.813Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.185758] nix-grpc-daemon[1751]: time=2026-09-21T09:29:59.816Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 152.214083] niks3-server[1023]: 2026/09/21 09:29:59 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 152.230430] niks3-server[1023]: 2026/09/21 09:29:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 152.230380] nix-grpc-daemon[1751]: time=2026-09-21T09:29:59.861Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.243390] niks3-server[1023]: 2026/09/21 09:29:59 INFO Signed narinfos id=51 count=1 lb # [ 152.248328] niks3-server[1023]: 2026/09/21 09:29:59 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 152.251697] niks3-server[1023]: 2026/09/21 09:29:59 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 152.258056] niks3-server[1023]: 2026/09/21 09:29:59 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 152.263585] niks3-server[1023]: 2026/09/21 09:29:59 INFO Completed upload id=51 worker1 # [ 152.257511] nix-grpc-daemon[1751]: time=2026-09-21T09:29:59.889Z level=INFO msg="Upload complete. (333ms)" lb # [ 152.266002] niks3-server[1023]: 2026/09/21 09:29:59 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker1 # [ 152.277275] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=1 worker1 # [ 152.292530] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:59Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 152.298457] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:59Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 152.303119] nix-daemon[839]: reaped child process 1848, status = succeeded worker1 # [ 152.310638] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 152.325470] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 152.339862] nix-grpc-daemon[1751]: time=2026-09-21T09:29:59.971Z level=INFO msg="All 1 paths already cached" worker1 # [ 152.348716] nix-grpc-daemon[1686]: ts=2026-09-21T09:29:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 152.361904] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 152.551802] nix-daemon[839]: accepted connection from pid 1875, user nix-grpc-daemon (trusted) worker1 # [ 152.572500] nix-daemon[839]: reaped child process 1878, status = succeeded worker1 # [ 152.750837] nix-daemon[839]: accepted connection from pid 1880, user nix-grpc-daemon (trusted) worker1 # [ 152.769705] nix-daemon[839]: reaped child process 1883, status = succeeded lb # [ 152.786307] niks3-server[1023]: 2026/09/21 09:30:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.790052] nix-grpc-daemon[1751]: time=2026-09-21T09:30:00.421Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 152.791569] nix-grpc-daemon[1751]: time=2026-09-21T09:30:00.421Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 152.813088] niks3-server[1023]: 2026/09/21 09:30:00 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 152.822226] nix-grpc-daemon[1751]: time=2026-09-21T09:30:00.454Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.827773] niks3-server[1023]: 2026/09/21 09:30:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 152.839995] niks3-server[1023]: 2026/09/21 09:30:00 INFO Signed narinfos id=52 count=1 lb # [ 152.847562] niks3-server[1023]: 2026/09/21 09:30:00 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 152.855589] niks3-server[1023]: 2026/09/21 09:30:00 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete worker1 # [ 152.856734] nix-grpc-daemon[1751]: time=2026-09-21T09:30:00.488Z level=INFO msg="Upload complete. (481ms)" lb # [ 152.863278] niks3-server[1023]: 2026/09/21 09:30:00 INFO Completed upload id=52 lb # [ 152.867027] niks3-server[1023]: 2026/09/21 09:30:00 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 152.864170] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 152.876256] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 152.882333] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 152.887200] nix-daemon[839]: reaped child process 1873, status = succeeded worker1 # [ 152.900973] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 154.147361] nix-daemon[839]: reaped child process 1887, status = succeeded worker1 # [ 154.339482] nix-daemon[839]: accepted connection from pid 1903, user nix-grpc-daemon (trusted) worker1 # [ 154.355644] nix-daemon[839]: reaped child process 1906, status = succeeded lb # [ 154.376935] niks3-server[1023]: 2026/09/21 09:30:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.383619] nix-grpc-daemon[1751]: time=2026-09-21T09:30:02.012Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.385461] nix-grpc-daemon[1751]: time=2026-09-21T09:30:02.012Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 154.414614] niks3-server[1023]: 2026/09/21 09:30:02 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 154.427889] niks3-server[1023]: 2026/09/21 09:30:02 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 154.436563] niks3-server[1023]: 2026/09/21 09:30:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 154.436537] nix-grpc-daemon[1751]: time=2026-09-21T09:30:02.068Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.446172] niks3-server[1023]: 2026/09/21 09:30:02 INFO Signed narinfos id=53 count=1 lb # [ 154.452281] niks3-server[1023]: 2026/09/21 09:30:02 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 154.460143] niks3-server[1023]: 2026/09/21 09:30:02 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 154.466417] niks3-server[1023]: 2026/09/21 09:30:02 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo lb # [ 154.472182] niks3-server[1023]: 2026/09/21 09:30:02 INFO Completed upload id=53 worker1 # [ 154.466578] nix-grpc-daemon[1751]: time=2026-09-21T09:30:02.098Z level=INFO msg="Upload complete. (355ms)" worker1 # [ 154.485079] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=1 worker1 # [ 154.505356] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:02Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 154.510019] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 154.514186] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:02Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 154.518943] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 154.523302] nix-daemon[839]: reaped child process 1885, status = succeeded worker1 # [ 154.525282] nix-grpc-daemon[1751]: time=2026-09-21T09:30:02.154Z level=INFO msg="All 1 paths already cached" worker1 # [ 154.529731] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 154.543159] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 154.725082] nix-daemon[839]: accepted connection from pid 1912, user nix-grpc-daemon (trusted) worker1 # [ 154.741741] nix-daemon[839]: reaped child process 1915, status = succeeded worker1 # [ 154.914520] nix-daemon[839]: accepted connection from pid 1917, user nix-grpc-daemon (trusted) worker1 # [ 154.930633] nix-daemon[839]: reaped child process 1920, status = succeeded lb # [ 154.947222] niks3-server[1023]: 2026/09/21 09:30:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.950639] nix-grpc-daemon[1751]: time=2026-09-21T09:30:02.582Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.952245] nix-grpc-daemon[1751]: time=2026-09-21T09:30:02.582Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 154.974741] niks3-server[1023]: 2026/09/21 09:30:02 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 154.986526] niks3-server[1023]: 2026/09/21 09:30:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 154.986501] nix-grpc-daemon[1751]: time=2026-09-21T09:30:02.618Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.996714] niks3-server[1023]: 2026/09/21 09:30:02 INFO Signed narinfos id=54 count=1 lb # [ 155.004524] niks3-server[1023]: 2026/09/21 09:30:02 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 155.017715] niks3-server[1023]: 2026/09/21 09:30:02 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 155.020331] nix-grpc-daemon[1751]: time=2026-09-21T09:30:02.652Z level=INFO msg="Upload complete. (471ms)" lb # [ 155.026033] niks3-server[1023]: 2026/09/21 09:30:02 INFO Completed upload id=54 lb # [ 155.029571] niks3-server[1023]: 2026/09/21 09:30:02 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 155.028205] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 155.042766] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 155.046321] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 155.051899] nix-daemon[839]: reaped child process 1910, status = succeeded worker1 # [ 155.063141] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 156.306830] nix-daemon[839]: reaped child process 1924, status = succeeded worker1 # [ 156.478552] nix-daemon[839]: accepted connection from pid 1940, user nix-grpc-daemon (trusted) worker1 # [ 156.496622] nix-daemon[839]: reaped child process 1943, status = succeeded lb # [ 156.517322] niks3-server[1023]: 2026/09/21 09:30:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.528410] nix-grpc-daemon[1751]: time=2026-09-21T09:30:04.157Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.529930] nix-grpc-daemon[1751]: time=2026-09-21T09:30:04.157Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 156.557669] niks3-server[1023]: 2026/09/21 09:30:04 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 156.570670] niks3-server[1023]: 2026/09/21 09:30:04 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 156.582629] niks3-server[1023]: 2026/09/21 09:30:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 156.582108] nix-grpc-daemon[1751]: time=2026-09-21T09:30:04.213Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.592115] niks3-server[1023]: 2026/09/21 09:30:04 INFO Signed narinfos id=55 count=1 lb # [ 156.594582] niks3-server[1023]: 2026/09/21 09:30:04 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 156.602756] niks3-server[1023]: 2026/09/21 09:30:04 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 156.611891] niks3-server[1023]: 2026/09/21 09:30:04 INFO Completed upload id=55 worker1 # [ 156.606275] nix-grpc-daemon[1751]: time=2026-09-21T09:30:04.238Z level=INFO msg="Upload complete. (333ms)" lb # [ 156.614963] niks3-server[1023]: 2026/09/21 09:30:04 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 156.628453] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=1 worker1 # [ 156.638267] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:04Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 156.647707] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 156.652926] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:04Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 156.657510] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 156.661702] nix-daemon[839]: reaped child process 1922, status = succeeded worker1 # [ 156.663501] nix-grpc-daemon[1751]: time=2026-09-21T09:30:04.293Z level=INFO msg="All 1 paths already cached" worker1 # [ 156.666983] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 156.679258] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 156.864502] nix-daemon[839]: accepted connection from pid 1949, user nix-grpc-daemon (trusted) worker1 # [ 156.883178] nix-daemon[839]: reaped child process 1952, status = succeeded worker1 # [ 157.053961] nix-daemon[839]: accepted connection from pid 1954, user nix-grpc-daemon (trusted) worker1 # [ 157.070298] nix-daemon[839]: reaped child process 1957, status = succeeded lb # [ 157.087052] niks3-server[1023]: 2026/09/21 09:30:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.089956] nix-grpc-daemon[1751]: time=2026-09-21T09:30:04.721Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 157.091497] nix-grpc-daemon[1751]: time=2026-09-21T09:30:04.721Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 157.111856] niks3-server[1023]: 2026/09/21 09:30:04 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 157.125239] niks3-server[1023]: 2026/09/21 09:30:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 157.127149] nix-grpc-daemon[1751]: time=2026-09-21T09:30:04.758Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.136661] niks3-server[1023]: 2026/09/21 09:30:04 INFO Signed narinfos id=56 count=1 lb # [ 157.139607] niks3-server[1023]: 2026/09/21 09:30:04 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 157.150599] niks3-server[1023]: 2026/09/21 09:30:04 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 157.157564] niks3-server[1023]: 2026/09/21 09:30:04 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo lb # [ 157.161444] niks3-server[1023]: 2026/09/21 09:30:04 INFO Completed upload id=56 worker1 # [ 157.155857] nix-grpc-daemon[1751]: time=2026-09-21T09:30:04.787Z level=INFO msg="Upload complete. (464ms)" worker1 # [ 157.164715] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 157.177540] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 157.184427] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 157.192262] nix-daemon[839]: reaped child process 1947, status = succeeded worker1 # [ 157.199180] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 158.426487] nix-daemon[839]: reaped child process 1961, status = succeeded worker1 # [ 158.600710] nix-daemon[839]: accepted connection from pid 1977, user nix-grpc-daemon (trusted) worker1 # [ 158.617083] nix-daemon[839]: reaped child process 1980, status = succeeded lb # [ 158.635268] niks3-server[1023]: 2026/09/21 09:30:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.640551] nix-grpc-daemon[1751]: time=2026-09-21T09:30:06.272Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.643106] nix-grpc-daemon[1751]: time=2026-09-21T09:30:06.274Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 158.676184] niks3-server[1023]: 2026/09/21 09:30:06 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 158.689640] niks3-server[1023]: 2026/09/21 09:30:06 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 158.696114] niks3-server[1023]: 2026/09/21 09:30:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 158.695102] nix-grpc-daemon[1751]: time=2026-09-21T09:30:06.326Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.704803] niks3-server[1023]: 2026/09/21 09:30:06 INFO Signed narinfos id=57 count=1 lb # [ 158.709866] niks3-server[1023]: 2026/09/21 09:30:06 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 158.716453] niks3-server[1023]: 2026/09/21 09:30:06 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 158.724739] niks3-server[1023]: 2026/09/21 09:30:06 INFO Completed upload id=57 worker1 # [ 158.719171] nix-grpc-daemon[1751]: time=2026-09-21T09:30:06.351Z level=INFO msg="Upload complete. (311ms)" lb # [ 158.727384] niks3-server[1023]: 2026/09/21 09:30:06 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker1 # [ 158.737306] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=1 worker1 # [ 158.758823] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:06Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 158.763994] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 158.769262] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:06Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 158.774616] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 158.779555] nix-daemon[839]: reaped child process 1959, status = succeeded worker1 # [ 158.781793] nix-grpc-daemon[1751]: time=2026-09-21T09:30:06.410Z level=INFO msg="All 2 paths already cached" worker1 # [ 158.788124] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 158.798022] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 158.980398] nix-daemon[839]: accepted connection from pid 1986, user nix-grpc-daemon (trusted) worker1 # [ 158.998920] nix-daemon[839]: reaped child process 1989, status = succeeded worker1 # [ 159.167877] nix-daemon[839]: accepted connection from pid 1991, user nix-grpc-daemon (trusted) worker1 # [ 159.185781] nix-daemon[839]: reaped child process 1994, status = succeeded lb # [ 159.203333] niks3-server[1023]: 2026/09/21 09:30:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.206352] nix-grpc-daemon[1751]: time=2026-09-21T09:30:06.838Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 159.207845] nix-grpc-daemon[1751]: time=2026-09-21T09:30:06.838Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 159.228556] niks3-server[1023]: 2026/09/21 09:30:06 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 159.243014] niks3-server[1023]: 2026/09/21 09:30:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker1 # [ 159.243790] nix-grpc-daemon[1751]: time=2026-09-21T09:30:06.875Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.255347] niks3-server[1023]: 2026/09/21 09:30:06 INFO Signed narinfos id=58 count=1 lb # [ 159.260764] niks3-server[1023]: 2026/09/21 09:30:06 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 159.268271] niks3-server[1023]: 2026/09/21 09:30:06 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 159.273058] niks3-server[1023]: 2026/09/21 09:30:06 INFO Completed upload id=58 worker1 # [ 159.267270] nix-grpc-daemon[1751]: time=2026-09-21T09:30:06.899Z level=INFO msg="Upload complete. (460ms)" lb # [ 159.275764] niks3-server[1023]: 2026/09/21 09:30:06 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 159.275041] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 159.287978] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 159.294091] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 159.298889] nix-daemon[839]: reaped child process 1984, status = succeeded worker1 # [ 159.312205] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 160.357614] nix-daemon[839]: reaped child process 1998, status = succeeded worker1 # [ 160.536139] nix-daemon[839]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker1 # [ 160.554142] nix-daemon[839]: reaped child process 2017, status = succeeded lb # [ 160.573941] niks3-server[1023]: 2026/09/21 09:30:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.576449] nix-grpc-daemon[1751]: time=2026-09-21T09:30:08.207Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 160.578264] nix-grpc-daemon[1751]: time=2026-09-21T09:30:08.207Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" worker1 # [ 160.615831] nix-grpc-daemon[1751]: time=2026-09-21T09:30:08.247Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.615188] niks3-server[1023]: 2026/09/21 09:30:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 160.632333] niks3-server[1023]: 2026/09/21 09:30:08 INFO Signed narinfos id=59 count=1 lb # [ 160.635415] niks3-server[1023]: 2026/09/21 09:30:08 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 160.652472] niks3-server[1023]: 2026/09/21 09:30:08 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst worker1 # [ 160.652307] nix-grpc-daemon[1751]: time=2026-09-21T09:30:08.284Z level=INFO msg="Upload complete. (330ms)" lb # [ 160.658135] niks3-server[1023]: 2026/09/21 09:30:08 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 160.661840] niks3-server[1023]: 2026/09/21 09:30:08 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 160.666720] niks3-server[1023]: 2026/09/21 09:30:08 INFO Completed upload id=59 lb # [ 160.669689] niks3-server[1023]: 2026/09/21 09:30:08 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker1 # [ 160.664922] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=1 worker1 # [ 160.680422] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:08Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 160.685678] nix-daemon[839]: reaped child process 1996, status = succeeded worker1 # [ 160.710418] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 160.725672] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 160.740317] nix-grpc-daemon[1751]: time=2026-09-21T09:30:08.372Z level=INFO msg="All 2 paths already cached" worker1 # [ 160.749236] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 160.762809] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 160.970115] nix-daemon[839]: accepted connection from pid 2021, user nix-grpc-daemon (trusted) worker1 # [ 160.988829] nix-daemon[839]: reaped child process 2024, status = succeeded worker1 # [ 161.157617] nix-daemon[839]: accepted connection from pid 2026, user nix-grpc-daemon (trusted) worker1 # [ 161.174963] nix-daemon[839]: reaped child process 2029, status = succeeded lb # [ 161.192144] niks3-server[1023]: 2026/09/21 09:30:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.196058] nix-grpc-daemon[1751]: time=2026-09-21T09:30:08.827Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.198048] nix-grpc-daemon[1751]: time=2026-09-21T09:30:08.827Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 161.223054] niks3-server[1023]: 2026/09/21 09:30:08 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 161.234730] niks3-server[1023]: 2026/09/21 09:30:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker1 # [ 161.235379] nix-grpc-daemon[1751]: time=2026-09-21T09:30:08.867Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.246096] niks3-server[1023]: 2026/09/21 09:30:08 INFO Signed narinfos id=60 count=1 lb # [ 161.252843] niks3-server[1023]: 2026/09/21 09:30:08 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 161.264258] niks3-server[1023]: 2026/09/21 09:30:08 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 161.262877] nix-grpc-daemon[1751]: time=2026-09-21T09:30:08.894Z level=INFO msg="Upload complete. (482ms)" lb # [ 161.268715] niks3-server[1023]: 2026/09/21 09:30:08 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo lb # [ 161.272413] niks3-server[1023]: 2026/09/21 09:30:08 INFO Completed upload id=60 worker1 # [ 161.271397] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 161.283238] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 161.289185] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 161.293774] nix-daemon[839]: reaped child process 2019, status = succeeded worker1 # [ 161.306672] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 162.940885] nix-daemon[839]: reaped child process 2033, status = succeeded worker1 # [ 163.116589] nix-daemon[839]: accepted connection from pid 2049, user nix-grpc-daemon (trusted) worker1 # [ 163.132233] nix-daemon[839]: reaped child process 2052, status = succeeded lb # [ 163.155138] niks3-server[1023]: 2026/09/21 09:30:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.157653] nix-grpc-daemon[1751]: time=2026-09-21T09:30:10.788Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.159135] nix-grpc-daemon[1751]: time=2026-09-21T09:30:10.788Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 163.184400] niks3-server[1023]: 2026/09/21 09:30:10 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 163.200701] niks3-server[1023]: 2026/09/21 09:30:10 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 163.210183] niks3-server[1023]: 2026/09/21 09:30:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 163.209954] nix-grpc-daemon[1751]: time=2026-09-21T09:30:10.841Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.219240] niks3-server[1023]: 2026/09/21 09:30:10 INFO Signed narinfos id=61 count=1 lb # [ 163.225636] niks3-server[1023]: 2026/09/21 09:30:10 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 163.233676] niks3-server[1023]: 2026/09/21 09:30:10 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 163.239965] niks3-server[1023]: 2026/09/21 09:30:10 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo lb # [ 163.246004] niks3-server[1023]: 2026/09/21 09:30:10 INFO Completed upload id=61 worker1 # [ 163.240412] nix-grpc-daemon[1751]: time=2026-09-21T09:30:10.872Z level=INFO msg="Upload complete. (323ms)" worker1 # [ 163.253312] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=1 worker1 # [ 163.269049] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:10Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.273798] nix-daemon[839]: reaped child process 2031, status = succeeded worker1 # [ 163.294651] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 163.309352] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 163.323630] nix-grpc-daemon[1751]: time=2026-09-21T09:30:10.955Z level=INFO msg="All 2 paths already cached" worker1 # [ 163.332586] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 163.346045] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 163.542083] nix-daemon[839]: accepted connection from pid 2056, user nix-grpc-daemon (trusted) worker1 # [ 163.559991] nix-daemon[839]: reaped child process 2059, status = succeeded worker1 # [ 163.734995] nix-daemon[839]: accepted connection from pid 2061, user nix-grpc-daemon (trusted) worker1 # [ 163.751027] nix-daemon[839]: reaped child process 2064, status = succeeded lb # [ 163.769306] niks3-server[1023]: 2026/09/21 09:30:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.774141] nix-grpc-daemon[1751]: time=2026-09-21T09:30:11.405Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.775618] nix-grpc-daemon[1751]: time=2026-09-21T09:30:11.405Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 163.798592] niks3-server[1023]: 2026/09/21 09:30:11 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst lb # [ 163.812816] niks3-server[1023]: 2026/09/21 09:30:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 163.812951] nix-grpc-daemon[1751]: time=2026-09-21T09:30:11.444Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.825291] niks3-server[1023]: 2026/09/21 09:30:11 INFO Signed narinfos id=62 count=1 lb # [ 163.831799] niks3-server[1023]: 2026/09/21 09:30:11 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 163.841659] niks3-server[1023]: 2026/09/21 09:30:11 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete worker1 # [ 163.841360] nix-grpc-daemon[1751]: time=2026-09-21T09:30:11.473Z level=INFO msg="Upload complete. (478ms)" lb # [ 163.847882] niks3-server[1023]: 2026/09/21 09:30:11 INFO Completed upload id=62 lb # [ 163.850919] niks3-server[1023]: 2026/09/21 09:30:11 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 163.850737] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 163.863684] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 163.874163] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 163.877078] nix-daemon[839]: reaped child process 2054, status = succeeded worker1 # [ 163.890718] nix-daemon[839]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 165.130669] nix-daemon[839]: reaped child process 2068, status = succeeded worker1 # [ 165.296854] nix-daemon[839]: accepted connection from pid 2084, user nix-grpc-daemon (trusted) worker1 # [ 165.315338] nix-daemon[839]: reaped child process 2087, status = succeeded lb # [ 165.334261] niks3-server[1023]: 2026/09/21 09:30:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.340544] nix-grpc-daemon[1751]: time=2026-09-21T09:30:12.971Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.342908] nix-grpc-daemon[1751]: time=2026-09-21T09:30:12.971Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 165.372320] niks3-server[1023]: 2026/09/21 09:30:12 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 165.384382] niks3-server[1023]: 2026/09/21 09:30:13 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 165.396874] niks3-server[1023]: 2026/09/21 09:30:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 165.396146] nix-grpc-daemon[1751]: time=2026-09-21T09:30:13.027Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.404377] niks3-server[1023]: 2026/09/21 09:30:13 INFO Signed narinfos id=63 count=1 lb # [ 165.412040] niks3-server[1023]: 2026/09/21 09:30:13 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 165.421716] niks3-server[1023]: 2026/09/21 09:30:13 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 165.429814] niks3-server[1023]: 2026/09/21 09:30:13 INFO Completed upload id=63 lb # [ 165.433923] niks3-server[1023]: 2026/09/21 09:30:13 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 165.424261] nix-grpc-daemon[1751]: time=2026-09-21T09:30:13.056Z level=INFO msg="Upload complete. (323ms)" worker1 # [ 165.440585] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58132 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=1 worker1 # [ 165.455539] nix-daemon[839]: reaped child process 2066, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.99 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 165.653867] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 7d0370952dbd40c482d1d47cd1deee9e client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client # [ 165.904783] nix[1357]: don't know how to build these paths: client # [ 165.905890] nix[1357]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker1 # [ 165.909900] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58132 worker2 # [ 165.927580] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53824 client # [ 165.936364] nix[1357]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker worker1 # [ 165.942351] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:13Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 170.858522] envoy[913]: conn peer=[2001:db8:1::1]:51180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27131 tx=11350 ms=19653 client # [ 195.938440] nix[1357]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 195.952132] nix[1357]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 195.998119] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 196.005936] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 196.010566] systemd[1]: gpu.service: Consumed 175ms CPU time over 30.349s wall clock time, 35.4M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.28 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.12 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.10 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 198.215983] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:45Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 199.139064] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 199.145871] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58132 worker1 # [ 199.173883] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:46Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker1 # [ 199.179867] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:46Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 199.230176] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 199.246399] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53824 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 199.262717] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 199.278311] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 199.482163] nix-daemon[861]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker2 # [ 199.500951] nix-daemon[861]: reaped child process 1683, status = succeeded worker2 # [ 199.675308] nix-daemon[861]: accepted connection from pid 1685, user nix-grpc-daemon (trusted) worker2 # [ 199.692455] nix-daemon[861]: reaped child process 1688, status = succeeded lb # [ 199.703877] niks3-server[1023]: 2026/09/21 09:30:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 199.719487] nix-grpc-daemon[1499]: time=2026-09-21T09:30:47.346Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 199.721139] nix-grpc-daemon[1499]: time=2026-09-21T09:30:47.346Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 199.737008] niks3-server[1023]: 2026/09/21 09:30:47 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 199.752109] niks3-server[1023]: 2026/09/21 09:30:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker2 # [ 199.760879] nix-grpc-daemon[1499]: time=2026-09-21T09:30:47.388Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.763186] niks3-server[1023]: 2026/09/21 09:30:47 INFO Signed narinfos id=64 count=1 lb # [ 199.768319] niks3-server[1023]: 2026/09/21 09:30:47 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 199.776321] niks3-server[1023]: 2026/09/21 09:30:47 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 199.781136] niks3-server[1023]: 2026/09/21 09:30:47 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo lb # [ 199.784845] niks3-server[1023]: 2026/09/21 09:30:47 INFO Completed upload id=64 worker2 # [ 199.788438] nix-grpc-daemon[1499]: time=2026-09-21T09:30:47.416Z level=INFO msg="Upload complete. (493ms)" worker2 # [ 199.796149] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 199.811042] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 199.817737] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 199.822694] nix-daemon[861]: reaped child process 1678, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... worker2 # [ 199.833683] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 200.455736] nix-daemon[861]: reaped child process 1692, status = succeeded worker2 # [ 200.613052] nix-daemon[861]: accepted connection from pid 1708, user nix-grpc-daemon (trusted) worker2 # [ 200.628804] nix-daemon[861]: reaped child process 1711, status = succeeded lb # [ 200.638186] niks3-server[1023]: 2026/09/21 09:30:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.652064] nix-grpc-daemon[1499]: time=2026-09-21T09:30:48.279Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 200.653542] nix-grpc-daemon[1499]: time=2026-09-21T09:30:48.279Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 200.679524] niks3-server[1023]: 2026/09/21 09:30:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 200.690780] nix-grpc-daemon[1499]: time=2026-09-21T09:30:48.318Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.695989] niks3-server[1023]: 2026/09/21 09:30:48 INFO Signed narinfos id=65 count=1 lb # [ 200.699286] niks3-server[1023]: 2026/09/21 09:30:48 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 200.721828] niks3-server[1023]: 2026/09/21 09:30:48 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 200.728280] niks3-server[1023]: 2026/09/21 09:30:48 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 200.734421] niks3-server[1023]: 2026/09/21 09:30:48 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 200.738504] niks3-server[1023]: 2026/09/21 09:30:48 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo lb # [ 200.753055] niks3-server[1023]: 2026/09/21 09:30:48 INFO Completed upload id=65 worker2 # [ 200.758078] nix-grpc-daemon[1499]: time=2026-09-21T09:30:48.384Z level=INFO msg="Upload complete. (312ms)" worker2 # [ 200.769627] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=0 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=1 worker2 # [ 200.785464] nix-daemon[861]: reaped child process 1690, status = succeeded worker1 # [ 200.807801] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:48Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker1 # [ 200.813784] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:48Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 lb # [ 200.859367] envoy[913]: conn peer=[2001:db8:1::1]:53486 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30057 worker2 # [ 200.862839] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 200.871524] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 200.879527] nix-grpc-daemon[1499]: time=2026-09-21T09:30:48.507Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 200.886400] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 200.894421] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 201.075458] nix-daemon[861]: accepted connection from pid 1715, user nix-grpc-daemon (trusted) worker2 # [ 201.094954] nix-daemon[861]: reaped child process 1718, status = succeeded worker2 # [ 201.269991] nix-daemon[861]: accepted connection from pid 1720, user nix-grpc-daemon (trusted) worker2 # [ 201.286044] nix-daemon[861]: reaped child process 1723, status = succeeded lb # [ 201.294701] niks3-server[1023]: 2026/09/21 09:30:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 201.309672] nix-grpc-daemon[1499]: time=2026-09-21T09:30:48.937Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 201.311158] nix-grpc-daemon[1499]: time=2026-09-21T09:30:48.937Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 201.327018] niks3-server[1023]: 2026/09/21 09:30:48 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 201.340861] nix-grpc-daemon[1499]: time=2026-09-21T09:30:48.968Z level=INFO msg="Uploading 1 narinfos" lb # [ 201.343237] niks3-server[1023]: 2026/09/21 09:30:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker2 # [ 201.358700] nix-grpc-daemon[1499]: time=2026-09-21T09:30:48.986Z level=INFO msg="Upload complete. (452ms)" lb # [ 201.356974] niks3-server[1023]: 2026/09/21 09:30:48 INFO Signed narinfos id=66 count=1 lb # [ 201.360501] niks3-server[1023]: 2026/09/21 09:30:48 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 201.364626] niks3-server[1023]: 2026/09/21 09:30:48 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 201.367905] niks3-server[1023]: 2026/09/21 09:30:48 INFO Completed upload id=66 worker2 # [ 201.371252] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=0 paths=1 nar_bytes_in=632 lb # [ 201.370044] niks3-server[1023]: 2026/09/21 09:30:48 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 201.375456] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 201.378497] nix-daemon[861]: reaped child process 1713, status = succeeded worker2 # [ 201.384849] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... worker2 # [ 201.396449] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 202.637886] nix-daemon[861]: reaped child process 1727, status = succeeded worker2 # [ 202.831927] nix-daemon[861]: accepted connection from pid 1743, user nix-grpc-daemon (trusted) worker2 # [ 202.850312] nix-daemon[861]: reaped child process 1746, status = succeeded lb # [ 202.862021] niks3-server[1023]: 2026/09/21 09:30:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 202.876576] nix-grpc-daemon[1499]: time=2026-09-21T09:30:50.501Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 202.878116] nix-grpc-daemon[1499]: time=2026-09-21T09:30:50.501Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 202.903175] niks3-server[1023]: 2026/09/21 09:30:50 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 202.915928] niks3-server[1023]: 2026/09/21 09:30:50 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 202.923368] niks3-server[1023]: 2026/09/21 09:30:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 202.932078] nix-grpc-daemon[1499]: time=2026-09-21T09:30:50.559Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.933735] niks3-server[1023]: 2026/09/21 09:30:50 INFO Signed narinfos id=67 count=1 lb # [ 202.938736] niks3-server[1023]: 2026/09/21 09:30:50 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 202.944114] niks3-server[1023]: 2026/09/21 09:30:50 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 202.950266] niks3-server[1023]: 2026/09/21 09:30:50 INFO Completed upload id=67 worker2 # [ 202.953670] nix-grpc-daemon[1499]: time=2026-09-21T09:30:50.581Z level=INFO msg="Upload complete. (344ms)" lb # [ 202.953653] niks3-server[1023]: 2026/09/21 09:30:50 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 202.965324] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=1 worker1 # [ 202.971046] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:50Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 202.985699] nix-daemon[861]: reaped child process 1725, status = succeeded worker1 # [ 202.971648] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:50Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 203.024147] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 203.040882] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 203.056512] nix-grpc-daemon[1499]: time=2026-09-21T09:30:50.684Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 203.066112] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 203.080550] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 203.289952] nix-daemon[861]: accepted connection from pid 1750, user nix-grpc-daemon (trusted) worker2 # [ 203.310027] nix-daemon[861]: reaped child process 1753, status = succeeded worker2 # [ 203.482408] nix-daemon[861]: accepted connection from pid 1755, user nix-grpc-daemon (trusted) worker2 # [ 203.499432] nix-daemon[861]: reaped child process 1758, status = succeeded lb # [ 203.510596] niks3-server[1023]: 2026/09/21 09:30:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 203.524114] nix-grpc-daemon[1499]: time=2026-09-21T09:30:51.151Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 203.525610] nix-grpc-daemon[1499]: time=2026-09-21T09:30:51.151Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 203.542359] niks3-server[1023]: 2026/09/21 09:30:51 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst lb # [ 203.555915] niks3-server[1023]: 2026/09/21 09:30:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker2 # [ 203.567228] nix-grpc-daemon[1499]: time=2026-09-21T09:30:51.194Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.569496] niks3-server[1023]: 2026/09/21 09:30:51 INFO Signed narinfos id=68 count=1 lb # [ 203.575257] niks3-server[1023]: 2026/09/21 09:30:51 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 203.582739] niks3-server[1023]: 2026/09/21 09:30:51 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 203.589222] niks3-server[1023]: 2026/09/21 09:30:51 INFO Completed upload id=68 worker2 # [ 203.592883] nix-grpc-daemon[1499]: time=2026-09-21T09:30:51.220Z level=INFO msg="Upload complete. (493ms)" lb # [ 203.591661] niks3-server[1023]: 2026/09/21 09:30:51 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 203.600222] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 203.614891] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 worker2 # [ 203.621687] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 203.626588] nix-daemon[861]: reaped child process 1748, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 203.640687] nix-daemon[861]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 204.688402] nix-daemon[861]: reaped child process 1762, status = succeeded worker2 # [ 204.867682] nix-daemon[861]: accepted connection from pid 1778, user nix-grpc-daemon (trusted) worker2 # [ 204.884703] nix-daemon[861]: reaped child process 1781, status = succeeded lb # [ 204.897780] niks3-server[1023]: 2026/09/21 09:30:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 204.920276] nix-grpc-daemon[1499]: time=2026-09-21T09:30:52.546Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 204.921746] nix-grpc-daemon[1499]: time=2026-09-21T09:30:52.546Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 204.932820] niks3-server[1023]: 2026/09/21 09:30:52 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 204.947304] niks3-server[1023]: 2026/09/21 09:30:52 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 204.960078] niks3-server[1023]: 2026/09/21 09:30:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker2 # [ 204.969108] nix-grpc-daemon[1499]: time=2026-09-21T09:30:52.596Z level=INFO msg="Uploading 1 narinfos" lb # [ 204.969263] niks3-server[1023]: 2026/09/21 09:30:52 INFO Signed narinfos id=69 count=1 lb # [ 204.971596] niks3-server[1023]: 2026/09/21 09:30:52 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 204.979565] niks3-server[1023]: 2026/09/21 09:30:52 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 204.986946] niks3-server[1023]: 2026/09/21 09:30:52 INFO Completed upload id=69 worker2 # [ 204.990246] nix-grpc-daemon[1499]: time=2026-09-21T09:30:52.617Z level=INFO msg="Upload complete. (339ms)" lb # [ 204.989777] niks3-server[1023]: 2026/09/21 09:30:52 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 205.001085] nix-grpc-daemon[1407]: ts=2026-09-21T09:30:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53824 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=1 worker2 # [ 205.016424] nix-daemon[861]: reaped child process 1760, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.22 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 206.220399] nix-grpc-daemon[1686]: ts=2026-09-21T09:30:53Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.05 seconds) (finished: run the VM test script, in 207.60 seconds) test script finished in 207.89s cleanup kill QemuMachine (pid 50) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 49) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.05 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh