vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #512
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client: QEMU running (pid 50)13client # Disk image does not exist, creating the virtualisation disk image...14worker1 # Disk image does not exist, creating the virtualisation disk image...15client # Formatting '/build/vm-state-client/tmp.JO3hjrkQ10', fmt=raw size=107374182416worker2 # Disk image does not exist, creating the virtualisation disk image...17lb # Disk image does not exist, creating the virtualisation disk image...18lb: QEMU running (pid 49)19client # mke2fs 1.47.4 (6-Mar-2025)20worker2 # Formatting '/build/vm-state-worker2/tmp.iH2VnOHPtG', fmt=raw size=107374182421lb # Formatting '/build/vm-state-lb/tmp.KRPi5SeysP', fmt=raw size=107374182422worker1 # Formatting '/build/vm-state-worker1/tmp.k2DZKaqZEx', fmt=raw size=107374182423worker1: QEMU running (pid 51)24worker2: QEMU running (pid 52)25client # Discarding device blocks: 0/262144 done26worker2 # mke2fs 1.47.4 (6-Mar-2025)27worker1 # mke2fs 1.47.4 (6-Mar-2025)28lb # mke2fs 1.47.4 (6-Mar-2025)29client # Creating filesystem with 262144 4k blocks and 65536 inodes30worker1 # Discarding device blocks: 0/262144 done31lb # Discarding device blocks: 0/262144 done32client # Filesystem UUID: 9b461f11-b1d6-4956-868d-e04030333ae333worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes34lb # Creating filesystem with 262144 4k blocks and 65536 inodes35client # Superblock backups stored on blocks:36worker1 # Filesystem UUID: c161b43a-11e9-4d85-b10c-52abfa81c9ee37lb # Filesystem UUID: 8622face-eab8-4b8c-b722-453650c9cee338client # 32768, 98304, 163840, 22937639worker1 # Superblock backups stored on blocks:40lb # Superblock backups stored on blocks:41client # 42worker1 # 32768, 98304, 163840, 22937643lb # 32768, 98304, 163840, 22937644client # Allocating group tables: 0/8 done45worker1 # 46lb # 47client # Writing inode tables: 0/8 done48worker1 # Allocating group tables: 0/8 done49lb # Allocating group tables: 0/8 done50client # Creating journal (8192 blocks): done51worker1 # Writing inode tables: 0/8 done52lb # Writing inode tables: 0/8 done53client # Writing superblocks and filesystem accounting information: 0/8 done54worker1 # Creating journal (8192 blocks): done55lb # Creating journal (8192 blocks): done56client # 57worker1 # Writing superblocks and filesystem accounting information: 0/8 done58lb # Writing superblocks and filesystem accounting information: 0/8 done59client # Virtualisation disk image created.60worker1 # 61lb # 62client # Starting virtiofs daemons...63worker1 # Virtualisation disk image created.64lb # Virtualisation disk image created.65client # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)66worker1 # Starting virtiofs daemons...67lb # Starting virtiofs daemons...68client # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether69worker1 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)70lb # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)71client # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...72worker1 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether73lb # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether74client # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)75worker1 # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...76lb # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...77client # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether78worker1 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)79lb # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)80client # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...81worker1 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether82lb # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether83client # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)84worker1 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)85lb # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...86client # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether87worker1 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether88lb # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)89client # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...90worker1 # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...91lb # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether92lb # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...93worker1 # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...94client # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests95lb # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests96worker1 # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests97client # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests98lb # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests99worker1 # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests100client # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests101lb # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests102worker1 # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests103(finished: start all VMs, in 0.57 seconds)104worker2 # Discarding device blocks: 0/262144 done105client: waiting for unit network-addresses-eth1.service106worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes107client: waiting for the VM to finish booting108worker2 # Filesystem UUID: 37680bca-f3e2-43ad-91ac-3b964e5ce3f5109worker2 # Superblock backups stored on blocks:110worker2 # 32768, 98304, 163840, 229376111worker2 # 112worker2 # Allocating group tables: 0/8 done113worker2 # Writing inode tables: 0/8 done114worker2 # Creating journal (8192 blocks): done115worker2 # Writing superblocks and filesystem accounting information: 0/8 done116worker2 # 117worker2 # Virtualisation disk image created.118worker2 # Starting virtiofs daemons...119worker2 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)120worker2 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether121worker2 # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...122worker2 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)123worker2 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether124worker2 # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...125worker2 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)126worker2 # [2026-09-23T04:42:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether127worker2 # [2026-09-23T04:42:20Z INFO virtiofsd] Waiting for vhost-user socket connection...128worker2 # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests129worker2 # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests130worker2 # [2026-09-23T04:42:20Z INFO virtiofsd] Client connected, servicing requests131worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]132worker2 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026133worker2 # [ 0.000000] KASLR enabled134worker2 # [ 0.000000] random: crng init done135worker2 # [ 0.000000] Machine model: linux,dummy-virt136worker2 # [ 0.000000] efi: UEFI not found.137worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT138worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]139worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]140worker2 # [ 0.000000] Zone ranges:141worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]142worker2 # [ 0.000000] DMA32 empty143worker2 # [ 0.000000] Normal empty144worker2 # [ 0.000000] Device empty145worker2 # [ 0.000000] Movable zone start for each node146worker2 # [ 0.000000] Early memory node ranges147worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]148worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]149worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000150worker2 # [ 0.000000] psci: probing for conduit method from DT.151worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.152worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]153worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs154worker2 # [ 0.000000] psci: Trusted OS migration not required155worker2 # [ 0.000000] psci: SMC Calling Convention v1.1156worker1 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026157worker1 # [ 0.000000] KASLR enabled158worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)159worker1 # [ 0.000000] random: crng init done160worker1 # [ 0.000000] Machine model: linux,dummy-virt161worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296162worker1 # [ 0.000000] efi: UEFI not found.163worker2 # [ 0.000000] Detected PIPT I-cache on CPU0164worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT165worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)166worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]167worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface168worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]169worker2 # [ 0.000000] CPU features: detected: Spectre-v4170worker1 # [ 0.000000] Zone ranges:171client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]172worker2 # [ 0.000000] CPU features: detected: Spectre-BHB173worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]174worker1 # [ 0.000000] DMA32 empty175worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38176worker1 # [ 0.000000] Normal empty177worker1 # [ 0.000000] Device empty178client # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026179worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23180client # [ 0.000000] KASLR enabled181worker1 # [ 0.000000] Movable zone start for each node182worker2 # [ 0.000000] alternatives: applying boot alternatives183client # [ 0.000000] random: crng init done184worker1 # [ 0.000000] Early memory node ranges185client # [ 0.000000] Machine model: linux,dummy-virt186client # [ 0.000000] efi: UEFI not found.187worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]188client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT189worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]190worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000191client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]192worker1 # [ 0.000000] psci: probing for conduit method from DT.193client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]194worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.195client # [ 0.000000] Zone ranges:196worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rcm8j4pnk0zmlmgsymh11jg6bfkli2cx-nixos-system-worker2-test/init regInfo=/nix/store/fvbwcpswlxlq4vwgzpa0axny9f1av68s-closure-info/registration console=ttyAMA0,115200n8 console=tty0197worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs198client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]199worker1 # [ 0.000000] psci: Trusted OS migration not required200client # [ 0.000000] DMA32 empty201client # [ 0.000000] Normal empty202worker1 # [ 0.000000] psci: SMC Calling Convention v1.1203worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/fvbwcpswlxlq4vwgzpa0axny9f1av68s-closure-info/registration", will be passed to user space.204client # [ 0.000000] Device empty205client # [ 0.000000] Movable zone start for each node206worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes207worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)208client # [ 0.000000] Early memory node ranges209worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296210worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)211client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]212worker1 # [ 0.000000] Detected PIPT I-cache on CPU0213client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]214worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)215worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)216client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000217worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB218worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface219client # [ 0.000000] psci: probing for conduit method from DT.220worker2 # [ 0.000000] software IO TLB: area num 1.221worker1 # [ 0.000000] CPU features: detected: Spectre-v4222client # [ 0.000000] psci: PSCIv1.3 detected in firmware.223worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB224worker1 # [ 0.000000] CPU features: detected: Spectre-BHB225client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs226worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38227worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)228client # [ 0.000000] psci: Trusted OS migration not required229worker2 # [ 0.000000] Fallback order for Node 0: 0230client # [ 0.000000] psci: SMC Calling Convention v1.1231worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23232worker1 # [ 0.000000] alternatives: applying boot alternatives233worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216234worker2 # [ 0.000000] Policy zone: DMA235client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)236worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off237client # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296238client # [ 0.000000] Detected PIPT I-cache on CPU0239worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1240worker2 # [ 0.000000] allocated 3145728 bytes of page_ext241client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)242worker2 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages243client # [ 0.000000] CPU features: detected: GICv3 CPU interface244worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bn37sc2n1i20ygvgim4ix1wq2wbb4gsw-nixos-system-worker1-test/init regInfo=/nix/store/a7bckkg7lmpj6xb6ww918qxp6p1axf1r-closure-info/registration console=ttyAMA0,115200n8 console=tty0245worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups246client # [ 0.000000] CPU features: detected: Spectre-v4247worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.248client # [ 0.000000] CPU features: detected: Spectre-BHB249worker2 # [ 0.000000] rcu: RCU event tracing is enabled.250client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38251worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/a7bckkg7lmpj6xb6ww918qxp6p1axf1r-closure-info/registration", will be passed to user space.252worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.253client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23254worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes255worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.256client # [ 0.000000] alternatives: applying boot alternatives257worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.258worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)259worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.260worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)261worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.262worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB263lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]264worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1265worker1 # [ 0.000000] software IO TLB: area num 1.266worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.267worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB268client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/h0h42468m1lycnnbixi8y4srnpd3qprr-nixos-system-client-test/init regInfo=/nix/store/kglfpnzighnmmpghycx27bi8sqvfg32g-closure-info/registration console=ttyAMA0,115200n8 console=tty0269lb # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026270lb # [ 0.000000] KASLR enabled271lb # [ 0.000000] random: crng init done272worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)273worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.274lb # [ 0.000000] Machine model: linux,dummy-virt275worker1 # [ 0.000000] Fallback order for Node 0: 0276lb # [ 0.000000] efi: UEFI not found.277client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/kglfpnzighnmmpghycx27bi8sqvfg32g-closure-info/registration", will be passed to user space.278worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216279worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.280lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT281worker1 # [ 0.000000] Policy zone: DMA282client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes283worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0284worker2 # [ 0.000000] GICv3: 256 SPIs implemented285worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off286lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]287client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)288worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented289worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1290lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]291worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq292lb # [ 0.000000] Zone ranges:293client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)294worker1 # [ 0.000000] allocated 3145728 bytes of page_ext295worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI296lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]297worker1 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages298client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB299worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0300lb # [ 0.000000] DMA32 empty301client # [ 0.000000] software IO TLB: area num 1.302lb # [ 0.000000] Normal empty303worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups304lb # [ 0.000000] Device empty305worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000306worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.307client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB308lb # [ 0.000000] Movable zone start for each node309worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]310worker1 # [ 0.000000] rcu: RCU event tracing is enabled.311lb # [ 0.000000] Early memory node ranges312client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)313worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.314worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)315lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]316client # [ 0.000000] Fallback order for Node 0: 0317worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.318lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]319client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216320worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.321worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)322client # [ 0.000000] Policy zone: DMA323lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000324worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.325worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000326client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off327lb # [ 0.000000] psci: probing for conduit method from DT.328worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.329lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.330worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000331client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1332lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs333worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1334client # [ 0.000000] allocated 3145728 bytes of page_ext335worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.336lb # [ 0.000000] psci: Trusted OS migration not required337client # [ 0.000000] ftrace: allocating 74950 entries in 294 pages338worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.339lb # [ 0.000000] psci: SMC Calling Convention v1.1340client # [ 0.000000] ftrace: allocated 294 pages with 4 groups341worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns342client # [ 0.000000] rcu: Hierarchical RCU implementation.343lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)344worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.345worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).346client # [ 0.000000] rcu: RCU event tracing is enabled.347lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296348worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.349client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.350lb # [ 0.000000] Detected PIPT I-cache on CPU0351worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns352worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0353client # [ 0.000000] Trampoline variant of Tasks RCU enabled.354worker1 # [ 0.000000] GICv3: 256 SPIs implemented355lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)356client # [ 0.000000] Rude variant of Tasks RCU enabled.357worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns358worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented359worker2 # [ 0.000034] arm-pv: using stolen time PV360lb # [ 0.000000] CPU features: detected: GICv3 CPU interface361client # [ 0.000000] Tracing variant of Tasks RCU enabled.362worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq363lb # [ 0.000000] CPU features: detected: Spectre-v4364worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI365client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.366lb # [ 0.000000] CPU features: detected: Spectre-BHB367worker2 # [ 0.000669] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)368worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0369worker2 # [ 0.000860] Console: colour dummy device 80x25370client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1371lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38372worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000373worker2 # [ 0.000868] printk: legacy console [tty0] enabled374lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23375worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]376client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.377lb # [ 0.000000] alternatives: applying boot alternatives378worker2 # [ 0.001070] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)379worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)380client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.381worker2 # [ 0.001077] pid_max: default: 32768 minimum: 301382worker2 # [ 0.001152] LSM: initializing lsm=capability,landlock,yama,bpf,ima383worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)384client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.385worker2 # [ 0.001314] landlock: Up and running.386client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0387worker2 # [ 0.001317] Yama: becoming mindful.388worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000389client # [ 0.000000] GICv3: 256 SPIs implemented390worker2 # [ 0.001985] LSM support for eBPF active391worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000392client # [ 0.000000] GICv3: 0 Extended SPIs implemented393lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/kgjzg78npi7z07am2szqxkr41f06jp5w-nixos-system-lb-test/init regInfo=/nix/store/lcw0xq38k7svc2ifmp8wza1s56mbyq61-closure-info/registration console=ttyAMA0,115200n8 console=tty0394worker2 # [ 0.002171] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)395client # [ 0.000000] Root IRQ handler: gic_handle_irq396worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.397client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI398worker2 # [ 0.002207] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)399client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0400worker2 # [ 0.004254] rcu: Hierarchical SRCU implementation.401lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/lcw0xq38k7svc2ifmp8wza1s56mbyq61-closure-info/registration", will be passed to user space.402worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns403worker2 # [ 0.004259] rcu: Max phase no-delay instances is 1000.404client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000405worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).406client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]407worker2 # [ 0.005545] fsl-mc MSI: its@8080000 domain created408lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes409worker2 # [ 0.005638] EFI services will not be available.410worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns411client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)412worker2 # [ 0.005721] smp: Bringing up secondary CPUs ...413lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)414worker2 # [ 0.005730] smp: Brought up 1 node, 1 CPU415worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns416lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)417client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)418worker2 # [ 0.005733] SMP: Total of 1 processors activated.419worker1 # [ 0.000033] arm-pv: using stolen time PV420worker2 # [ 0.005739] CPU: All CPU(s) started at EL1421lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB422client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000423worker2 # [ 0.005750] CPU features: detected: Branch Target Identification424worker1 # [ 0.000454] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)425lb # [ 0.000000] software IO TLB: area num 1.426client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000427worker1 # [ 0.000670] Console: colour dummy device 80x25428worker2 # [ 0.005755] CPU features: detected: ARMv8.4 Translation Table Level429lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB430worker1 # [ 0.000678] printk: legacy console [tty0] enabled431client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.432lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)433worker2 # [ 0.005758] CPU features: detected: Instruction cache invalidation not required for I/D coherence434lb # [ 0.000000] Fallback order for Node 0: 0435worker1 # [ 0.000891] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)436client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns437worker2 # [ 0.005762] CPU features: detected: Data cache clean to the PoU not required for I/D coherence438lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216439worker1 # [ 0.000898] pid_max: default: 32768 minimum: 301440client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).441lb # [ 0.000000] Policy zone: DMA442worker2 # [ 0.005765] CPU features: detected: Common not Private translations443worker1 # [ 0.000977] LSM: initializing lsm=capability,landlock,yama,bpf,ima444worker1 # [ 0.001125] landlock: Up and running.445lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off446worker2 # [ 0.005768] CPU features: detected: CRC32 instructions447client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns448worker1 # [ 0.001128] Yama: becoming mindful.449lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1450worker1 # [ 0.001610] LSM support for eBPF active451worker2 # [ 0.005771] CPU features: detected: Data cache clean to Point of Deep Persistence452client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns453lb # [ 0.000000] allocated 3145728 bytes of page_ext454worker1 # [ 0.001754] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)455client # [ 0.000032] arm-pv: using stolen time PV456worker2 # [ 0.005775] CPU features: detected: Data cache clean to Point of Persistence457lb # [ 0.000000] ftrace: allocating 74950 entries in 294 pages458lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups459worker1 # [ 0.001789] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)460worker2 # [ 0.005778] CPU features: detected: Data independent timing control (DIT)461client # [ 0.000471] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)462worker2 # [ 0.005781] CPU features: detected: E0PD463lb # [ 0.000000] rcu: Hierarchical RCU implementation.464worker1 # [ 0.003852] rcu: Hierarchical SRCU implementation.465client # [ 0.000676] Console: colour dummy device 80x25466lb # [ 0.000000] rcu: RCU event tracing is enabled.467worker1 # [ 0.003858] rcu: Max phase no-delay instances is 1000.468worker2 # [ 0.005784] CPU features: detected: Enhanced Counter Virtualization469client # [ 0.000684] printk: legacy console [tty0] enabled470worker1 # [ 0.005181] fsl-mc MSI: its@8080000 domain created471lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.472worker2 # [ 0.005787] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)473worker1 # [ 0.005271] EFI services will not be available.474lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.475client # [ 0.000894] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)476worker1 # [ 0.005346] smp: Bringing up secondary CPUs ...477worker2 # [ 0.005790] CPU features: detected: Enhanced Virtualization Traps478lb # [ 0.000000] Rude variant of Tasks RCU enabled.479worker1 # [ 0.005355] smp: Brought up 1 node, 1 CPU480client # [ 0.000902] pid_max: default: 32768 minimum: 301481worker2 # [ 0.005794] CPU features: detected: Fine Grained Traps482lb # [ 0.000000] Tracing variant of Tasks RCU enabled.483worker1 # [ 0.005358] SMP: Total of 1 processors activated.484client # [ 0.000988] LSM: initializing lsm=capability,landlock,yama,bpf,ima485worker1 # [ 0.005364] CPU: All CPU(s) started at EL1486worker2 # [ 0.005797] CPU features: detected: Generic authentication (architected QARMA5 algorithm)487client # [ 0.001140] landlock: Up and running.488lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.489client # [ 0.001144] Yama: becoming mindful.490worker2 # [ 0.005802] CPU features: detected: RCpc load-acquire (LDAPR)491worker1 # [ 0.005375] CPU features: detected: Branch Target Identification492lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1493client # [ 0.001630] LSM support for eBPF active494worker2 # [ 0.005805] CPU features: detected: LSE atomic instructions495worker1 # [ 0.005380] CPU features: detected: ARMv8.4 Translation Table Level496client # [ 0.001799] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)497lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.498worker2 # [ 0.005808] CPU features: detected: Privileged Access Never499worker1 # [ 0.005383] CPU features: detected: Instruction cache invalidation not required for I/D coherence500worker2 # [ 0.005810] CPU features: detected: PMUv3501client # [ 0.001834] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)502lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.503worker2 # [ 0.005813] CPU features: detected: RAS Extension Support504client # [ 0.003764] rcu: Hierarchical SRCU implementation.505worker1 # [ 0.005387] CPU features: detected: Data cache clean to the PoU not required for I/D coherence506worker2 # [ 0.005816] CPU features: detected: RASv1p1 Extension Support507lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.508client # [ 0.003770] rcu: Max phase no-delay instances is 1000.509worker1 # [ 0.005391] CPU features: detected: Common not Private translations510worker2 # [ 0.005819] CPU features: detected: Random Number Generator511client # [ 0.005052] fsl-mc MSI: its@8080000 domain created512lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0513worker1 # [ 0.005394] CPU features: detected: CRC32 instructions514client # [ 0.005145] EFI services will not be available.515lb # [ 0.000000] GICv3: 256 SPIs implemented516worker2 # [ 0.005821] CPU features: detected: Speculation barrier (SB)517client # [ 0.005216] smp: Bringing up secondary CPUs ...518lb # [ 0.000000] GICv3: 0 Extended SPIs implemented519worker1 # [ 0.005397] CPU features: detected: Data cache clean to Point of Deep Persistence520worker2 # [ 0.005824] CPU features: detected: Stage-2 Force Write-Back521client # [ 0.005225] smp: Brought up 1 node, 1 CPU522lb # [ 0.000000] Root IRQ handler: gic_handle_irq523worker1 # [ 0.005400] CPU features: detected: Data cache clean to Point of Persistence524worker2 # [ 0.005827] CPU features: detected: TLB range maintenance instructions525client # [ 0.005228] SMP: Total of 1 processors activated.526lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI527client # [ 0.005233] CPU: All CPU(s) started at EL1528lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0529worker1 # [ 0.005403] CPU features: detected: Data independent timing control (DIT)530worker2 # [ 0.005832] CPU features: detected: Speculative Store Bypassing Safe (SSBS)531worker1 # [ 0.005407] CPU features: detected: E0PD532client # [ 0.005244] CPU features: detected: Branch Target Identification533worker2 # [ 0.005870] alternatives: applying system-wide alternatives534lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000535worker1 # [ 0.005409] CPU features: detected: Enhanced Counter Virtualization536client # [ 0.005249] CPU features: detected: ARMv8.4 Translation Table Level537lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]538worker2 # [ 0.008920] CPU features: detected: BBM Level 2 without TLB conflict abort539worker1 # [ 0.005412] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)540lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)541client # [ 0.005252] CPU features: detected: Instruction cache invalidation not required for I/D coherence542worker1 # [ 0.005416] CPU features: detected: Enhanced Virtualization Traps543worker2 # [ 0.009113] Memory: 1405916K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124632K reserved, 32768K cma-reserved)544worker1 # [ 0.005419] CPU features: detected: Fine Grained Traps545client # [ 0.005255] CPU features: detected: Data cache clean to the PoU not required for I/D coherence546lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)547worker2 # [ 0.009535] devtmpfs: initialized548client # [ 0.005259] CPU features: detected: Common not Private translations549worker1 # [ 0.005422] CPU features: detected: Generic authentication (architected QARMA5 algorithm)550lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000551worker2 # [ 0.011515] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)552client # [ 0.005262] CPU features: detected: CRC32 instructions553worker1 # [ 0.005427] CPU features: detected: RCpc load-acquire (LDAPR)554lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000555worker2 # [ 0.011538] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).556worker1 # [ 0.005430] CPU features: detected: LSE atomic instructions557client # [ 0.005265] CPU features: detected: Data cache clean to Point of Deep Persistence558lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.559worker1 # [ 0.005432] CPU features: detected: Privileged Access Never560worker2 # [ 0.011734] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL561client # [ 0.005269] CPU features: detected: Data cache clean to Point of Persistence562worker1 # [ 0.005435] CPU features: detected: PMUv3563worker2 # [ 0.011738] 0 pages in range for non-PLT usage564lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns565client # [ 0.005272] CPU features: detected: Data independent timing control (DIT)566worker2 # [ 0.011739] 508272 pages in range for PLT usage567worker1 # [ 0.005438] CPU features: detected: RAS Extension Support568lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).569client # [ 0.005275] CPU features: detected: E0PD570worker2 # [ 0.011858] pinctrl core: initialized pinctrl subsystem571worker1 # [ 0.005441] CPU features: detected: RASv1p1 Extension Support572worker2 # [ 0.012628] DMI not present or invalid.573client # [ 0.005278] CPU features: detected: Enhanced Counter Virtualization574worker1 # [ 0.005444] CPU features: detected: Random Number Generator575lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns576worker2 # [ 0.016400] NET: Registered PF_NETLINK/PF_ROUTE protocol family577client # [ 0.005281] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)578worker1 # [ 0.005446] CPU features: detected: Speculation barrier (SB)579worker2 # [ 0.018796] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations580lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns581client # [ 0.005284] CPU features: detected: Enhanced Virtualization Traps582worker1 # [ 0.005449] CPU features: detected: Stage-2 Force Write-Back583lb # [ 0.000031] arm-pv: using stolen time PV584client # [ 0.005288] CPU features: detected: Fine Grained Traps585worker1 # [ 0.005452] CPU features: detected: TLB range maintenance instructions586worker2 # [ 0.018981] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations587lb # [ 0.000377] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)588worker1 # [ 0.005457] CPU features: detected: Speculative Store Bypassing Safe (SSBS)589client # [ 0.005291] CPU features: detected: Generic authentication (architected QARMA5 algorithm)590worker2 # [ 0.019186] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations591lb # [ 0.000567] Console: colour dummy device 80x25592worker1 # [ 0.005496] alternatives: applying system-wide alternatives593client # [ 0.005296] CPU features: detected: RCpc load-acquire (LDAPR)594worker2 # [ 0.019211] audit: initializing netlink subsys (disabled)595lb # [ 0.000574] printk: legacy console [tty0] enabled596client # [ 0.005299] CPU features: detected: LSE atomic instructions597worker1 # [ 0.008580] CPU features: detected: BBM Level 2 without TLB conflict abort598worker2 # [ 0.019836] thermal_sys: Registered thermal governor 'fair_share'599client # [ 0.005302] CPU features: detected: Privileged Access Never600worker2 # [ 0.019838] thermal_sys: Registered thermal governor 'bang_bang'601lb # [ 0.000764] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)602client # [ 0.005305] CPU features: detected: PMUv3603lb # [ 0.000770] pid_max: default: 32768 minimum: 301604worker2 # [ 0.019842] thermal_sys: Registered thermal governor 'step_wise'605worker1 # [ 0.008741] Memory: 1405636K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124664K reserved, 32768K cma-reserved)606client # [ 0.005307] CPU features: detected: RAS Extension Support607worker1 # [ 0.009205] devtmpfs: initialized608lb # [ 0.000874] LSM: initializing lsm=capability,landlock,yama,bpf,ima609worker2 # [ 0.019845] thermal_sys: Registered thermal governor 'user_space'610client # [ 0.005310] CPU features: detected: RASv1p1 Extension Support611lb # [ 0.001018] landlock: Up and running.612worker1 # [ 0.011028] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)613lb # [ 0.001021] Yama: becoming mindful.614worker2 # [ 0.019850] thermal_sys: Registered thermal governor 'power_allocator'615client # [ 0.005313] CPU features: detected: Random Number Generator616lb # [ 0.001455] LSM support for eBPF active617client # [ 0.005316] CPU features: detected: Speculation barrier (SB)618worker1 # [ 0.011052] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).619worker2 # [ 0.019877] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1620lb # [ 0.001609] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)621client # [ 0.005318] CPU features: detected: Stage-2 Force Write-Back622worker2 # [ 0.019884] cpuidle: using governor ladder623worker1 # [ 0.011265] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL624worker2 # [ 0.019890] cpuidle: using governor menu625worker1 # [ 0.011269] 0 pages in range for non-PLT usage626client # [ 0.005321] CPU features: detected: TLB range maintenance instructions627lb # [ 0.001647] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)628worker1 # [ 0.011270] 508272 pages in range for PLT usage629worker2 # [ 0.020089] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.630lb # [ 0.003440] rcu: Hierarchical SRCU implementation.631client # [ 0.005326] CPU features: detected: Speculative Store Bypassing Safe (SSBS)632worker1 # [ 0.011399] pinctrl core: initialized pinctrl subsystem633worker2 # [ 0.020105] ASID allocator initialised with 65536 entries634lb # [ 0.003445] rcu: Max phase no-delay instances is 1000.635client # [ 0.005365] alternatives: applying system-wide alternatives636worker1 # [ 0.012147] DMI not present or invalid.637worker2 # [ 0.021404] Serial: AMBA PL011 UART driver638lb # [ 0.004688] fsl-mc MSI: its@8080000 domain created639client # [ 0.008456] CPU features: detected: BBM Level 2 without TLB conflict abort640worker1 # [ 0.015731] NET: Registered PF_NETLINK/PF_ROUTE protocol family641lb # [ 0.004788] EFI services will not be available.642worker2 # [ 0.026673] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1643lb # [ 0.004854] smp: Bringing up secondary CPUs ...644worker1 # [ 0.018039] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations645worker2 # [ 0.026812] printk: console [ttyAMA0] enabled646lb # [ 0.004862] smp: Brought up 1 node, 1 CPU647lb # [ 0.004865] SMP: Total of 1 processors activated.648client # [ 0.008639] Memory: 1405856K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124660K reserved, 32768K cma-reserved)649worker1 # [ 0.018235] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations650client # [ 0.009045] devtmpfs: initialized651lb # [ 0.004870] CPU: All CPU(s) started at EL1652worker1 # [ 0.018444] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations653lb # [ 0.004881] CPU features: detected: Branch Target Identification654client # [ 0.010957] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)655worker1 # [ 0.018471] audit: initializing netlink subsys (disabled)656lb # [ 0.004886] CPU features: detected: ARMv8.4 Translation Table Level657client # [ 0.010981] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).658worker1 # [ 0.019084] thermal_sys: Registered thermal governor 'fair_share'659lb # [ 0.004889] CPU features: detected: Instruction cache invalidation not required for I/D coherence660client # [ 0.011183] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL661worker1 # [ 0.019087] thermal_sys: Registered thermal governor 'bang_bang'662client # [ 0.011187] 0 pages in range for non-PLT usage663worker1 # [ 0.019090] thermal_sys: Registered thermal governor 'step_wise'664lb # [ 0.004893] CPU features: detected: Data cache clean to the PoU not required for I/D coherence665client # [ 0.011189] 508272 pages in range for PLT usage666worker1 # [ 0.019093] thermal_sys: Registered thermal governor 'user_space'667client # [ 0.011317] pinctrl core: initialized pinctrl subsystem668lb # [ 0.004896] CPU features: detected: Common not Private translations669client # [ 0.012121] DMI not present or invalid.670worker1 # [ 0.019099] thermal_sys: Registered thermal governor 'power_allocator'671lb # [ 0.004900] CPU features: detected: CRC32 instructions672client # [ 0.015749] NET: Registered PF_NETLINK/PF_ROUTE protocol family673worker1 # [ 0.019134] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1674lb # [ 0.004902] CPU features: detected: Data cache clean to Point of Deep Persistence675worker1 # [ 0.019142] cpuidle: using governor ladder676client # [ 0.018053] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations677worker2 # [ 0.145267] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages678lb # [ 0.004906] CPU features: detected: Data cache clean to Point of Persistence679worker1 # [ 0.019149] cpuidle: using governor menu680worker2 # [ 0.145286] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page681client # [ 0.018249] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations682lb # [ 0.004909] CPU features: detected: Data independent timing control (DIT)683worker1 # [ 0.019350] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.684worker2 # [ 0.145291] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages685lb # [ 0.004912] CPU features: detected: E0PD686worker1 # [ 0.019366] ASID allocator initialised with 65536 entries687client # [ 0.018455] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations688worker1 # [ 0.020573] Serial: AMBA PL011 UART driver689lb # [ 0.004914] CPU features: detected: Enhanced Counter Virtualization690worker2 # [ 0.145295] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page691client # [ 0.018481] audit: initializing netlink subsys (disabled)692lb # [ 0.004918] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)693client # [ 0.019090] thermal_sys: Registered thermal governor 'fair_share'694worker2 # [ 0.145299] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages695worker1 # [ 0.025864] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1696worker1 # [ 0.026036] printk: console [ttyAMA0] enabled697lb # [ 0.004922] CPU features: detected: Enhanced Virtualization Traps698worker2 # [ 0.145303] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page699client # [ 0.019093] thermal_sys: Registered thermal governor 'bang_bang'700lb # [ 0.004925] CPU features: detected: Fine Grained Traps701client # [ 0.019096] thermal_sys: Registered thermal governor 'step_wise'702worker2 # [ 0.145308] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages703client # [ 0.019099] thermal_sys: Registered thermal governor 'user_space'704lb # [ 0.004928] CPU features: detected: Generic authentication (architected QARMA5 algorithm)705worker2 # [ 0.145312] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page706lb # [ 0.004932] CPU features: detected: RCpc load-acquire (LDAPR)707client # [ 0.019107] thermal_sys: Registered thermal governor 'power_allocator'708lb # [ 0.004935] CPU features: detected: LSE atomic instructions709client # [ 0.019141] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1710lb # [ 0.004938] CPU features: detected: Privileged Access Never711client # [ 0.019150] cpuidle: using governor ladder712worker2 # [ 0.152693] fbcon: Taking over console713lb # [ 0.004941] CPU features: detected: PMUv3714client # [ 0.019156] cpuidle: using governor menu715worker2 # [ 0.152709] ACPI: Interpreter disabled.716lb # [ 0.004944] CPU features: detected: RAS Extension Support717client # [ 0.019339] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.718lb # [ 0.004946] CPU features: detected: RASv1p1 Extension Support719client # [ 0.019356] ASID allocator initialised with 65536 entries720lb # [ 0.004949] CPU features: detected: Random Number Generator721client # [ 0.020633] Serial: AMBA PL011 UART driver722lb # [ 0.004951] CPU features: detected: Speculation barrier (SB)723client # [ 0.026026] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1724lb # [ 0.004954] CPU features: detected: Stage-2 Force Write-Back725client # [ 0.026158] printk: console [ttyAMA0] enabled726worker1 # [ 0.143310] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages727lb # [ 0.004957] CPU features: detected: TLB range maintenance instructions728worker1 # [ 0.143330] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page729lb # [ 0.004962] CPU features: detected: Speculative Store Bypassing Safe (SSBS)730worker1 # [ 0.143335] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages731lb # [ 0.004999] alternatives: applying system-wide alternatives732worker1 # [ 0.143340] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page733lb # [ 0.007921] CPU features: detected: BBM Level 2 without TLB conflict abort734worker1 # [ 0.143344] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages735worker1 # [ 0.143349] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page736lb # [ 0.008212] Memory: 1405672K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124636K reserved, 32768K cma-reserved)737worker1 # [ 0.143353] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages738worker2 # [ 0.161727] iommu: Default domain type: Translated739lb # [ 0.008599] devtmpfs: initialized740worker1 # [ 0.143358] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page741worker2 # [ 0.161739] iommu: DMA domain TLB invalidation policy: strict mode742lb # [ 0.010401] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)743worker2 # [ 0.162102] SCSI subsystem initialized744lb # [ 0.010423] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).745client # [ 0.144529] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages746worker2 # [ 0.164106] usbcore: registered new interface driver usbfs747lb # [ 0.010602] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL748worker1 # [ 0.150858] fbcon: Taking over console749worker2 # [ 0.164144] usbcore: registered new interface driver hub750client # [ 0.144549] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page751worker1 # [ 0.150874] ACPI: Interpreter disabled.752lb # [ 0.010606] 0 pages in range for non-PLT usage753worker2 # [ 0.164160] usbcore: registered new device driver usb754lb # [ 0.010607] 508272 pages in range for PLT usage755client # [ 0.144555] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages756worker2 # [ 0.164424] pps_core: LinuxPPS API ver. 1 registered757lb # [ 0.010701] pinctrl core: initialized pinctrl subsystem758client # [ 0.144559] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page759lb # [ 0.011485] DMI not present or invalid.760worker2 # [ 0.164431] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>761client # [ 0.144564] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages762lb # [ 0.014933] NET: Registered PF_NETLINK/PF_ROUTE protocol family763worker2 # [ 0.164441] PTP clock support registered764worker2 # [ 0.164489] EDAC MC: Ver: 3.0.0765client # [ 0.144568] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page766lb # [ 0.017229] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations767client # [ 0.144572] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages768worker2 # [ 0.169082] scmi_core: SCMI protocol bus registered769lb # [ 0.017402] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations770client # [ 0.144577] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page771worker2 # [ 0.170064] FPGA manager framework772lb # [ 0.017602] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations773worker2 # [ 0.171063] vgaarb: loaded774lb # [ 0.017627] audit: initializing netlink subsys (disabled)775worker2 # [ 0.171719] clocksource: Switched to clocksource arch_sys_counter776lb # [ 0.018220] thermal_sys: Registered thermal governor 'fair_share'777client # [ 0.152093] fbcon: Taking over console778client # [ 0.152110] ACPI: Interpreter disabled.779lb # [ 0.018222] thermal_sys: Registered thermal governor 'bang_bang'780lb # [ 0.018225] thermal_sys: Registered thermal governor 'step_wise'781worker1 # [ 0.159887] iommu: Default domain type: Translated782lb # [ 0.018228] thermal_sys: Registered thermal governor 'user_space'783worker1 # [ 0.159898] iommu: DMA domain TLB invalidation policy: strict mode784lb # [ 0.018233] thermal_sys: Registered thermal governor 'power_allocator'785worker1 # [ 0.160234] SCSI subsystem initialized786worker1 # [ 0.162316] usbcore: registered new interface driver usbfs787worker1 # [ 0.162356] usbcore: registered new interface driver hub788worker1 # [ 0.162370] usbcore: registered new device driver usb789worker1 # [ 0.162657] pps_core: LinuxPPS API ver. 1 registered790worker2 # [ 0.178399] VFS: Disk quotas dquot_6.6.0791worker2 # [ 0.178462] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)792worker1 # [ 0.162663] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>793worker1 # [ 0.162674] PTP clock support registered794worker2 # [ 0.180188] netfs: FS-Cache loaded795worker1 # [ 0.162722] EDAC MC: Ver: 3.0.0796worker2 # [ 0.180318] pnp: PnP ACPI: disabled797client # [ 0.161163] iommu: Default domain type: Translated798worker1 # [ 0.167512] scmi_core: SCMI protocol bus registered799client # [ 0.161173] iommu: DMA domain TLB invalidation policy: strict mode800worker1 # [ 0.168510] FPGA manager framework801client # [ 0.161549] SCSI subsystem initialized802worker1 # [ 0.169519] vgaarb: loaded803client # [ 0.163594] usbcore: registered new interface driver usbfs804worker1 # [ 0.170217] clocksource: Switched to clocksource arch_sys_counter805lb # [ 0.018257] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1806client # [ 0.163628] usbcore: registered new interface driver hub807lb # [ 0.018265] cpuidle: using governor ladder808lb # [ 0.018271] cpuidle: using governor menu809client # [ 0.163644] usbcore: registered new device driver usb810client # [ 0.163976] pps_core: LinuxPPS API ver. 1 registered811lb # [ 0.018451] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.812lb # [ 0.018468] ASID allocator initialised with 65536 entries813client # [ 0.163982] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>814lb # [ 0.019714] Serial: AMBA PL011 UART driver815client # [ 0.163992] PTP clock support registered816worker1 # [ 0.174188] VFS: Disk quotas dquot_6.6.0817client # [ 0.164041] EDAC MC: Ver: 3.0.0818worker2 # [ 0.184376] NET: Registered PF_INET protocol family819lb # [ 0.025035] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1820lb # [ 0.025161] printk: console [ttyAMA0] enabled821worker2 # [ 0.184674] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)822client # [ 0.168771] scmi_core: SCMI protocol bus registered823lb # [ 0.145747] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages824client # [ 0.169923] FPGA manager framework825client # [ 0.170985] vgaarb: loaded826lb # [ 0.145765] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page827worker1 # [ 0.176833] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)828client # [ 0.171608] clocksource: Switched to clocksource arch_sys_counter829lb # [ 0.145770] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages830worker1 # [ 0.178068] netfs: FS-Cache loaded831worker1 # [ 0.178210] pnp: PnP ACPI: disabled832lb # [ 0.145774] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page833lb # [ 0.145779] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages834lb # [ 0.145783] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page835lb # [ 0.145787] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages836lb # [ 0.145791] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page837client # [ 0.176251] VFS: Disk quotas dquot_6.6.0838client # [ 0.176299] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)839lb # [ 0.153216] fbcon: Taking over console840lb # [ 0.153229] ACPI: Interpreter disabled.841lb # [ 0.155117] iommu: Default domain type: Translated842lb # [ 0.155127] iommu: DMA domain TLB invalidation policy: strict mode843worker1 # [ 0.182310] NET: Registered PF_INET protocol family844client # [ 0.180222] netfs: FS-Cache loaded845client # [ 0.180360] pnp: PnP ACPI: disabled846lb # [ 0.156798] SCSI subsystem initialized847worker1 # [ 0.182631] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)848client # [ 0.184435] NET: Registered PF_INET protocol family849client # [ 0.184740] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)850lb # [ 0.164530] usbcore: registered new interface driver usbfs851lb # [ 0.164565] usbcore: registered new interface driver hub852lb # [ 0.164590] usbcore: registered new device driver usb853lb # [ 0.164878] pps_core: LinuxPPS API ver. 1 registered854lb # [ 0.164884] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>855lb # [ 0.164895] PTP clock support registered856lb # [ 0.164951] EDAC MC: Ver: 3.0.0857lb # [ 0.169650] scmi_core: SCMI protocol bus registered858lb # [ 0.170718] FPGA manager framework859lb # [ 0.171714] vgaarb: loaded860worker2 # [ 0.215273] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)861lb # [ 0.172377] clocksource: Switched to clocksource arch_sys_counter862worker2 # [ 0.215330] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)863lb # [ 0.173032] VFS: Disk quotas dquot_6.6.0864worker2 # [ 0.215362] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)865lb # [ 0.173059] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)866worker2 # [ 0.215447] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)867lb # [ 0.175440] netfs: FS-Cache loaded868lb # [ 0.175556] pnp: PnP ACPI: disabled869worker2 # [ 0.215589] TCP: Hash tables configured (established 16384 bind 16384)870worker2 # [ 0.215684] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)871worker2 # [ 0.221510] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)872lb # [ 0.181713] NET: Registered PF_INET protocol family873worker2 # [ 0.221552] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)874lb # [ 0.182009] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)875worker2 # [ 0.221650] NET: Registered PF_UNIX/PF_LOCAL protocol family876worker2 # [ 0.221676] NET: Registered PF_XDP protocol family877worker2 # [ 0.221698] PCI: CLS 0 bytes, default 64878worker2 # [ 0.221980] Trying to unpack rootfs image as initramfs...879worker1 # [ 0.213302] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)880worker1 # [ 0.213361] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)881worker1 # [ 0.213394] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)882worker1 # [ 0.213476] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)883worker1 # [ 0.213618] TCP: Hash tables configured (established 16384 bind 16384)884worker1 # [ 0.213712] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)885worker1 # [ 0.213749] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)886worker1 # [ 0.213788] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)887worker1 # [ 0.213886] NET: Registered PF_UNIX/PF_LOCAL protocol family888client # [ 0.216079] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)889worker1 # [ 0.213907] NET: Registered PF_XDP protocol family890worker1 # [ 0.213926] PCI: CLS 0 bytes, default 64891client # [ 0.216135] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)892worker1 # [ 0.214193] Trying to unpack rootfs image as initramfs...893client # [ 0.216170] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)894client # [ 0.216255] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)895client # [ 0.216400] TCP: Hash tables configured (established 16384 bind 16384)896worker2 # [ 0.239757] kvm [1]: HYP mode not available897client # [ 0.216496] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)898client # [ 0.216535] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)899client # [ 0.216573] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)900client # [ 0.216672] NET: Registered PF_UNIX/PF_LOCAL protocol family901client # [ 0.216725] NET: Registered PF_XDP protocol family902worker1 # [ 0.232178] kvm [1]: HYP mode not available903client # [ 0.216745] PCI: CLS 0 bytes, default 64904client # [ 0.217010] Trying to unpack rootfs image as initramfs...905client # [ 0.233629] kvm [1]: HYP mode not available906lb # [ 0.212555] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)907lb # [ 0.212615] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)908lb # [ 0.212647] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)909lb # [ 0.212732] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)910lb # [ 0.212877] TCP: Hash tables configured (established 16384 bind 16384)911lb # [ 0.212979] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)912lb # [ 0.213017] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)913lb # [ 0.213054] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)914lb # [ 0.213155] NET: Registered PF_UNIX/PF_LOCAL protocol family915lb # [ 0.213175] NET: Registered PF_XDP protocol family916lb # [ 0.213193] PCI: CLS 0 bytes, default 64917lb # [ 0.213461] Trying to unpack rootfs image as initramfs...918lb # [ 0.230250] kvm [1]: HYP mode not available919worker2 # [ 0.355246] Initialise system trusted keyrings920worker2 # [ 0.356096] workingset: timestamp_bits=42 max_order=19 bucket_order=0921worker2 # [ 0.357357] squashfs: version 4.0 (2009/01/31) Phillip Lougher922worker2 # [ 0.358106] 9p: Installing v9fs 9p2000 file system support923worker1 # [ 0.354794] Initialise system trusted keyrings924worker1 # [ 0.355552] workingset: timestamp_bits=42 max_order=19 bucket_order=0925worker1 # [ 0.356942] squashfs: version 4.0 (2009/01/31) Phillip Lougher926worker1 # [ 0.357741] 9p: Installing v9fs 9p2000 file system support927client # [ 0.356192] Initialise system trusted keyrings928client # [ 0.356976] workingset: timestamp_bits=42 max_order=19 bucket_order=0929client # [ 0.358312] squashfs: version 4.0 (2009/01/31) Phillip Lougher930client # [ 0.359120] 9p: Installing v9fs 9p2000 file system support931worker2 # [ 0.382250] Key type asymmetric registered932worker2 # [ 0.382282] Asymmetric key parser 'x509' registered933worker2 # [ 0.382360] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)934lb # [ 0.343258] Initialise system trusted keyrings935worker2 # [ 0.387799] io scheduler mq-deadline registered936lb # [ 0.344026] workingset: timestamp_bits=42 max_order=19 bucket_order=0937worker2 # [ 0.387821] io scheduler kyber registered938lb # [ 0.345429] squashfs: version 4.0 (2009/01/31) Phillip Lougher939lb # [ 0.346194] 9p: Installing v9fs 9p2000 file system support940worker1 # [ 0.386562] Key type asymmetric registered941worker1 # [ 0.386591] Asymmetric key parser 'x509' registered942worker2 # [ 0.399913] pl061_gpio 9030000.pl061: PL061 GPIO chip registered943worker1 # [ 0.386684] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)944worker1 # [ 0.388887] io scheduler mq-deadline registered945worker1 # [ 0.388899] io scheduler kyber registered946client # [ 0.387950] Key type asymmetric registered947worker2 # [ 0.401776] ledtrig-cpu: registered to indicate activity on CPUs948client # [ 0.387981] Asymmetric key parser 'x509' registered949worker2 # [ 0.402188] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:950client # [ 0.388078] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)951worker2 # [ 0.402205] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000952client # [ 0.390254] io scheduler mq-deadline registered953client # [ 0.390265] io scheduler kyber registered954worker2 # [ 0.402219] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000955worker2 # [ 0.402228] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000956worker1 # [ 0.398384] pl061_gpio 9030000.pl061: PL061 GPIO chip registered957worker2 # [ 0.402268] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits958lb # [ 0.370300] Key type asymmetric registered959worker2 # [ 0.402295] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]960lb # [ 0.370333] Asymmetric key parser 'x509' registered961worker2 # [ 0.402370] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00962lb # [ 0.370413] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)963worker2 # [ 0.402380] pci_bus 0000:00: root bus resource [bus 00-ff]964worker1 # [ 0.399838] ledtrig-cpu: registered to indicate activity on CPUs965lb # [ 0.372574] io scheduler mq-deadline registered966worker2 # [ 0.402386] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]967lb # [ 0.372584] io scheduler kyber registered968worker1 # [ 0.400250] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:969worker2 # [ 0.402391] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]970worker1 # [ 0.400268] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000971worker2 # [ 0.402396] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]972worker1 # [ 0.400282] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000973worker2 # [ 0.402473] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint974worker1 # [ 0.400290] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000975worker2 # [ 0.402932] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint976client # [ 0.399766] pl061_gpio 9030000.pl061: PL061 GPIO chip registered977worker2 # [ 0.403126] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]978worker1 # [ 0.400310] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits979worker2 # [ 0.403144] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]980worker1 # [ 0.400338] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]981worker2 # [ 0.403174] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]982worker1 # [ 0.400441] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00983worker2 # [ 0.403191] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]984worker1 # [ 0.400450] pci_bus 0000:00: root bus resource [bus 00-ff]985worker2 # [ 0.403667] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint986worker1 # [ 0.400457] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]987worker2 # [ 0.403885] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]988worker1 # [ 0.400462] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]989worker2 # [ 0.403902] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]990worker1 # [ 0.400466] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]991worker2 # [ 0.403932] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]992worker1 # [ 0.400560] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint993client # [ 0.401297] ledtrig-cpu: registered to indicate activity on CPUs994worker2 # [ 0.404386] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint995worker2 # [ 0.404572] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]996client # [ 0.401725] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:997worker1 # [ 0.401034] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint998worker2 # [ 0.404588] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]999worker1 # [ 0.401222] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1000client # [ 0.401747] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001001worker2 # [ 0.404618] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1002worker1 # [ 0.401239] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1003client # [ 0.401760] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001004worker1 # [ 0.401269] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1005worker2 # [ 0.405080] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1006worker2 # [ 0.405268] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1007worker1 # [ 0.401286] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1008client # [ 0.401770] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001009worker2 # [ 0.405284] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1010worker1 # [ 0.401748] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1011client # [ 0.401793] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1012worker2 # [ 0.405313] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1013worker1 # [ 0.401933] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1014worker2 # [ 0.405332] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1015worker1 # [ 0.401950] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1016client # [ 0.401823] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1017worker1 # [ 0.401979] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1018worker2 # [ 0.405794] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1019client # [ 0.401904] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001020client # [ 0.401913] pci_bus 0000:00: root bus resource [bus 00-ff]1021worker2 # [ 0.405983] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1022client # [ 0.401920] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1023worker2 # [ 0.406013] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1024worker1 # [ 0.421717] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1025client # [ 0.401926] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1026worker1 # [ 0.421911] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1027worker2 # [ 0.406485] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1028worker1 # [ 0.421927] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1029client # [ 0.401931] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1030worker2 # [ 0.406677] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1031worker1 # [ 0.421958] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1032client # [ 0.402019] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1033worker2 # [ 0.406706] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1034worker2 # [ 0.407148] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1035client # [ 0.402464] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1036lb # [ 0.388595] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1037client # [ 0.402651] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1038worker2 # [ 0.407332] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1039lb # [ 0.389320] ledtrig-cpu: registered to indicate activity on CPUs1040client # [ 0.402668] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1041worker2 # [ 0.407580] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1042client # [ 0.402698] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1043lb # [ 0.389713] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1044client # [ 0.402714] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1045lb # [ 0.389730] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001046client # [ 0.403196] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1047lb # [ 0.389743] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001048client # [ 0.403383] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1049client # [ 0.403399] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1050lb # [ 0.389751] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001051client # [ 0.403428] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1052lb # [ 0.389778] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1053client # [ 0.403914] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1054lb # [ 0.389805] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1055client # [ 0.404099] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1056lb # [ 0.389901] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001057client # [ 0.404115] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1058lb # [ 0.389909] pci_bus 0000:00: root bus resource [bus 00-ff]1059client # [ 0.404145] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1060lb # [ 0.389915] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1061client # [ 0.404611] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1062lb # [ 0.389921] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1063client # [ 0.404796] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1064lb # [ 0.389926] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1065client # [ 0.404811] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1066worker2 # [ 0.447882] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1067worker1 # [ 0.430587] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1068lb # [ 0.390047] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1069client # [ 0.404841] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1070worker2 # [ 0.447931] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1071worker1 # [ 0.430803] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1072client # [ 0.404860] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1073lb # [ 0.390509] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1074worker1 # [ 0.430822] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1075worker2 # [ 0.448470] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1076lb # [ 0.390695] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1077client # [ 0.405327] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1078worker1 # [ 0.430853] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1079worker2 # [ 0.448672] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1080lb # [ 0.390730] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1081client # [ 0.405516] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1082worker1 # [ 0.430873] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1083worker2 # [ 0.448704] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084lb # [ 0.390761] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1085client # [ 0.405546] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1086worker1 # [ 0.431343] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1087worker2 # [ 0.449174] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1088lb # [ 0.390777] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1089client # [ 0.406000] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1090worker1 # [ 0.431534] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1091worker2 # [ 0.449366] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1092lb # [ 0.391265] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1093client # [ 0.406189] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1094worker2 # [ 0.449397] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1095worker1 # [ 0.431565] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1096lb # [ 0.391458] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1097client # [ 0.406219] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1098lb # [ 0.391473] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1099worker2 # [ 0.449865] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1100worker1 # [ 0.432028] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1101client # [ 0.406621] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1102worker2 # [ 0.450188] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1103worker1 # [ 0.432220] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1104lb # [ 0.391503] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1105client # [ 0.406803] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1106worker2 # [ 0.450206] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1107worker1 # [ 0.432250] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1108lb # [ 0.391957] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1109client # [ 0.407120] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1110worker2 # [ 0.450236] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1111lb # [ 0.392143] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1112worker1 # [ 0.432651] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1113client # [ 0.407310] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1114lb # [ 0.392159] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1115worker1 # [ 0.432836] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1116worker2 # [ 0.450734] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1117client # [ 0.407340] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1118worker2 # [ 0.450923] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1119lb # [ 0.392188] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1120worker1 # [ 0.433151] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1121worker2 # [ 0.450939] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1122worker1 # [ 0.433343] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1123lb # [ 0.392661] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1124worker2 # [ 0.450970] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1125lb # [ 0.392844] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1126worker1 # [ 0.433374] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1127lb # [ 0.392859] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1128worker2 # [ 0.451571] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1129worker1 # [ 0.433834] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1130lb # [ 0.392888] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131worker2 # [ 0.451582] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1132worker1 # [ 0.434024] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1133lb # [ 0.392907] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1134worker2 # [ 0.451588] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1135worker1 # [ 0.434055] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1136lb # [ 0.393365] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1137worker2 # [ 0.451635] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1138worker1 # [ 0.434531] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1139lb # [ 0.393560] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1140worker1 # [ 0.434723] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1141worker2 # [ 0.451684] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1142lb # [ 0.393590] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1143worker1 # [ 0.434754] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1144lb # [ 0.394042] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1145worker1 # [ 0.435235] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1146lb # [ 0.394228] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1147worker1 # [ 0.435554] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1148lb # [ 0.394257] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1149client # [ 0.447958] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1150worker1 # [ 0.435571] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1151worker2 # [ 0.469118] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1152lb # [ 0.394641] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1153worker1 # [ 0.435602] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1154client # [ 0.448180] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1155lb # [ 0.394830] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1156worker2 # [ 0.469173] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1157client # [ 0.448212] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1158worker1 # [ 0.436074] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1159worker2 # [ 0.469224] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1160worker1 # [ 0.436262] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1161lb # [ 0.395113] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1162client # [ 0.448706] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1163lb # [ 0.395300] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1164worker1 # [ 0.436278] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1165client # [ 0.448897] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1166worker2 # [ 0.469274] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1167lb # [ 0.395329] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1168worker1 # [ 0.436309] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1169client # [ 0.448927] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1170worker2 # [ 0.469322] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1171worker1 # [ 0.436944] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1172lb # [ 0.395780] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1173client # [ 0.449391] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1174worker2 # [ 0.469370] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1175lb # [ 0.395965] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1176worker1 # [ 0.436955] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1177client # [ 0.449704] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1178worker2 # [ 0.469417] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1179lb # [ 0.395995] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1180client # [ 0.449722] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1181worker1 # [ 0.436961] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1182worker2 # [ 0.469513] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1183client # [ 0.449752] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1184worker1 # [ 0.437008] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1185worker2 # [ 0.469580] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1186client # [ 0.450218] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1187worker1 # [ 0.437056] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1188worker2 # [ 0.469602] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1189client # [ 0.450405] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1190worker1 # [ 0.437104] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1191client # [ 0.450421] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1192worker2 # [ 0.469625] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1193client # [ 0.450458] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1194worker2 # [ 0.469646] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1195worker1 # [ 0.437151] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1196client # [ 0.451066] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1197worker2 # [ 0.469668] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1198worker1 # [ 0.437198] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1199worker2 # [ 0.469691] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1200client # [ 0.451079] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1201worker1 # [ 0.437245] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1202worker2 # [ 0.469713] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1203client # [ 0.451085] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1204worker1 # [ 0.437292] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1205worker2 # [ 0.469742] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1206client # [ 0.451135] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1207worker1 # [ 0.437338] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1208worker2 # [ 0.469764] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1209client # [ 0.451183] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1210worker1 # [ 0.437385] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1211worker2 # [ 0.469787] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1212client # [ 0.451231] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1213worker2 # [ 0.469809] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1214worker1 # [ 0.437469] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1215worker2 # [ 0.469832] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1216client # [ 0.451280] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1217worker1 # [ 0.437522] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1218worker2 # [ 0.469854] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1219worker1 # [ 0.437544] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1220client # [ 0.451328] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1221worker2 # [ 0.469875] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1222worker1 # [ 0.437565] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1223client # [ 0.451376] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1224worker2 # [ 0.469897] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1225worker1 # [ 0.437586] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1226lb # [ 0.440542] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1227worker2 # [ 0.469919] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1228client # [ 0.451424] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1229worker1 # [ 0.437608] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1230lb # [ 0.440759] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1231worker2 # [ 0.469942] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1232client # [ 0.451470] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1233worker1 # [ 0.437630] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1234lb # [ 0.440790] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1235worker2 # [ 0.469964] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1236client # [ 0.451517] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1237worker1 # [ 0.437655] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1238worker2 # [ 0.469992] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1239lb # [ 0.441335] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1240worker1 # [ 0.437681] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1241worker2 # [ 0.470002] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1242lb # [ 0.441656] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1243client # [ 0.451606] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1244lb # [ 0.441673] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1245worker1 # [ 0.437703] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1246worker2 # [ 0.470006] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1247worker2 # [ 0.470889] pci 0000:00:07.0: enabling device (0000 -> 0002)1248lb # [ 0.441704] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1249worker1 # [ 0.437725] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1250worker1 # [ 0.437748] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1251lb # [ 0.442183] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1252lb # [ 0.442366] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1253worker1 # [ 0.437771] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1254lb # [ 0.442381] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1255worker1 # [ 0.437792] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1256worker1 # [ 0.437814] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1257lb # [ 0.442410] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1258worker1 # [ 0.437836] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1259lb # [ 0.443015] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1260worker1 # [ 0.437857] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1261lb # [ 0.443027] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1262worker1 # [ 0.437879] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1263lb # [ 0.443033] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1264worker1 # [ 0.437901] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1265worker1 # [ 0.437928] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1266lb # [ 0.443084] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1267client # [ 0.479752] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1268worker1 # [ 0.437938] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1269lb # [ 0.443131] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1270client # [ 0.479780] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1271worker1 # [ 0.437942] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1272lb # [ 0.443179] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1273client # [ 0.479803] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1274lb # [ 0.443227] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1275client # [ 0.479827] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1276lb # [ 0.443275] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1277client # [ 0.479850] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1278lb # [ 0.443322] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1279client # [ 0.479874] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1280client # [ 0.479897] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1281lb # [ 0.443370] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1282client # [ 0.479924] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1283lb # [ 0.443420] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1284client # [ 0.479948] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1285lb # [ 0.443466] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1286client # [ 0.479971] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1287lb # [ 0.443573] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1288client # [ 0.479995] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1289lb # [ 0.443629] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1290client # [ 0.480018] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1291lb # [ 0.443651] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1292client # [ 0.480039] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1293lb # [ 0.443672] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1294client # [ 0.480062] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1295lb # [ 0.443693] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1296client # [ 0.480084] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1297lb # [ 0.443715] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1298client # [ 0.480105] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1299client # [ 0.480127] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1300lb # [ 0.443736] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1301client # [ 0.480149] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1302lb # [ 0.443758] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1303client # [ 0.480183] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1304lb # [ 0.443784] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1305client # [ 0.480193] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1306lb # [ 0.443806] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1307worker1 # [ 0.502948] pci 0000:00:07.0: enabling device (0000 -> 0002)1308client # [ 0.480197] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1309lb # [ 0.443827] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1310client # [ 0.481034] pci 0000:00:07.0: enabling device (0000 -> 0002)1311lb # [ 0.443850] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1312lb # [ 0.443872] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1313lb # [ 0.443893] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1314lb # [ 0.443914] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1315lb # [ 0.443935] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1316lb # [ 0.443956] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1317worker2 # [ 0.523599] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1318lb # [ 0.443977] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1319lb # [ 0.443998] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1320lb # [ 0.444024] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1321lb # [ 0.444034] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1322lb # [ 0.444038] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1323lb # [ 0.444895] pci 0000:00:07.0: enabling device (0000 -> 0002)1324worker2 # [ 0.533190] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1325worker1 # [ 0.524509] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1326client # [ 0.526784] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1327worker2 # [ 0.544413] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1328worker1 # [ 0.535802] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1329worker2 # [ 0.546625] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1330worker2 # [ 0.548815] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1331worker2 # [ 0.551125] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1332lb # [ 0.511108] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1333worker1 # [ 0.539825] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1334worker1 # [ 0.542127] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1335client # [ 0.537133] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1336lb # [ 0.514258] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1337worker2 # [ 0.561285] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1338worker2 # [ 0.563652] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1339client # [ 0.542011] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1340worker1 # [ 0.551935] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1341client # [ 0.544241] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1342client # [ 0.546425] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1343worker2 # [ 0.574889] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1344lb # [ 0.524653] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1345lb # [ 0.526813] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1346worker1 # [ 0.558480] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1347lb # [ 0.529041] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1348worker1 # [ 0.560666] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1349client # [ 0.556574] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1350lb # [ 0.531376] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1351client # [ 0.558796] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1352worker2 # [ 0.581181] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1353lb # [ 0.541654] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1354lb # [ 0.544121] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1355client # [ 0.570044] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1356worker2 # [ 0.587817] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1357worker1 # [ 0.574992] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1358worker1 # [ 0.577108] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1359worker1 # [ 0.580535] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1360lb # [ 0.555229] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1361worker1 # [ 0.583640] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1362worker2 # [ 0.605031] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1363client # [ 0.579872] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1364client # [ 0.583685] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1365client # [ 0.586550] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1366lb # [ 0.561553] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1367lb # [ 0.563968] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1368worker2 # [ 0.607772] msm_serial: driver initialized1369worker2 # [ 0.607951] SuperH (H)SCI(F) driver initialized1370worker2 # [ 0.608006] STM32 USART driver initialized1371worker1 # [ 0.603536] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1372worker1 # [ 0.606438] msm_serial: driver initialized1373worker1 # [ 0.606575] SuperH (H)SCI(F) driver initialized1374worker1 # [ 0.606628] STM32 USART driver initialized1375lb # [ 0.580756] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1376client # [ 0.604963] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1377lb # [ 0.583314] msm_serial: driver initialized1378lb # [ 0.583461] SuperH (H)SCI(F) driver initialized1379lb # [ 0.583515] STM32 USART driver initialized1380client # [ 0.607776] msm_serial: driver initialized1381client # [ 0.607917] SuperH (H)SCI(F) driver initialized1382client # [ 0.607972] STM32 USART driver initialized1383worker2 # [ 0.639045] loop: module loaded1384worker2 # [ 0.639254] virtio_blk virtio2: 1/0/0 default/read/poll queues1385worker2 # [ 0.641367] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1386worker1 # [ 0.639178] loop: module loaded1387worker1 # [ 0.639374] virtio_blk virtio2: 1/0/0 default/read/poll queues1388worker1 # [ 0.640225] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1389worker2 # [ 0.652458] megasas: 07.734.00.00-rc11390worker2 # [ 0.653213] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1391worker2 # [ 0.655658] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001392worker2 # [ 0.655690] Intel/Sharp Extended Query Table at 0x00311393client # [ 0.642553] loop: module loaded1394worker2 # [ 0.657430] Using buffer write method1395worker1 # [ 0.646970] megasas: 07.734.00.00-rc11396client # [ 0.642769] virtio_blk virtio2: 1/0/0 default/read/poll queues1397worker2 # [ 0.657521] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1398worker1 # [ 0.647705] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1399client # [ 0.643586] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1400worker1 # [ 0.650167] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001401lb # [ 0.621021] loop: module loaded1402worker2 # [ 0.659428] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001403lb # [ 0.621222] virtio_blk virtio2: 1/0/0 default/read/poll queues1404worker2 # [ 0.659454] Intel/Sharp Extended Query Table at 0x00311405lb # [ 0.622029] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1406worker1 # [ 0.658305] Intel/Sharp Extended Query Table at 0x00311407worker2 # [ 0.677855] Using buffer write method1408worker1 # [ 0.660106] Using buffer write method1409worker2 # [ 0.677901] Concatenating MTD devices:1410worker2 # [ 0.677906] (0): "0.flash"1411worker2 # [ 0.677910] (1): "0.flash"1412worker1 # [ 0.660192] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1413worker2 # [ 0.677919] into device "0.flash"1414lb # [ 0.629087] megasas: 07.734.00.00-rc11415worker1 # [ 0.662157] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001416worker1 # [ 0.662185] Intel/Sharp Extended Query Table at 0x00311417lb # [ 0.629782] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1418worker1 # [ 0.663984] Using buffer write method1419worker1 # [ 0.664011] Concatenating MTD devices:1420worker1 # [ 0.664015] (0): "0.flash"1421lb # [ 0.632158] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001422worker1 # [ 0.664018] (1): "0.flash"1423lb # [ 0.632187] Intel/Sharp Extended Query Table at 0x00311424worker1 # [ 0.664030] into device "0.flash"1425client # [ 0.656365] megasas: 07.734.00.00-rc11426lb # [ 0.633821] Using buffer write method1427client # [ 0.657120] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1428lb # [ 0.633899] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1429client # [ 0.659371] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001430client # [ 0.659404] Intel/Sharp Extended Query Table at 0x00311431lb # [ 0.635808] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001432client # [ 0.661132] Using buffer write method1433lb # [ 0.635836] Intel/Sharp Extended Query Table at 0x00311434client # [ 0.661202] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1435client # [ 0.663038] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001436client # [ 0.663093] Intel/Sharp Extended Query Table at 0x00311437lb # [ 0.654658] Using buffer write method1438lb # [ 0.654724] Concatenating MTD devices:1439lb # [ 0.654728] (0): "0.flash"1440lb # [ 0.654733] (1): "0.flash"1441lb # [ 0.654741] into device "0.flash"1442client # [ 0.681790] Using buffer write method1443client # [ 0.681839] Concatenating MTD devices:1444client # [ 0.681843] (0): "0.flash"1445client # [ 0.681847] (1): "0.flash"1446client # [ 0.681857] into device "0.flash"1447worker2 # [ 0.966055] Freeing initrd memory: 26944K1448worker2 # [ 0.972206] tun: Universal TUN/TAP device driver, 1.61449worker1 # [ 0.964398] Freeing initrd memory: 26976K1450worker2 # [ 0.976079] thunder_xcv, ver 1.01451worker2 # [ 0.976122] thunder_bgx, ver 1.01452worker2 # [ 0.976150] nicpf, ver 1.01453worker2 # [ 0.976709] e1000: Intel(R) PRO/1000 Network Driver1454worker2 # [ 0.976719] e1000: Copyright (c) 1999-2006 Intel Corporation.1455worker2 # [ 0.976741] e1000e: Intel(R) PRO/1000 Network Driver1456worker2 # [ 0.976750] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1457worker1 # [ 0.970632] tun: Universal TUN/TAP device driver, 1.61458worker2 # [ 0.976778] igb: Intel(R) Gigabit Ethernet Network Driver1459worker2 # [ 0.976784] igb: Copyright (c) 2007-2014 Intel Corporation.1460worker2 # [ 0.976806] igbvf: Intel(R) Gigabit Virtual Function Network Driver1461worker2 # [ 0.976812] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1462worker2 # [ 0.976947] sky2: driver version 1.301463worker2 # [ 0.978922] usbcore: registered new interface driver usb-storage1464worker2 # [ 0.979054] usbcore: registered new interface driver usbserial_generic1465worker2 # [ 0.979069] usbserial: USB Serial support registered for generic1466worker2 # [ 0.979679] hv_vmbus: registering driver hyperv_keyboard1467worker2 # [ 0.980575] ehci-pci 0000:00:07.0: EHCI Host Controller1468worker2 # [ 0.980603] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11469worker2 # [ 0.980904] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001470worker1 # [ 0.974568] thunder_xcv, ver 1.01471worker1 # [ 0.974608] thunder_bgx, ver 1.01472worker1 # [ 0.974630] nicpf, ver 1.01473worker1 # [ 0.975200] e1000: Intel(R) PRO/1000 Network Driver1474worker2 # [ 0.993386] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001475client # [ 0.973178] Freeing initrd memory: 26972K1476worker2 # [ 0.993754] hub 1-0:1.0: USB hub found1477worker1 # [ 0.975211] e1000: Copyright (c) 1999-2006 Intel Corporation.1478worker2 # [ 0.993780] hub 1-0:1.0: 6 ports detected1479worker1 # [ 0.975235] e1000e: Intel(R) PRO/1000 Network Driver1480worker1 # [ 0.975244] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1481worker1 # [ 0.975274] igb: Intel(R) Gigabit Ethernet Network Driver1482worker1 # [ 0.975280] igb: Copyright (c) 2007-2014 Intel Corporation.1483worker2 # [ 0.996974] rtc-pl031 9010000.pl031: registered as rtc01484worker1 # [ 0.975304] igbvf: Intel(R) Gigabit Virtual Function Network Driver1485worker1 # [ 0.975312] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1486worker2 # [ 0.997016] rtc-pl031 9010000.pl031: setting system clock to 2026-09-23T04:42:22 UTC (1790138542)1487client # [ 0.979533] tun: Universal TUN/TAP device driver, 1.61488worker1 # [ 0.975446] sky2: driver version 1.301489lb # [ 0.955588] Freeing initrd memory: 26948K1490worker2 # [ 0.997355] i2c_dev: i2c /dev entries driver1491worker1 # [ 0.977130] usbcore: registered new interface driver usb-storage1492worker1 # [ 0.977188] usbcore: registered new interface driver usbserial_generic1493worker1 # [ 0.977201] usbserial: USB Serial support registered for generic1494worker1 # [ 0.977813] hv_vmbus: registering driver hyperv_keyboard1495worker1 # [ 0.979027] ehci-pci 0000:00:07.0: EHCI Host Controller1496client # [ 0.983434] thunder_xcv, ver 1.01497client # [ 0.983482] thunder_bgx, ver 1.01498client # [ 0.983506] nicpf, ver 1.01499worker1 # [ 0.979057] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11500worker2 # [ 1.002931] sdhci: Secure Digital Host Controller Interface driver1501worker2 # [ 1.002952] sdhci: Copyright(c) Pierre Ossman1502worker1 # [ 0.979366] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001503worker2 # [ 1.003222] Synopsys Designware Multimedia Card Interface Driver1504lb # [ 0.961708] tun: Universal TUN/TAP device driver, 1.61505worker2 # [ 1.003598] sdhci-pltfm: SDHCI platform and OF driver helper1506worker1 # [ 0.991671] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001507worker1 # [ 0.992037] hub 1-0:1.0: USB hub found1508worker1 # [ 0.992058] hub 1-0:1.0: 6 ports detected1509client # [ 0.985379] e1000: Intel(R) PRO/1000 Network Driver1510client # [ 0.985388] e1000: Copyright (c) 1999-2006 Intel Corporation.1511worker2 # [ 1.008004] hid: raw HID events driver (C) Jiri Kosina1512worker1 # [ 0.994596] rtc-pl031 9010000.pl031: registered as rtc01513client # [ 0.985417] e1000e: Intel(R) PRO/1000 Network Driver1514worker2 # [ 1.008263] usbcore: registered new interface driver usbhid1515worker2 # [ 1.008270] usbhid: USB HID core driver1516worker1 # [ 0.994625] rtc-pl031 9010000.pl031: setting system clock to 2026-09-23T04:42:22 UTC (1790138542)1517client # [ 0.985424] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1518worker1 # [ 0.995048] i2c_dev: i2c /dev entries driver1519client # [ 0.985453] igb: Intel(R) Gigabit Ethernet Network Driver1520client # [ 0.985459] igb: Copyright (c) 2007-2014 Intel Corporation.1521worker2 # [ 1.011244] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1522client # [ 0.985487] igbvf: Intel(R) Gigabit Virtual Function Network Driver1523lb # [ 0.965642] thunder_xcv, ver 1.01524client # [ 0.985493] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1525lb # [ 0.965688] thunder_bgx, ver 1.01526client # [ 0.985634] sky2: driver version 1.301527lb # [ 0.965714] nicpf, ver 1.01528worker2 # [ 1.014031] drop_monitor: Initializing network drop monitor service1529lb # [ 0.966262] e1000: Intel(R) PRO/1000 Network Driver1530client # [ 0.987337] usbcore: registered new interface driver usb-storage1531worker2 # [ 1.014191] NET: Registered PF_INET6 protocol family1532lb # [ 0.966269] e1000: Copyright (c) 1999-2006 Intel Corporation.1533client # [ 0.987510] usbcore: registered new interface driver usbserial_generic1534lb # [ 0.966292] e1000e: Intel(R) PRO/1000 Network Driver1535worker1 # [ 1.000618] sdhci: Secure Digital Host Controller Interface driver1536client # [ 0.987526] usbserial: USB Serial support registered for generic1537worker1 # [ 1.000634] sdhci: Copyright(c) Pierre Ossman1538worker2 # [ 1.016441] Segment Routing with IPv61539lb # [ 0.966301] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1540client # [ 0.988355] ehci-pci 0000:00:07.0: EHCI Host Controller1541worker2 # [ 1.016466] In-situ OAM (IOAM) with IPv61542worker1 # [ 1.000920] Synopsys Designware Multimedia Card Interface Driver1543lb # [ 0.966331] igb: Intel(R) Gigabit Ethernet Network Driver1544worker2 # [ 1.016500] NET: Registered PF_PACKET protocol family1545client # [ 0.988386] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11546worker1 # [ 1.001306] sdhci-pltfm: SDHCI platform and OF driver helper1547lb # [ 0.966337] igb: Copyright (c) 2007-2014 Intel Corporation.1548client # [ 0.988770] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001549lb # [ 0.966359] igbvf: Intel(R) Gigabit Virtual Function Network Driver1550lb # [ 0.966365] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1551worker2 # [ 1.018094] 9pnet: Installing 9P2000 support1552worker1 # [ 1.005522] hid: raw HID events driver (C) Jiri Kosina1553lb # [ 0.966497] sky2: driver version 1.301554worker2 # [ 1.018156] Key type dns_resolver registered1555worker1 # [ 1.005754] usbcore: registered new interface driver usbhid1556client # [ 1.000041] hv_vmbus: registering driver hyperv_keyboard1557lb # [ 0.968124] usbcore: registered new interface driver usb-storage1558worker1 # [ 1.005761] usbhid: USB HID core driver1559client # [ 1.001503] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001560lb # [ 0.968225] usbcore: registered new interface driver usbserial_generic1561lb # [ 0.968243] usbserial: USB Serial support registered for generic1562client # [ 1.002614] hub 1-0:1.0: USB hub found1563client # [ 1.003139] hub 1-0:1.0: 6 ports detected1564lb # [ 0.969355] ehci-pci 0000:00:07.0: EHCI Host Controller1565lb # [ 0.969390] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11566lb # [ 0.969570] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001567worker1 # [ 1.008709] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1568client # [ 1.004311] rtc-pl031 9010000.pl031: registered as rtc01569worker1 # [ 1.011423] drop_monitor: Initializing network drop monitor service1570lb # [ 0.981221] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001571worker1 # [ 1.011564] NET: Registered PF_INET6 protocol family1572client # [ 1.004344] rtc-pl031 9010000.pl031: setting system clock to 2026-09-23T04:42:22 UTC (1790138542)1573lb # [ 0.981633] hub 1-0:1.0: USB hub found1574client # [ 1.004703] i2c_dev: i2c /dev entries driver1575lb # [ 0.981659] hub 1-0:1.0: 6 ports detected1576worker1 # [ 1.013538] Segment Routing with IPv61577worker1 # [ 1.013558] In-situ OAM (IOAM) with IPv61578worker2 # [ 1.025147] registered taskstats version 11579worker1 # [ 1.013590] NET: Registered PF_PACKET protocol family1580worker2 # [ 1.025314] Loading compiled-in X.509 certificates1581lb # [ 0.984565] hv_vmbus: registering driver hyperv_keyboard1582lb # [ 0.986183] rtc-pl031 9010000.pl031: registered as rtc01583client # [ 1.010258] sdhci: Secure Digital Host Controller Interface driver1584worker1 # [ 1.015485] 9pnet: Installing 9P2000 support1585client # [ 1.010273] sdhci: Copyright(c) Pierre Ossman1586lb # [ 0.986217] rtc-pl031 9010000.pl031: setting system clock to 2026-09-23T04:42:22 UTC (1790138542)1587worker1 # [ 1.015532] Key type dns_resolver registered1588client # [ 1.010540] Synopsys Designware Multimedia Card Interface Driver1589lb # [ 0.986538] i2c_dev: i2c /dev entries driver1590client # [ 1.010954] sdhci-pltfm: SDHCI platform and OF driver helper1591worker2 # [ 1.034159] Demotion targets for Node 0: null1592worker2 # [ 1.034291] Key type .fscrypt registered1593client # [ 1.015339] hid: raw HID events driver (C) Jiri Kosina1594worker1 # [ 1.022194] registered taskstats version 11595worker2 # [ 1.034297] Key type fscrypt-provisioning registered1596lb # [ 0.992143] sdhci: Secure Digital Host Controller Interface driver1597worker2 # [ 1.034402] ima: No TPM chip found, activating TPM-bypass!1598lb # [ 0.992157] sdhci: Copyright(c) Pierre Ossman1599worker2 # [ 1.034421] ima: Allocated hash algorithm: sha11600client # [ 1.016285] usbcore: registered new interface driver usbhid1601worker2 # [ 1.034463] ima: No architecture policies found1602client # [ 1.016297] usbhid: USB HID core driver1603worker2 # [ 1.038666] input: gpio-keys as /devices/platform/gpio-keys/input/input01604client # [ 1.018611] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1605lb # [ 0.993743] Synopsys Designware Multimedia Card Interface Driver1606worker1 # [ 1.022873] Loading compiled-in X.509 certificates1607lb # [ 0.994134] sdhci-pltfm: SDHCI platform and OF driver helper1608lb # [ 0.995735] hid: raw HID events driver (C) Jiri Kosina1609client # [ 1.021420] drop_monitor: Initializing network drop monitor service1610client # [ 1.021598] NET: Registered PF_INET6 protocol family1611lb # [ 0.995987] usbcore: registered new interface driver usbhid1612lb # [ 0.995994] usbhid: USB HID core driver1613client # [ 1.023765] Segment Routing with IPv61614client # [ 1.023787] In-situ OAM (IOAM) with IPv61615client # [ 1.023839] NET: Registered PF_PACKET protocol family1616worker1 # [ 1.031292] Demotion targets for Node 0: null1617worker1 # [ 1.031421] Key type .fscrypt registered1618worker1 # [ 1.031428] Key type fscrypt-provisioning registered1619lb # [ 1.000553] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1620worker1 # [ 1.031536] ima: No TPM chip found, activating TPM-bypass!1621client # [ 1.025508] 9pnet: Installing 9P2000 support1622lb # [ 1.002133] drop_monitor: Initializing network drop monitor service1623worker1 # [ 1.031555] ima: Allocated hash algorithm: sha11624client # [ 1.025566] Key type dns_resolver registered1625lb # [ 1.002302] NET: Registered PF_INET6 protocol family1626worker1 # [ 1.031576] ima: No architecture policies found1627lb # [ 1.005710] Segment Routing with IPv61628worker1 # [ 1.035731] input: gpio-keys as /devices/platform/gpio-keys/input/input01629lb # [ 1.005736] In-situ OAM (IOAM) with IPv61630lb # [ 1.005765] NET: Registered PF_PACKET protocol family1631lb # [ 1.007538] 9pnet: Installing 9P2000 support1632lb # [ 1.007598] Key type dns_resolver registered1633client # [ 1.033060] registered taskstats version 11634client # [ 1.033226] Loading compiled-in X.509 certificates1635worker2 # [ 1.056811] clk: Disabling unused clocks1636worker2 # [ 1.056854] PM: genpd: Disabling unused power domains1637lb # [ 1.014591] registered taskstats version 11638lb # [ 1.014762] Loading compiled-in X.509 certificates1639worker2 # [ 1.061105] Freeing unused kernel memory: 4736K1640worker2 # [ 1.061279] Run /init as init process1641client # [ 1.042600] Demotion targets for Node 0: null1642client # [ 1.042749] Key type .fscrypt registered1643client # [ 1.042757] Key type fscrypt-provisioning registered1644client # [ 1.042904] ima: No TPM chip found, activating TPM-bypass!1645client # [ 1.042934] ima: Allocated hash algorithm: sha11646client # [ 1.042964] ima: No architecture policies found1647client # [ 1.047246] input: gpio-keys as /devices/platform/gpio-keys/input/input01648lb # [ 1.023610] Demotion targets for Node 0: null1649lb # [ 1.023755] Key type .fscrypt registered1650lb # [ 1.023762] Key type fscrypt-provisioning registered1651lb # [ 1.023890] ima: No TPM chip found, activating TPM-bypass!1652lb # [ 1.023910] ima: Allocated hash algorithm: sha11653worker1 # [ 1.054655] clk: Disabling unused clocks1654lb # [ 1.023937] ima: No architecture policies found1655worker1 # [ 1.054688] PM: genpd: Disabling unused power domains1656lb # [ 1.028266] input: gpio-keys as /devices/platform/gpio-keys/input/input01657worker1 # [ 1.058914] Freeing unused kernel memory: 4736K1658worker1 # [ 1.059101] Run /init as init process1659worker2 # [ 1.078141] systemd[1]: Successfully made /usr/ read-only.1660client # [ 1.066462] clk: Disabling unused clocks1661client # [ 1.066499] PM: genpd: Disabling unused power domains1662worker1 # [ 1.076953] systemd[1]: Successfully made /usr/ read-only.1663client # [ 1.070786] Freeing unused kernel memory: 4736K1664client # [ 1.071009] Run /init as init process1665lb # [ 1.047881] clk: Disabling unused clocks1666lb # [ 1.047921] PM: genpd: Disabling unused power domains1667lb # [ 1.052172] Freeing unused kernel memory: 4736K1668lb # [ 1.052980] Run /init as init process1669client # [ 1.086262] systemd[1]: Successfully made /usr/ read-only.1670lb # [ 1.071051] systemd[1]: Successfully made /usr/ read-only.1671worker2 # [ 1.239792] usb 1-1: new high-speed USB device number 2 using ehci-pci1672worker1 # [ 1.238330] usb 1-1: new high-speed USB device number 2 using ehci-pci1673client # [ 1.251709] usb 1-1: new high-speed USB device number 2 using ehci-pci1674lb # [ 1.228467] usb 1-1: new high-speed USB device number 2 using ehci-pci1675worker2 # [ 1.389640] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11676worker1 # [ 1.392693] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11677lb # [ 1.378148] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11678worker2 # [ 1.413274] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1679worker2 # [ 1.425589] systemd[1]: Detected virtualization qemu.1680worker2 # [ 1.427780] systemd[1]: Detected architecture arm64.1681worker2 # [ 1.429700] systemd[1]: Running in initrd.1682client # [ 1.406310] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11683worker2 # [ 1.432505] systemd[1]: Initializing machine ID from random generator.1684worker2 # [ 1.435580] systemd[1]: Hostname set to <worker2>.1685worker1 # [ 1.411949] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1686worker1 # [ 1.424167] systemd[1]: Detected virtualization qemu.1687worker1 # [ 1.426306] systemd[1]: Detected architecture arm64.1688worker1 # [ 1.428213] systemd[1]: Running in initrd.1689worker1 # [ 1.431032] systemd[1]: Initializing machine ID from random generator.1690worker1 # [ 1.434112] systemd[1]: Hostname set to <worker1>.1691client # [ 1.421369] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1692client # [ 1.434941] systemd[1]: Detected virtualization qemu.1693lb # [ 1.406072] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1694client # [ 1.437144] systemd[1]: Detected architecture arm64.1695lb # [ 1.414519] systemd[1]: Detected virtualization qemu.1696lb # [ 1.415704] systemd[1]: Detected architecture arm64.1697client # [ 1.439121] systemd[1]: Running in initrd.1698lb # [ 1.416753] systemd[1]: Running in initrd.1699lb # [ 1.418195] systemd[1]: Initializing machine ID from random generator.1700client # [ 1.442164] systemd[1]: Initializing machine ID from random generator.1701lb # [ 1.419891] systemd[1]: Hostname set to <lb>.1702client # [ 1.445350] systemd[1]: Hostname set to <client>.1703worker2 # [ 1.480069] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01704worker1 # [ 1.482645] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01705client # [ 1.492019] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01706lb # [ 1.468709] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01707worker2 # [ 1.603819] usb 1-2: new high-speed USB device number 3 using ehci-pci1708worker1 # [ 1.606262] usb 1-2: new high-speed USB device number 3 using ehci-pci1709client # [ 1.615649] usb 1-2: new high-speed USB device number 3 using ehci-pci1710lb # [ 1.592448] usb 1-2: new high-speed USB device number 3 using ehci-pci1711worker2 # [ 1.726219] systemd[1]: bpf-restrict-fs: LSM BPF program attached1712worker1 # [ 1.729473] systemd[1]: bpf-restrict-fs: LSM BPF program attached1713worker2 # [ 1.757866] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21714worker2 # [ 1.759670] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01715client # [ 1.755148] systemd[1]: bpf-restrict-fs: LSM BPF program attached1716worker1 # [ 1.767968] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21717worker1 # [ 1.770526] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01718lb # [ 1.741889] systemd[1]: bpf-restrict-fs: LSM BPF program attached1719worker2 # [ 1.790883] systemd[1]: Queued start job for default target Initrd Default Target.1720worker2 # [ 1.801797] systemd[1]: Created slice Slice /system/modprobe.1721client # [ 1.778148] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21722worker2 # [ 1.802819] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1723lb # [ 1.754984] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21724worker2 # [ 1.803897] systemd[1]: Expecting device /dev/disk/by-label/nixos...1725worker2 # [ 1.803932] systemd[1]: Reached target Path Units.1726worker2 # [ 1.803950] systemd[1]: Reached target Slice Units.1727client # [ 1.784160] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01728worker2 # [ 1.803967] systemd[1]: Reached target Swaps.1729worker2 # [ 1.803985] systemd[1]: Reached target Timer Units.1730worker2 # [ 1.804161] systemd[1]: Listening on D-Bus System Message Bus Socket.1731worker2 # [ 1.804289] systemd[1]: Listening on Journal Socket (/dev/log).1732lb # [ 1.762195] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01733worker2 # [ 1.804409] systemd[1]: Listening on Journal Sockets.1734worker2 # [ 1.804518] systemd[1]: Listening on udev Control Socket.1735worker2 # [ 1.804610] systemd[1]: Listening on udev Kernel Socket.1736worker2 # [ 1.804630] systemd[1]: Reached target Socket Units.1737worker2 # [ 1.813446] systemd[1]: Starting Create List of Static Device Nodes...1738worker2 # [ 1.814368] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1739worker1 # [ 1.808773] systemd[1]: Queued start job for default target Initrd Default Target.1740worker2 # [ 1.823992] systemd[1]: Mounting Kernel Configuration File System...1741worker2 # [ 1.832043] systemd[1]: Starting Journal Service...1742worker1 # [ 1.820368] systemd[1]: Created slice Slice /system/modprobe.1743worker1 # [ 1.821453] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1744worker1 # [ 1.822644] systemd[1]: Expecting device /dev/disk/by-label/nixos...1745worker1 # [ 1.822679] systemd[1]: Reached target Path Units.1746worker1 # [ 1.822696] systemd[1]: Reached target Slice Units.1747worker1 # [ 1.822714] systemd[1]: Reached target Swaps.1748worker1 # [ 1.822731] systemd[1]: Reached target Timer Units.1749worker1 # [ 1.822906] systemd[1]: Listening on D-Bus System Message Bus Socket.1750worker1 # [ 1.823046] systemd[1]: Listening on Journal Socket (/dev/log).1751worker1 # [ 1.823177] systemd[1]: Listening on Journal Sockets.1752worker1 # [ 1.823291] systemd[1]: Listening on udev Control Socket.1753worker1 # [ 1.823386] systemd[1]: Listening on udev Kernel Socket.1754worker1 # [ 1.823405] systemd[1]: Reached target Socket Units.1755worker1 # [ 1.832984] systemd[1]: Starting Create List of Static Device Nodes...1756worker1 # [ 1.834078] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1757worker1 # [ 1.842395] systemd[1]: Mounting Kernel Configuration File System...1758worker2 # [ 1.855955] systemd[1]: Starting Load Kernel Modules...1759worker2 # [ 1.856106] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1760worker1 # [ 1.850549] systemd[1]: Starting Journal Service...1761worker2 # [ 1.867427] systemd[1]: Starting Coldplug All udev Devices...1762worker2 # [ 1.881690] systemd-journald[72]: Collecting audit messages is disabled.1763client # [ 1.866348] systemd[1]: Queued start job for default target Initrd Default Target.1764worker2 # [ 1.884769] systemd[1]: Finished Create List of Static Device Nodes.1765worker2 # [ 1.885593] systemd[1]: Mounted Kernel Configuration File System.1766worker1 # [ 1.873876] systemd[1]: Starting Load Kernel Modules...1767worker1 # [ 1.874003] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1768client # [ 1.873799] systemd[1]: Created slice Slice /system/modprobe.1769client # [ 1.874880] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1770client # [ 1.876045] systemd[1]: Expecting device /dev/disk/by-label/nixos...1771client # [ 1.876952] systemd[1]: Reached target Path Units.1772client # [ 1.877644] systemd[1]: Reached target Slice Units.1773client # [ 1.878345] systemd[1]: Reached target Swaps.1774lb # [ 1.854167] systemd[1]: Queued start job for default target Initrd Default Target.1775client # [ 1.878992] systemd[1]: Reached target Timer Units.1776client # [ 1.879898] systemd[1]: Listening on D-Bus System Message Bus Socket.1777client # [ 1.880938] systemd[1]: Listening on Journal Socket (/dev/log).1778client # [ 1.881898] systemd[1]: Listening on Journal Sockets.1779client # [ 1.882764] systemd[1]: Listening on udev Control Socket.1780client # [ 1.883721] systemd[1]: Listening on udev Kernel Socket.1781worker2 # [ 1.900124] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1782client # [ 1.884479] systemd[1]: Reached target Socket Units.1783client # [ 1.886823] systemd[1]: Starting Create List of Static Device Nodes...1784lb # [ 1.863500] systemd[1]: Created slice Slice /system/modprobe.1785lb # [ 1.864966] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1786client # [ 1.887866] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1787worker1 # [ 1.894526] systemd[1]: Starting Coldplug All udev Devices...1788lb # [ 1.866380] systemd[1]: Expecting device /dev/disk/by-label/nixos...1789lb # [ 1.867526] systemd[1]: Reached target Path Units.1790worker1 # [ 1.898086] systemd-journald[72]: Collecting audit messages is disabled.1791lb # [ 1.868433] systemd[1]: Reached target Slice Units.1792lb # [ 1.869305] systemd[1]: Reached target Swaps.1793lb # [ 1.870086] systemd[1]: Reached target Timer Units.1794lb # [ 1.871312] systemd[1]: Listening on D-Bus System Message Bus Socket.1795client # [ 1.895796] systemd[1]: Mounting Kernel Configuration File System...1796lb # [ 1.872667] systemd[1]: Listening on Journal Socket (/dev/log).1797lb # [ 1.873850] systemd[1]: Listening on Journal Sockets.1798lb # [ 1.875107] systemd[1]: Listening on udev Control Socket.1799lb # [ 1.876194] systemd[1]: Listening on udev Kernel Socket.1800lb # [ 1.877212] systemd[1]: Reached target Socket Units.1801client # [ 1.903916] systemd[1]: Starting Journal Service...1802lb # [ 1.880208] systemd[1]: Starting Create List of Static Device Nodes...1803lb # [ 1.881540] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1804worker1 # [ 1.912495] systemd[1]: Finished Create List of Static Device Nodes.1805worker1 # [ 1.913236] systemd[1]: Mounted Kernel Configuration File System.1806lb # [ 1.890082] systemd[1]: Mounting Kernel Configuration File System...1807worker1 # [ 1.923000] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1808worker2 # [ 1.940432] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1809lb # [ 1.899015] systemd[1]: Starting Journal Service...1810worker2 # [ 1.944139] systemd[1]: Starting Create Static Device Nodes in /dev...1811worker2 # [ 1.954986] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1812client # [ 1.936016] systemd[1]: Starting Load Kernel Modules...1813client # [ 1.936157] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1814worker2 # [ 1.961298] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1815lb # [ 1.920877] systemd[1]: Starting Load Kernel Modules...1816lb # [ 1.921856] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1817lb # [ 1.930568] systemd[1]: Starting Coldplug All udev Devices...1818worker1 # [ 1.960624] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1819worker2 # [ 1.977188] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01820worker2 # [ 1.977484] [drm] features: -virgl +edid -resource_blob -host_visible1821worker2 # [ 1.977495] [drm] features: -context_init1822worker2 # [ 1.978234] [drm] number of scanouts: 11823worker2 # [ 1.978252] [drm] number of cap sets: 01824client # [ 1.961956] systemd-journald[72]: Collecting audit messages is disabled.1825client # [ 1.963505] systemd[1]: Starting Coldplug All udev Devices...1826worker2 # [ 1.995335] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1827worker2 # [ 1.995368] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01828client # [ 1.981369] systemd[1]: Finished Create List of Static Device Nodes.1829client # [ 1.982112] systemd[1]: Mounted Kernel Configuration File System.1830worker1 # [ 1.986362] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1831worker1 # [ 1.992770] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01832worker1 # [ 1.993068] [drm] features: -virgl +edid -resource_blob -host_visible1833worker1 # [ 1.993079] [drm] features: -context_init1834worker1 # [ 1.993791] [drm] number of scanouts: 11835worker1 # [ 1.993809] [drm] number of cap sets: 01836lb # [ 1.965278] systemd[1]: Finished Create List of Static Device Nodes.1837client # [ 1.992314] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1838worker2 # [ 2.015959] systemd[1]: Finished Create Static Device Nodes in /dev.1839worker2 # [ 2.016437] systemd[1]: Reached target Preparation for Local File Systems.1840worker2 # [ 2.016481] systemd[1]: Reached target Local File Systems.1841worker1 # [ 2.006960] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1842worker1 # [ 2.010655] systemd[1]: Starting Create Static Device Nodes in /dev...1843client # [ 2.006713] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1844worker2 # [ 2.024260] systemd[1]: Starting Rule-based Manager for Device Events and Files...1845worker2 # [ 2.033066] Console: switching to colour frame buffer device 160x501846lb # [ 1.998085] systemd-journald[72]: Collecting audit messages is disabled.1847worker1 # [ 2.022656] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1848worker1 # [ 2.022681] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01849client # [ 2.019700] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1850client # [ 2.025993] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01851lb # [ 2.004658] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1852client # [ 2.026244] [drm] features: -virgl +edid -resource_blob -host_visible1853lb # [ 2.005383] systemd[1]: Mounted Kernel Configuration File System.1854client # [ 2.026254] [drm] features: -context_init1855client # [ 2.027030] [drm] number of scanouts: 11856client # [ 2.027048] [drm] number of cap sets: 01857worker2 # [ 2.056365] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1858lb # [ 2.016741] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1859lb # [ 2.018556] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1860worker1 # [ 2.042711] Console: switching to colour frame buffer device 160x501861worker2 # [ 2.072450] systemd[1]: Finished Load Kernel Modules.1862worker2 # [ 2.077090] systemd[1]: Starting Apply Kernel Variables...1863lb # [ 2.033910] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01864lb # [ 2.034174] [drm] features: -virgl +edid -resource_blob -host_visible1865lb # [ 2.034188] [drm] features: -context_init1866lb # [ 2.034995] [drm] number of scanouts: 11867lb # [ 2.035019] [drm] number of cap sets: 01868client # [ 2.055850] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1869client # [ 2.055875] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01870client # [ 2.065807] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1871worker1 # [ 2.075300] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1872client # [ 2.068541] systemd[1]: Starting Create Static Device Nodes in /dev...1873worker2 # [ 2.076341] systemd-modules-load[73]: Inserted module 'dm_mod'1874worker2 # [ 2.077468] systemd-modules-load[73]: Module 'virtio_balloon' is built in1875worker1 # [ 2.082944] systemd[1]: Finished Create Static Device Nodes in /dev.1876worker1 # [ 2.083350] systemd[1]: Reached target Preparation for Local File Systems.1877worker1 # [ 2.083387] systemd[1]: Reached target Local File Systems.1878lb # [ 2.057121] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1879worker2 # [ 2.088338] systemd-modules-load[73]: Module 'virtio_console' is built in1880lb # [ 2.060834] systemd[1]: Starting Create Static Device Nodes in /dev...1881worker1 # [ 2.090643] systemd[1]: Starting Rule-based Manager for Device Events and Files...1882client # [ 2.080022] Console: switching to colour frame buffer device 160x501883worker1 # [ 2.093043] systemd[1]: Started Journal Service.1884worker2 # [ 2.105278] systemd[1]: Started Journal Service.1885worker2 # [ 2.093979] systemd-modules-load[73]: Inserted module 'virtio_gpu'1886worker1 # [ 2.084223] systemd-modules-load[74]: Inserted module 'dm_mod'1887lb # [ 2.064884] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1888lb # [ 2.064911] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01889worker1 # [ 2.088286] systemd-modules-load[74]: Module 'virtio_balloon' is built in1890worker1 # [ 2.089454] systemd-modules-load[74]: Module 'virtio_console' is built in1891worker1 # [ 2.090543] systemd-modules-load[74]: Inserted module 'virtio_gpu'1892worker1 # [ 2.091577] systemd-modules-load[74]: Module 'virtio_rng' is built in1893worker2 # [ 2.103840] systemd-modules-load[73]: Module 'virtio_rng' is built in1894client # [ 2.104263] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1895worker1 # [ 2.098620] systemd[1]: Finished Load Kernel Modules.1896worker2 # [ 2.118404] systemd[1]: Starting Create System Files and Directories...1897worker2 # [ 2.126259] systemd[1]: Finished Apply Kernel Variables.1898client # [ 2.120390] systemd[1]: Finished Load Kernel Modules.1899client # [ 2.124005] systemd[1]: Starting Apply Kernel Variables...1900worker1 # [ 2.117560] systemd[1]: Starting Apply Kernel Variables...1901lb # [ 2.097060] Console: switching to colour frame buffer device 160x501902worker2 # [ 2.130855] systemd-udevd[79]: Using default interface naming scheme 'v261'.1903lb # [ 2.101300] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1904worker1 # [ 2.126606] systemd[1]: Starting Create System Files and Directories...1905lb # [ 2.117688] systemd[1]: Finished Create Static Device Nodes in /dev.1906lb # [ 2.117949] systemd[1]: Reached target Preparation for Local File Systems.1907lb # [ 2.117987] systemd[1]: Reached target Local File Systems.1908lb # [ 2.129095] systemd[1]: Starting Rule-based Manager for Device Events and Files...1909client # [ 2.152038] systemd[1]: Finished Create Static Device Nodes in /dev.1910client # [ 2.152525] systemd[1]: Reached target Preparation for Local File Systems.1911client # [ 2.152569] systemd[1]: Reached target Local File Systems.1912worker2 # [ 2.161767] systemd[1]: Finished Create System Files and Directories.1913client # [ 2.158147] systemd[1]: Starting Rule-based Manager for Device Events and Files...1914client # [ 2.152467] systemd-modules-load[73]: Inserted module 'dm_mod'1915client # [ 2.153859] systemd-modules-load[73]: Module 'virtio_balloon' is built in1916worker2 # [ 2.175864] systemd[1]: Started Rule-based Manager for Device Events and Files.1917client # [ 2.172397] systemd[1]: Started Journal Service.1918lb # [ 2.148583] systemd[1]: Finished Load Kernel Modules.1919client # [ 2.160434] systemd-modules-load[73]: Module 'virtio_console' is built in1920client # [ 2.165176] systemd-modules-load[73]: Inserted module 'virtio_gpu'1921lb # [ 2.152556] systemd[1]: Starting Apply Kernel Variables...1922worker1 # [ 2.173447] systemd[1]: Finished Apply Kernel Variables.1923client # [ 2.169489] systemd-modules-load[73]: Module 'virtio_rng' is built in1924client # [ 2.178698] systemd[1]: Finished Apply Kernel Variables.1925worker1 # [ 2.191521] systemd-udevd[78]: Using default interface naming scheme 'v261'.1926worker1 # [ 2.194198] systemd[1]: Finished Create System Files and Directories.1927lb # [ 2.168571] systemd-modules-load[73]: Inserted module 'dm_mod'1928lb # [ 2.169794] systemd-modules-load[73]: Module 'virtio_balloon' is built in1929lb # [ 2.170999] systemd-modules-load[73]: Module 'virtio_console' is built in1930client # [ 2.196178] systemd[1]: Starting Create System Files and Directories...1931lb # [ 2.192813] systemd[1]: Started Journal Service.1932lb # [ 2.180946] systemd-modules-load[73]: Inserted module 'virtio_gpu'1933lb # [ 2.186240] systemd-modules-load[73]: Module 'virtio_rng' is built in1934worker1 # [ 2.224758] systemd[1]: Started Rule-based Manager for Device Events and Files.1935worker2 # [ 2.240533] systemd[1]: Starting Virtual Console Setup...1936lb # [ 2.209413] systemd[1]: Starting Create System Files and Directories...1937client # [ 2.237752] systemd[1]: Finished Create System Files and Directories.1938lb # [ 2.217612] systemd[1]: Finished Apply Kernel Variables.1939client # [ 2.249672] systemd-udevd[79]: Using default interface naming scheme 'v261'.1940worker1 # [ 2.284829] systemd[1]: Starting Virtual Console Setup...1941lb # [ 2.255602] systemd-udevd[78]: Using default interface naming scheme 'v261'.1942worker2 # [ 2.300595] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1943client # [ 2.281748] systemd[1]: Started Rule-based Manager for Device Events and Files.1944worker2 # [ 2.304147] systemd[1]: Finished Virtual Console Setup.1945lb # [ 2.273252] systemd[1]: Finished Create System Files and Directories.1946lb # [ 2.297616] systemd[1]: Started Rule-based Manager for Device Events and Files.1947worker1 # [ 2.348592] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1948client # [ 2.343320] systemd[1]: Starting Virtual Console Setup...1949worker1 # [ 2.352276] systemd[1]: Finished Virtual Console Setup.1950lb # [ 2.360824] systemd[1]: Starting Virtual Console Setup...1951client # [ 2.404545] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1952client # [ 2.408168] systemd[1]: Finished Virtual Console Setup.1953lb # [ 2.420558] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones.1954lb # [ 2.424469] systemd[1]: Finished Virtual Console Setup.1955worker2 # [ 2.926426] systemd[1]: Finished Coldplug All udev Devices.1956worker2 # [ 2.927471] systemd[1]: Reached target System Initialization.1957worker2 # [ 2.928613] systemd[1]: Reached target Basic System.1958worker1 # [ 2.971740] systemd[1]: Finished Coldplug All udev Devices.1959worker1 # [ 2.972842] systemd[1]: Reached target System Initialization.1960worker1 # [ 2.973692] systemd[1]: Reached target Basic System.1961client # [ 3.039275] systemd[1]: Finished Coldplug All udev Devices.1962client # [ 3.044807] systemd[1]: Reached target System Initialization.1963client # [ 3.045767] systemd[1]: Reached target Basic System.1964worker2 # [ 3.092107] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1965worker2 # [ 3.107891] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1966worker2 # [ 3.122464] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1967lb # [ 3.079589] systemd[1]: Finished Coldplug All udev Devices.1968lb # [ 3.084810] systemd[1]: Reached target System Initialization.1969lb # [ 3.085802] systemd[1]: Reached target Basic System.1970worker1 # [ 3.151960] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1971worker1 # [ 3.161817] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1972worker1 # [ 3.168296] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1973worker2 # [ 3.215833] systemd[1]: Found device /dev/disk/by-label/nixos.1974worker2 # [ 3.218791] systemd[1]: Reached target Initrd Root Device.1975worker2 # [ 3.223377] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976lb # [ 3.200342] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1977client # [ 3.227010] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1978worker2 # [ 3.269465] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1979worker2 # [ 3.275631] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1980worker2 # [ 3.279942] systemd[1]: Mounting /sysroot...1981worker1 # [ 3.268975] systemd[1]: Found device /dev/disk/by-label/nixos.1982worker1 # [ 3.273231] systemd[1]: Reached target Initrd Root Device.1983client # [ 3.265809] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1984worker1 # [ 3.275858] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1985client # [ 3.269958] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1986lb # [ 3.273400] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1987lb # [ 3.278405] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1988worker2 # [ 3.339095] EXT4-fs (vda): mounted filesystem 37680bca-f3e2-43ad-91ac-3b964e5ce3f5 r/w with ordered data mode. Quota mode: none.1989worker2 # [ 3.330066] systemd[1]: Mounted /sysroot.1990worker2 # [ 3.333020] systemd[1]: Reached target Initrd Root File System.1991worker1 # [ 3.325537] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks1992worker2 # [ 3.339663] systemd[1]: Starting Mountpoints Configured in the Real Root...1993worker1 # [ 3.333550] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1994worker1 # [ 3.340303] systemd[1]: Mounting /sysroot...1995worker2 # [ 3.374372] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1996client # [ 3.356406] systemd[1]: Found device /dev/disk/by-label/nixos.1997lb # [ 3.336160] systemd[1]: Found device /dev/disk/by-label/nixos.1998worker2 # [ 3.382232] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1999client # [ 3.364148] systemd[1]: Reached target Initrd Root Device.2000lb # [ 3.340769] systemd[1]: Reached target Initrd Root Device.
loading 2,460 hidden lines…
4461client # farm-a> node-a: building 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4462worker1 # [ 56.324167] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4463client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4464client # farm-a> LOG-farm-a-sig4465worker1 # [ 57.608532] nix-daemon[855]: reaped child process 926, status = succeeded4466worker1 # [ 57.673132] nix-daemon[855]: accepted connection from pid 942, user nix-grpc-daemon (trusted)4467worker1 # [ 57.693999] nix-daemon[855]: reaped child process 945, status = succeeded4468lb # [ 57.667031] niks3-server[1001]: 2026/09/23 04:43:19 INFO Received uploads request method=POST path=/api/pending_closures4469worker1 # [ 57.711591] nix-grpc-daemon[906]: time=2026-09-23T04:43:19.228Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4470worker1 # [ 57.713836] nix-grpc-daemon[906]: time=2026-09-23T04:43:19.228Z level=INFO msg="Uploading 2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a (128B)"4471lb # [ 57.703417] niks3-server[1001]: 2026/09/23 04:43:19 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4472lb # [ 57.722068] niks3-server[1001]: 2026/09/23 04:43:19 INFO Registered completed upload object_key=log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4473worker1 # [ 57.762568] nix-grpc-daemon[906]: time=2026-09-23T04:43:19.281Z level=INFO msg="Uploading 1 narinfos"4474lb # [ 57.734430] niks3-server[1001]: 2026/09/23 04:43:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4475lb # [ 57.741693] niks3-server[1001]: 2026/09/23 04:43:19 INFO Signed narinfos id=10 count=14476lb # [ 57.743736] niks3-server[1001]: 2026/09/23 04:43:19 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.ls4477worker1 # [ 57.786717] nix-grpc-daemon[906]: time=2026-09-23T04:43:19.306Z level=INFO msg="Upload complete. (251ms)"4478lb # [ 57.754953] niks3-server[1001]: 2026/09/23 04:43:19 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4479lb # [ 57.759822] niks3-server[1001]: 2026/09/23 04:43:19 INFO Completed upload id=104480lb # [ 57.762188] niks3-server[1001]: 2026/09/23 04:43:19 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo4481worker1 # [ 57.796750] nix-grpc-daemon[770]: ts=2026-09-23T04:43:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=1 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv assign_id=5 outputs=14482worker1 # [ 57.805637] nix-daemon[855]: reaped child process 924, status = succeeded4483worker1 # [ 57.807862] nix-grpc-daemon[770]: ts=2026-09-23T04:43:19Z level=debug event=want client=4 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv cached=04484worker1 # [ 57.810503] nix-grpc-daemon[770]: ts=2026-09-23T04:43:19Z level=debug event=assigned drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker=192.168.1.3:50051 clients=14485worker1 # [ 57.853626] nix-grpc-daemon[770]: ts=2026-09-23T04:43:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591064486worker1 # [ 57.869995] nix-grpc-daemon[770]: ts=2026-09-23T04:43:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591064487worker1 # [ 57.884457] nix-grpc-daemon[906]: time=2026-09-23T04:43:19.403Z level=INFO msg="All 1 paths already cached"4488client # copying 1 paths to 'lb:50051'...4489client # copying path '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' to 'lb:50051'...4490worker1 # [ 57.895948] nix-grpc-daemon[770]: ts=2026-09-23T04:43:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:591064491worker1 # [ 57.910923] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4492worker1 # [ 58.060985] nix-daemon[855]: accepted connection from pid 951, user nix-grpc-daemon (trusted)4493worker1 # [ 58.084962] nix-daemon[855]: reaped child process 954, status = succeeded4494lb # [ 58.056981] niks3-server[1001]: 2026/09/23 04:43:19 INFO Received uploads request method=POST path=/api/pending_closures4495worker1 # [ 58.097176] nix-grpc-daemon[906]: time=2026-09-23T04:43:19.616Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4496worker1 # [ 58.098746] nix-grpc-daemon[906]: time=2026-09-23T04:43:19.616Z level=INFO msg="Uploading z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv (624B)"4497lb # [ 58.078747] niks3-server[1001]: 2026/09/23 04:43:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4498worker1 # [ 58.118031] nix-grpc-daemon[906]: time=2026-09-23T04:43:19.637Z level=INFO msg="Uploading 1 narinfos"4499lb # [ 58.088892] niks3-server[1001]: 2026/09/23 04:43:19 INFO Signed narinfos id=11 count=14500lb # [ 58.094128] niks3-server[1001]: 2026/09/23 04:43:19 INFO Registered completed upload object_key=nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst4501lb # [ 58.102568] niks3-server[1001]: 2026/09/23 04:43:19 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.ls4502worker1 # [ 58.140232] nix-grpc-daemon[906]: time=2026-09-23T04:43:19.659Z level=INFO msg="Upload complete. (214ms)"4503lb # [ 58.107911] niks3-server[1001]: 2026/09/23 04:43:19 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4504lb # [ 58.111015] niks3-server[1001]: 2026/09/23 04:43:19 INFO Completed upload id=114505worker1 # [ 58.146330] nix-grpc-daemon[770]: ts=2026-09-23T04:43:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=0 paths=1 nar_bytes_in=6244506lb # [ 58.114716] niks3-server[1001]: 2026/09/23 04:43:19 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo4507worker1 # [ 58.159825] nix-grpc-daemon[770]: ts=2026-09-23T04:43:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591064508worker1 # [ 58.166077] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4509worker1 # [ 58.170719] nix-daemon[855]: reaped child process 949, status = succeeded4510client # building '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' on lb:50051...4511worker1 # [ 58.181236] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4512client # farm-b> node-a: building z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4513client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4514client # farm-b> LOG-farm-b-sig4515worker1 # [ 59.485500] nix-daemon[855]: reaped child process 958, status = succeeded4516worker1 # [ 59.559093] nix-daemon[855]: accepted connection from pid 974, user nix-grpc-daemon (trusted)4517worker1 # [ 59.583093] nix-daemon[855]: reaped child process 977, status = succeeded4518lb # [ 59.554901] niks3-server[1001]: 2026/09/23 04:43:21 INFO Received uploads request method=POST path=/api/pending_closures4519worker1 # [ 59.598392] nix-grpc-daemon[906]: time=2026-09-23T04:43:21.116Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4520worker1 # [ 59.599885] nix-grpc-daemon[906]: time=2026-09-23T04:43:21.116Z level=INFO msg="Uploading h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b (176B)"4521lb # [ 59.595712] niks3-server[1001]: 2026/09/23 04:43:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4522worker1 # [ 59.638703] nix-grpc-daemon[906]: time=2026-09-23T04:43:21.157Z level=INFO msg="Uploading 1 narinfos"4523lb # [ 59.619526] niks3-server[1001]: 2026/09/23 04:43:21 INFO Signed narinfos id=12 count=14524lb # [ 59.627947] niks3-server[1001]: 2026/09/23 04:43:21 INFO Registered completed upload object_key=nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst4525lb # [ 59.645567] niks3-server[1001]: 2026/09/23 04:43:21 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls4526worker1 # [ 59.683193] nix-grpc-daemon[906]: time=2026-09-23T04:43:21.202Z level=INFO msg="Upload complete. (289ms)"4527lb # [ 59.651781] niks3-server[1001]: 2026/09/23 04:43:21 INFO Registered completed upload object_key=log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4528worker1 # [ 59.692439] nix-grpc-daemon[770]: ts=2026-09-23T04:43:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=1 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv assign_id=6 outputs=14529lb # [ 59.662149] niks3-server[1001]: 2026/09/23 04:43:21 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4530lb # [ 59.666896] niks3-server[1001]: 2026/09/23 04:43:21 INFO Completed upload id=124531lb # [ 59.670602] niks3-server[1001]: 2026/09/23 04:43:21 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo4532worker1 # [ 59.706114] nix-daemon[855]: reaped child process 956, status = succeeded4533worker1 # [ 59.709220] nix-grpc-daemon[770]: ts=2026-09-23T04:43:21Z level=debug event=want client=4 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv cached=04534worker1 # [ 59.714349] nix-grpc-daemon[770]: ts=2026-09-23T04:43:21Z level=debug event=assigned drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker=192.168.1.3:50051 clients=14535worker1 # [ 59.762403] nix-grpc-daemon[770]: ts=2026-09-23T04:43:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591064536worker1 # [ 59.774266] nix-grpc-daemon[770]: ts=2026-09-23T04:43:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591064537worker1 # [ 59.784957] nix-grpc-daemon[906]: time=2026-09-23T04:43:21.304Z level=INFO msg="All 2 paths already cached"4538client # copying 1 paths to 'lb:50051'...4539client # copying path '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' to 'lb:50051'...4540worker1 # [ 59.794540] nix-grpc-daemon[770]: ts=2026-09-23T04:43:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:591064541worker1 # [ 59.804752] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4542worker1 # [ 59.931055] nix-daemon[855]: accepted connection from pid 983, user nix-grpc-daemon (trusted)4543worker1 # [ 59.955360] nix-daemon[855]: reaped child process 986, status = succeeded4544lb # [ 59.920422] niks3-server[1001]: 2026/09/23 04:43:21 INFO Received uploads request method=POST path=/api/pending_closures4545worker1 # [ 59.962073] nix-grpc-daemon[906]: time=2026-09-23T04:43:21.481Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4546worker1 # [ 59.963665] nix-grpc-daemon[906]: time=2026-09-23T04:43:21.481Z level=INFO msg="Uploading knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv (752B)"4547lb # [ 59.951360] niks3-server[1001]: 2026/09/23 04:43:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4548worker1 # [ 59.990834] nix-grpc-daemon[906]: time=2026-09-23T04:43:21.510Z level=INFO msg="Uploading 1 narinfos"4549lb # [ 59.965736] niks3-server[1001]: 2026/09/23 04:43:21 INFO Signed narinfos id=13 count=14550lb # [ 59.973881] niks3-server[1001]: 2026/09/23 04:43:21 INFO Registered completed upload object_key=nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst4551lb # [ 59.988534] niks3-server[1001]: 2026/09/23 04:43:21 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls4552lb # [ 59.991626] niks3-server[1001]: 2026/09/23 04:43:21 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4553worker1 # [ 60.029837] nix-grpc-daemon[906]: time=2026-09-23T04:43:21.549Z level=INFO msg="Upload complete. (214ms)"4554lb # [ 59.998783] niks3-server[1001]: 2026/09/23 04:43:21 INFO Completed upload id=134555lb # [ 60.001759] niks3-server[1001]: 2026/09/23 04:43:21 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo4556worker1 # [ 60.036144] nix-grpc-daemon[770]: ts=2026-09-23T04:43:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=0 paths=1 nar_bytes_in=7524557worker1 # [ 60.045977] nix-grpc-daemon[770]: ts=2026-09-23T04:43:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591064558worker1 # [ 60.049924] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4559worker1 # [ 60.053743] nix-daemon[855]: reaped child process 981, status = succeeded4560worker1 # [ 60.062233] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4561client # building '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' on lb:50051...4562client # farm-top> node-a: building knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4563lb # [ 60.178384] envoy[891]: conn peer=[2001:db8:1::1]:60118 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9562 tx=4361 ms=59154564lb # [ 60.183503] envoy[891]: conn peer=[2001:db8:1::1]:60100 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=824565lb # [ 60.189255] envoy[891]: conn peer=[2001:db8:1::1]:60106 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4185 tx=1897 ms=22124566client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4567client # farm-top> LOG-farm-top-sig4568worker1 # [ 61.152610] nix-daemon[855]: reaped child process 990, status = succeeded4569worker1 # [ 61.249069] nix-daemon[855]: accepted connection from pid 1006, user nix-grpc-daemon (trusted)4570worker1 # [ 61.272632] nix-daemon[855]: reaped child process 1009, status = succeeded4571lb # [ 61.245472] niks3-server[1001]: 2026/09/23 04:43:22 INFO Received uploads request method=POST path=/api/pending_closures4572worker1 # [ 61.291472] nix-grpc-daemon[906]: time=2026-09-23T04:43:22.808Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4573worker1 # [ 61.293526] nix-grpc-daemon[906]: time=2026-09-23T04:43:22.808Z level=INFO msg="Uploading 4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top (232B)"4574lb # [ 61.288535] niks3-server[1001]: 2026/09/23 04:43:22 INFO Registered completed upload object_key=nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst4575lb # [ 61.301211] niks3-server[1001]: 2026/09/23 04:43:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4576worker1 # [ 61.339638] nix-grpc-daemon[906]: time=2026-09-23T04:43:22.858Z level=INFO msg="Uploading 1 narinfos"4577lb # [ 61.311166] niks3-server[1001]: 2026/09/23 04:43:22 INFO Registered completed upload object_key=log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4578lb # [ 61.321600] niks3-server[1001]: 2026/09/23 04:43:22 INFO Signed narinfos id=14 count=14579lb # [ 61.323690] niks3-server[1001]: 2026/09/23 04:43:22 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4580worker1 # [ 61.364040] nix-grpc-daemon[906]: time=2026-09-23T04:43:22.883Z level=INFO msg="Upload complete. (291ms)"4581lb # [ 61.332217] niks3-server[1001]: 2026/09/23 04:43:22 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls4582lb # [ 61.334941] niks3-server[1001]: 2026/09/23 04:43:22 INFO Completed upload id=144583lb # [ 61.338473] niks3-server[1001]: 2026/09/23 04:43:22 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo4584worker1 # [ 61.370976] nix-grpc-daemon[770]: ts=2026-09-23T04:43:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=1 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv assign_id=7 outputs=14585worker1 # [ 61.383138] nix-daemon[855]: reaped child process 988, status = succeeded4586client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&2, in 5.89 seconds)4587client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath4588client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath, in 0.19 seconds)4589client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4590worker1 # [ 61.752421] nix-grpc-daemon[770]: ts=2026-09-23T04:43:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:384284591worker1 # [ 61.794359] nix-grpc-daemon[770]: ts=2026-09-23T04:43:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:384284592client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.25 seconds)4593client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4594worker2 # [ 62.060711] nix-grpc-daemon[773]: ts=2026-09-23T04:43:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:431784595client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):4596client # /nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a4597client # /nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b4598client # /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4599worker2 # [ 62.107934] nix-grpc-daemon[773]: ts=2026-09-23T04:43:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:431784600worker2 # [ 62.117035] nix-grpc-daemon[773]: copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'http://lb:5751'...4601worker2 # [ 62.134056] nix-grpc-daemon[773]: copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'http://lb:5751'...4602worker2 # [ 62.148653] nix-grpc-daemon[773]: copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'http://lb:5751'...4603client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.32 seconds)4604client: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4605client # finding garbage collector roots...4606client # removing stale temporary roots file "/nix/var/nix/temproots/849"4607client # removing stale temporary roots file "/nix/var/nix/temproots/906"4608client # removing stale temporary roots file "/nix/var/nix/temproots/886"4609client # removing stale temporary roots file "/nix/var/nix/temproots/898"4610client # removing stale temporary roots file "/nix/var/nix/temproots/927"4611client # removing stale temporary roots file "/nix/var/nix/temproots/919"4612client # removing stale temporary roots file "/nix/var/nix/temproots/865"4613client # removing stale temporary roots file "/nix/var/nix/temproots/942"4614client # deleting specified paths...4615client # deleting '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top'4616client # deleting unused links...4617client # note: hard linking is currently saving 0.0 KiB4618worker2 # [ 62.543526] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:327684619worker2 # [ 62.550098] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327684620worker2 # [ 62.558824] nix-grpc-daemon[856]: time=2026-09-23T04:43:24.076Z level=INFO msg="All 1 paths already cached"4621worker2 # [ 62.564372] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:327684622worker2 # [ 62.570817] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:327684623client # copying 3 paths...4624worker2 # [ 62.581219] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:327684625client # copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'grpc://lb:50051'...4626worker2 # [ 62.602854] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:327684627worker2 # [ 62.610474] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_out=2324628worker1 # [ 62.605238] nix-grpc-daemon[770]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:591064629worker1 # [ 62.613176] nix-grpc-daemon[770]: ts=2026-09-23T04:43:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=0 paths=1 nar_bytes_out=1764630worker2 # [ 62.628489] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:327684631worker2 # [ 62.635519] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_out=1284632client # copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'grpc://lb:50051'...4633client # copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'grpc://lb:50051'...4634client: (finished: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.54 seconds)4635(finished: subtest: outputs read back through any worker carry the cache signature, in 7.18 seconds)4636subtest: two clients wanting the same drv build it once4637client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4638client # [ 62.756751] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4639client # Running as unit: dedup1.service; invocation ID: ad6f64b680fc47738f58a1c368887b804640client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 0.06 seconds)4641client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4642worker2 # [ 62.971429] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:327684643client # [ 62.958294] nix[995]: don't know how to build these paths:4644client # [ 62.959435] nix[995]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4645worker1 # [ 62.978171] nix-grpc-daemon[770]: ts=2026-09-23T04:43:24Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04646worker1 # [ 62.983536] nix-grpc-daemon[770]: ts=2026-09-23T04:43:24Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14647worker2 # [ 63.039306] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327684648worker2 # [ 63.056096] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327684649client # [ 63.052176] nix[995]: copying 1 paths to 'lb:50051'...4650worker2 # [ 63.073122] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:327684651client # [ 63.054534] nix[995]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4652worker2 # [ 63.089157] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4653worker2 # [ 63.251400] nix-daemon[843]: accepted connection from pid 1006, user nix-grpc-daemon (trusted)4654worker2 # [ 63.272580] nix-daemon[843]: reaped child process 1009, status = succeeded4655lb # [ 63.234904] niks3-server[1001]: 2026/09/23 04:43:24 INFO Received uploads request method=POST path=/api/pending_closures4656worker2 # [ 63.289488] nix-grpc-daemon[856]: time=2026-09-23T04:43:24.807Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4657worker2 # [ 63.291094] nix-grpc-daemon[856]: time=2026-09-23T04:43:24.807Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4658lb # [ 63.269913] niks3-server[1001]: 2026/09/23 04:43:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4659worker2 # [ 63.328121] nix-grpc-daemon[856]: time=2026-09-23T04:43:24.846Z level=INFO msg="Uploading 1 narinfos"4660lb # [ 63.288410] niks3-server[1001]: 2026/09/23 04:43:24 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4661lb # [ 63.294388] niks3-server[1001]: 2026/09/23 04:43:24 INFO Signed narinfos id=15 count=14662lb # [ 63.303227] niks3-server[1001]: 2026/09/23 04:43:24 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4663lb # [ 63.313454] niks3-server[1001]: 2026/09/23 04:43:24 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4664worker2 # [ 63.363308] nix-grpc-daemon[856]: time=2026-09-23T04:43:24.881Z level=INFO msg="Upload complete. (256ms)"4665lb # [ 63.321130] niks3-server[1001]: 2026/09/23 04:43:24 INFO Completed upload id=154666lb # [ 63.324142] niks3-server[1001]: 2026/09/23 04:43:24 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4667worker2 # [ 63.377297] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_in=4324668worker2 # [ 63.391892] nix-grpc-daemon[773]: ts=2026-09-23T04:43:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327684669worker2 # [ 63.400414] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4670worker2 # [ 63.406265] nix-daemon[843]: reaped child process 1004, status = succeeded4671worker2 # [ 63.417259] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4672client # [ 63.397085] nix[995]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4673client # [ 63.852873] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4674client # Running as unit: dedup2.service; invocation ID: 54f9ab5bbf434548a16b761b7de44b4e4675client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 1.12 seconds)4676worker1 # [ 64.098428] nix-grpc-daemon[770]: ts=2026-09-23T04:43:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:591064677client # [ 64.099441] nix[1011]: don't know how to build these paths:4678client # [ 64.100692] nix[1011]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4679worker1 # [ 64.115144] nix-grpc-daemon[770]: ts=2026-09-23T04:43:25Z level=debug event=want client=6 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04680worker2 # [ 64.134263] nix-grpc-daemon[773]: ts=2026-09-23T04:43:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327684681client # [ 64.122404] nix[1011]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4682client: must succeed: sleep 24683client: (finished: must succeed: sleep 2, in 2.05 seconds)4684client: waiting for success: ! systemctl is-active dedup1 dedup24685worker2 # [ 67.446656] nix-daemon[843]: reaped child process 1013, status = succeeded4686worker2 # [ 67.546985] nix-daemon[843]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)4687worker2 # [ 67.570292] nix-daemon[843]: reaped child process 1046, status = succeeded4688lb # [ 67.525175] niks3-server[1001]: 2026/09/23 04:43:29 INFO Received uploads request method=POST path=/api/pending_closures4689worker2 # [ 67.588906] nix-grpc-daemon[856]: time=2026-09-23T04:43:29.107Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4690worker2 # [ 67.594021] nix-grpc-daemon[856]: time=2026-09-23T04:43:29.109Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4691lb # [ 67.579803] niks3-server[1001]: 2026/09/23 04:43:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4692worker2 # [ 67.633348] nix-grpc-daemon[856]: time=2026-09-23T04:43:29.151Z level=INFO msg="Uploading 1 narinfos"4693lb # [ 67.595493] niks3-server[1001]: 2026/09/23 04:43:29 INFO Signed narinfos id=16 count=14694lb # [ 67.603564] niks3-server[1001]: 2026/09/23 04:43:29 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4695lb # [ 67.612230] niks3-server[1001]: 2026/09/23 04:43:29 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4696lb # [ 67.615197] niks3-server[1001]: 2026/09/23 04:43:29 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4697lb # [ 67.628240] niks3-server[1001]: 2026/09/23 04:43:29 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4698lb # [ 67.634685] niks3-server[1001]: 2026/09/23 04:43:29 INFO Completed upload id=164699lb # [ 67.638416] niks3-server[1001]: 2026/09/23 04:43:29 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4700worker2 # [ 67.679421] nix-grpc-daemon[856]: time=2026-09-23T04:43:29.197Z level=INFO msg="Upload complete. (247ms)"4701worker2 # [ 67.688954] nix-grpc-daemon[773]: ts=2026-09-23T04:43:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14702worker2 # [ 67.700238] nix-grpc-daemon[773]: ts=2026-09-23T04:43:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14703worker2 # [ 67.707023] nix-daemon[843]: reaped child process 1011, status = succeeded4704client # [ 67.704902] systemd[1]: dedup2.service: Deactivated successfully.4705client # [ 67.709871] systemd[1]: dedup2.service: Consumed 208ms CPU time over 3.856s wall clock time, 35.2M memory peak, 5.9K incoming IP traffic, 5.6K outgoing IP traffic.4706client # [ 67.747104] systemd[1]: dedup1.service: Deactivated successfully.4707client # [ 67.750255] systemd[1]: dedup1.service: Consumed 176ms CPU time over 4.993s wall clock time, 39.5M memory peak, 7.2K incoming IP traffic, 8.5K outgoing IP traffic.4708client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.13 seconds)4709client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4710client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.06 seconds)4711worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4712worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4713worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4714worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4715worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4716worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4717worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4718worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4719(finished: subtest: two clients wanting the same drv build it once, in 6.13 seconds)4720subtest: --timeout and --max-silent-time reach the builder4721worker1 # [ 69.087490] nix-grpc-daemon[770]: ts=2026-09-23T04:43:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:591064722worker1 # [ 69.105299] nix-grpc-daemon[770]: ts=2026-09-23T04:43:30Z level=debug event=want client=7 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=04723worker1 # [ 69.112500] nix-grpc-daemon[770]: ts=2026-09-23T04:43:30Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.3:50051 clients=14724worker1 # [ 69.121626] nix-grpc-daemon[770]: ts=2026-09-23T04:43:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591064725worker1 # [ 69.133698] nix-grpc-daemon[770]: ts=2026-09-23T04:43:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591064726worker1 # [ 69.151775] nix-grpc-daemon[770]: ts=2026-09-23T04:43:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:591064727worker1 # [ 69.165977] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4728worker1 # [ 69.323042] nix-daemon[855]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4729worker1 # [ 69.348293] nix-daemon[855]: reaped child process 1043, status = succeeded4730lb # [ 69.321720] niks3-server[1001]: 2026/09/23 04:43:30 INFO Received uploads request method=POST path=/api/pending_closures4731worker1 # [ 69.364516] nix-grpc-daemon[906]: time=2026-09-23T04:43:30.883Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4732worker1 # [ 69.366474] nix-grpc-daemon[906]: time=2026-09-23T04:43:30.883Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)"4733lb # [ 69.360248] niks3-server[1001]: 2026/09/23 04:43:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4734worker1 # [ 69.401096] nix-grpc-daemon[906]: time=2026-09-23T04:43:30.920Z level=INFO msg="Uploading 1 narinfos"4735lb # [ 69.372687] niks3-server[1001]: 2026/09/23 04:43:30 INFO Signed narinfos id=17 count=14736lb # [ 69.380114] niks3-server[1001]: 2026/09/23 04:43:30 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls4737lb # [ 69.388580] niks3-server[1001]: 2026/09/23 04:43:30 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst4738worker1 # [ 69.435065] nix-grpc-daemon[906]: time=2026-09-23T04:43:30.954Z level=INFO msg="Upload complete. (253ms)"4739lb # [ 69.403269] niks3-server[1001]: 2026/09/23 04:43:30 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4740lb # [ 69.411507] niks3-server[1001]: 2026/09/23 04:43:30 INFO Completed upload id=174741lb # [ 69.416378] niks3-server[1001]: 2026/09/23 04:43:30 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo4742worker1 # [ 69.448973] nix-grpc-daemon[770]: ts=2026-09-23T04:43:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=0 paths=1 nar_bytes_in=4244743worker1 # [ 69.463722] nix-grpc-daemon[770]: ts=2026-09-23T04:43:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591064744worker1 # [ 69.469857] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4745worker1 # [ 69.474537] nix-daemon[855]: reaped child process 1038, status = succeeded4746worker1 # [ 69.487652] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4747lb # [ 70.181363] envoy[891]: conn peer=[2001:db8:1::1]:60108 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9584 tx=4414 ms=56504748lb # [ 70.186405] envoy[891]: conn peer=[2001:db8:1::1]:46540 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2887 ms=1654749lb # [ 70.192161] envoy[891]: conn peer=[2001:db8:1::1]:46572 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=814750lb # [ 70.196901] envoy[891]: conn peer=[2001:db8:1::1]:46566 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=944751lb # [ 70.201532] envoy[891]: conn peer=[2001:db8:1::1]:46550 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=409 ms=1074752lb # [ 70.206973] envoy[891]: conn peer=[2001:db8:1::1]:46588 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1198 ms=36034753lb # [ 70.212183] envoy[891]: conn peer=[2001:db8:1::1]:46576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3018 tx=1541 ms=47794754worker1 # [ 75.305703] nix-grpc-daemon[770]: ts=2026-09-23T04:43:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=5 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=9 outputs=04755worker1 # [ 75.347652] nix-daemon[855]: reaped child process 1045, status = succeeded4756worker1 # [ 75.350795] nix-daemon[855]: reaped child process 1047, status = succeeded4757worker1 # [ 75.550309] nix-grpc-daemon[770]: ts=2026-09-23T04:43:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:591064758worker1 # [ 75.566190] nix-grpc-daemon[770]: ts=2026-09-23T04:43:37Z level=debug event=want client=8 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=04759worker1 # [ 75.573036] nix-grpc-daemon[770]: ts=2026-09-23T04:43:37Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.4:50051 clients=14760worker2 # [ 75.589675] nix-grpc-daemon[773]: ts=2026-09-23T04:43:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327684761worker2 # [ 75.608321] nix-grpc-daemon[773]: ts=2026-09-23T04:43:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327684762worker2 # [ 75.623140] nix-grpc-daemon[773]: ts=2026-09-23T04:43:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:327684763worker2 # [ 75.638467] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4764worker2 # [ 75.800256] nix-daemon[843]: accepted connection from pid 1059, user nix-grpc-daemon (trusted)4765worker2 # [ 75.821044] nix-daemon[843]: reaped child process 1062, status = succeeded4766lb # [ 75.783815] niks3-server[1001]: 2026/09/23 04:43:37 INFO Received uploads request method=POST path=/api/pending_closures4767worker2 # [ 75.840744] nix-grpc-daemon[856]: time=2026-09-23T04:43:37.358Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4768worker2 # [ 75.842418] nix-grpc-daemon[856]: time=2026-09-23T04:43:37.358Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)"4769lb # [ 75.823664] niks3-server[1001]: 2026/09/23 04:43:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4770worker2 # [ 75.878420] nix-grpc-daemon[856]: time=2026-09-23T04:43:37.396Z level=INFO msg="Uploading 1 narinfos"4771lb # [ 75.836288] niks3-server[1001]: 2026/09/23 04:43:37 INFO Signed narinfos id=18 count=14772lb # [ 75.846226] niks3-server[1001]: 2026/09/23 04:43:37 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst4773lb # [ 75.856308] niks3-server[1001]: 2026/09/23 04:43:37 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls4774lb # [ 75.866722] niks3-server[1001]: 2026/09/23 04:43:37 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4775lb # [ 75.873697] niks3-server[1001]: 2026/09/23 04:43:37 INFO Completed upload id=184776worker2 # [ 75.917179] nix-grpc-daemon[856]: time=2026-09-23T04:43:37.435Z level=INFO msg="Upload complete. (261ms)"4777lb # [ 75.877182] niks3-server[1001]: 2026/09/23 04:43:37 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo4778worker2 # [ 75.928369] nix-grpc-daemon[773]: ts=2026-09-23T04:43:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_in=4244779worker2 # [ 75.948118] nix-grpc-daemon[773]: ts=2026-09-23T04:43:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327684780worker2 # [ 75.955905] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4781worker2 # [ 75.962187] nix-daemon[843]: reaped child process 1057, status = succeeded4782worker2 # [ 75.973695] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4783lb # [ 80.184559] envoy[891]: conn peer=[2001:db8:1::1]:46592 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3027 tx=952 ms=62494784worker2 # [ 81.791640] nix-grpc-daemon[773]: ts=2026-09-23T04:43:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=5 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=10 outputs=04785worker2 # [ 81.830102] nix-daemon[843]: reaped child process 1064, status = succeeded4786worker2 # [ 81.834067] nix-daemon[843]: reaped child process 1066, status = succeeded4787(finished: subtest: --timeout and --max-silent-time reach the builder, in 13.16 seconds)4788subtest: the first client leaving does not fail the second4789client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4790client # [ 82.069547] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4791client # Running as unit: share1.service; invocation ID: f9331f6e64c044a5b437aa847330800d4792client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 0.09 seconds)4793client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4794worker2 # [ 82.298052] nix-grpc-daemon[773]: ts=2026-09-23T04:43:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:327684795client # [ 82.285836] nix[1085]: don't know how to build these paths:4796client # [ 82.286810] nix[1085]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4797worker1 # [ 82.305426] nix-grpc-daemon[770]: ts=2026-09-23T04:43:43Z level=debug event=want client=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04798worker1 # [ 82.311952] nix-grpc-daemon[770]: ts=2026-09-23T04:43:43Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.3:50051 clients=14799worker1 # [ 82.322329] nix-grpc-daemon[770]: ts=2026-09-23T04:43:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591064800worker1 # [ 82.338029] nix-grpc-daemon[770]: ts=2026-09-23T04:43:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591064801client # [ 82.343477] nix[1085]: copying 1 paths to 'lb:50051'...4802client # [ 82.347776] nix[1085]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'...4803worker1 # [ 82.355743] nix-grpc-daemon[770]: ts=2026-09-23T04:43:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:591064804worker1 # [ 82.371740] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4805worker1 # [ 82.533346] nix-daemon[855]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4806worker1 # [ 82.551644] nix-daemon[855]: reaped child process 1077, status = succeeded4807lb # [ 82.530259] niks3-server[1001]: 2026/09/23 04:43:44 INFO Received uploads request method=POST path=/api/pending_closures4808worker1 # [ 82.571438] nix-grpc-daemon[906]: time=2026-09-23T04:43:44.090Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4809worker1 # [ 82.573389] nix-grpc-daemon[906]: time=2026-09-23T04:43:44.090Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)"4810lb # [ 82.563229] niks3-server[1001]: 2026/09/23 04:43:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4811worker1 # [ 82.604285] nix-grpc-daemon[906]: time=2026-09-23T04:43:44.123Z level=INFO msg="Uploading 1 narinfos"4812lb # [ 82.575374] niks3-server[1001]: 2026/09/23 04:43:44 INFO Signed narinfos id=19 count=14813lb # [ 82.585754] niks3-server[1001]: 2026/09/23 04:43:44 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls4814lb # [ 82.593959] niks3-server[1001]: 2026/09/23 04:43:44 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst4815lb # [ 82.607419] niks3-server[1001]: 2026/09/23 04:43:44 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4816lb # [ 82.612485] niks3-server[1001]: 2026/09/23 04:43:44 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo4817worker1 # [ 82.644813] nix-grpc-daemon[906]: time=2026-09-23T04:43:44.164Z level=INFO msg="Upload complete. (255ms)"4818lb # [ 82.615786] niks3-server[1001]: 2026/09/23 04:43:44 INFO Completed upload id=194819worker1 # [ 82.656484] nix-grpc-daemon[770]: ts=2026-09-23T04:43:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=0 paths=1 nar_bytes_in=4324820worker1 # [ 82.668694] nix-grpc-daemon[770]: ts=2026-09-23T04:43:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591064821worker1 # [ 82.680612] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4822worker1 # [ 82.686453] nix-daemon[855]: reaped child process 1072, status = succeeded4823client # [ 82.688952] nix[1085]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4824worker1 # [ 82.699430] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4825client # [ 83.177600] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4826client # Running as unit: share2.service; invocation ID: 413e0c2530d5482abee3d20c4723c1434827client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 1.12 seconds)4828worker2 # [ 83.415095] nix-grpc-daemon[773]: ts=2026-09-23T04:43:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:327684829client # [ 83.404381] nix[1101]: don't know how to build these paths:4830client # [ 83.405469] nix[1101]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4831worker1 # [ 83.422002] nix-grpc-daemon[770]: ts=2026-09-23T04:43:44Z level=debug event=want client=10 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04832client # [ 83.423553] nix[1101]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4833worker1 # [ 83.430138] nix-grpc-daemon[770]: ts=2026-09-23T04:43:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591064834client: must succeed: sleep 2; systemctl kill -s INT share14835client # [ 86.565476] systemd[1]: share1.service: Sent signal SIGINT to main process 1085 (nix) on client request.4836client # [ 86.576886] nix[1085]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)4837client # [ 86.584710] nix[1085]: [mutex.cc : 451] RAW: Unlock 0xfbf7089fc788 @ 0xfbfb0d0359a4 0xfbfb0e10d40c 0xfbfb2d5957bc 0xfbfb2d597414 0xfbfb2d58e1d4 0xfbfb2c5d4f7c 0xfbfb2c362d804838client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.09 seconds)4839client: waiting for success: ! systemctl is-active share14840client # [ 86.616851] systemd-coredump[1116]: Process 1085 (nix) of user 0 terminated abnormally with signal 11/SEGV, processing...4841client # [ 86.645683] systemd[1]: Created slice Slice /system/systemd-coredump.4842client # [ 86.653985] systemd[1]: Started Process Core Dump (PID 1116/UID 0).4843client # [ 89.158303] systemd-coredump[1121]: Cannot store coredump of 1085 (nix): No space left on device4844client # [ 89.288918] systemd-coredump[1121]: Process 1085 (nix) of user 0 terminated abnormally without generating a coredump.4845client # [ 89.309073] systemd[1]: systemd-coredump@0-1-1116_1117-0.service: Deactivated successfully.4846client # [ 89.310668] systemd[1]: systemd-coredump@0-1-1116_1117-0.service: Consumed 2.106s CPU time over 2.647s wall clock time, 968.8M memory peak, 926.5M written to disk.4847client # [ 89.319667] systemd[1]: share1.service: Main process exited, code=dumped, status=11/SEGV4848client # [ 89.323076] systemd[1]: share1.service: Failed with result 'core-dump'.4849client # [ 89.324513] systemd[1]: share1.service: Consumed 398ms CPU time over 7.253s wall clock time, 41.5M memory peak, 4K written to disk, 6.2K incoming IP traffic, 8.2K outgoing IP traffic.4850client: (finished: waiting for success: ! systemctl is-active share1, in 3.29 seconds)4851worker1 # [ 90.132610] nix-daemon[855]: reaped child process 1081, status = succeeded4852client: waiting for success: ! systemctl is-active share24853lb # [ 90.187818] envoy[891]: conn peer=[2001:db8:1::1]:39716 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2989 tx=977 ms=62934854lb # [ 90.193117] envoy[891]: conn peer=[2001:db8:1::1]:38418 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3029 tx=788 ms=70354855worker1 # [ 90.233800] nix-daemon[855]: accepted connection from pid 1117, user nix-grpc-daemon (trusted)4856worker1 # [ 90.257995] nix-daemon[855]: reaped child process 1120, status = succeeded4857lb # [ 90.230457] niks3-server[1001]: 2026/09/23 04:43:51 INFO Received uploads request method=POST path=/api/pending_closures4858worker1 # [ 90.275577] nix-grpc-daemon[906]: time=2026-09-23T04:43:51.792Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4859worker1 # [ 90.277275] nix-grpc-daemon[906]: time=2026-09-23T04:43:51.792Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)"4860lb # [ 90.285309] niks3-server[1001]: 2026/09/23 04:43:51 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4861lb # [ 90.296758] niks3-server[1001]: 2026/09/23 04:43:51 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst4862worker1 # [ 90.339094] nix-grpc-daemon[906]: time=2026-09-23T04:43:51.858Z level=INFO msg="Uploading 1 narinfos"4863lb # [ 90.306476] niks3-server[1001]: 2026/09/23 04:43:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4864lb # [ 90.314435] niks3-server[1001]: 2026/09/23 04:43:51 INFO Signed narinfos id=20 count=14865lb # [ 90.318762] niks3-server[1001]: 2026/09/23 04:43:51 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls4866lb # [ 90.327890] niks3-server[1001]: 2026/09/23 04:43:51 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4867worker1 # [ 90.365934] nix-grpc-daemon[906]: time=2026-09-23T04:43:51.885Z level=INFO msg="Upload complete. (249ms)"4868lb # [ 90.334175] niks3-server[1001]: 2026/09/23 04:43:51 INFO Completed upload id=204869lb # [ 90.339124] niks3-server[1001]: 2026/09/23 04:43:51 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo4870worker1 # [ 90.381410] nix-grpc-daemon[770]: ts=2026-09-23T04:43:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=6 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14871worker1 # [ 90.399508] nix-grpc-daemon[770]: ts=2026-09-23T04:43:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=7 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14872worker1 # [ 90.405551] nix-daemon[855]: reaped child process 1079, status = succeeded4873client # [ 90.461038] systemd[1]: share2.service: Deactivated successfully.4874client # [ 90.466239] systemd[1]: share2.service: Consumed 200ms CPU time over 7.289s wall clock time, 33.3M memory peak, 4K written to disk, 6.1K incoming IP traffic, 5.7K outgoing IP traffic.4875client: (finished: waiting for success: ! systemctl is-active share2, in 1.18 seconds)4876client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }4877client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.07 seconds)4878(finished: subtest: the first client leaving does not fail the second, in 9.40 seconds)4879subtest: build hook: nix-daemon with builders = grpc://lb4880client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log4881client # [ 91.588446] systemd[1]: Started Nix Daemon.4882client # [ 91.748881] nix-daemon[1167]: accepted connection from pid 1164, user root (trusted)4883worker1 # [ 91.967116] nix-grpc-daemon[770]: ts=2026-09-23T04:43:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:591064884worker2 # [ 91.988424] nix-grpc-daemon[773]: ts=2026-09-23T04:43:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327684885worker1 # [ 91.994010] nix-grpc-daemon[770]: ts=2026-09-23T04:43:53Z level=debug event=want client=11 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04886worker1 # [ 92.001823] nix-grpc-daemon[770]: ts=2026-09-23T04:43:53Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14887worker2 # [ 92.018998] nix-grpc-daemon[773]: ts=2026-09-23T04:43:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327684888worker2 # [ 92.040902] nix-grpc-daemon[773]: ts=2026-09-23T04:43:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327684889worker2 # [ 92.062845] nix-grpc-daemon[773]: ts=2026-09-23T04:43:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:327684890worker2 # [ 92.082164] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4891worker2 # [ 92.320209] nix-daemon[843]: accepted connection from pid 1105, user nix-grpc-daemon (trusted)4892worker2 # [ 92.342960] nix-daemon[843]: reaped child process 1108, status = succeeded4893lb # [ 92.311221] niks3-server[1001]: 2026/09/23 04:43:53 INFO Received uploads request method=POST path=/api/pending_closures4894worker2 # [ 92.366036] nix-grpc-daemon[856]: time=2026-09-23T04:43:53.883Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4895worker2 # [ 92.367653] nix-grpc-daemon[856]: time=2026-09-23T04:43:53.883Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4896worker2 # [ 92.420111] nix-grpc-daemon[856]: time=2026-09-23T04:43:53.937Z level=INFO msg="Uploading 1 narinfos"4897lb # [ 92.358938] niks3-server[1001]: 2026/09/23 04:43:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4898lb # [ 92.379993] niks3-server[1001]: 2026/09/23 04:43:53 INFO Signed narinfos id=21 count=14899lb # [ 92.388807] niks3-server[1001]: 2026/09/23 04:43:53 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4900lb # [ 92.398901] niks3-server[1001]: 2026/09/23 04:43:53 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4901lb # [ 92.413979] niks3-server[1001]: 2026/09/23 04:43:53 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4902worker2 # [ 92.469020] nix-grpc-daemon[856]: time=2026-09-23T04:43:53.987Z level=INFO msg="Upload complete. (361ms)"4903lb # [ 92.426800] niks3-server[1001]: 2026/09/23 04:43:53 INFO Completed upload id=214904lb # [ 92.429708] niks3-server[1001]: 2026/09/23 04:43:53 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4905worker2 # [ 92.485109] nix-grpc-daemon[773]: ts=2026-09-23T04:43:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_in=5124906worker2 # [ 92.496605] nix-grpc-daemon[773]: ts=2026-09-23T04:43:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327684907worker2 # [ 92.519128] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4908worker2 # [ 92.528264] nix-daemon[843]: reaped child process 1103, status = succeeded4909worker2 # [ 92.546299] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4910worker2 # [ 93.801370] nix-daemon[843]: reaped child process 1112, status = succeeded4911worker2 # [ 93.906707] nix-daemon[843]: accepted connection from pid 1128, user nix-grpc-daemon (trusted)4912worker2 # [ 93.930387] nix-daemon[843]: reaped child process 1131, status = succeeded4913lb # [ 93.885269] niks3-server[1001]: 2026/09/23 04:43:55 INFO Received uploads request method=POST path=/api/pending_closures4914worker2 # [ 93.942429] nix-grpc-daemon[856]: time=2026-09-23T04:43:55.458Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4915worker2 # [ 93.944070] nix-grpc-daemon[856]: time=2026-09-23T04:43:55.459Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4916lb # [ 93.927008] niks3-server[1001]: 2026/09/23 04:43:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4917worker2 # [ 93.981457] nix-grpc-daemon[856]: time=2026-09-23T04:43:55.499Z level=INFO msg="Uploading 1 narinfos"4918lb # [ 93.941251] niks3-server[1001]: 2026/09/23 04:43:55 INFO Signed narinfos id=22 count=14919lb # [ 93.949486] niks3-server[1001]: 2026/09/23 04:43:55 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4920worker2 # [ 94.004990] nix-grpc-daemon[856]: time=2026-09-23T04:43:55.523Z level=INFO msg="Upload complete. (242ms)"4921lb # [ 93.957816] niks3-server[1001]: 2026/09/23 04:43:55 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4922lb # [ 93.969109] niks3-server[1001]: 2026/09/23 04:43:55 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4923worker2 # [ 94.014160] nix-grpc-daemon[773]: ts=2026-09-23T04:43:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=12 outputs=14924lb # [ 93.975488] niks3-server[1001]: 2026/09/23 04:43:55 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4925lb # [ 93.979895] niks3-server[1001]: 2026/09/23 04:43:55 INFO Completed upload id=224926lb # [ 93.983518] niks3-server[1001]: 2026/09/23 04:43:55 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4927worker2 # [ 94.031893] nix-grpc-daemon[773]: ts=2026-09-23T04:43:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:327684928worker2 # [ 94.036080] nix-daemon[843]: reaped child process 1110, status = succeeded4929worker2 # [ 94.049975] nix-grpc-daemon[773]: ts=2026-09-23T04:43:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:327684930worker2 # [ 94.055486] nix-grpc-daemon[773]: ts=2026-09-23T04:43:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_out=1284931worker1 # [ 94.337720] nix-grpc-daemon[770]: ts=2026-09-23T04:43:55Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:591064932worker2 # [ 94.352639] nix-grpc-daemon[773]: ts=2026-09-23T04:43:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327684933worker2 # [ 94.417944] nix-grpc-daemon[856]: time=2026-09-23T04:43:55.936Z level=INFO msg="All 1 paths already cached"4934worker1 # [ 94.428252] nix-grpc-daemon[770]: ts=2026-09-23T04:43:55Z level=debug event=want client=12 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04935worker1 # [ 94.434681] nix-grpc-daemon[770]: ts=2026-09-23T04:43:55Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14936worker2 # [ 94.493691] nix-grpc-daemon[773]: ts=2026-09-23T04:43:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327684937worker2 # [ 94.509401] nix-grpc-daemon[773]: ts=2026-09-23T04:43:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327684938worker2 # [ 94.527195] nix-grpc-daemon[856]: time=2026-09-23T04:43:56.045Z level=INFO msg="All 1 paths already cached"4939worker2 # [ 94.537353] nix-grpc-daemon[773]: ts=2026-09-23T04:43:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:327684940worker2 # [ 94.551756] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4941worker2 # [ 94.719693] nix-daemon[843]: accepted connection from pid 1135, user nix-grpc-daemon (trusted)4942worker2 # [ 94.739011] nix-daemon[843]: reaped child process 1138, status = succeeded4943lb # [ 94.698199] niks3-server[1001]: 2026/09/23 04:43:56 INFO Received uploads request method=POST path=/api/pending_closures4944worker2 # [ 94.752887] nix-grpc-daemon[856]: time=2026-09-23T04:43:56.271Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4945worker2 # [ 94.754570] nix-grpc-daemon[856]: time=2026-09-23T04:43:56.271Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4946lb # [ 94.728994] niks3-server[1001]: 2026/09/23 04:43:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4947worker2 # [ 94.782148] nix-grpc-daemon[856]: time=2026-09-23T04:43:56.300Z level=INFO msg="Uploading 1 narinfos"4948lb # [ 94.741301] niks3-server[1001]: 2026/09/23 04:43:56 INFO Signed narinfos id=23 count=14949lb # [ 94.751350] niks3-server[1001]: 2026/09/23 04:43:56 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4950lb # [ 94.761542] niks3-server[1001]: 2026/09/23 04:43:56 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4951worker2 # [ 94.817042] nix-grpc-daemon[856]: time=2026-09-23T04:43:56.335Z level=INFO msg="Upload complete. (247ms)"4952lb # [ 94.775633] niks3-server[1001]: 2026/09/23 04:43:56 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4953lb # [ 94.785233] niks3-server[1001]: 2026/09/23 04:43:56 INFO Completed upload id=234954worker2 # [ 94.828533] nix-grpc-daemon[773]: ts=2026-09-23T04:43:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_in=6244955lb # [ 94.788105] niks3-server[1001]: 2026/09/23 04:43:56 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4956worker2 # [ 94.844508] nix-grpc-daemon[773]: ts=2026-09-23T04:43:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327684957worker2 # [ 94.852444] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4958worker2 # [ 94.857751] nix-daemon[843]: reaped child process 1133, status = succeeded4959worker2 # [ 94.869264] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4960worker2 # [ 95.497016] nix-daemon[843]: reaped child process 1142, status = succeeded4961worker2 # [ 95.609556] nix-daemon[843]: accepted connection from pid 1158, user nix-grpc-daemon (trusted)4962worker2 # [ 95.632903] nix-daemon[843]: reaped child process 1161, status = succeeded4963lb # [ 95.594150] niks3-server[1001]: 2026/09/23 04:43:57 INFO Received uploads request method=POST path=/api/pending_closures4964worker2 # [ 95.648426] nix-grpc-daemon[856]: time=2026-09-23T04:43:57.165Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4965worker2 # [ 95.649895] nix-grpc-daemon[856]: time=2026-09-23T04:43:57.165Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4966lb # [ 95.638460] niks3-server[1001]: 2026/09/23 04:43:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4967worker2 # [ 95.688346] nix-grpc-daemon[856]: time=2026-09-23T04:43:57.206Z level=INFO msg="Uploading 1 narinfos"4968lb # [ 95.651336] niks3-server[1001]: 2026/09/23 04:43:57 INFO Signed narinfos id=24 count=14969lb # [ 95.658913] niks3-server[1001]: 2026/09/23 04:43:57 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4970worker2 # [ 95.715236] nix-grpc-daemon[856]: time=2026-09-23T04:43:57.233Z level=INFO msg="Upload complete. (234ms)"4971lb # [ 95.671290] niks3-server[1001]: 2026/09/23 04:43:57 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4972lb # [ 95.678548] niks3-server[1001]: 2026/09/23 04:43:57 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4973lb # [ 95.684331] niks3-server[1001]: 2026/09/23 04:43:57 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4974lb # [ 95.690730] niks3-server[1001]: 2026/09/23 04:43:57 INFO Completed upload id=244975worker2 # [ 95.724967] nix-grpc-daemon[773]: ts=2026-09-23T04:43:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=13 outputs=14976lb # [ 95.693352] niks3-server[1001]: 2026/09/23 04:43:57 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4977worker2 # [ 95.740974] nix-daemon[843]: reaped child process 1140, status = succeeded4978worker1 # [ 95.765712] nix-grpc-daemon[770]: ts=2026-09-23T04:43:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:591064979worker1 # [ 95.786856] nix-grpc-daemon[770]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4980worker1 # [ 95.804924] nix-grpc-daemon[770]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4981worker2 # [ 95.857360] nix-grpc-daemon[773]: ts=2026-09-23T04:43:57Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:327684982worker2 # [ 95.864627] nix-grpc-daemon[773]: ts=2026-09-23T04:43:57Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_out=1764983worker1 # [ 96.102826] nix-grpc-daemon[770]: ts=2026-09-23T04:43:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:591064984worker2 # [ 96.121067] nix-grpc-daemon[773]: ts=2026-09-23T04:43:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327684985worker2 # [ 96.343680] nix-grpc-daemon[856]: time=2026-09-23T04:43:57.862Z level=INFO msg="All 2 paths already cached"4986worker1 # [ 96.356440] nix-grpc-daemon[770]: ts=2026-09-23T04:43:57Z level=debug event=want client=13 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04987worker1 # [ 96.362953] nix-grpc-daemon[770]: ts=2026-09-23T04:43:57Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14988worker2 # [ 96.379643] nix-grpc-daemon[773]: ts=2026-09-23T04:43:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327684989worker2 # [ 96.397706] nix-grpc-daemon[773]: ts=2026-09-23T04:43:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327684990worker2 # [ 96.417395] nix-grpc-daemon[856]: time=2026-09-23T04:43:57.935Z level=INFO msg="All 2 paths already cached"4991worker2 # [ 96.428922] nix-grpc-daemon[773]: ts=2026-09-23T04:43:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:327684992worker2 # [ 96.443911] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4993worker2 # [ 96.608411] nix-daemon[843]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)4994worker2 # [ 96.629192] nix-daemon[843]: reaped child process 1168, status = succeeded4995lb # [ 96.589447] niks3-server[1001]: 2026/09/23 04:43:58 INFO Received uploads request method=POST path=/api/pending_closures4996worker2 # [ 96.645478] nix-grpc-daemon[856]: time=2026-09-23T04:43:58.163Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4997worker2 # [ 96.647167] nix-grpc-daemon[856]: time=2026-09-23T04:43:58.163Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4998lb # [ 96.622534] niks3-server[1001]: 2026/09/23 04:43:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4999worker2 # [ 96.677922] nix-grpc-daemon[856]: time=2026-09-23T04:43:58.195Z level=INFO msg="Uploading 1 narinfos"5000lb # [ 96.642730] niks3-server[1001]: 2026/09/23 04:43:58 INFO Signed narinfos id=25 count=15001lb # [ 96.648964] niks3-server[1001]: 2026/09/23 04:43:58 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls5002lb # [ 96.659650] niks3-server[1001]: 2026/09/23 04:43:58 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst5003lb # [ 96.663919] niks3-server[1001]: 2026/09/23 04:43:58 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5004lb # [ 96.669279] niks3-server[1001]: 2026/09/23 04:43:58 INFO Completed upload id=255005worker2 # [ 96.712637] nix-grpc-daemon[856]: time=2026-09-23T04:43:58.231Z level=INFO msg="Upload complete. (250ms)"5006lb # [ 96.674564] niks3-server[1001]: 2026/09/23 04:43:58 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo5007worker2 # [ 96.725413] nix-grpc-daemon[773]: ts=2026-09-23T04:43:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_in=7525008worker2 # [ 96.740241] nix-grpc-daemon[773]: ts=2026-09-23T04:43:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327685009worker2 # [ 96.746514] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5010worker2 # [ 96.751241] nix-daemon[843]: reaped child process 1163, status = succeeded5011worker2 # [ 96.763220] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5012worker2 # [ 98.470879] nix-daemon[843]: reaped child process 1172, status = succeeded5013worker2 # [ 98.538676] nix-daemon[843]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5014worker2 # [ 98.560471] nix-daemon[843]: reaped child process 1191, status = succeeded5015lb # [ 98.521870] niks3-server[1001]: 2026/09/23 04:44:00 INFO Received uploads request method=POST path=/api/pending_closures5016worker2 # [ 98.576427] nix-grpc-daemon[856]: time=2026-09-23T04:44:00.094Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5017worker2 # [ 98.578135] nix-grpc-daemon[856]: time=2026-09-23T04:44:00.094Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"5018worker2 # [ 98.623142] nix-grpc-daemon[856]: time=2026-09-23T04:44:00.141Z level=INFO msg="Uploading 1 narinfos"5019lb # [ 98.567102] niks3-server[1001]: 2026/09/23 04:44:00 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv5020lb # [ 98.582618] niks3-server[1001]: 2026/09/23 04:44:00 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst5021lb # [ 98.593128] niks3-server[1001]: 2026/09/23 04:44:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5022lb # [ 98.603867] niks3-server[1001]: 2026/09/23 04:44:00 INFO Signed narinfos id=26 count=15023worker2 # [ 98.648456] nix-grpc-daemon[856]: time=2026-09-23T04:44:00.167Z level=INFO msg="Upload complete. (272ms)"5024lb # [ 98.609987] niks3-server[1001]: 2026/09/23 04:44:00 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls5025lb # [ 98.616176] niks3-server[1001]: 2026/09/23 04:44:00 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5026worker2 # [ 98.661115] nix-grpc-daemon[773]: ts=2026-09-23T04:44:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=14 outputs=15027lb # [ 98.621454] niks3-server[1001]: 2026/09/23 04:44:00 INFO Completed upload id=265028lb # [ 98.624979] niks3-server[1001]: 2026/09/23 04:44:00 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo5029worker2 # [ 98.679250] nix-daemon[843]: reaped child process 1170, status = succeeded5030worker1 # [ 98.666150] nix-grpc-daemon[770]: ts=2026-09-23T04:44:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:591065031worker1 # [ 98.678119] nix-grpc-daemon[770]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...5032worker2 # [ 98.730103] nix-grpc-daemon[773]: ts=2026-09-23T04:44:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:327685033worker2 # [ 98.737582] nix-grpc-daemon[773]: ts=2026-09-23T04:44:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_out=2325034client # [ 98.804775] nix-daemon[1167]: reaped child process 1169, status = succeeded5035client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.43 seconds)5036client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top5037client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)5038client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5039client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)5040client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5041client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)5042(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.54 seconds)5043subtest: an input only one worker has still reaches the builder5044client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only5045client # this derivation will be built:5046client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv5047client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...5048client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only, in 0.30 seconds)5049client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure5050client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.12 seconds)5051worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5052worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds)5053worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only5054worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds)5055client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&25056client # [ 99.786664] nix-daemon[1167]: accepted connection from pid 1250, user root (trusted)5057client # this derivation will be built:5058client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5059client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5060worker1 # [ 99.956348] nix-grpc-daemon[770]: ts=2026-09-23T04:44:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:591065061worker2 # [ 99.973419] nix-grpc-daemon[773]: ts=2026-09-23T04:44:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327685062client # copying 1 paths...5063client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...5064worker2 # [ 99.990692] nix-grpc-daemon[773]: ts=2026-09-23T04:44:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:327685065worker2 # [ 100.006272] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5066worker2 # [ 100.175944] nix-daemon[843]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)5067worker2 # [ 100.199782] nix-daemon[843]: reaped child process 1201, status = succeeded5068lb # [ 100.159750] niks3-server[1001]: 2026/09/23 04:44:01 INFO Received uploads request method=POST path=/api/pending_closures5069worker2 # [ 100.217189] nix-grpc-daemon[856]: time=2026-09-23T04:44:01.735Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5070worker2 # [ 100.219824] nix-grpc-daemon[856]: time=2026-09-23T04:44:01.737Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"5071lb # [ 100.191702] envoy[891]: conn peer=[2001:db8:1::1]:38420 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1197 ms=70345072lb # [ 100.206595] envoy[891]: conn peer=[2001:db8:1::1]:57584 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3414 tx=1943 ms=21415073worker2 # [ 100.265443] nix-grpc-daemon[856]: time=2026-09-23T04:44:01.783Z level=INFO msg="Uploading 1 narinfos"5074lb # [ 100.223322] envoy[891]: conn peer=[2001:db8:1::1]:57596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=333 ms=675075lb # [ 100.236773] envoy[891]: conn peer=[2001:db8:1::1]:57598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3871 tx=2141 ms=15365076lb # [ 100.249644] envoy[891]: conn peer=[2001:db8:1::1]:57602 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=315077lb # [ 100.259335] envoy[891]: conn peer=[2001:db8:1::1]:57608 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2392 ms=26425078worker2 # [ 100.316508] nix-grpc-daemon[856]: time=2026-09-23T04:44:01.834Z level=INFO msg="Upload complete. (292ms)"5079lb # [ 100.273297] envoy[891]: conn peer=[2001:db8:1::1]:57612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=295080lb # [ 100.278908] niks3-server[1001]: 2026/09/23 04:44:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5081lb # [ 100.285098] niks3-server[1001]: 2026/09/23 04:44:01 INFO Signed narinfos id=27 count=15082lb # [ 100.287423] niks3-server[1001]: 2026/09/23 04:44:01 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls5083worker2 # [ 100.328468] nix-grpc-daemon[773]: ts=2026-09-23T04:44:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_in=1205084lb # [ 100.291641] niks3-server[1001]: 2026/09/23 04:44:01 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5085lb # [ 100.297657] niks3-server[1001]: 2026/09/23 04:44:01 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5086lb # [ 100.302701] niks3-server[1001]: 2026/09/23 04:44:01 INFO Completed upload id=275087worker2 # [ 100.350503] nix-daemon[843]: reaped child process 1196, status = succeeded5088lb # [ 100.305333] niks3-server[1001]: 2026/09/23 04:44:01 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo5089worker1 # [ 100.341623] nix-grpc-daemon[770]: ts=2026-09-23T04:44:01Z level=debug event=want client=14 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=05090worker1 # [ 100.350785] nix-grpc-daemon[770]: ts=2026-09-23T04:44:01Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=15091worker1 # [ 100.390660] nix-grpc-daemon[770]: ts=2026-09-23T04:44:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591065092worker1 # [ 100.412823] nix-grpc-daemon[770]: ts=2026-09-23T04:44:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591065093client # copying 2 paths to 'lb:50051'...5094client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...5095worker1 # [ 100.439190] nix-grpc-daemon[770]: ts=2026-09-23T04:44:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:591065096client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...5097worker1 # [ 100.460772] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)5098worker1 # [ 100.627002] nix-daemon[855]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)5099worker1 # [ 100.648244] nix-daemon[855]: reaped child process 1143, status = succeeded5100lb # [ 100.619692] niks3-server[1001]: 2026/09/23 04:44:02 INFO Received uploads request method=POST path=/api/pending_closures5101lb # [ 100.630051] niks3-server[1001]: 2026/09/23 04:44:02 INFO Received uploads request method=POST path=/api/pending_closures5102worker1 # [ 100.672535] nix-grpc-daemon[906]: time=2026-09-23T04:44:02.191Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5103worker1 # [ 100.674495] nix-grpc-daemon[906]: time=2026-09-23T04:44:02.191Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"5104worker1 # [ 100.680509] nix-grpc-daemon[906]: time=2026-09-23T04:44:02.191Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"5105lb # [ 100.681045] niks3-server[1001]: 2026/09/23 04:44:02 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst5106lb # [ 100.692368] niks3-server[1001]: 2026/09/23 04:44:02 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst5107lb # [ 100.706758] niks3-server[1001]: 2026/09/23 04:44:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5108worker1 # [ 100.740148] nix-grpc-daemon[906]: time=2026-09-23T04:44:02.258Z level=INFO msg="Uploading 3 narinfos"5109lb # [ 100.713637] niks3-server[1001]: 2026/09/23 04:44:02 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls5110lb # [ 100.719200] niks3-server[1001]: 2026/09/23 04:44:02 INFO Signed narinfos id=29 count=25111lb # [ 100.723266] niks3-server[1001]: 2026/09/23 04:44:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5112lb # [ 100.731325] niks3-server[1001]: 2026/09/23 04:44:02 INFO Signed narinfos id=28 count=15113lb # [ 100.735401] niks3-server[1001]: 2026/09/23 04:44:02 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls5114lb # [ 100.745544] niks3-server[1001]: 2026/09/23 04:44:02 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo5115lb # [ 100.755164] niks3-server[1001]: 2026/09/23 04:44:02 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5116lb # [ 100.763143] niks3-server[1001]: 2026/09/23 04:44:02 INFO Completed upload id=285117worker1 # [ 100.795792] nix-grpc-daemon[906]: time=2026-09-23T04:44:02.315Z level=INFO msg="Upload complete. (313ms)"5118lb # [ 100.765065] niks3-server[1001]: 2026/09/23 04:44:02 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5119lb # [ 100.768270] niks3-server[1001]: 2026/09/23 04:44:02 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo5120lb # [ 100.771916] niks3-server[1001]: 2026/09/23 04:44:02 INFO Completed upload id=295121lb # [ 100.774795] niks3-server[1001]: 2026/09/23 04:44:02 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo5122worker1 # [ 100.807899] nix-grpc-daemon[770]: ts=2026-09-23T04:44:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=0 paths=2 nar_bytes_in=9845123worker1 # [ 100.824673] nix-grpc-daemon[770]: ts=2026-09-23T04:44:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591065124worker1 # [ 100.835165] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)5125worker1 # [ 100.843527] nix-daemon[855]: reaped child process 1138, status = succeeded5126client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...5127worker1 # [ 100.857049] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)5128client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5129client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds5130worker1 # [ 101.936288] nix-daemon[855]: reaped child process 1147, status = succeeded5131worker1 # [ 102.027158] nix-daemon[855]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5132worker1 # [ 102.047649] nix-daemon[855]: reaped child process 1166, status = succeeded5133lb # [ 102.014836] niks3-server[1001]: 2026/09/23 04:44:03 INFO Received uploads request method=POST path=/api/pending_closures5134worker1 # [ 102.060129] nix-grpc-daemon[906]: time=2026-09-23T04:44:03.576Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5135lb # [ 102.043480] niks3-server[1001]: 2026/09/23 04:44:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5136worker1 # [ 102.084689] nix-grpc-daemon[906]: time=2026-09-23T04:44:03.604Z level=INFO msg="Uploading 1 narinfos"5137lb # [ 102.054817] niks3-server[1001]: 2026/09/23 04:44:03 INFO Signed narinfos id=30 count=15138lb # [ 102.066084] niks3-server[1001]: 2026/09/23 04:44:03 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5139lb # [ 102.080623] niks3-server[1001]: 2026/09/23 04:44:03 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls5140worker1 # [ 102.119693] nix-grpc-daemon[906]: time=2026-09-23T04:44:03.639Z level=INFO msg="Upload complete. (247ms)"5141lb # [ 102.088041] niks3-server[1001]: 2026/09/23 04:44:03 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5142lb # [ 102.093603] niks3-server[1001]: 2026/09/23 04:44:03 INFO Completed upload id=305143lb # [ 102.097428] niks3-server[1001]: 2026/09/23 04:44:03 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo5144worker1 # [ 102.132923] nix-grpc-daemon[770]: ts=2026-09-23T04:44:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=15 outputs=15145worker1 # [ 102.146084] nix-daemon[855]: reaped child process 1145, status = succeeded5146client # copying 1 paths...5147worker1 # [ 102.178732] nix-grpc-daemon[770]: ts=2026-09-23T04:44:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:591065148client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...5149worker2 # [ 102.227841] nix-grpc-daemon[773]: ts=2026-09-23T04:44:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:327685150worker2 # [ 102.241549] nix-grpc-daemon[773]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...5151worker2 # [ 102.258121] nix-grpc-daemon[773]: ts=2026-09-23T04:44:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_out=1205152client # [ 102.374977] nix-daemon[1167]: reaped child process 1253, status = succeeded5153client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.79 seconds)5154client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&25155client # [ 102.541187] nix-daemon[1167]: accepted connection from pid 1272, user root (trusted)5156client # this derivation will be built:5157client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5158worker2 # [ 102.716040] nix-grpc-daemon[773]: ts=2026-09-23T04:44:04Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:327685159client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5160worker1 # [ 102.708801] nix-grpc-daemon[770]: ts=2026-09-23T04:44:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591065161worker1 # [ 102.719329] nix-grpc-daemon[906]: time=2026-09-23T04:44:04.238Z level=INFO msg="All 1 paths already cached"5162worker1 # [ 102.737536] nix-grpc-daemon[770]: ts=2026-09-23T04:44:04Z level=debug event=want client=15 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=05163worker1 # [ 102.744405] nix-grpc-daemon[770]: ts=2026-09-23T04:44:04Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15164worker2 # [ 102.759881] nix-grpc-daemon[773]: ts=2026-09-23T04:44:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327685165worker2 # [ 102.776562] nix-grpc-daemon[773]: ts=2026-09-23T04:44:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327685166client # copying 1 paths to 'lb:50051'...5167client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...5168worker2 # [ 102.799853] nix-grpc-daemon[773]: ts=2026-09-23T04:44:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:327685169worker2 # [ 102.815023] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5170worker2 # [ 102.837746] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5)5171worker2 # [ 102.915133] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 2/5)5172worker2 # [ 102.924643] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 3/5)5173worker2 # [ 103.080416] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 429 ms (attempt 4/5)5174worker2 # [ 103.513303] nix-grpc-daemon[773]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5175worker2 # [ 103.521363] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5176worker2 # [ 103.528872] nix-grpc-daemon[773]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...5177worker2 # [ 103.693936] nix-daemon[843]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5178worker2 # [ 103.720376] nix-daemon[843]: reaped child process 1214, status = succeeded5179lb # [ 103.674736] niks3-server[1001]: 2026/09/23 04:44:05 INFO Received uploads request method=POST path=/api/pending_closures5180worker2 # [ 103.729430] nix-grpc-daemon[856]: time=2026-09-23T04:44:05.247Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5181worker2 # [ 103.731019] nix-grpc-daemon[856]: time=2026-09-23T04:44:05.247Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"5182lb # [ 103.702804] niks3-server[1001]: 2026/09/23 04:44:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5183worker2 # [ 103.756704] nix-grpc-daemon[856]: time=2026-09-23T04:44:05.275Z level=INFO msg="Uploading 1 narinfos"5184lb # [ 103.716947] niks3-server[1001]: 2026/09/23 04:44:05 INFO Signed narinfos id=31 count=15185lb # [ 103.724509] niks3-server[1001]: 2026/09/23 04:44:05 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst5186lb # [ 103.738411] niks3-server[1001]: 2026/09/23 04:44:05 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5187worker2 # [ 103.792964] nix-grpc-daemon[856]: time=2026-09-23T04:44:05.311Z level=INFO msg="Upload complete. (251ms)"5188lb # [ 103.749219] niks3-server[1001]: 2026/09/23 04:44:05 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls5189lb # [ 103.754978] niks3-server[1001]: 2026/09/23 04:44:05 INFO Completed upload id=315190lb # [ 103.758926] niks3-server[1001]: 2026/09/23 04:44:05 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo5191worker2 # [ 103.803744] nix-grpc-daemon[773]: ts=2026-09-23T04:44:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_in=5685192worker2 # [ 103.812320] nix-grpc-daemon[773]: ts=2026-09-23T04:44:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:327685193worker2 # [ 103.824806] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5194worker2 # [ 103.830127] nix-daemon[843]: reaped child process 1204, status = succeeded5195client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...5196worker2 # [ 103.841573] nix-daemon[843]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5197client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5198client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds5199worker2 # [ 105.302961] nix-daemon[843]: reaped child process 1218, status = succeeded5200worker2 # [ 105.431512] nix-daemon[843]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5201worker2 # [ 105.454605] nix-daemon[843]: reaped child process 1237, status = succeeded5202lb # [ 105.409364] niks3-server[1001]: 2026/09/23 04:44:06 INFO Received uploads request method=POST path=/api/pending_closures5203worker2 # [ 105.464520] nix-grpc-daemon[856]: time=2026-09-23T04:44:06.981Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5204lb # [ 105.439230] niks3-server[1001]: 2026/09/23 04:44:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5205worker2 # [ 105.493881] nix-grpc-daemon[856]: time=2026-09-23T04:44:07.012Z level=INFO msg="Uploading 1 narinfos"5206lb # [ 105.455039] niks3-server[1001]: 2026/09/23 04:44:06 INFO Signed narinfos id=32 count=15207lb # [ 105.462378] niks3-server[1001]: 2026/09/23 04:44:06 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls5208worker2 # [ 105.517868] nix-grpc-daemon[856]: time=2026-09-23T04:44:07.036Z level=INFO msg="Upload complete. (266ms)"5209lb # [ 105.472657] niks3-server[1001]: 2026/09/23 04:44:06 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5210lb # [ 105.479370] niks3-server[1001]: 2026/09/23 04:44:06 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5211lb # [ 105.486443] niks3-server[1001]: 2026/09/23 04:44:07 INFO Completed upload id=325212worker2 # [ 105.527444] nix-grpc-daemon[773]: ts=2026-09-23T04:44:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=16 outputs=15213lb # [ 105.488679] niks3-server[1001]: 2026/09/23 04:44:07 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo5214worker2 # [ 105.545567] nix-daemon[843]: reaped child process 1216, status = succeeded5215client # copying 1 paths...5216worker1 # [ 105.563192] nix-grpc-daemon[770]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:591065217worker1 # [ 105.577038] nix-grpc-daemon[770]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...5218client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...5219worker1 # [ 105.621866] nix-grpc-daemon[770]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:591065220worker1 # [ 105.630799] nix-grpc-daemon[770]: ts=2026-09-23T04:44:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=0 paths=1 nar_bytes_out=1205221client # [ 105.750427] nix-daemon[1167]: reaped child process 1275, status = succeeded5222client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.37 seconds)5223client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&25224client # [ 105.923474] nix-daemon[1167]: accepted connection from pid 1294, user root (trusted)5225client # this derivation will be built:5226client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5227worker2 # [ 106.094399] nix-grpc-daemon[773]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:327685228client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5229worker2 # [ 106.102258] nix-grpc-daemon[773]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:327685230worker2 # [ 106.109489] nix-grpc-daemon[856]: time=2026-09-23T04:44:07.626Z level=INFO msg="All 1 paths already cached"5231worker1 # [ 106.109693] nix-grpc-daemon[770]: ts=2026-09-23T04:44:07Z level=debug event=want client=16 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=05232worker1 # [ 106.118038] nix-grpc-daemon[770]: ts=2026-09-23T04:44:07Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15233worker1 # [ 106.127582] nix-grpc-daemon[770]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591065234worker1 # [ 106.139016] nix-grpc-daemon[770]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:591065235client # copying 1 paths to 'lb:50051'...5236worker1 # [ 106.155657] nix-grpc-daemon[906]: time=2026-09-23T04:44:07.672Z level=INFO msg="All 1 paths already cached"5237client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...5238worker1 # [ 106.161798] nix-grpc-daemon[770]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:591065239worker1 # [ 106.177096] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)5240worker1 # [ 106.326839] nix-daemon[855]: accepted connection from pid 1175, user nix-grpc-daemon (trusted)5241worker1 # [ 106.348466] nix-daemon[855]: reaped child process 1178, status = succeeded5242lb # [ 106.314088] niks3-server[1001]: 2026/09/23 04:44:07 INFO Received uploads request method=POST path=/api/pending_closures5243worker1 # [ 106.356183] nix-grpc-daemon[906]: time=2026-09-23T04:44:07.875Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5244worker1 # [ 106.357680] nix-grpc-daemon[906]: time=2026-09-23T04:44:07.875Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"5245lb # [ 106.349604] niks3-server[1001]: 2026/09/23 04:44:07 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst5246worker1 # [ 106.394268] nix-grpc-daemon[906]: time=2026-09-23T04:44:07.913Z level=INFO msg="Uploading 1 narinfos"5247lb # [ 106.364902] niks3-server[1001]: 2026/09/23 04:44:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5248lb # [ 106.374240] niks3-server[1001]: 2026/09/23 04:44:07 INFO Signed narinfos id=33 count=15249lb # [ 106.382094] niks3-server[1001]: 2026/09/23 04:44:07 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls5250worker1 # [ 106.419627] nix-grpc-daemon[906]: time=2026-09-23T04:44:07.939Z level=INFO msg="Upload complete. (227ms)"5251lb # [ 106.391011] niks3-server[1001]: 2026/09/23 04:44:07 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5252lb # [ 106.399035] niks3-server[1001]: 2026/09/23 04:44:07 INFO Completed upload id=335253worker1 # [ 106.428321] nix-grpc-daemon[770]: ts=2026-09-23T04:44:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=0 paths=1 nar_bytes_in=5685254lb # [ 106.402895] niks3-server[1001]: 2026/09/23 04:44:07 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo5255worker1 # [ 106.444597] nix-grpc-daemon[770]: ts=2026-09-23T04:44:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:591065256worker1 # [ 106.450702] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)5257worker1 # [ 106.455584] nix-daemon[855]: reaped child process 1173, status = succeeded5258client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...5259worker1 # [ 106.467781] nix-daemon[855]: accepted connection from pid 770, user nix-grpc-daemon (trusted)5260client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5261client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds5262worker1 # [ 107.728235] nix-daemon[855]: reaped child process 1182, status = succeeded5263worker1 # [ 107.822769] nix-daemon[855]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)5264worker1 # [ 107.841817] nix-daemon[855]: reaped child process 1201, status = succeeded5265lb # [ 107.815361] niks3-server[1001]: 2026/09/23 04:44:09 INFO Received uploads request method=POST path=/api/pending_closures5266worker1 # [ 107.858734] nix-grpc-daemon[906]: time=2026-09-23T04:44:09.376Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5267lb # [ 107.847145] niks3-server[1001]: 2026/09/23 04:44:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5268worker1 # [ 107.890607] nix-grpc-daemon[906]: time=2026-09-23T04:44:09.409Z level=INFO msg="Uploading 1 narinfos"5269lb # [ 107.864304] niks3-server[1001]: 2026/09/23 04:44:09 INFO Signed narinfos id=34 count=15270lb # [ 107.874398] niks3-server[1001]: 2026/09/23 04:44:09 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5271lb # [ 107.883368] niks3-server[1001]: 2026/09/23 04:44:09 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls5272lb # [ 107.891595] niks3-server[1001]: 2026/09/23 04:44:09 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5273worker1 # [ 107.931250] nix-grpc-daemon[906]: time=2026-09-23T04:44:09.450Z level=INFO msg="Upload complete. (249ms)"5274lb # [ 107.898848] niks3-server[1001]: 2026/09/23 04:44:09 INFO Completed upload id=345275lb # [ 107.903637] niks3-server[1001]: 2026/09/23 04:44:09 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo5276worker1 # [ 107.945127] nix-grpc-daemon[770]: ts=2026-09-23T04:44:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59106 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=17 outputs=15277worker1 # [ 107.960959] nix-daemon[855]: reaped child process 1180, status = succeeded5278client # copying 1 paths...5279worker2 # [ 108.003973] nix-grpc-daemon[773]: ts=2026-09-23T04:44:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:327685280worker2 # [ 108.013907] nix-grpc-daemon[773]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...5281client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...5282worker2 # [ 108.060176] nix-grpc-daemon[773]: ts=2026-09-23T04:44:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:327685283worker2 # [ 108.067102] nix-grpc-daemon[773]: ts=2026-09-23T04:44:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:32768 duration_s=0 paths=1 nar_bytes_out=1205284client # [ 108.174122] nix-daemon[1167]: reaped child process 1297, status = succeeded5285client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.42 seconds)5286(finished: subtest: an input only one worker has still reaches the builder, in 9.24 seconds)5287subtest: upload whose reference the worker lacks is completed from the cache5288client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache5289client # this derivation will be built:5290client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv5291client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...5292client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache, in 0.34 seconds)5293client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache5294client # this derivation will be built:5295client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv5296client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...5297client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache, in 0.30 seconds)5298client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure5299client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.13 seconds)5300worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5301worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds)5302worker2 # [ 109.239028] systemd[1]: Stopping Nix worker-protocol over gRPC...5303worker2 # [ 109.609336] nix-grpc-daemon[773]: ts=2026-09-23T04:44:11Z level=info event=signal_exit5304lb # [ 110.188705] envoy[891]: conn peer=[2001:db8:1::1]:42618 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=975305lb # [ 110.193704] envoy[891]: conn peer=[2001:db8:1::1]:57622 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4271 tx=2050 ms=23525306lb # [ 110.198554] envoy[891]: conn peer=[2001:db8:1::1]:42622 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3766 tx=2127 ms=29865307lb # [ 110.204665] envoy[891]: conn peer=[2001:db8:1::1]:42626 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=725308lb # [ 110.209443] envoy[891]: conn peer=[2001:db8:1::1]:42628 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3737 tx=2083 ms=20315309lb # [ 110.214282] envoy[891]: conn peer=[2001:db8:1::1]:42644 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=715310worker1 # [ 110.675801] nix-grpc-daemon[770]: ts=2026-09-23T04:44:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:452805311worker2 # [ 110.693032] nix-grpc-daemon[773]: ts=2026-09-23T04:44:12Z level=info event=scheduler_restarting5312worker1 # [ 110.680777] nix-grpc-daemon[770]: ts=2026-09-23T04:44:12Z level=info event=worker_gone addr=192.168.1.4:500515313worker2 # [ 110.720529] nix-grpc-daemon[773]: ts=2026-09-23T04:44:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5314worker2 # [ 110.740256] nix-daemon[843]: reaped child process 845, status = succeeded5315worker2 # [ 110.802087] nix-grpc-daemon[773]: E0000 00:00:1790138652.320292 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true5316worker2 # [ 110.808786] nix-grpc-daemon[773]: E0000 00:00:1790138652.320640 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5317worker2 # [ 110.929149] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5318worker2 # [ 110.939721] systemd[1]: Stopped Nix worker-protocol over gRPC.5319worker2 # [ 110.944980] systemd[1]: nix-grpc-daemon.service: Consumed 3.904s CPU time over 1min 30.571s wall clock time, 65.6M memory peak, 111.8K incoming IP traffic, 262.2K outgoing IP traffic.5320worker2 # [ 110.958362] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5321worker2 # [ 110.961738] systemd[1]: Closed Nix worker-protocol over gRPC.5322worker2 # [ 110.963528] systemd[1]: nix-grpc-daemon.socket: Consumed 682us CPU time over 1min 40.436s wall clock time, 256K memory peak, 106.1K incoming IP traffic, 90.8K outgoing IP traffic.5323lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy5324lb: must succeed: curl -sf localhost:9901/clusters5325lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5326lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds)5327client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&25328worker1 # [ 111.255620] nix-grpc-daemon[770]: ts=2026-09-23T04:44:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:591065329worker1 # [ 111.262399] nix-grpc-daemon[770]: ts=2026-09-23T04:44:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:591065330client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5331client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.25 seconds)5332worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5333worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds)5334worker2 # [ 111.398162] systemd[1]: Listening on Nix worker-protocol over gRPC.5335worker1 # [ 111.457497] systemd[1]: Stopping Nix worker-protocol over gRPC...5336worker1 # [ 111.474256] nix-grpc-daemon[770]: ts=2026-09-23T04:44:12Z level=info event=signal_exit5337lb # [ 111.638044] niks3-server[1001]: 2026/09/23 04:44:13 INFO lead: released remote=192.168.1.3:381165338worker2 # [ 111.931001] systemd[1]: Starting scheduler-token.service...5339worker2 # [ 112.018780] systemd[1]: scheduler-token.service: Deactivated successfully.5340worker2 # [ 112.028717] systemd[1]: Finished scheduler-token.service.5341worker2 # [ 112.030821] systemd[1]: scheduler-token.service: Consumed 58ms CPU time over 92ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5342worker2 # [ 112.039275] systemd[1]: Starting Nix worker-protocol over gRPC...5343worker2 # [ 112.173601] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:13Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5344worker2 # [ 112.175893] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5345worker2 # [ 112.179957] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15346worker2 # [ 112.186990] nix-grpc-daemon[1262]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5347worker2 # [ 112.203907] nix-grpc-daemon[1262]: E0000 00:00:1790138653.703122 1262 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5348lb # [ 112.160179] niks3-server[1001]: 2026/09/23 04:44:13 INFO lead: acquired remote=192.168.1.4:592385349worker2 # [ 112.235691] nix-grpc-daemon[1262]: E0000 00:00:1790138653.705302 1262 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5350worker2 # [ 112.239114] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5351worker2 # [ 112.241478] nix-grpc-daemon[1262]: E0000 00:00:1790138653.717887 1302 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5352worker2 # [ 112.243994] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:13Z level=info event=scheduler_take_over5353worker2 # [ 112.245140] nix-grpc-daemon[1262]: E0000 00:00:1790138653.739189 1302 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5354worker2 # [ 112.250283] nix-grpc-daemon[1262]: E0000 00:00:1790138653.739372 1302 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5355worker2 # [ 112.255183] nix-grpc-daemon[1262]: E0000 00:00:1790138653.754076 1302 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5356worker2 # [ 112.257787] systemd[1]: Started Nix worker-protocol over gRPC.5357worker2 # [ 112.258621] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:13Z level=info event=scheduler_connected addr=lb:500515358worker2 # [ 112.259866] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5359worker2 # [ 112.456738] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:13Z level=info event=scheduler_connected addr=lb:500515360worker2 # [ 112.461762] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5361worker2 # [ 112.662912] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:14Z level=info event=scheduler_connected addr=lb:500515362worker2 # [ 112.668279] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5363worker1 # [ 112.671779] nix-grpc-daemon[770]: ts=2026-09-23T04:44:14Z level=info event=scheduler_restarting5364worker1 # [ 112.682171] nix-grpc-daemon[770]: ts=2026-09-23T04:44:14Z level=info event=scheduler_restarting addr=lb:500515365worker1 # [ 112.686826] nix-grpc-daemon[770]: ts=2026-09-23T04:44:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:452805366worker1 # [ 112.691876] nix-grpc-daemon[770]: ts=2026-09-23T04:44:14Z level=info event=worker_gone addr=192.168.1.3:500515367worker1 # [ 112.719825] nix-daemon[855]: reaped child process 857, status = succeeded5368worker2 # [ 112.869283] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:14Z level=info event=scheduler_connected addr=lb:500515369worker2 # [ 112.874410] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5370worker1 # [ 112.897607] nix-grpc-daemon[770]: ts=2026-09-23T04:44:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5371worker2 # [ 113.075538] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:14Z level=info event=scheduler_connected addr=lb:500515372worker2 # [ 113.080911] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5373worker2 # [ 113.283267] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:14Z level=info event=scheduler_connected addr=lb:500515374worker2 # [ 113.300173] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:14Z level=info event=oidc_jwks provider=mock keys=15375worker2 # [ 113.304544] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:14Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:350445376worker2 # [ 113.309822] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05377worker1 # [ 113.642001] nix-grpc-daemon[770]: E0000 00:00:1790138655.160986 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true5378worker1 # [ 113.642448] nix-grpc-daemon[770]: E0000 00:00:1790138655.161394 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5379worker1 # [ 114.872250] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5380worker1 # [ 114.876667] systemd[1]: Stopped Nix worker-protocol over gRPC.5381worker1 # [ 114.883905] systemd[1]: nix-grpc-daemon.service: Consumed 2.893s CPU time over 1min 34.659s wall clock time, 68.4M memory peak, 97.7K incoming IP traffic, 193.1K outgoing IP traffic.5382worker1 # [ 114.900634] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5383worker1 # [ 114.902943] systemd[1]: Closed Nix worker-protocol over gRPC.5384worker1 # [ 114.909420] systemd[1]: nix-grpc-daemon.socket: Consumed 581us CPU time over 1min 44.314s wall clock time, 256K memory peak, 118.9K incoming IP traffic, 101.1K outgoing IP traffic.5385lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy5386lb: must succeed: curl -sf localhost:9901/clusters5387lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5388lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds)5389client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&25390worker2 # [ 115.229242] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350505391worker2 # [ 115.244794] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5392worker2 # [ 115.274937] nix-grpc-daemon[1262]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5)5393worker2 # [ 115.299973] nix-grpc-daemon[1262]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 186 ms (attempt 2/5)5394worker2 # [ 115.487998] nix-grpc-daemon[1262]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 3/5)5395worker2 # [ 115.497298] nix-grpc-daemon[1262]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 665 ms (attempt 4/5)5396worker2 # [ 116.164453] nix-grpc-daemon[1262]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5397worker2 # [ 116.168729] nix-grpc-daemon[1262]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5398client # copying 2 paths...5399client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...5400worker2 # [ 116.196136] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:350505401client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...5402worker2 # [ 116.213994] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5403worker2 # [ 116.245810] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:17Z level=info event=niks3_push_started pid=13235404worker2 # [ 116.400585] nix-grpc-daemon[1323]: time=2026-09-23T04:44:17.918Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""5405worker2 # [ 116.511010] nix-daemon[843]: accepted connection from pid 1336, user nix-grpc-daemon (trusted)5406worker2 # [ 116.530679] nix-daemon[843]: reaped child process 1339, status = succeeded5407lb # [ 116.491128] niks3-server[1001]: 2026/09/23 04:44:18 INFO Received uploads request method=POST path=/api/pending_closures5408lb # [ 116.682426] niks3-server[1001]: 2026/09/23 04:44:18 INFO Received uploads request method=POST path=/api/pending_closures5409worker2 # [ 116.740155] nix-grpc-daemon[1323]: time=2026-09-23T04:44:18.257Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5410worker2 # [ 116.754250] nix-grpc-daemon[1323]: time=2026-09-23T04:44:18.257Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"5411worker2 # [ 116.760183] nix-grpc-daemon[1323]: time=2026-09-23T04:44:18.257Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"5412lb # [ 116.766728] niks3-server[1001]: 2026/09/23 04:44:18 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls5413lb # [ 116.778970] niks3-server[1001]: 2026/09/23 04:44:18 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst5414worker2 # [ 116.826628] nix-grpc-daemon[1323]: time=2026-09-23T04:44:18.342Z level=INFO msg="Uploading 3 narinfos"5415lb # [ 116.790354] niks3-server[1001]: 2026/09/23 04:44:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5416lb # [ 116.797100] niks3-server[1001]: 2026/09/23 04:44:18 INFO Signed narinfos id=36 count=25417lb # [ 116.799301] niks3-server[1001]: 2026/09/23 04:44:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5418lb # [ 116.808239] niks3-server[1001]: 2026/09/23 04:44:18 INFO Signed narinfos id=35 count=15419lb # [ 116.810412] niks3-server[1001]: 2026/09/23 04:44:18 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5420lb # [ 116.823481] niks3-server[1001]: 2026/09/23 04:44:18 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls5421lb # [ 116.829801] niks3-server[1001]: 2026/09/23 04:44:18 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo5422lb # [ 116.837443] niks3-server[1001]: 2026/09/23 04:44:18 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5423lb # [ 116.843136] niks3-server[1001]: 2026/09/23 04:44:18 INFO Completed upload id=355424lb # [ 116.848260] niks3-server[1001]: 2026/09/23 04:44:18 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5425lb # [ 116.856786] niks3-server[1001]: 2026/09/23 04:44:18 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5426worker2 # [ 116.899314] nix-grpc-daemon[1323]: time=2026-09-23T04:44:18.417Z level=INFO msg="Upload complete. (494ms)"5427lb # [ 116.859004] niks3-server[1001]: 2026/09/23 04:44:18 INFO Completed upload id=365428worker2 # [ 116.912326] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35050 duration_s=0 paths=2 nar_bytes_in=3125429lb # [ 116.873954] niks3-server[1001]: 2026/09/23 04:44:18 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5430worker2 # [ 116.929501] nix-daemon[843]: reaped child process 1321, status = succeeded5431client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.94 seconds)5432worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache5433worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)5434worker1 # [ 117.041081] systemd[1]: Listening on Nix worker-protocol over gRPC.5435worker1 # [ 117.048427] systemd[1]: Starting Nix worker-protocol over gRPC...5436worker1 # [ 117.189219] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:18Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5437worker1 # [ 117.191543] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5438worker1 # [ 117.195475] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15439worker1 # [ 117.202680] nix-grpc-daemon[1224]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5440worker1 # [ 117.210894] nix-grpc-daemon[1224]: E0000 00:00:1790138658.719900 1224 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5441worker1 # [ 117.215459] nix-grpc-daemon[1224]: E0000 00:00:1790138658.722015 1224 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5442lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5443lb: must succeed: curl -sf localhost:9901/clusters5444worker1 # [ 117.248189] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5445worker1 # [ 117.249995] nix-grpc-daemon[1224]: E0000 00:00:1790138658.734112 1264 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5446worker1 # [ 117.255502] nix-grpc-daemon[1224]: E0000 00:00:1790138658.753142 1264 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5447worker1 # [ 117.258482] nix-grpc-daemon[1224]: E0000 00:00:1790138658.753308 1264 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5448worker1 # [ 117.261103] systemd[1]: Started Nix worker-protocol over gRPC.5449worker1 # [ 117.261969] nix-grpc-daemon[1224]: E0000 00:00:1790138658.773954 1264 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5450worker1 # [ 117.275143] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:18Z level=info event=scheduler_connected addr=lb:500515451worker2 # [ 117.292504] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:18Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:350445452worker2 # [ 117.297399] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05453lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5454lb: must succeed: curl -sf localhost:9901/clusters5455lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5456lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.14 seconds)5457(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.19 seconds)5458subtest: a niks3 restart does not cost the leader its role5459lb: must succeed: curl -sf localhost:9901/clusters5460lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5461lb: must succeed: curl -sf localhost:9901/clusters5462lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5463lb # [ 118.475502] niks3-server[1001]: 2026/09/23 04:44:20 INFO Shutdown signal received, draining in-flight requests timeout=10s5464worker1 # [ 118.508922] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:20Z level=info event=scheduler_lock_lost status=2005465worker2 # [ 118.521256] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:20Z level=info event=scheduler_lock_lost status=2005466lb # [ 118.481973] niks3-server[1001]: 2026/09/23 04:44:20 INFO lead: released remote=192.168.1.4:592385467lb # [ 118.495194] systemd[1]: Stopping niks3 server...5468lb # [ 118.504536] systemd[1]: niks3.service: Deactivated successfully.5469lb # [ 118.507075] systemd[1]: Stopped niks3 server.5470lb # [ 118.507801] systemd[1]: niks3.service: Consumed 678ms CPU time over 1min 29.173s wall clock time, 27.7M memory peak, 95.8K incoming IP traffic, 139.5K outgoing IP traffic.5471lb # [ 118.517628] systemd[1]: Starting niks3 server...5472lb # [ 118.575119] niks3-server[1141]: 2026/09/23 04:44:20 goose: no migrations to run. current version: 202609200000005473lb # [ 118.579994] niks3-server[1141]: 2026/09/23 04:44:20 OK 1_commit_pending_closure.sql (6.54ms)5474lb # [ 118.583612] niks3-server[1141]: 2026/09/23 04:44:20 OK 2_object_stats_trigger.sql (3.26ms)5475lb # [ 118.585526] niks3-server[1141]: 2026/09/23 04:44:20 goose: up to current file version: 25476lb # [ 118.587699] niks3-server[1141]: 2026/09/23 04:44:20 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key5477lb # [ 118.597913] niks3-server[1141]: 2026/09/23 04:44:20 INFO Read proxy enabled — serving cache objects from S35478lb # [ 118.599243] niks3-server[1141]: 2026/09/23 04:44:20 INFO Using socket-activated listener address=0.0.0.0:57515479lb # [ 118.604715] niks3-server[1141]: 2026/09/23 04:44:20 INFO systemd watchdog enabled interval=15s5480lb # [ 118.606517] niks3-server[1141]: 2026/09/23 04:44:20 INFO Starting HTTP server address=0.0.0.0:57515481lb # [ 118.608293] systemd[1]: Started niks3 server.5482lb: waiting for unit niks3.service5483lb: (finished: waiting for unit niks3.service, in 0.03 seconds)5484lb: must succeed: curl -sf localhost:9901/clusters5485lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5486worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5487worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5488lb: must succeed: curl -sf localhost:9901/clusters5489lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5490lb: must succeed: curl -sf localhost:9901/clusters5491lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5492worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5493worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.07 seconds)5494client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&25495worker1 # [ 119.124136] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:428905496worker1 # [ 119.140188] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5497client # don't know how to build these paths:5498client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5499worker2 # [ 119.176621] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350505500worker2 # [ 119.209962] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:20Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=05501worker2 # [ 119.217528] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:20Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.4:50051 clients=15502worker2 # [ 119.256707] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350505503worker2 # [ 119.272737] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350505504client # copying 1 paths to 'lb:50051'...5505client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'...5506worker2 # [ 119.288721] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:350505507worker2 # [ 119.303413] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5508worker2 # [ 119.457045] nix-daemon[843]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5509worker2 # [ 119.476771] nix-daemon[843]: reaped child process 1359, status = succeeded5510lb # [ 119.436926] niks3-server[1141]: 2026/09/23 04:44:20 INFO Received uploads request method=POST path=/api/pending_closures5511worker2 # [ 119.495572] nix-grpc-daemon[1323]: time=2026-09-23T04:44:21.013Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5512worker2 # [ 119.497381] nix-grpc-daemon[1323]: time=2026-09-23T04:44:21.013Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)"5513lb # [ 119.485676] niks3-server[1141]: 2026/09/23 04:44:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5514lb # [ 119.509429] niks3-server[1141]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls5515lb # [ 119.539473] niks3-server[1141]: 2026/09/23 04:44:21 INFO Signed narinfos id=37 count=15516worker2 # [ 119.587891] nix-grpc-daemon[1323]: time=2026-09-23T04:44:21.105Z level=INFO msg="Uploading 1 narinfos"5517lb # [ 119.545388] niks3-server[1141]: 2026/09/23 04:44:21 INFO lead: acquired remote=192.168.1.4:593365518lb # [ 119.556883] niks3-server[1141]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst5519lb # [ 119.568388] niks3-server[1141]: 2026/09/23 04:44:21 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5520worker2 # [ 119.620717] nix-grpc-daemon[1323]: time=2026-09-23T04:44:21.139Z level=INFO msg="Upload complete. (300ms)"5521lb # [ 119.581070] niks3-server[1141]: 2026/09/23 04:44:21 INFO Completed upload id=375522lb # [ 119.584328] niks3-server[1141]: 2026/09/23 04:44:21 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo5523worker2 # [ 119.634320] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35050 duration_s=0 paths=1 nar_bytes_in=5445524worker2 # [ 119.648808] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350505525worker2 # [ 119.660064] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5526worker2 # [ 119.666942] nix-daemon[843]: reaped child process 1354, status = succeeded5527client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051...5528worker2 # [ 119.678062] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5529client # farm-a> worker2: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5530lb # [ 120.191961] envoy[891]: conn peer=[2001:db8:1::4]:40330 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=76951 tx=4359 ms=900715531lb # [ 120.197077] envoy[891]: conn peer=[2001:db8:1::1]:46352 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=285532lb # [ 120.201697] envoy[891]: conn peer=[2001:db8:1::3]:32914 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=15224 tx=4184 ms=923795533lb # [ 120.206613] envoy[891]: conn peer=[2001:db8:1::1]:46362 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=304 ms=17005534client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5535client # farm-a> LOG-farm-a-after-niks3-restart5536worker2 # [ 121.352997] nix-daemon[843]: reaped child process 1365, status = succeeded5537worker2 # [ 121.478159] nix-daemon[843]: accepted connection from pid 1381, user nix-grpc-daemon (trusted)5538worker2 # [ 121.498389] nix-daemon[843]: reaped child process 1384, status = succeeded5539lb # [ 121.455963] niks3-server[1141]: 2026/09/23 04:44:22 INFO Received uploads request method=POST path=/api/pending_closures5540worker2 # [ 121.515311] nix-grpc-daemon[1323]: time=2026-09-23T04:44:23.031Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5541worker2 # [ 121.517109] nix-grpc-daemon[1323]: time=2026-09-23T04:44:23.031Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)"5542lb # [ 121.503628] niks3-server[1141]: 2026/09/23 04:44:23 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls5543worker2 # [ 121.562085] nix-grpc-daemon[1323]: time=2026-09-23T04:44:23.080Z level=INFO msg="Uploading 1 narinfos"5544lb # [ 121.518416] niks3-server[1141]: 2026/09/23 04:44:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5545lb # [ 121.529743] niks3-server[1141]: 2026/09/23 04:44:23 INFO Signed narinfos id=38 count=15546lb # [ 121.535576] niks3-server[1141]: 2026/09/23 04:44:23 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5547lb # [ 121.546950] niks3-server[1141]: 2026/09/23 04:44:23 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5548lb # [ 121.552284] niks3-server[1141]: 2026/09/23 04:44:23 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5549worker2 # [ 121.596511] nix-grpc-daemon[1323]: time=2026-09-23T04:44:23.114Z level=INFO msg="Upload complete. (304ms)"5550lb # [ 121.555340] niks3-server[1141]: 2026/09/23 04:44:23 INFO Completed upload id=385551lb # [ 121.558301] niks3-server[1141]: 2026/09/23 04:44:23 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo5552worker2 # [ 121.620909] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35050 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=15553worker2 # [ 121.635678] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:23Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=05554worker2 # [ 121.639707] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:23Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.4:50051 clients=15555worker2 # [ 121.643780] nix-daemon[843]: reaped child process 1363, status = succeeded5556worker2 # [ 121.661107] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350505557worker2 # [ 121.676335] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350505558worker2 # [ 121.692309] nix-grpc-daemon[1323]: time=2026-09-23T04:44:23.210Z level=INFO msg="All 1 paths already cached"5559client # copying 1 paths to 'lb:50051'...5560client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'...5561worker2 # [ 121.703019] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:350505562worker2 # [ 121.716736] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5563worker2 # [ 121.870695] nix-daemon[843]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5564worker2 # [ 121.889799] nix-daemon[843]: reaped child process 1393, status = succeeded5565lb # [ 121.849046] niks3-server[1141]: 2026/09/23 04:44:23 INFO Received uploads request method=POST path=/api/pending_closures5566worker2 # [ 121.903044] nix-grpc-daemon[1323]: time=2026-09-23T04:44:23.421Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5567worker2 # [ 121.904623] nix-grpc-daemon[1323]: time=2026-09-23T04:44:23.421Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)"5568lb # [ 121.880317] niks3-server[1141]: 2026/09/23 04:44:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5569worker2 # [ 121.935641] nix-grpc-daemon[1323]: time=2026-09-23T04:44:23.453Z level=INFO msg="Uploading 1 narinfos"5570lb # [ 121.896390] niks3-server[1141]: 2026/09/23 04:44:23 INFO Signed narinfos id=39 count=15571lb # [ 121.899596] niks3-server[1141]: 2026/09/23 04:44:23 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls5572worker2 # [ 121.959322] nix-grpc-daemon[1323]: time=2026-09-23T04:44:23.477Z level=INFO msg="Upload complete. (227ms)"5573lb # [ 121.916653] niks3-server[1141]: 2026/09/23 04:44:23 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst5574lb # [ 121.925860] niks3-server[1141]: 2026/09/23 04:44:23 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5575worker2 # [ 121.968206] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35050 duration_s=0 paths=1 nar_bytes_in=6565576lb # [ 121.929381] niks3-server[1141]: 2026/09/23 04:44:23 INFO Completed upload id=395577lb # [ 121.931278] niks3-server[1141]: 2026/09/23 04:44:23 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo5578worker2 # [ 121.980505] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350505579worker2 # [ 121.992177] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5580worker2 # [ 121.997589] nix-daemon[843]: reaped child process 1388, status = succeeded5581client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051...5582client # farm-b> worker2: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5583worker2 # [ 122.012149] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5584client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5585client # farm-b> LOG-farm-b-after-niks3-restart5586worker2 # [ 123.109590] nix-daemon[843]: reaped child process 1397, status = succeeded5587worker2 # [ 123.174308] nix-daemon[843]: accepted connection from pid 1413, user nix-grpc-daemon (trusted)5588worker2 # [ 123.195788] nix-daemon[843]: reaped child process 1416, status = succeeded5589lb # [ 123.155087] niks3-server[1141]: 2026/09/23 04:44:24 INFO Received uploads request method=POST path=/api/pending_closures5590worker2 # [ 123.212393] nix-grpc-daemon[1323]: time=2026-09-23T04:44:24.729Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5591worker2 # [ 123.214319] nix-grpc-daemon[1323]: time=2026-09-23T04:44:24.729Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)"5592lb # [ 123.199531] niks3-server[1141]: 2026/09/23 04:44:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5593worker2 # [ 123.252526] nix-grpc-daemon[1323]: time=2026-09-23T04:44:24.770Z level=INFO msg="Uploading 1 narinfos"5594lb # [ 123.213526] niks3-server[1141]: 2026/09/23 04:44:24 INFO Signed narinfos id=40 count=15595lb # [ 123.223256] niks3-server[1141]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst5596lb # [ 123.236129] niks3-server[1141]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls5597lb # [ 123.239382] niks3-server[1141]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5598lb # [ 123.252643] niks3-server[1141]: 2026/09/23 04:44:24 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5599lb # [ 123.260719] niks3-server[1141]: 2026/09/23 04:44:24 INFO Completed upload id=405600lb # [ 123.263782] niks3-server[1141]: 2026/09/23 04:44:24 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo5601worker2 # [ 123.296226] nix-grpc-daemon[1323]: time=2026-09-23T04:44:24.814Z level=INFO msg="Upload complete. (273ms)"5602worker2 # [ 123.313323] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35050 duration_s=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=15603worker2 # [ 123.332416] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:24Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=05604worker2 # [ 123.339342] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:24Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.4:50051 clients=15605worker2 # [ 123.344260] nix-daemon[843]: reaped child process 1395, status = succeeded5606worker2 # [ 123.361716] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350505607worker2 # [ 123.376950] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350505608worker2 # [ 123.391909] nix-grpc-daemon[1323]: time=2026-09-23T04:44:24.910Z level=INFO msg="All 2 paths already cached"5609client # copying 1 paths to 'lb:50051'...5610client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'...5611worker2 # [ 123.403241] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:350505612worker2 # [ 123.420183] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5613worker2 # [ 123.566154] nix-daemon[843]: accepted connection from pid 1422, user nix-grpc-daemon (trusted)5614worker2 # [ 123.583776] nix-daemon[843]: reaped child process 1425, status = succeeded5615lb # [ 123.544580] niks3-server[1141]: 2026/09/23 04:44:25 INFO Received uploads request method=POST path=/api/pending_closures5616worker2 # [ 123.599226] nix-grpc-daemon[1323]: time=2026-09-23T04:44:25.117Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5617worker2 # [ 123.600883] nix-grpc-daemon[1323]: time=2026-09-23T04:44:25.117Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)"5618lb # [ 123.574518] niks3-server[1141]: 2026/09/23 04:44:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5619worker2 # [ 123.628716] nix-grpc-daemon[1323]: time=2026-09-23T04:44:25.146Z level=INFO msg="Uploading 1 narinfos"5620lb # [ 123.590894] niks3-server[1141]: 2026/09/23 04:44:25 INFO Signed narinfos id=41 count=15621lb # [ 123.597177] niks3-server[1141]: 2026/09/23 04:44:25 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst5622lb # [ 123.608768] niks3-server[1141]: 2026/09/23 04:44:25 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls5623worker2 # [ 123.658225] nix-grpc-daemon[1323]: time=2026-09-23T04:44:25.176Z level=INFO msg="Upload complete. (226ms)"5624lb # [ 123.617631] niks3-server[1141]: 2026/09/23 04:44:25 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5625lb # [ 123.623212] niks3-server[1141]: 2026/09/23 04:44:25 INFO Completed upload id=415626worker2 # [ 123.668292] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35050 duration_s=0 paths=1 nar_bytes_in=7845627lb # [ 123.626914] niks3-server[1141]: 2026/09/23 04:44:25 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo5628worker2 # [ 123.679961] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350505629worker2 # [ 123.687187] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5630worker2 # [ 123.692820] nix-daemon[843]: reaped child process 1420, status = succeeded5631client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051...5632worker2 # [ 123.706751] nix-daemon[843]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)5633client # farm-top> worker2: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5634client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5635client # farm-top> LOG-farm-top-after-niks3-restart5636worker2 # [ 124.775394] nix-daemon[843]: reaped child process 1429, status = succeeded5637worker2 # [ 124.905845] nix-daemon[843]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)5638worker2 # [ 124.926888] nix-daemon[843]: reaped child process 1448, status = succeeded5639lb # [ 124.885409] niks3-server[1141]: 2026/09/23 04:44:26 INFO Received uploads request method=POST path=/api/pending_closures5640worker2 # [ 124.940422] nix-grpc-daemon[1323]: time=2026-09-23T04:44:26.458Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5641worker2 # [ 124.942194] nix-grpc-daemon[1323]: time=2026-09-23T04:44:26.458Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)"5642lb # [ 124.930272] niks3-server[1141]: 2026/09/23 04:44:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5643worker2 # [ 124.984295] nix-grpc-daemon[1323]: time=2026-09-23T04:44:26.502Z level=INFO msg="Uploading 1 narinfos"5644lb # [ 124.944530] niks3-server[1141]: 2026/09/23 04:44:26 INFO Signed narinfos id=42 count=15645lb # [ 124.954504] niks3-server[1141]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls5646lb # [ 124.963086] niks3-server[1141]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst5647lb # [ 124.970113] niks3-server[1141]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5648lb # [ 124.979715] niks3-server[1141]: 2026/09/23 04:44:26 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5649worker2 # [ 125.023753] nix-grpc-daemon[1323]: time=2026-09-23T04:44:26.542Z level=INFO msg="Upload complete. (303ms)"5650lb # [ 124.983973] niks3-server[1141]: 2026/09/23 04:44:26 INFO Completed upload id=425651lb # [ 124.987042] niks3-server[1141]: 2026/09/23 04:44:26 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo5652worker2 # [ 125.037276] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35050 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=15653worker2 # [ 125.058391] nix-daemon[843]: reaped child process 1427, status = succeeded5654client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2, in 6.18 seconds)5655client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath5656client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath, in 0.18 seconds)5657(finished: subtest: a niks3 restart does not cost the leader its role, in 6.87 seconds)5658subtest: scheduler down: the other node takes the lock and keeps it5659lb: must succeed: curl -sf localhost:9901/clusters5660lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5661lb: must succeed: curl -sf localhost:9901/clusters5662lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5663lb: must succeed: curl -sf localhost:9901/clusters5664lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5665lb: must succeed: curl -sf localhost:9901/clusters5666lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5667worker2 # [ 125.513146] systemd[1]: Stopping Nix worker-protocol over gRPC...5668worker2 # [ 126.199191] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:27Z level=info event=signal_exit5669lb # [ 126.499498] niks3-server[1141]: 2026/09/23 04:44:28 INFO lead: released remote=192.168.1.4:593365670worker1 # [ 127.535626] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:29Z level=info event=scheduler_restarting addr=lb:500515671worker2 # [ 127.553566] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:29Z level=info event=scheduler_restarting5672worker2 # [ 127.557703] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:29Z level=info event=scheduler_restarting addr=lb:500515673worker2 # [ 127.562194] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:350445674worker2 # [ 127.567622] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:29Z level=info event=worker_gone addr=192.168.1.4:500515675worker2 # [ 127.572232] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:350445676worker2 # [ 127.577413] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:29Z level=info event=worker_gone addr=192.168.1.3:500515677worker2 # [ 127.602744] nix-daemon[843]: reaped child process 1315, status = succeeded5678worker1 # [ 127.735274] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:29Z level=info event=scheduler_connected addr=lb:500515679worker1 # [ 127.741241] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5680worker2 # [ 127.769065] nix-grpc-daemon[1262]: ts=2026-09-23T04:44:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5681worker1 # [ 127.941797] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:29Z level=info event=scheduler_connected addr=lb:500515682worker1 # [ 127.947214] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5683worker1 # [ 128.148074] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:29Z level=info event=scheduler_connected addr=lb:500515684worker1 # [ 128.153319] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5685worker2 # [ 128.234959] nix-grpc-daemon[1262]: E0000 00:00:1790138669.753373 1308 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5686worker2 # [ 128.242850] nix-grpc-daemon[1262]: E0000 00:00:1790138669.761093 1308 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5687worker1 # [ 128.354495] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:29Z level=info event=scheduler_connected addr=lb:500515688worker1 # [ 128.359693] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5689worker1 # [ 128.562518] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:30Z level=info event=scheduler_connected addr=lb:500515690worker1 # [ 128.566782] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5691worker1 # [ 128.763223] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:30Z level=info event=scheduler_connected addr=lb:500515692worker1 # [ 128.768787] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5693worker2 # [ 128.812214] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5694worker2 # [ 128.821135] systemd[1]: Stopped Nix worker-protocol over gRPC.5695worker2 # [ 128.823727] systemd[1]: nix-grpc-daemon.service: Consumed 1.442s CPU time over 16.772s wall clock time, 39.4M memory peak, 46.5K incoming IP traffic, 82.9K outgoing IP traffic.5696worker2 # [ 128.839847] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5697worker2 # [ 128.842158] systemd[1]: Closed Nix worker-protocol over gRPC.5698worker2 # [ 128.843794] systemd[1]: nix-grpc-daemon.socket: Consumed 878us CPU time over 17.450s wall clock time, 256K memory peak, 38.7K incoming IP traffic, 29.2K outgoing IP traffic.5699worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5700worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.08 seconds)5701worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5702worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5703worker1 # [ 128.969266] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:30Z level=info event=scheduler_connected addr=lb:500515704worker1 # [ 128.972147] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5705worker1 # [ 129.173422] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:30Z level=info event=scheduler_connected addr=lb:500515706worker1 # [ 129.178898] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5707worker1 # [ 129.380355] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:30Z level=info event=scheduler_connected addr=lb:500515708worker1 # [ 129.385701] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5709worker1 # [ 129.518703] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:31Z level=info event=scheduler_take_over5710lb # [ 129.487369] niks3-server[1141]: 2026/09/23 04:44:31 INFO lead: acquired remote=192.168.1.3:414785711worker1 # [ 129.588743] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:31Z level=info event=scheduler_connected addr=lb:500515712worker1 # [ 129.594557] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5713worker1 # [ 129.796190] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:31Z level=info event=scheduler_connected addr=lb:500515714worker1 # [ 129.801872] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5715worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5716worker1 # [ 130.002906] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:31Z level=info event=scheduler_connected addr=lb:500515717worker1 # [ 130.019256] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:31Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:563745718worker1 # [ 130.031953] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05719worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.11 seconds)5720client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&25721lb # [ 130.190745] envoy[891]: conn peer=[2001:db8:1::1]:46368 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9706 tx=4399 ms=59195722lb # [ 130.199381] envoy[891]: conn peer=[2001:db8:1::4]:50752 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5513 tx=665 ms=155075723worker1 # [ 130.411872] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:428905724client # don't know how to build these paths:5725client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5726worker1 # [ 130.424433] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428905727worker1 # [ 130.443471] nix-grpc-daemon[1224]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5)5728worker1 # [ 130.499533] nix-grpc-daemon[1224]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 2/5)5729worker1 # [ 130.555061] nix-grpc-daemon[1224]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 331 ms (attempt 3/5)5730worker1 # [ 130.902054] nix-grpc-daemon[1224]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 389 ms (attempt 4/5)5731worker1 # [ 131.303563] nix-grpc-daemon[1224]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5732worker1 # [ 131.311239] nix-grpc-daemon[1224]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5733worker1 # [ 131.358165] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:32Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05734worker1 # [ 131.365982] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:32Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=15735worker1 # [ 131.411106] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428905736worker1 # [ 131.433091] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428905737client # copying 1 paths to 'lb:50051'...5738client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5739worker1 # [ 131.459483] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428905740worker1 # [ 131.481682] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5741worker1 # [ 131.524200] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:33Z level=info event=niks3_push_started pid=13015742worker1 # [ 131.753294] nix-grpc-daemon[1301]: time=2026-09-23T04:44:33.272Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""5743worker1 # [ 131.888138] nix-daemon[855]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5744worker1 # [ 131.912988] nix-daemon[855]: reaped child process 1317, status = succeeded5745lb # [ 131.893782] niks3-server[1141]: 2026/09/23 04:44:33 INFO Received uploads request method=POST path=/api/pending_closures5746worker1 # [ 131.940040] nix-grpc-daemon[1301]: time=2026-09-23T04:44:33.458Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5747worker1 # [ 131.941648] nix-grpc-daemon[1301]: time=2026-09-23T04:44:33.458Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5748lb # [ 131.958670] niks3-server[1141]: 2026/09/23 04:44:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5749worker1 # [ 132.003308] nix-grpc-daemon[1301]: time=2026-09-23T04:44:33.521Z level=INFO msg="Uploading 1 narinfos"5750lb # [ 131.971180] niks3-server[1141]: 2026/09/23 04:44:33 INFO Signed narinfos id=43 count=15751lb # [ 131.986514] niks3-server[1141]: 2026/09/23 04:44:33 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5752lb # [ 131.998289] niks3-server[1141]: 2026/09/23 04:44:33 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5753lb # [ 132.024742] niks3-server[1141]: 2026/09/23 04:44:33 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5754lb # [ 132.031489] niks3-server[1141]: 2026/09/23 04:44:33 INFO Completed upload id=435755worker1 # [ 132.063287] nix-grpc-daemon[1301]: time=2026-09-23T04:44:33.582Z level=INFO msg="Upload complete. (306ms)"5756lb # [ 132.037419] niks3-server[1141]: 2026/09/23 04:44:33 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5757worker1 # [ 132.078677] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42890 duration_s=0 paths=1 nar_bytes_in=5205758worker1 # [ 132.106024] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428905759worker1 # [ 132.116228] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5760worker1 # [ 132.123810] nix-daemon[855]: reaped child process 1299, status = succeeded5761client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5762worker1 # [ 132.142202] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5763client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5764client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5765client # farm-a> LOG-farm-a-on-standby5766worker1 # [ 133.205085] nix-daemon[855]: reaped child process 1321, status = succeeded5767worker1 # [ 133.315604] nix-daemon[855]: accepted connection from pid 1337, user nix-grpc-daemon (trusted)5768worker1 # [ 133.335398] nix-daemon[855]: reaped child process 1340, status = succeeded5769lb # [ 133.307786] niks3-server[1141]: 2026/09/23 04:44:34 INFO Received uploads request method=POST path=/api/pending_closures5770worker1 # [ 133.352042] nix-grpc-daemon[1301]: time=2026-09-23T04:44:34.869Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5771worker1 # [ 133.353543] nix-grpc-daemon[1301]: time=2026-09-23T04:44:34.869Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5772lb # [ 133.342233] niks3-server[1141]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5773lb # [ 133.360586] niks3-server[1141]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5774worker1 # [ 133.404247] nix-grpc-daemon[1301]: time=2026-09-23T04:44:34.923Z level=INFO msg="Uploading 1 narinfos"5775lb # [ 133.371371] niks3-server[1141]: 2026/09/23 04:44:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5776lb # [ 133.379770] niks3-server[1141]: 2026/09/23 04:44:34 INFO Signed narinfos id=44 count=15777lb # [ 133.384982] niks3-server[1141]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5778lb # [ 133.393214] niks3-server[1141]: 2026/09/23 04:44:34 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5779worker1 # [ 133.431500] nix-grpc-daemon[1301]: time=2026-09-23T04:44:34.950Z level=INFO msg="Upload complete. (272ms)"5780lb # [ 133.403012] niks3-server[1141]: 2026/09/23 04:44:34 INFO Completed upload id=445781lb # [ 133.408555] niks3-server[1141]: 2026/09/23 04:44:34 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5782worker1 # [ 133.456345] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42890 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15783worker1 # [ 133.467871] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:34Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05784worker1 # [ 133.471628] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:34Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15785worker1 # [ 133.475598] nix-daemon[855]: reaped child process 1319, status = succeeded5786worker1 # [ 133.497266] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428905787worker1 # [ 133.513614] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428905788worker1 # [ 133.527531] nix-grpc-daemon[1301]: time=2026-09-23T04:44:35.046Z level=INFO msg="All 1 paths already cached"5789client # copying 1 paths to 'lb:50051'...5790client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5791worker1 # [ 133.538460] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428905792worker1 # [ 133.554707] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5793worker1 # [ 133.706151] nix-daemon[855]: accepted connection from pid 1346, user nix-grpc-daemon (trusted)5794worker1 # [ 133.725642] nix-daemon[855]: reaped child process 1349, status = succeeded5795lb # [ 133.698206] niks3-server[1141]: 2026/09/23 04:44:35 INFO Received uploads request method=POST path=/api/pending_closures5796worker1 # [ 133.739286] nix-grpc-daemon[1301]: time=2026-09-23T04:44:35.258Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5797worker1 # [ 133.741656] nix-grpc-daemon[1301]: time=2026-09-23T04:44:35.260Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5798lb # [ 133.731112] niks3-server[1141]: 2026/09/23 04:44:35 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5799worker1 # [ 133.772725] nix-grpc-daemon[1301]: time=2026-09-23T04:44:35.291Z level=INFO msg="Uploading 1 narinfos"5800lb # [ 133.742240] niks3-server[1141]: 2026/09/23 04:44:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5801lb # [ 133.752595] niks3-server[1141]: 2026/09/23 04:44:35 INFO Signed narinfos id=45 count=15802lb # [ 133.765273] niks3-server[1141]: 2026/09/23 04:44:35 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5803worker1 # [ 133.806697] nix-grpc-daemon[1301]: time=2026-09-23T04:44:35.326Z level=INFO msg="Upload complete. (235ms)"5804lb # [ 133.774588] niks3-server[1141]: 2026/09/23 04:44:35 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5805lb # [ 133.779199] niks3-server[1141]: 2026/09/23 04:44:35 INFO Completed upload id=455806lb # [ 133.781919] niks3-server[1141]: 2026/09/23 04:44:35 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5807worker1 # [ 133.816298] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42890 duration_s=0 paths=1 nar_bytes_in=6405808worker1 # [ 133.833734] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428905809worker1 # [ 133.840600] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5810worker1 # [ 133.845860] nix-daemon[855]: reaped child process 1344, status = succeeded5811client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5812client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5813worker1 # [ 133.859425] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5814client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5815client # farm-b> LOG-farm-b-on-standby5816worker1 # [ 134.921098] nix-daemon[855]: reaped child process 1353, status = succeeded5817worker1 # [ 135.054365] nix-daemon[855]: accepted connection from pid 1369, user nix-grpc-daemon (trusted)5818worker1 # [ 135.073648] nix-daemon[855]: reaped child process 1372, status = succeeded5819lb # [ 135.042266] niks3-server[1141]: 2026/09/23 04:44:36 INFO Received uploads request method=POST path=/api/pending_closures5820worker1 # [ 135.083672] nix-grpc-daemon[1301]: time=2026-09-23T04:44:36.601Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5821worker1 # [ 135.086093] nix-grpc-daemon[1301]: time=2026-09-23T04:44:36.601Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5822lb # [ 135.083992] niks3-server[1141]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5823worker1 # [ 135.126564] nix-grpc-daemon[1301]: time=2026-09-23T04:44:36.645Z level=INFO msg="Uploading 1 narinfos"5824lb # [ 135.098624] niks3-server[1141]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5825lb # [ 135.106187] niks3-server[1141]: 2026/09/23 04:44:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5826lb # [ 135.113059] niks3-server[1141]: 2026/09/23 04:44:36 INFO Signed narinfos id=46 count=15827lb # [ 135.116176] niks3-server[1141]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5828lb # [ 135.123444] niks3-server[1141]: 2026/09/23 04:44:36 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5829lb # [ 135.127923] niks3-server[1141]: 2026/09/23 04:44:36 INFO Completed upload id=465830worker1 # [ 135.159866] nix-grpc-daemon[1301]: time=2026-09-23T04:44:36.679Z level=INFO msg="Upload complete. (289ms)"5831lb # [ 135.130965] niks3-server[1141]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5832worker1 # [ 135.180632] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42890 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15833worker1 # [ 135.196227] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:36Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05834worker1 # [ 135.200372] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:36Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15835worker1 # [ 135.204902] nix-daemon[855]: reaped child process 1351, status = succeeded5836worker1 # [ 135.220749] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428905837worker1 # [ 135.234656] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428905838worker1 # [ 135.248593] nix-grpc-daemon[1301]: time=2026-09-23T04:44:36.768Z level=INFO msg="All 2 paths already cached"5839client # copying 1 paths to 'lb:50051'...5840client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5841worker1 # [ 135.259741] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428905842worker1 # [ 135.274616] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5843worker1 # [ 135.416959] nix-daemon[855]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5844worker1 # [ 135.438086] nix-daemon[855]: reaped child process 1381, status = succeeded5845lb # [ 135.408820] niks3-server[1141]: 2026/09/23 04:44:36 INFO Received uploads request method=POST path=/api/pending_closures5846worker1 # [ 135.451077] nix-grpc-daemon[1301]: time=2026-09-23T04:44:36.970Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5847worker1 # [ 135.453148] nix-grpc-daemon[1301]: time=2026-09-23T04:44:36.970Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5848lb # [ 135.440209] niks3-server[1141]: 2026/09/23 04:44:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5849worker1 # [ 135.481400] nix-grpc-daemon[1301]: time=2026-09-23T04:44:37.000Z level=INFO msg="Uploading 1 narinfos"5850lb # [ 135.456307] niks3-server[1141]: 2026/09/23 04:44:36 INFO Signed narinfos id=47 count=15851lb # [ 135.459342] niks3-server[1141]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5852lb # [ 135.469813] niks3-server[1141]: 2026/09/23 04:44:36 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5853worker1 # [ 135.511502] nix-grpc-daemon[1301]: time=2026-09-23T04:44:37.030Z level=INFO msg="Upload complete. (223ms)"5854lb # [ 135.479860] niks3-server[1141]: 2026/09/23 04:44:37 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5855lb # [ 135.485630] niks3-server[1141]: 2026/09/23 04:44:37 INFO Completed upload id=475856worker1 # [ 135.520261] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42890 duration_s=0 paths=1 nar_bytes_in=7685857lb # [ 135.490972] niks3-server[1141]: 2026/09/23 04:44:37 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5858worker1 # [ 135.535581] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428905859worker1 # [ 135.543044] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5860worker1 # [ 135.548121] nix-daemon[855]: reaped child process 1376, status = succeeded5861client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5862worker1 # [ 135.559157] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5863client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5864client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5865client # farm-top> LOG-farm-top-on-standby5866worker1 # [ 136.856934] nix-daemon[855]: reaped child process 1385, status = succeeded5867worker1 # [ 136.926980] nix-daemon[855]: accepted connection from pid 1401, user nix-grpc-daemon (trusted)5868worker1 # [ 136.949326] nix-daemon[855]: reaped child process 1404, status = succeeded5869lb # [ 136.918016] niks3-server[1141]: 2026/09/23 04:44:38 INFO Received uploads request method=POST path=/api/pending_closures5870worker1 # [ 136.960491] nix-grpc-daemon[1301]: time=2026-09-23T04:44:38.477Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5871worker1 # [ 136.962357] nix-grpc-daemon[1301]: time=2026-09-23T04:44:38.477Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5872lb # [ 136.954809] niks3-server[1141]: 2026/09/23 04:44:38 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5873lb # [ 136.970019] niks3-server[1141]: 2026/09/23 04:44:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5874lb # [ 136.985425] niks3-server[1141]: 2026/09/23 04:44:38 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5875lb # [ 136.994184] niks3-server[1141]: 2026/09/23 04:44:38 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5876lb # [ 137.000841] niks3-server[1141]: 2026/09/23 04:44:38 INFO Signed narinfos id=48 count=15877worker1 # [ 137.033412] nix-grpc-daemon[1301]: time=2026-09-23T04:44:38.552Z level=INFO msg="Uploading 1 narinfos"5878lb # [ 137.009123] niks3-server[1141]: 2026/09/23 04:44:38 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5879lb # [ 137.016608] niks3-server[1141]: 2026/09/23 04:44:38 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5880lb # [ 137.029602] niks3-server[1141]: 2026/09/23 04:44:38 INFO Completed upload id=485881worker1 # [ 137.062315] nix-grpc-daemon[1301]: time=2026-09-23T04:44:38.581Z level=INFO msg="Upload complete. (291ms)"5882worker1 # [ 137.077151] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42890 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15883worker1 # [ 137.095489] nix-daemon[855]: reaped child process 1383, status = succeeded5884client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2, in 7.05 seconds)5885client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath5886client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath, in 0.18 seconds)5887worker2 # [ 137.398949] systemd[1]: Listening on Nix worker-protocol over gRPC.5888worker2 # [ 137.408508] systemd[1]: Starting scheduler-token.service...5889worker2 # [ 137.488862] systemd[1]: scheduler-token.service: Deactivated successfully.5890worker2 # [ 137.493757] systemd[1]: Finished scheduler-token.service.5891worker2 # [ 137.495382] systemd[1]: scheduler-token.service: Consumed 44ms CPU time over 84ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5892worker2 # [ 137.505405] systemd[1]: Starting Nix worker-protocol over gRPC...5893worker2 # [ 137.634528] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:39Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5894worker2 # [ 137.636961] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5895worker2 # [ 137.641003] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15896worker2 # [ 137.647957] nix-grpc-daemon[1469]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5897worker2 # [ 137.663006] nix-grpc-daemon[1469]: E0000 00:00:1790138679.164206 1469 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5898lb: must succeed: curl -sf localhost:9901/clusters5899worker2 # [ 137.692146] nix-grpc-daemon[1469]: E0000 00:00:1790138679.166428 1469 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5900worker2 # [ 137.696296] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5901worker2 # [ 137.698539] nix-grpc-daemon[1469]: E0000 00:00:1790138679.176621 1509 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5902worker2 # [ 137.701136] nix-grpc-daemon[1469]: E0000 00:00:1790138679.195790 1509 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5903worker2 # [ 137.703382] nix-grpc-daemon[1469]: E0000 00:00:1790138679.195957 1509 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5904worker2 # [ 137.709254] nix-grpc-daemon[1469]: E0000 00:00:1790138679.213856 1509 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5905worker2 # [ 137.713731] systemd[1]: Started Nix worker-protocol over gRPC.5906worker2 # [ 137.714670] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:39Z level=info event=scheduler_connected addr=lb:500515907worker1 # [ 137.712194] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:39Z level=info event=oidc_jwks provider=mock keys=15908worker1 # [ 137.717581] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:39Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:563745909worker1 # [ 137.722947] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:39Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05910lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5911worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5912worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5913lb: must succeed: curl -sf localhost:9901/clusters5914lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5915lb: must succeed: curl -sf localhost:9901/clusters5916lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5917worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5918worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5919(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.76 seconds)5920subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5921client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs5922client # [ 138.068917] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs.5923client # Running as unit: rs.service; invocation ID: 87f9f3c8d7bb460b980f2095e4a004875924client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs, in 0.09 seconds)5925worker2 # [ 138.287999] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:595805926worker2 # [ 138.305334] nix-daemon[843]: accepted connection from pid 1469, user nix-grpc-daemon (trusted)5927client # [ 138.302685] nix[1421]: don't know how to build these paths:5928client # [ 138.305122] nix[1421]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5929worker1 # [ 138.326853] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:39Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05930worker1 # [ 138.332412] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:39Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15931worker1 # [ 138.373743] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428905932worker1 # [ 138.389696] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428905933client # [ 138.396244] nix[1421]: copying 1 paths to 'lb:50051'...5934worker1 # [ 138.404352] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428905935client # [ 138.398552] nix[1421]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5936worker1 # [ 138.421401] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5937worker1 # [ 138.580273] nix-daemon[855]: accepted connection from pid 1417, user nix-grpc-daemon (trusted)5938worker1 # [ 138.599621] nix-daemon[855]: reaped child process 1420, status = succeeded5939lb # [ 138.571987] niks3-server[1141]: 2026/09/23 04:44:40 INFO Received uploads request method=POST path=/api/pending_closures5940worker1 # [ 138.621196] nix-grpc-daemon[1301]: time=2026-09-23T04:44:40.140Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5941worker1 # [ 138.622732] nix-grpc-daemon[1301]: time=2026-09-23T04:44:40.140Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5942lb # [ 138.614478] niks3-server[1141]: 2026/09/23 04:44:40 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5943worker1 # [ 138.655146] nix-grpc-daemon[1301]: time=2026-09-23T04:44:40.174Z level=INFO msg="Uploading 1 narinfos"5944lb # [ 138.627563] niks3-server[1141]: 2026/09/23 04:44:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5945lb # [ 138.637642] niks3-server[1141]: 2026/09/23 04:44:40 INFO Signed narinfos id=49 count=15946lb # [ 138.639853] niks3-server[1141]: 2026/09/23 04:44:40 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5947worker1 # [ 138.680114] nix-grpc-daemon[1301]: time=2026-09-23T04:44:40.199Z level=INFO msg="Upload complete. (241ms)"5948lb # [ 138.649438] niks3-server[1141]: 2026/09/23 04:44:40 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5949lb # [ 138.653518] niks3-server[1141]: 2026/09/23 04:44:40 INFO Completed upload id=495950lb # [ 138.657084] niks3-server[1141]: 2026/09/23 04:44:40 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5951worker1 # [ 138.689349] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42890 duration_s=0 paths=1 nar_bytes_in=4165952worker1 # [ 138.703708] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428905953worker1 # [ 138.710350] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5954worker1 # [ 138.719975] nix-daemon[855]: reaped child process 1415, status = succeeded5955client # [ 138.717072] nix[1421]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5956worker1 # [ 138.727347] nix-daemon[855]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5957lb # [ 140.191175] envoy[891]: conn peer=[2001:db8:1::1]:55370 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9623 tx=4432 ms=66835958lb: must succeed: curl -sf localhost:9901/clusters5959lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5960lb: must succeed: curl -sf localhost:9901/clusters5961lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5962lb: must succeed: curl -sf localhost:9901/clusters5963lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5964lb: must succeed: curl -sf localhost:9901/clusters5965lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5966worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5967worker2 # [ 140.894751] systemd-journald[262]: Received client request to rotate journal, rotating.5968worker2 # [ 140.919314] systemd-journald[262]: Vacuuming done, freed 0B of archived journals from /var/log/journal/adab33dca4b240439adaf1a3266c8e0a.5969worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5970worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5971worker1 # [ 140.953907] systemd[1]: Stopping Nix worker-protocol over gRPC...5972worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5973client: must succeed: sleep 5.05974worker1 # [ 141.221925] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:42Z level=info event=draining5975client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5976worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5977worker1 # [ 146.437786] nix-daemon[855]: reaped child process 1424, status = succeeded5978worker1 # [ 146.509664] nix-daemon[855]: accepted connection from pid 1465, user nix-grpc-daemon (trusted)5979worker1 # [ 146.530039] nix-daemon[855]: reaped child process 1468, status = succeeded5980lb # [ 146.496241] niks3-server[1141]: 2026/09/23 04:44:48 INFO Received uploads request method=POST path=/api/pending_closures5981worker1 # [ 146.539358] nix-grpc-daemon[1301]: time=2026-09-23T04:44:48.058Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5982worker1 # [ 146.543986] nix-grpc-daemon[1301]: time=2026-09-23T04:44:48.058Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5983lb # [ 146.543459] niks3-server[1141]: 2026/09/23 04:44:48 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5984worker1 # [ 146.591002] nix-grpc-daemon[1301]: time=2026-09-23T04:44:48.110Z level=INFO msg="Uploading 1 narinfos"5985lb # [ 146.561513] niks3-server[1141]: 2026/09/23 04:44:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5986lb # [ 146.572526] niks3-server[1141]: 2026/09/23 04:44:48 INFO Signed narinfos id=50 count=15987lb # [ 146.575072] niks3-server[1141]: 2026/09/23 04:44:48 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5988worker1 # [ 146.619591] nix-grpc-daemon[1301]: time=2026-09-23T04:44:48.139Z level=INFO msg="Upload complete. (276ms)"5989lb # [ 146.587698] niks3-server[1141]: 2026/09/23 04:44:48 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5990lb # [ 146.592179] niks3-server[1141]: 2026/09/23 04:44:48 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5991lb # [ 146.596724] niks3-server[1141]: 2026/09/23 04:44:48 INFO Completed upload id=505992lb # [ 146.599985] niks3-server[1141]: 2026/09/23 04:44:48 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5993worker1 # [ 146.633876] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42890 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15994worker1 # [ 146.652957] nix-daemon[855]: reaped child process 1422, status = succeeded5995client # [ 146.663866] systemd[1]: rs.service: Deactivated successfully.5996client # [ 146.668113] systemd[1]: rs.service: Consumed 190ms CPU time over 8.598s wall clock time, 41.2M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.5997worker1 # [ 147.223240] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:48Z level=info event=signal_exit5998lb # [ 147.488261] niks3-server[1141]: 2026/09/23 04:44:49 INFO lead: released remote=192.168.1.3:414785999lb # [ 147.614051] niks3-server[1141]: 2026/09/23 04:44:49 INFO lead: acquired remote=192.168.1.4:358826000worker2 # [ 147.663841] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:49Z level=info event=scheduler_take_over6001worker2 # [ 148.533830] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:50Z level=info event=scheduler_restarting addr=lb:500516002worker1 # [ 148.527428] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:50Z level=info event=scheduler_restarting6003worker1 # [ 148.527893] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:563746004worker1 # [ 148.537140] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:50Z level=info event=worker_gone addr=192.168.1.4:500516005worker1 # [ 148.542393] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:50Z level=info event=scheduler_restarting addr=lb:500516006worker1 # [ 148.547035] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:563746007worker1 # [ 148.552558] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:50Z level=info event=worker_gone addr=192.168.1.3:500516008worker1 # [ 148.577081] nix-daemon[855]: reaped child process 1277, status = succeeded6009worker2 # [ 148.736322] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:50Z level=info event=scheduler_connected addr=lb:500516010worker1 # [ 148.726337] nix-grpc-daemon[1224]: E0000 00:00:1790138690.245393 1270 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true6011worker1 # [ 148.754586] nix-grpc-daemon[1224]: ts=2026-09-23T04:44:50Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6012worker1 # [ 148.956577] nix-grpc-daemon[1224]: E0000 00:00:1790138690.475692 1270 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6013worker1 # [ 148.963122] nix-grpc-daemon[1224]: E0000 00:00:1790138690.476029 1270 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6014worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.24 seconds)6015client: waiting for success: ! systemctl is-active rs6016client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)6017client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }6018client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)6019client: must fail: journalctl -u rs | grep -q 'reconnecting'6020client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)6021lb: must succeed: curl -sf localhost:9901/clusters6022lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6023worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6024worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6025worker1 # [ 149.851023] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6026worker1 # [ 149.856845] systemd[1]: Stopped Nix worker-protocol over gRPC.6027worker1 # [ 149.859414] systemd[1]: nix-grpc-daemon.service: Consumed 1.744s CPU time over 32.806s wall clock time, 39.1M memory peak, 48.3K incoming IP traffic, 90.7K outgoing IP traffic.6028worker2 # [ 149.887736] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:51Z level=info event=oidc_jwks provider=mock keys=16029worker2 # [ 149.892279] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:51Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:330046030worker1 # [ 149.882826] systemd[1]: Starting Nix worker-protocol over gRPC...6031worker2 # [ 149.897633] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06032worker1 # [ 150.024719] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6033worker1 # [ 150.026665] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6034worker1 # [ 150.030527] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16035worker1 # [ 150.036061] nix-grpc-daemon[1475]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6036worker1 # [ 150.037518] nix-grpc-daemon[1475]: E0000 00:00:1790138691.554589 1475 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6037worker1 # [ 150.074464] nix-grpc-daemon[1475]: E0000 00:00:1790138691.561014 1475 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6038worker1 # [ 150.081461] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6039worker1 # [ 150.083639] nix-grpc-daemon[1475]: E0000 00:00:1790138691.567669 1515 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6040worker1 # [ 150.086378] nix-grpc-daemon[1475]: E0000 00:00:1790138691.583112 1515 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6041worker1 # [ 150.091738] nix-grpc-daemon[1475]: E0000 00:00:1790138691.583269 1515 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6042worker1 # [ 150.096186] systemd[1]: Started Nix worker-protocol over gRPC.6043worker1 # [ 150.097156] nix-grpc-daemon[1475]: E0000 00:00:1790138691.600069 1515 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6044worker1 # [ 150.099412] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:51Z level=info event=scheduler_connected addr=lb:500516045worker2 # [ 150.109028] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:330046046worker2 # [ 150.115214] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=06047lb # [ 150.189631] envoy[891]: conn peer=[2001:db8:1::1]:33906 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3005 tx=1516 ms=83786048lb # [ 150.194551] envoy[891]: conn peer=[2001:db8:1::3]:50178 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2987 tx=1005 ms=314666049lb: must succeed: curl -sf localhost:9901/clusters6050lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6051worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6052worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6053(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.92 seconds)6054subtest: scheduler restart mid-build: build finishes, no double build6055client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid6056client # [ 150.990481] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid.6057client # Running as unit: mid.service; invocation ID: 73a181792c2e4aa7ba27687a6bd9027d6058client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid, in 0.09 seconds)6059worker2 # [ 151.205704] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:595806060client # [ 151.193988] nix[1457]: don't know how to build these paths:6061client # [ 151.194933] nix[1457]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv6062worker2 # [ 151.225310] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:52Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=06063worker2 # [ 151.232341] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:52Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=16064worker2 # [ 151.273024] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595806065worker2 # [ 151.288615] nix-grpc-daemon[1469]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5)6066worker2 # [ 151.301531] nix-grpc-daemon[1469]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 2/5)6067worker2 # [ 151.353277] nix-grpc-daemon[1469]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 3/5)6068worker2 # [ 151.407968] nix-grpc-daemon[1469]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 750 ms (attempt 4/5)6069worker2 # [ 152.160372] nix-grpc-daemon[1469]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6070worker2 # [ 152.164584] nix-grpc-daemon[1469]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6071worker2 # [ 152.184760] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595806072client # [ 152.177868] nix[1457]: copying 1 paths to 'lb:50051'...6073client # [ 152.182398] nix[1457]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...6074worker2 # [ 152.203070] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:595806075worker2 # [ 152.218130] nix-daemon[843]: accepted connection from pid 1469, user nix-grpc-daemon (trusted)6076worker2 # [ 152.256906] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:53Z level=info event=niks3_push_started pid=15986077worker2 # [ 152.416659] nix-grpc-daemon[1598]: time=2026-09-23T04:44:53.932Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""6078worker2 # [ 152.523100] nix-daemon[843]: accepted connection from pid 1615, user nix-grpc-daemon (trusted)6079worker2 # [ 152.541949] nix-daemon[843]: reaped child process 1618, status = succeeded6080lb # [ 152.502751] niks3-server[1141]: 2026/09/23 04:44:54 INFO Received uploads request method=POST path=/api/pending_closures6081worker2 # [ 152.558667] nix-grpc-daemon[1598]: time=2026-09-23T04:44:54.076Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6082worker2 # [ 152.562462] nix-grpc-daemon[1598]: time=2026-09-23T04:44:54.076Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"6083lb # [ 152.546262] niks3-server[1141]: 2026/09/23 04:44:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6084lb # [ 152.560344] niks3-server[1141]: 2026/09/23 04:44:54 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls6085lb # [ 152.577244] niks3-server[1141]: 2026/09/23 04:44:54 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst6086lb # [ 152.586806] niks3-server[1141]: 2026/09/23 04:44:54 INFO Signed narinfos id=51 count=16087worker2 # [ 152.631523] nix-grpc-daemon[1598]: time=2026-09-23T04:44:54.148Z level=INFO msg="Uploading 1 narinfos"6088lb # [ 152.598394] niks3-server[1141]: 2026/09/23 04:44:54 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6089lb # [ 152.611516] niks3-server[1141]: 2026/09/23 04:44:54 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo6090lb # [ 152.622216] niks3-server[1141]: 2026/09/23 04:44:54 INFO Completed upload id=516091worker2 # [ 152.667284] nix-grpc-daemon[1598]: time=2026-09-23T04:44:54.185Z level=INFO msg="Upload complete. (252ms)"6092worker2 # [ 152.680311] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59580 duration_s=0 paths=1 nar_bytes_in=4246093worker2 # [ 152.698686] nix-grpc-daemon[1469]: ts=2026-09-23T04:44:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595806094worker2 # [ 152.703024] nix-daemon[843]: accepted connection from pid 1469, user nix-grpc-daemon (trusted)6095worker2 # [ 152.710489] nix-daemon[843]: reaped child process 1596, status = succeeded6096worker2 # [ 152.722441] nix-daemon[843]: accepted connection from pid 1469, user nix-grpc-daemon (trusted)6097client # [ 152.702528] nix[1457]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...6098lb: must succeed: curl -sf localhost:9901/clusters6099lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6100lb: must succeed: curl -sf localhost:9901/clusters6101lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6102worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service6103worker2 # [ 154.994346] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1469 (nix-grpc-daemon) on client request.6104worker2 # [ 154.995928] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.6105lb # [ 154.966706] niks3-server[1141]: 2026/09/23 04:44:56 INFO lead: released remote=192.168.1.4:358826106client # [ 154.999392] nix[1457]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again6107worker1 # [ 155.006475] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:56Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"6108worker2 # [ 155.026790] systemd[1]: Starting scheduler-token.service...6109worker2 # [ 155.027675] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL6110client # [ 155.005774] nix[1457]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting6111worker2 # [ 155.038361] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.6112worker2 # [ 155.039665] systemd[1]: nix-grpc-daemon.service: Consumed 503ms CPU time over 17.519s wall clock time, 34.4M memory peak, 15.2K incoming IP traffic, 23.8K outgoing IP traffic.6113lb # [ 155.017203] niks3-server[1141]: 2026/09/23 04:44:56 INFO lead: acquired remote=192.168.1.3:355226114worker1 # [ 155.053782] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:56Z level=info event=scheduler_take_over6115worker2 # [ 155.072404] nix-daemon[843]: reaped child process 1620, status = succeeded6116worker2 # [ 155.075260] nix-daemon[843]: reaped child process 1529, status = succeeded6117worker2 # [ 155.080464] nix-daemon[1622]: unexpected Nix daemon error: error: interrupted by the user6118worker2 # [ 155.090996] nix-daemon[843]: reaped child process 1622, status = failed with exit code 16119worker2 # [ 155.110875] systemd[1]: scheduler-token.service: Deactivated successfully.6120worker2 # [ 155.115031] systemd[1]: Finished scheduler-token.service.6121worker2 # [ 155.115834] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 88ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6122worker2 # [ 155.119654] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.6123worker2 # [ 155.124272] systemd[1]: Starting scheduler-token.service...6124worker2 # [ 155.165743] systemd[1]: scheduler-token.service: Deactivated successfully.6125worker2 # [ 155.167994] systemd[1]: Finished scheduler-token.service.6126worker2 # [ 155.170676] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 48ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6127worker2 # [ 155.179453] systemd[1]: Starting Nix worker-protocol over gRPC...6128worker1 # [ 155.206573] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:56Z level=info event=scheduler_connected addr=lb:500516129worker2 # [ 155.273768] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:56Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6130worker2 # [ 155.276286] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6131worker2 # [ 155.279987] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16132worker2 # [ 155.286432] nix-grpc-daemon[1665]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6133worker2 # [ 155.287887] nix-grpc-daemon[1665]: E0000 00:00:1790138696.802994 1665 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6134worker1 # [ 155.294533] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6135worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.36 seconds)6136client: must succeed: sleep 5.06137worker2 # [ 155.332115] nix-grpc-daemon[1665]: E0000 00:00:1790138696.804935 1665 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6138worker2 # [ 155.336478] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:56Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6139worker2 # [ 155.338632] nix-grpc-daemon[1665]: E0000 00:00:1790138696.820647 1705 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6140worker2 # [ 155.341254] nix-grpc-daemon[1665]: E0000 00:00:1790138696.837339 1705 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6141worker2 # [ 155.346215] nix-grpc-daemon[1665]: E0000 00:00:1790138696.837492 1705 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6142worker2 # [ 155.350947] nix-grpc-daemon[1665]: E0000 00:00:1790138696.854288 1705 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6143worker2 # [ 155.353904] systemd[1]: Started Nix worker-protocol over gRPC.6144worker2 # [ 155.354726] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:56Z level=info event=scheduler_connected addr=lb:500516145worker2 # [ 155.355994] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6146worker1 # [ 155.495381] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=scheduler_connected addr=lb:500516147worker1 # [ 155.500836] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6148client # [ 155.503798] nix[1457]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting6149worker2 # [ 155.555195] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:57Z level=info event=scheduler_connected addr=lb:500516150worker2 # [ 155.561931] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6151worker1 # [ 155.701578] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=scheduler_connected addr=lb:500516152worker1 # [ 155.706909] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6153worker2 # [ 155.763081] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:57Z level=info event=scheduler_connected addr=lb:500516154worker2 # [ 155.769755] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6155worker1 # [ 155.907505] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=scheduler_connected addr=lb:500516156worker1 # [ 155.918129] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6157worker2 # [ 155.970935] nix-grpc-daemon[1665]: ts=2026-09-23T04:44:57Z level=info event=scheduler_connected addr=lb:500516158worker1 # [ 155.980231] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=oidc_jwks provider=mock keys=16159worker1 # [ 155.984677] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:356026160worker1 # [ 155.989994] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06161worker1 # [ 156.120387] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=scheduler_connected addr=lb:500516162worker1 # [ 156.125557] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6163worker1 # [ 156.326429] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=scheduler_connected addr=lb:500516164worker1 # [ 156.332667] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:356026165worker1 # [ 156.337551] nix-grpc-daemon[1475]: ts=2026-09-23T04:44:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=06166client # [ 156.510881] nix[1457]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting6167worker1 # [ 158.532515] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:00Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=06168worker1 # [ 158.532838] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:00Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=16169worker2 # [ 158.595557] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417306170worker2 # [ 158.610619] nix-daemon[843]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)6171worker2 # [ 158.633212] nix-daemon[843]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)6172client # [ 158.629482] nix[1457]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...6173worker2 # [ 158.652259] nix-daemon[843]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)6174lb # [ 160.190201] envoy[891]: conn peer=[2001:db8:1::4]:36054 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1935 tx=328 ms=173176175client: (finished: must succeed: sleep 5.0, in 5.05 seconds)6176client: waiting for success: ! systemctl is-active mid6177worker2 # [ 160.680385] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:02Z level=info event=niks3_push_started pid=17476178worker2 # [ 160.690542] nix-daemon[843]: reaped child process 1722, status = succeeded6179worker2 # [ 160.804105] nix-grpc-daemon[1747]: time=2026-09-23T04:45:02.322Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""6180worker2 # [ 160.910722] nix-daemon[843]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)6181worker2 # [ 160.930891] nix-daemon[843]: reaped child process 1763, status = succeeded6182lb # [ 160.893211] niks3-server[1141]: 2026/09/23 04:45:02 INFO Received uploads request method=POST path=/api/pending_closures6183worker2 # [ 160.951418] nix-grpc-daemon[1747]: time=2026-09-23T04:45:02.468Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6184worker2 # [ 160.954981] nix-grpc-daemon[1747]: time=2026-09-23T04:45:02.468Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"6185lb # [ 160.950531] niks3-server[1141]: 2026/09/23 04:45:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6186worker2 # [ 161.008905] nix-grpc-daemon[1747]: time=2026-09-23T04:45:02.526Z level=INFO msg="Uploading 1 narinfos"6187lb # [ 160.964574] niks3-server[1141]: 2026/09/23 04:45:02 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv6188lb # [ 160.977523] niks3-server[1141]: 2026/09/23 04:45:02 INFO Signed narinfos id=52 count=16189lb # [ 160.979357] niks3-server[1141]: 2026/09/23 04:45:02 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls6190lb # [ 160.995231] niks3-server[1141]: 2026/09/23 04:45:02 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6191worker2 # [ 161.045046] nix-grpc-daemon[1747]: time=2026-09-23T04:45:02.563Z level=INFO msg="Upload complete. (237ms)"6192lb # [ 161.004278] niks3-server[1141]: 2026/09/23 04:45:02 INFO Completed upload id=526193lb # [ 161.007003] niks3-server[1141]: 2026/09/23 04:45:02 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6194lb # [ 161.011611] niks3-server[1141]: 2026/09/23 04:45:02 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo6195worker2 # [ 161.055303] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41730 duration_s=2 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=16196worker2 # [ 161.074821] nix-daemon[843]: reaped child process 1720, status = succeeded6197client # [ 161.074531] systemd[1]: mid.service: Deactivated successfully.6198client # [ 161.078737] systemd[1]: mid.service: Consumed 202ms CPU time over 10.085s wall clock time, 41.4M memory peak, 9.4K incoming IP traffic, 11.3K outgoing IP traffic.6199client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds)6200client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6201client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)6202(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.84 seconds)6203subtest: interrupting the client stops the build on the worker6204client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr6205client # [ 161.809506] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr.6206client # Running as unit: intr.service; invocation ID: f8e7fca39b434e7dbf199bd5e4c1a94a6207client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr, in 0.05 seconds)6208worker1 # [ 162.010054] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:328486209worker1 # [ 162.024432] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6210client # [ 162.036450] nix[1493]: don't know how to build these paths:6211client # [ 162.038346] nix[1493]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6212worker1 # [ 162.059226] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:03Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=06213worker1 # [ 162.065987] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:03Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=16214worker1 # [ 162.105189] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486215worker1 # [ 162.121369] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5)6216worker1 # [ 162.162105] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 2/5)6217worker1 # [ 162.225080] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 266 ms (attempt 3/5)6218worker1 # [ 162.493374] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 663 ms (attempt 4/5)6219worker1 # [ 163.160658] nix-grpc-daemon[1475]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6220worker1 # [ 163.165179] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6221worker1 # [ 163.185213] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486222client # [ 163.193408] nix[1493]: copying 1 paths to 'lb:50051'...6223worker1 # [ 163.201264] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328486224client # [ 163.196744] nix[1493]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...6225worker1 # [ 163.220649] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6226worker1 # [ 163.249389] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:04Z level=info event=niks3_push_started pid=15766227worker1 # [ 163.395684] nix-grpc-daemon[1576]: time=2026-09-23T04:45:04.914Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""6228worker1 # [ 163.502828] nix-daemon[855]: accepted connection from pid 1589, user nix-grpc-daemon (trusted)6229worker1 # [ 163.523150] nix-daemon[855]: reaped child process 1592, status = succeeded6230lb # [ 163.492693] niks3-server[1141]: 2026/09/23 04:45:05 INFO Received uploads request method=POST path=/api/pending_closures6231worker1 # [ 163.536074] nix-grpc-daemon[1576]: time=2026-09-23T04:45:05.054Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6232worker1 # [ 163.537595] nix-grpc-daemon[1576]: time=2026-09-23T04:45:05.054Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"6233lb # [ 163.532225] niks3-server[1141]: 2026/09/23 04:45:05 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst6234worker1 # [ 163.576042] nix-grpc-daemon[1576]: time=2026-09-23T04:45:05.094Z level=INFO msg="Uploading 1 narinfos"6235lb # [ 163.547511] niks3-server[1141]: 2026/09/23 04:45:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6236lb # [ 163.555903] niks3-server[1141]: 2026/09/23 04:45:05 INFO Signed narinfos id=53 count=16237worker1 # [ 163.597929] nix-grpc-daemon[1576]: time=2026-09-23T04:45:05.117Z level=INFO msg="Upload complete. (199ms)"6238lb # [ 163.565462] niks3-server[1141]: 2026/09/23 04:45:05 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6239worker1 # [ 163.604288] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=4246240lb # [ 163.575220] niks3-server[1141]: 2026/09/23 04:45:05 INFO Completed upload id=536241lb # [ 163.578013] niks3-server[1141]: 2026/09/23 04:45:05 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls6242worker1 # [ 163.613316] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486243worker1 # [ 163.622462] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6244worker1 # [ 163.626841] nix-daemon[855]: reaped child process 1574, status = succeeded6245worker1 # [ 163.635673] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6246client # [ 163.628340] nix[1493]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...6247client: must succeed: systemctl kill -s INT intr6248worker1 # [ 165.464854] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:06Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6249client # [ 165.453734] systemd[1]: intr.service: Sent signal SIGINT to main process 1493 (nix) on client request.6250client # [ 165.463508] nix[1493]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6251client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds)6252client # [ 165.480446] nix[1493]: [mutex.cc : 451] RAW: Unlock 0xebfeff9fc788 @ 0xec03040b59a4 0xec030518d40c 0xec03245f57bc 0xec03245f7414 0xec03245ee1d4 0xec0323634f7c 0xec03233c2d806253client # [ 165.492787] systemd-coredump[1507]: Process 1493 (nix) of user 0 terminated abnormally with signal 11/SEGV, processing...6254client # [ 165.509136] systemd[1]: Started Process Core Dump (PID 1507/UID 0).6255worker1 # [ 165.662025] nix-daemon[855]: reaped child process 1594, status = succeeded6256worker1 # [ 165.663866] nix-daemon[1596]: unexpected Nix daemon error: error: interrupted by the user6257worker1 # [ 165.672938] nix-daemon[855]: reaped child process 1596, status = failed with exit code 16258(finished: subtest: interrupting the client stops the build on the worker, in 4.98 seconds)6259subtest: a deploy mid-build drains: the build finishes, the new generation takes over6260client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw6261client # [ 166.794354] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw.6262client # Running as unit: sw.service; invocation ID: 0c9f581f3a7d423788777dcd1c159ea96263client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw, in 0.06 seconds)6264worker1 # [ 167.155844] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:328486265client # [ 167.151101] nix[1514]: don't know how to build these paths:6266client # [ 167.153405] nix[1514]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6267worker1 # [ 167.166085] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:08Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=06268worker1 # [ 167.169629] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:08Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=16269worker2 # [ 167.226734] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417306270worker2 # [ 167.242781] nix-grpc-daemon[1665]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5)6271worker2 # [ 167.252220] nix-grpc-daemon[1665]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 134 ms (attempt 2/5)6272client # [ 167.343504] systemd-coredump[1508]: Cannot store coredump of 1493 (nix): No space left on device6273worker2 # [ 167.387987] nix-grpc-daemon[1665]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 77 ms (attempt 3/5)6274worker2 # [ 167.466903] nix-grpc-daemon[1665]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 157 ms (attempt 4/5)6275client # [ 167.468527] systemd-coredump[1508]: Process 1493 (nix) of user 0 terminated abnormally without generating a coredump.6276client # [ 167.480860] systemd[1]: systemd-coredump@1-2-1507_1508-0.service: Deactivated successfully.6277client # [ 167.483951] systemd[1]: systemd-coredump@1-2-1507_1508-0.service: Consumed 1.391s CPU time over 1.973s wall clock time, 968.6M memory peak, 926.1M written to disk.6278client # [ 167.494520] systemd[1]: intr.service: Main process exited, code=dumped, status=11/SEGV6279client # [ 167.497382] systemd[1]: intr.service: Failed with result 'core-dump'.6280client # [ 167.498574] systemd[1]: intr.service: Consumed 362ms CPU time over 5.686s wall clock time, 41.5M memory peak, 4K written to disk, 6.6K incoming IP traffic, 8.2K outgoing IP traffic.6281worker2 # [ 167.634060] nix-grpc-daemon[1665]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6282worker2 # [ 167.640380] nix-grpc-daemon[1665]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6283worker2 # [ 167.659434] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417306284client # [ 167.656173] nix[1514]: copying 1 paths to 'lb:50051'...6285worker2 # [ 167.675725] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417306286client # [ 167.658806] nix[1514]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...6287worker2 # [ 167.690766] nix-daemon[843]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)6288worker2 # [ 167.849499] nix-daemon[843]: accepted connection from pid 1799, user nix-grpc-daemon (trusted)6289worker2 # [ 167.868553] nix-daemon[843]: reaped child process 1802, status = succeeded6290lb # [ 167.831192] niks3-server[1141]: 2026/09/23 04:45:09 INFO Received uploads request method=POST path=/api/pending_closures6291worker2 # [ 167.889562] nix-grpc-daemon[1747]: time=2026-09-23T04:45:09.407Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6292worker2 # [ 167.891201] nix-grpc-daemon[1747]: time=2026-09-23T04:45:09.407Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"6293lb # [ 167.863736] niks3-server[1141]: 2026/09/23 04:45:09 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls6294worker2 # [ 167.922496] nix-grpc-daemon[1747]: time=2026-09-23T04:45:09.440Z level=INFO msg="Uploading 1 narinfos"6295lb # [ 167.877944] niks3-server[1141]: 2026/09/23 04:45:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6296lb # [ 167.889193] niks3-server[1141]: 2026/09/23 04:45:09 INFO Signed narinfos id=54 count=16297lb # [ 167.895585] niks3-server[1141]: 2026/09/23 04:45:09 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst6298lb # [ 167.908294] niks3-server[1141]: 2026/09/23 04:45:09 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6299lb # [ 167.919289] niks3-server[1141]: 2026/09/23 04:45:09 INFO Completed upload id=546300worker2 # [ 167.963627] nix-grpc-daemon[1747]: time=2026-09-23T04:45:09.482Z level=INFO msg="Upload complete. (256ms)"6301lb # [ 167.922162] niks3-server[1141]: 2026/09/23 04:45:09 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo6302worker2 # [ 167.974295] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41730 duration_s=0 paths=1 nar_bytes_in=4166303worker2 # [ 167.988605] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417306304worker2 # [ 168.000512] nix-daemon[843]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)6305worker2 # [ 168.005697] nix-daemon[843]: reaped child process 1797, status = succeeded6306worker2 # [ 168.018623] nix-daemon[843]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)6307client # [ 167.997402] nix[1514]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...6308lb # [ 170.191125] envoy[891]: conn peer=[2001:db8:1::1]:59954 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4314 tx=2076 ms=98676309worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26310worker2 # Checking switch inhibitors... done6311lb # [ 170.196808] envoy[891]: conn peer=[2001:db8:1::1]:59384 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554536:system_library:OPENSSL_internal:Connection_reset_by_peer:TLS_error_end" rx=2987 tx=887 ms=55056312worker2 # [ 170.931485] nixos[1842]: switching to system configuration /nix/store/8la61jwrdhbab16camb5i9ydwcpwnkl9-nixos-system-worker2-test6313worker2 # activating the configuration...6314worker2 # [ 170.938023] systemd[1]: Stopped target Local File Systems.6315worker2 # [ 170.938824] systemd[1]: Stopped target Remote File Systems.6316worker2 # setting up /etc...6317worker2 # [ 171.480706] systemd[1]: Reload requested from client PID 1842 ('.switch-to-conf') (unit backdoor.service)...6318worker2 # [ 171.482226] systemd[1]: Reloading...6319worker2 # [ 176.363583] systemd[1]: Reloading finished in 4871 ms.6320worker2 # restarting sysinit-reactivation.target6321worker2 # [ 176.492767] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6322worker2 # [ 176.619525] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6323worker2 # [ 176.621403] systemd[1]: Reached target Reactivate sysinit units.6324worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6325worker2 # [ 176.628403] systemd[1]: Reloading D-Bus System Message Bus...6326worker2 # [ 176.631202] dbus-broker-launch[485]: Caught SIGHUP, trigger reload.6327worker2 # [ 176.633786] systemd[1]: Reloading Nix worker-protocol over gRPC...6328worker2 # [ 176.647938] dbus-broker-launch[485]: Looking up NSS user entry for 'systemd-timesync'...6329worker2 # [ 176.649988] dbus-broker-launch[485]: NSS returned no entry for 'systemd-timesync'6330worker2 # [ 176.651013] dbus-broker-launch[485]: Invalid user-name in /nix/store/ng2ydfkv03gvmdws4f4mjf9wj6qj3kq6-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6331worker2 # [ 176.675950] systemd[1]: Reloaded Nix worker-protocol over gRPC.6332worker2 # [ 176.693484] systemd[1]: Reloaded D-Bus System Message Bus.6333worker2 # [ 176.696496] systemd[1]: Reached target Remote File Systems.6334worker2 # [ 176.702249] systemd[1]: Reached target Local File Systems.6335worker2 # [ 176.703075] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6336worker2 # [ 176.712425] systemd[1]: Starting Create SUID/SGID Wrappers...6337worker2 # [ 176.713300] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6338worker2 # [ 176.714464] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676339worker2 # [ 176.728132] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6340worker2 # [ 176.729971] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6341worker2 # [ 176.731204] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6342worker2 # [ 176.736385] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6343worker2 # [ 176.737655] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6344worker2 # [ 177.045882] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6345worker2 # [ 177.046952] systemd[1]: Finished Create SUID/SGID Wrappers.6346worker2 # [ 177.052546] systemd[1]: Starting linger-users.service...6347worker2 # [ 177.093279] systemd[1]: linger-users.service: Deactivated successfully.6348worker2 # [ 177.094200] systemd[1]: Finished linger-users.service.6349worker2 # [ 177.299313] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:18Z level=info event=draining6350worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6351worker2 # [ 177.353945] nixos[1842]: finished switching to system configuration /nix/store/8la61jwrdhbab16camb5i9ydwcpwnkl9-nixos-system-worker2-test6352worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 6.87 seconds)6353worker2: must succeed: pgrep -f 'read -t [9]0 x'6354worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6355client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&26356worker2 # [ 177.623461] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417306357client # don't know how to build these paths:6358client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6359worker1 # [ 177.619178] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486360worker1 # [ 177.646428] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:19Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=06361worker1 # [ 177.653662] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:19Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=16362worker1 # [ 177.692682] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486363worker1 # [ 177.708431] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486364client # copying 1 paths to 'lb:50051'...6365client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...6366worker1 # [ 177.724113] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328486367worker1 # [ 177.738899] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6368worker1 # [ 177.893136] nix-daemon[855]: accepted connection from pid 1655, user nix-grpc-daemon (trusted)6369worker1 # [ 177.914966] nix-daemon[855]: reaped child process 1658, status = succeeded6370lb # [ 177.881272] niks3-server[1141]: 2026/09/23 04:45:19 INFO Received uploads request method=POST path=/api/pending_closures6371worker1 # [ 177.925639] nix-grpc-daemon[1576]: time=2026-09-23T04:45:19.444Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6372worker1 # [ 177.927123] nix-grpc-daemon[1576]: time=2026-09-23T04:45:19.444Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"6373lb # [ 177.912872] niks3-server[1141]: 2026/09/23 04:45:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6374worker1 # [ 177.954704] nix-grpc-daemon[1576]: time=2026-09-23T04:45:19.473Z level=INFO msg="Uploading 1 narinfos"6375lb # [ 177.929244] niks3-server[1141]: 2026/09/23 04:45:19 INFO Signed narinfos id=55 count=16376lb # [ 177.937878] niks3-server[1141]: 2026/09/23 04:45:19 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls6377lb # [ 177.945582] niks3-server[1141]: 2026/09/23 04:45:19 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst6378lb # [ 177.958437] niks3-server[1141]: 2026/09/23 04:45:19 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6379lb # [ 177.964339] niks3-server[1141]: 2026/09/23 04:45:19 INFO Completed upload id=556380worker1 # [ 177.995365] nix-grpc-daemon[1576]: time=2026-09-23T04:45:19.514Z level=INFO msg="Upload complete. (240ms)"6381lb # [ 177.966518] niks3-server[1141]: 2026/09/23 04:45:19 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo6382worker1 # [ 178.004354] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=5286383worker1 # [ 178.022827] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486384worker1 # [ 178.030242] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6385worker1 # [ 178.035839] nix-daemon[855]: reaped child process 1653, status = succeeded6386client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...6387worker1 # [ 178.049843] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6388client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6389client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6390client # farm-a> LOG-farm-a-during-drain6391worker1 # [ 179.120241] nix-daemon[855]: reaped child process 1662, status = succeeded6392worker1 # [ 179.236422] nix-daemon[855]: accepted connection from pid 1678, user nix-grpc-daemon (trusted)6393worker1 # [ 179.255396] nix-daemon[855]: reaped child process 1681, status = succeeded6394lb # [ 179.227609] niks3-server[1141]: 2026/09/23 04:45:20 INFO Received uploads request method=POST path=/api/pending_closures6395worker1 # [ 179.276592] nix-grpc-daemon[1576]: time=2026-09-23T04:45:20.793Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6396worker1 # [ 179.278755] nix-grpc-daemon[1576]: time=2026-09-23T04:45:20.793Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"6397lb # [ 179.259334] niks3-server[1141]: 2026/09/23 04:45:20 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6398lb # [ 179.276729] niks3-server[1141]: 2026/09/23 04:45:20 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6399lb # [ 179.288881] niks3-server[1141]: 2026/09/23 04:45:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6400worker1 # [ 179.321858] nix-grpc-daemon[1576]: time=2026-09-23T04:45:20.841Z level=INFO msg="Uploading 1 narinfos"6401lb # [ 179.292912] niks3-server[1141]: 2026/09/23 04:45:20 INFO Signed narinfos id=56 count=16402lb # [ 179.297291] niks3-server[1141]: 2026/09/23 04:45:20 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls6403lb # [ 179.303913] niks3-server[1141]: 2026/09/23 04:45:20 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6404lb # [ 179.307684] niks3-server[1141]: 2026/09/23 04:45:20 INFO Completed upload id=566405worker1 # [ 179.339839] nix-grpc-daemon[1576]: time=2026-09-23T04:45:20.859Z level=INFO msg="Upload complete. (275ms)"6406lb # [ 179.311742] niks3-server[1141]: 2026/09/23 04:45:20 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo6407worker1 # [ 179.357073] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=16408worker1 # [ 179.372298] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:20Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=06409worker1 # [ 179.376837] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:20Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=16410worker1 # [ 179.380601] nix-daemon[855]: reaped child process 1660, status = succeeded6411worker1 # [ 179.401037] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486412worker1 # [ 179.414289] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486413worker1 # [ 179.428625] nix-grpc-daemon[1576]: time=2026-09-23T04:45:20.948Z level=INFO msg="All 1 paths already cached"6414client # copying 1 paths to 'lb:50051'...6415client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...6416worker1 # [ 179.439324] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328486417worker1 # [ 179.452847] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6418worker1 # [ 179.601044] nix-daemon[855]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6419worker1 # [ 179.618146] nix-daemon[855]: reaped child process 1690, status = succeeded6420lb # [ 179.592479] niks3-server[1141]: 2026/09/23 04:45:21 INFO Received uploads request method=POST path=/api/pending_closures6421worker1 # [ 179.637300] nix-grpc-daemon[1576]: time=2026-09-23T04:45:21.156Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6422worker1 # [ 179.638929] nix-grpc-daemon[1576]: time=2026-09-23T04:45:21.156Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"6423lb # [ 179.627284] niks3-server[1141]: 2026/09/23 04:45:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6424worker1 # [ 179.667204] nix-grpc-daemon[1576]: time=2026-09-23T04:45:21.186Z level=INFO msg="Uploading 1 narinfos"6425lb # [ 179.641312] niks3-server[1141]: 2026/09/23 04:45:21 INFO Signed narinfos id=57 count=16426lb # [ 179.643936] niks3-server[1141]: 2026/09/23 04:45:21 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst6427worker1 # [ 179.695584] nix-grpc-daemon[1576]: time=2026-09-23T04:45:21.215Z level=INFO msg="Upload complete. (227ms)"6428lb # [ 179.663628] niks3-server[1141]: 2026/09/23 04:45:21 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls6429lb # [ 179.673515] niks3-server[1141]: 2026/09/23 04:45:21 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6430worker1 # [ 179.704283] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=6406431lb # [ 179.678323] niks3-server[1141]: 2026/09/23 04:45:21 INFO Completed upload id=576432lb # [ 179.680812] niks3-server[1141]: 2026/09/23 04:45:21 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo6433worker1 # [ 179.719860] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486434worker1 # [ 179.728318] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6435worker1 # [ 179.732928] nix-daemon[855]: reaped child process 1685, status = succeeded6436client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...6437client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6438worker1 # [ 179.747149] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6439client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6440client # farm-b> LOG-farm-b-during-drain6441worker1 # [ 180.610820] nix-daemon[855]: reaped child process 1694, status = succeeded6442worker1 # [ 180.742230] nix-daemon[855]: accepted connection from pid 1710, user nix-grpc-daemon (trusted)6443worker1 # [ 180.758290] nix-daemon[855]: reaped child process 1713, status = succeeded6444lb # [ 180.734204] niks3-server[1141]: 2026/09/23 04:45:22 INFO Received uploads request method=POST path=/api/pending_closures6445worker1 # [ 180.777454] nix-grpc-daemon[1576]: time=2026-09-23T04:45:22.295Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6446worker1 # [ 180.779122] nix-grpc-daemon[1576]: time=2026-09-23T04:45:22.295Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"6447lb # [ 180.772130] niks3-server[1141]: 2026/09/23 04:45:22 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst6448worker1 # [ 180.818593] nix-grpc-daemon[1576]: time=2026-09-23T04:45:22.337Z level=INFO msg="Uploading 1 narinfos"6449lb # [ 180.785536] niks3-server[1141]: 2026/09/23 04:45:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6450lb # [ 180.798143] niks3-server[1141]: 2026/09/23 04:45:22 INFO Signed narinfos id=58 count=16451lb # [ 180.804482] niks3-server[1141]: 2026/09/23 04:45:22 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6452lb # [ 180.813424] niks3-server[1141]: 2026/09/23 04:45:22 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls6453lb # [ 180.826107] niks3-server[1141]: 2026/09/23 04:45:22 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6454worker1 # [ 180.858990] nix-grpc-daemon[1576]: time=2026-09-23T04:45:22.377Z level=INFO msg="Upload complete. (301ms)"6455lb # [ 180.831041] niks3-server[1141]: 2026/09/23 04:45:22 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo6456lb # [ 180.836181] niks3-server[1141]: 2026/09/23 04:45:22 INFO Completed upload id=586457worker1 # [ 180.876182] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=16458worker1 # [ 180.894907] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:22Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=06459worker1 # [ 180.901620] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:22Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=16460worker1 # [ 180.906666] nix-daemon[855]: reaped child process 1692, status = succeeded6461worker1 # [ 180.940477] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486462worker1 # [ 180.955067] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486463worker1 # [ 180.969963] nix-grpc-daemon[1576]: time=2026-09-23T04:45:22.489Z level=INFO msg="All 2 paths already cached"6464client # copying 1 paths to 'lb:50051'...6465client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...6466worker1 # [ 180.979985] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328486467worker1 # [ 180.993122] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6468worker1 # [ 181.144371] nix-daemon[855]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)6469worker1 # [ 181.161245] nix-daemon[855]: reaped child process 1722, status = succeeded6470lb # [ 181.133892] niks3-server[1141]: 2026/09/23 04:45:22 INFO Received uploads request method=POST path=/api/pending_closures6471worker1 # [ 181.175085] nix-grpc-daemon[1576]: time=2026-09-23T04:45:22.694Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6472worker1 # [ 181.176864] nix-grpc-daemon[1576]: time=2026-09-23T04:45:22.694Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"6473lb # [ 181.164240] niks3-server[1141]: 2026/09/23 04:45:22 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst6474worker1 # [ 181.206153] nix-grpc-daemon[1576]: time=2026-09-23T04:45:22.725Z level=INFO msg="Uploading 1 narinfos"6475lb # [ 181.179608] niks3-server[1141]: 2026/09/23 04:45:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6476lb # [ 181.189655] niks3-server[1141]: 2026/09/23 04:45:22 INFO Signed narinfos id=59 count=16477lb # [ 181.198226] niks3-server[1141]: 2026/09/23 04:45:22 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls6478worker1 # [ 181.236126] nix-grpc-daemon[1576]: time=2026-09-23T04:45:22.755Z level=INFO msg="Upload complete. (226ms)"6479lb # [ 181.204052] niks3-server[1141]: 2026/09/23 04:45:22 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6480lb # [ 181.207946] niks3-server[1141]: 2026/09/23 04:45:22 INFO Completed upload id=596481lb # [ 181.211296] niks3-server[1141]: 2026/09/23 04:45:22 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo6482worker1 # [ 181.244140] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=7686483worker1 # [ 181.259132] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486484worker1 # [ 181.268151] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6485worker1 # [ 181.270391] nix-daemon[855]: reaped child process 1717, status = succeeded6486client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...6487worker1 # [ 181.281286] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6488client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6489client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6490client # farm-top> LOG-farm-top-during-drain6491worker1 # [ 182.548972] nix-daemon[855]: reaped child process 1726, status = succeeded6492worker1 # [ 182.664571] nix-daemon[855]: accepted connection from pid 1742, user nix-grpc-daemon (trusted)6493worker1 # [ 182.686385] nix-daemon[855]: reaped child process 1745, status = succeeded6494lb # [ 182.659975] niks3-server[1141]: 2026/09/23 04:45:24 INFO Received uploads request method=POST path=/api/pending_closures6495worker1 # [ 182.703844] nix-grpc-daemon[1576]: time=2026-09-23T04:45:24.221Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6496worker1 # [ 182.705830] nix-grpc-daemon[1576]: time=2026-09-23T04:45:24.221Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"6497lb # [ 182.701448] niks3-server[1141]: 2026/09/23 04:45:24 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst6498worker1 # [ 182.745491] nix-grpc-daemon[1576]: time=2026-09-23T04:45:24.264Z level=INFO msg="Uploading 1 narinfos"6499lb # [ 182.717133] niks3-server[1141]: 2026/09/23 04:45:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6500lb # [ 182.726271] niks3-server[1141]: 2026/09/23 04:45:24 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls6501lb # [ 182.735077] niks3-server[1141]: 2026/09/23 04:45:24 INFO Signed narinfos id=60 count=16502worker1 # [ 182.767117] nix-grpc-daemon[1576]: time=2026-09-23T04:45:24.286Z level=INFO msg="Upload complete. (273ms)"6503lb # [ 182.738909] niks3-server[1141]: 2026/09/23 04:45:24 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6504lb # [ 182.743673] niks3-server[1141]: 2026/09/23 04:45:24 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6505lb # [ 182.747833] niks3-server[1141]: 2026/09/23 04:45:24 INFO Completed upload id=606506lb # [ 182.750335] niks3-server[1141]: 2026/09/23 04:45:24 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo6507worker1 # [ 182.781254] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=16508worker1 # [ 182.794924] nix-daemon[855]: reaped child process 1724, status = succeeded6509client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2, in 5.43 seconds)6510client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath6511client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath, in 0.18 seconds)6512worker2: must succeed: pkill -f 'read -t [9]0 x'6513worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6514client: waiting for success: ! systemctl is-active sw6515worker2 # [ 183.342086] nix-daemon[843]: reaped child process 1806, status = succeeded6516worker2 # [ 183.417035] nix-daemon[843]: accepted connection from pid 1983, user nix-grpc-daemon (trusted)6517worker2 # [ 183.437337] nix-daemon[843]: reaped child process 1986, status = succeeded6518lb # [ 183.391577] niks3-server[1141]: 2026/09/23 04:45:24 INFO Received uploads request method=POST path=/api/pending_closures6519worker2 # [ 183.446314] nix-grpc-daemon[1747]: time=2026-09-23T04:45:24.963Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6520worker2 # [ 183.447785] nix-grpc-daemon[1747]: time=2026-09-23T04:45:24.964Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"6521lb # [ 183.431244] niks3-server[1141]: 2026/09/23 04:45:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6522worker2 # [ 183.482830] nix-grpc-daemon[1747]: time=2026-09-23T04:45:25.001Z level=INFO msg="Uploading 1 narinfos"6523lb # [ 183.446144] niks3-server[1141]: 2026/09/23 04:45:24 INFO Signed narinfos id=61 count=16524lb # [ 183.453563] niks3-server[1141]: 2026/09/23 04:45:24 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6525lb # [ 183.463903] niks3-server[1141]: 2026/09/23 04:45:24 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls6526lb # [ 183.467583] niks3-server[1141]: 2026/09/23 04:45:24 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6527lb # [ 183.472214] niks3-server[1141]: 2026/09/23 04:45:24 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6528lb # [ 183.477741] niks3-server[1141]: 2026/09/23 04:45:25 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo6529worker2 # [ 183.523081] nix-grpc-daemon[1747]: time=2026-09-23T04:45:25.041Z level=INFO msg="Upload complete. (276ms)"6530lb # [ 183.484508] niks3-server[1141]: 2026/09/23 04:45:25 INFO Completed upload id=616531worker2 # [ 183.537151] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41730 duration_s=15 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=16532worker2 # [ 183.555533] nix-daemon[843]: reaped child process 1804, status = succeeded6533client # [ 183.551251] systemd[1]: sw.service: Deactivated successfully.6534client # [ 183.556558] systemd[1]: sw.service: Consumed 184ms CPU time over 16.757s wall clock time, 41.4M memory peak, 4K written to disk, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.6535client: (finished: waiting for success: ! systemctl is-active sw, in 1.10 seconds)6536client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6537client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)6538worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6539worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.06 seconds)6540lb: waiting until exactly no endpoints of aarch64-linux are unhealthy6541lb: must succeed: curl -sf localhost:9901/clusters6542worker2 # [ 184.302128] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:25Z level=info event=signal_exit6543lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6544worker1 # [ 185.301957] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:356026545worker1 # [ 185.302181] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:26Z level=info event=worker_gone addr=192.168.1.4:500516546worker2 # [ 185.316959] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:26Z level=info event=scheduler_restarting6547lb: must succeed: curl -sf localhost:9901/clusters6548worker2 # [ 185.342655] nix-grpc-daemon[1665]: ts=2026-09-23T04:45:26Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6549worker2 # [ 185.364965] nix-daemon[843]: reaped child process 1718, status = succeeded6550lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6551worker2 # [ 185.977596] nix-grpc-daemon[1665]: E0000 00:00:1790138727.495960 1711 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true6552worker2 # [ 185.994873] nix-grpc-daemon[1665]: E0000 00:00:1790138727.513348 1711 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6553lb: must succeed: curl -sf localhost:9901/clusters6554lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6555worker2 # [ 187.338177] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6556worker2 # [ 187.342890] systemd[1]: nix-grpc-daemon.service: Consumed 809ms CPU time over 32.317s wall clock time, 36.4M memory peak, 21.8K incoming IP traffic, 31.8K outgoing IP traffic.6557lb: must succeed: curl -sf localhost:9901/clusters6558lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6559worker2 # [ 188.341317] systemd[1]: Starting scheduler-token.service...6560worker2 # [ 188.424144] systemd[1]: scheduler-token.service: Deactivated successfully.6561worker2 # [ 188.429486] systemd[1]: Finished scheduler-token.service.6562worker2 # [ 188.431491] systemd[1]: scheduler-token.service: Consumed 57ms CPU time over 87ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6563worker2 # [ 188.455675] systemd[1]: Starting Nix worker-protocol over gRPC...6564lb: must succeed: curl -sf localhost:9901/clusters6565worker2 # [ 188.574191] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6566worker2 # [ 188.576498] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6567worker2 # [ 188.580368] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16568worker2 # [ 188.585697] nix-grpc-daemon[2001]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6569worker2 # [ 188.587123] nix-grpc-daemon[2001]: E0000 00:00:1790138730.103516 2001 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6570worker2 # [ 188.624037] nix-grpc-daemon[2001]: E0000 00:00:1790138730.109654 2001 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6571worker2 # [ 188.626341] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6572lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6573lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 4.35 seconds)6574lb: must succeed: curl -sf localhost:9901/clusters6575worker2 # [ 188.627998] systemd[1]: Started Nix worker-protocol over gRPC.6576worker2 # [ 188.640056] nix-grpc-daemon[2001]: E0000 00:00:1790138730.120259 2041 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6577worker2 # [ 188.642593] nix-grpc-daemon[2001]: E0000 00:00:1790138730.138133 2041 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6578worker2 # [ 188.647681] nix-grpc-daemon[2001]: E0000 00:00:1790138730.138252 2041 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6579worker2 # [ 188.652471] nix-grpc-daemon[2001]: E0000 00:00:1790138730.156764 2041 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6580worker2 # [ 188.654996] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:30Z level=info event=scheduler_connected addr=lb:500516581worker1 # [ 188.644807] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:356026582worker1 # [ 188.645284] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06583lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6584worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6585worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6586(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 21.98 seconds)6587subtest: queue gauges show a burst while every build blocks6588lb: must succeed: curl -sf localhost:9901/clusters6589lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6590lb: must succeed: curl -sf localhost:9901/clusters6591lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6592worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6593worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6594client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]'6595client # [ 188.955165] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]".6596client # Running as unit: burst.service; invocation ID: 2de0e452b5364482b62496af098911796597client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.09 seconds)6598lb: must succeed: curl -sf localhost:9901/clusters6599lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6600lb: must succeed: curl -sf localhost:9901/clusters6601lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6602worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6603worker2 # [ 189.174964] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:348106604worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6605worker2 # [ 189.190541] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)6606client # [ 189.190223] nix[1574]: don't know how to build these paths:6607client # [ 189.191590] nix[1574]: /nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv6608client # [ 189.193395] nix[1574]: /nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv6609client # [ 189.196308] nix[1574]: /nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv6610client # [ 189.198043] nix[1574]: /nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv6611worker1 # [ 189.213978] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=debug event=want client=5 drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv cached=06612worker2 # [ 189.237869] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348106613worker1 # [ 189.221686] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=debug event=assigned drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv worker=192.168.1.3:50051 clients=16614worker1 # [ 189.231726] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=debug event=want client=5 drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv cached=06615worker1 # [ 189.239803] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=debug event=assigned drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv worker=192.168.1.4:50051 clients=16616worker2 # [ 189.254209] nix-grpc-daemon[2001]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5)6617worker1 # [ 189.248647] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=debug event=want client=5 drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv cached=06618worker1 # [ 189.254484] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=debug event=want client=5 drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv cached=06619client # [ 189.256262] nix[1574]: copying 1 paths to 'lb:50051'...6620worker1 # [ 189.261549] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486621client # [ 189.261991] nix[1574]: copying path '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' to 'lb:50051'...6622worker1 # [ 189.266804] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486623worker1 # [ 189.282983] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328486624worker2 # [ 189.296281] nix-grpc-daemon[2001]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 2/5)6625worker1 # [ 189.294858] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6626worker1 # [ 189.432930] nix-daemon[855]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)6627worker1 # [ 189.452822] nix-daemon[855]: reaped child process 1763, status = succeeded6628lb # [ 189.425615] niks3-server[1141]: 2026/09/23 04:45:30 INFO Received uploads request method=POST path=/api/pending_closures6629worker1 # [ 189.469012] nix-grpc-daemon[1576]: time=2026-09-23T04:45:30.987Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6630worker1 # [ 189.470487] nix-grpc-daemon[1576]: time=2026-09-23T04:45:30.987Z level=INFO msg="Uploading d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv (416B)"6631worker2 # [ 189.495396] nix-grpc-daemon[2001]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 38 ms (attempt 3/5)6632lb # [ 189.464778] niks3-server[1141]: 2026/09/23 04:45:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6633worker1 # [ 189.504443] nix-grpc-daemon[1576]: time=2026-09-23T04:45:31.023Z level=INFO msg="Uploading 1 narinfos"6634lb # [ 189.474456] niks3-server[1141]: 2026/09/23 04:45:31 INFO Signed narinfos id=62 count=16635lb # [ 189.484765] niks3-server[1141]: 2026/09/23 04:45:31 INFO Registered completed upload object_key=d4rrlfallgfbcpmjnsn604l2mgff4hgx.ls6636lb # [ 189.491927] niks3-server[1141]: 2026/09/23 04:45:31 INFO Registered completed upload object_key=nar/06ismykzsix0w29371dm1hbzzf3ljf9jn7dyh8skp5wqfkkw0vlk.nar.zst6637worker2 # [ 189.535405] nix-grpc-daemon[2001]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 693 ms (attempt 4/5)6638lb # [ 189.503022] niks3-server[1141]: 2026/09/23 04:45:31 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6639worker1 # [ 189.539554] nix-grpc-daemon[1576]: time=2026-09-23T04:45:31.058Z level=INFO msg="Upload complete. (239ms)"6640lb # [ 189.511430] niks3-server[1141]: 2026/09/23 04:45:31 INFO Completed upload id=626641worker1 # [ 189.550707] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=4166642lb # [ 189.520874] niks3-server[1141]: 2026/09/23 04:45:31 INFO Registered completed upload object_key=d4rrlfallgfbcpmjnsn604l2mgff4hgx.narinfo6643worker1 # [ 189.568804] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486644worker1 # [ 189.576246] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6645worker1 # [ 189.582347] nix-daemon[855]: reaped child process 1758, status = succeeded6646client # [ 189.586949] nix[1574]: building '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' on lb:50051...6647worker1 # [ 189.598370] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6648lb: must succeed: curl -sf localhost:9901/clusters6649worker2 # [ 190.233422] nix-grpc-daemon[2001]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6650lb # [ 190.193238] envoy[891]: conn peer=[2001:db8:1::1]:56484 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9608 tx=4420 ms=51856651worker2 # [ 190.233742] nix-grpc-daemon[2001]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6652worker2 # [ 190.261477] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348106653client # [ 190.257303] nix[1574]: copying 1 paths to 'lb:50051'...6654lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)6655lb: must succeed: curl -sf localhost:9901/clusters6656worker2 # [ 190.277818] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348106657client # [ 190.263003] nix[1574]: copying path '/nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv' to 'lb:50051'...6658worker2 # [ 190.293703] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)6659lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6660worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6661worker2 # [ 190.322115] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:31Z level=info event=niks3_push_started pid=20626662worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6663worker2 # [ 190.481971] nix-grpc-daemon[2062]: time=2026-09-23T04:45:31.999Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""6664worker2 # [ 190.604992] nix-daemon[843]: accepted connection from pid 2079, user nix-grpc-daemon (trusted)6665worker2 # [ 190.625620] nix-daemon[843]: reaped child process 2082, status = succeeded6666lb # [ 190.198599] envoy[891]: conn peer=[2001:db8:1::1]:59390 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3038 tx=1578 ms=163926667lb # [ 190.198748] envoy[891]: conn peer=[2001:db8:1::4]:50044 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=3794 tx=500 ms=299746668lb # [ 190.586197] niks3-server[1141]: 2026/09/23 04:45:32 INFO Received uploads request method=POST path=/api/pending_closures6669worker2 # [ 190.651404] nix-grpc-daemon[2062]: time=2026-09-23T04:45:32.168Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6670worker2 # [ 190.655368] nix-grpc-daemon[2062]: time=2026-09-23T04:45:32.168Z level=INFO msg="Uploading dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv (416B)"6671lb # [ 190.634123] niks3-server[1141]: 2026/09/23 04:45:32 INFO Registered completed upload object_key=dspy0axfmddglppg9zj9blmxlzhfs40x.ls6672worker2 # [ 190.692946] nix-grpc-daemon[2062]: time=2026-09-23T04:45:32.210Z level=INFO msg="Uploading 1 narinfos"6673lb # [ 190.650553] niks3-server[1141]: 2026/09/23 04:45:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6674lb # [ 190.663202] niks3-server[1141]: 2026/09/23 04:45:32 INFO Signed narinfos id=63 count=16675lb # [ 190.671407] niks3-server[1141]: 2026/09/23 04:45:32 INFO Registered completed upload object_key=nar/06mdwsnf16qmfi86y8r33asi4vcrp5z7kdxqki87psgfpgvvpdki.nar.zst6676worker2 # [ 190.723398] nix-grpc-daemon[2062]: time=2026-09-23T04:45:32.241Z level=INFO msg="Upload complete. (238ms)"6677lb # [ 190.679506] niks3-server[1141]: 2026/09/23 04:45:32 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6678lb # [ 190.686022] niks3-server[1141]: 2026/09/23 04:45:32 INFO Completed upload id=636679worker2 # [ 190.732319] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34810 duration_s=0 paths=1 nar_bytes_in=4166680lb # [ 190.692312] niks3-server[1141]: 2026/09/23 04:45:32 INFO Registered completed upload object_key=dspy0axfmddglppg9zj9blmxlzhfs40x.narinfo6681worker2 # [ 190.748919] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348106682worker2 # [ 190.756471] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)6683worker2 # [ 190.762111] nix-daemon[843]: reaped child process 2060, status = succeeded6684client # [ 190.753027] nix[1574]: building '/nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv' on lb:50051...6685worker2 # [ 190.776070] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)6686worker1 # [ 191.861602] nix-daemon[855]: reaped child process 1767, status = succeeded6687worker1 # [ 191.990575] nix-daemon[855]: accepted connection from pid 1795, user nix-grpc-daemon (trusted)6688worker1 # [ 192.006633] nix-daemon[855]: reaped child process 1798, status = succeeded6689lb # [ 191.981843] niks3-server[1141]: 2026/09/23 04:45:33 INFO Received uploads request method=POST path=/api/pending_closures6690worker1 # [ 192.024425] nix-grpc-daemon[1576]: time=2026-09-23T04:45:33.543Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6691worker1 # [ 192.026204] nix-grpc-daemon[1576]: time=2026-09-23T04:45:33.543Z level=INFO msg="Uploading k6zivhvzgmlyxfmy64fzd759bxlhf9b5-slow-q0 (120B)"6692lb # [ 192.031039] niks3-server[1141]: 2026/09/23 04:45:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6693worker1 # [ 192.074937] nix-grpc-daemon[1576]: time=2026-09-23T04:45:33.594Z level=INFO msg="Uploading 1 narinfos"6694lb # [ 192.047504] niks3-server[1141]: 2026/09/23 04:45:33 INFO Registered completed upload object_key=log/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv6695lb # [ 192.063409] niks3-server[1141]: 2026/09/23 04:45:33 INFO Signed narinfos id=64 count=16696worker1 # [ 192.100599] nix-grpc-daemon[1576]: time=2026-09-23T04:45:33.619Z level=INFO msg="Upload complete. (287ms)"6697lb # [ 192.070230] niks3-server[1141]: 2026/09/23 04:45:33 INFO Registered completed upload object_key=k6zivhvzgmlyxfmy64fzd759bxlhf9b5.ls6698lb # [ 192.077777] niks3-server[1141]: 2026/09/23 04:45:33 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst6699lb # [ 192.083982] niks3-server[1141]: 2026/09/23 04:45:33 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6700worker1 # [ 192.113197] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=2 drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv assign_id=7 outputs=16701lb # [ 192.088853] niks3-server[1141]: 2026/09/23 04:45:33 INFO Completed upload id=646702lb # [ 192.091308] niks3-server[1141]: 2026/09/23 04:45:33 INFO Registered completed upload object_key=k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo6703worker1 # [ 192.135069] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:33Z level=debug event=assigned drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv worker=192.168.1.3:50051 clients=16704worker1 # [ 192.142037] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486705worker1 # [ 192.148005] nix-daemon[855]: reaped child process 1765, status = succeeded6706worker1 # [ 192.151460] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486707client # [ 192.146390] nix[1574]: copying 1 paths to 'lb:50051'...6708worker1 # [ 192.156494] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328486709client # [ 192.152177] nix[1574]: copying path '/nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv' to 'lb:50051'...6710worker1 # [ 192.172407] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6711worker1 # [ 192.304817] nix-daemon[855]: accepted connection from pid 1802, user nix-grpc-daemon (trusted)6712worker1 # [ 192.323395] nix-daemon[855]: reaped child process 1805, status = succeeded6713lb # [ 192.294366] niks3-server[1141]: 2026/09/23 04:45:33 INFO Received uploads request method=POST path=/api/pending_closures6714worker1 # [ 192.335596] nix-grpc-daemon[1576]: time=2026-09-23T04:45:33.854Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6715worker1 # [ 192.337300] nix-grpc-daemon[1576]: time=2026-09-23T04:45:33.854Z level=INFO msg="Uploading jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv (416B)"6716lb # [ 192.323678] niks3-server[1141]: 2026/09/23 04:45:33 INFO Registered completed upload object_key=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.ls6717worker1 # [ 192.368363] nix-grpc-daemon[1576]: time=2026-09-23T04:45:33.887Z level=INFO msg="Uploading 1 narinfos"6718lb # [ 192.335875] niks3-server[1141]: 2026/09/23 04:45:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6719lb # [ 192.349140] niks3-server[1141]: 2026/09/23 04:45:33 INFO Signed narinfos id=65 count=16720worker1 # [ 192.392409] nix-grpc-daemon[1576]: time=2026-09-23T04:45:33.911Z level=INFO msg="Upload complete. (214ms)"6721lb # [ 192.359853] niks3-server[1141]: 2026/09/23 04:45:33 INFO Registered completed upload object_key=nar/1fyfjzlx8vymsfmdv5cv8ymgjkr18fwm737qvys29plwwiwmyvwr.nar.zst6722worker1 # [ 192.399845] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=4166723lb # [ 192.371674] niks3-server[1141]: 2026/09/23 04:45:33 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6724lb # [ 192.377460] niks3-server[1141]: 2026/09/23 04:45:33 INFO Completed upload id=656725lb # [ 192.379921] niks3-server[1141]: 2026/09/23 04:45:33 INFO Registered completed upload object_key=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.narinfo6726worker1 # [ 192.414611] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486727worker1 # [ 192.420897] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6728worker1 # [ 192.425488] nix-daemon[855]: reaped child process 1800, status = succeeded6729worker1 # [ 192.436159] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6730client # [ 192.427920] nix[1574]: building '/nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv' on lb:50051...6731worker2 # [ 193.014475] nix-daemon[843]: reaped child process 2086, status = succeeded6732worker2 # [ 193.111682] nix-daemon[843]: accepted connection from pid 2111, user nix-grpc-daemon (trusted)6733worker2 # [ 193.129889] nix-daemon[843]: reaped child process 2114, status = succeeded6734lb # [ 193.091501] niks3-server[1141]: 2026/09/23 04:45:34 INFO Received uploads request method=POST path=/api/pending_closures6735worker2 # [ 193.146750] nix-grpc-daemon[2062]: time=2026-09-23T04:45:34.663Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6736worker2 # [ 193.149222] nix-grpc-daemon[2062]: time=2026-09-23T04:45:34.663Z level=INFO msg="Uploading y3qkgrgq2zzpgvi2rf5chq94i627wkdb-slow-q3 (120B)"6737worker2 # [ 193.187262] nix-grpc-daemon[2062]: time=2026-09-23T04:45:34.705Z level=INFO msg="Uploading 1 narinfos"6738lb # [ 193.132692] niks3-server[1141]: 2026/09/23 04:45:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6739lb # [ 193.146559] niks3-server[1141]: 2026/09/23 04:45:34 INFO Registered completed upload object_key=y3qkgrgq2zzpgvi2rf5chq94i627wkdb.ls6740lb # [ 193.156524] niks3-server[1141]: 2026/09/23 04:45:34 INFO Signed narinfos id=66 count=16741worker2 # [ 193.210486] nix-grpc-daemon[2062]: time=2026-09-23T04:45:34.729Z level=INFO msg="Upload complete. (223ms)"6742worker1 # [ 193.207520] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:34Z level=debug event=assigned drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv worker=192.168.1.4:50051 clients=16743lb # [ 193.166685] niks3-server[1141]: 2026/09/23 04:45:34 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst6744worker2 # [ 193.221428] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34810 duration_s=2 drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv assign_id=8 outputs=16745lb # [ 193.179223] niks3-server[1141]: 2026/09/23 04:45:34 INFO Registered completed upload object_key=log/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv6746lb # [ 193.184713] niks3-server[1141]: 2026/09/23 04:45:34 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6747lb # [ 193.189158] niks3-server[1141]: 2026/09/23 04:45:34 INFO Completed upload id=666748worker2 # [ 193.235281] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348106749lb # [ 193.191582] niks3-server[1141]: 2026/09/23 04:45:34 INFO Registered completed upload object_key=y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo6750worker2 # [ 193.239250] nix-daemon[843]: reaped child process 2084, status = succeeded6751worker2 # [ 193.247167] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348106752client # [ 193.240080] nix[1574]: copying 1 paths to 'lb:50051'...6753worker2 # [ 193.258517] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348106754client # [ 193.240324] nix[1574]: copying path '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' to 'lb:50051'...6755worker2 # [ 193.268440] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)6756worker2 # [ 193.395498] nix-daemon[843]: accepted connection from pid 2118, user nix-grpc-daemon (trusted)6757worker2 # [ 193.415907] nix-daemon[843]: reaped child process 2121, status = succeeded6758lb # [ 193.374362] niks3-server[1141]: 2026/09/23 04:45:34 INFO Received uploads request method=POST path=/api/pending_closures6759worker2 # [ 193.427825] nix-grpc-daemon[2062]: time=2026-09-23T04:45:34.946Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6760worker2 # [ 193.429500] nix-grpc-daemon[2062]: time=2026-09-23T04:45:34.946Z level=INFO msg="Uploading pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv (416B)"6761lb # [ 193.404302] niks3-server[1141]: 2026/09/23 04:45:34 INFO Registered completed upload object_key=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.ls6762worker2 # [ 193.459683] nix-grpc-daemon[2062]: time=2026-09-23T04:45:34.977Z level=INFO msg="Uploading 1 narinfos"6763lb # [ 193.418446] niks3-server[1141]: 2026/09/23 04:45:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6764lb # [ 193.429944] niks3-server[1141]: 2026/09/23 04:45:34 INFO Signed narinfos id=67 count=16765lb # [ 193.438959] niks3-server[1141]: 2026/09/23 04:45:34 INFO Registered completed upload object_key=nar/1k21jrz411xc9gkca2pnr9mrjq1s3bg3zhsam3nnv4j066dgzgm7.nar.zst6766worker2 # [ 193.491734] nix-grpc-daemon[2062]: time=2026-09-23T04:45:35.010Z level=INFO msg="Upload complete. (213ms)"6767lb # [ 193.448721] niks3-server[1141]: 2026/09/23 04:45:34 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6768lb # [ 193.453548] niks3-server[1141]: 2026/09/23 04:45:34 INFO Completed upload id=676769worker2 # [ 193.500247] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34810 duration_s=0 paths=1 nar_bytes_in=4166770lb # [ 193.457483] niks3-server[1141]: 2026/09/23 04:45:34 INFO Registered completed upload object_key=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.narinfo6771worker2 # [ 193.514103] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348106772worker2 # [ 193.519866] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)6773worker2 # [ 193.524892] nix-daemon[843]: reaped child process 2116, status = succeeded6774client # [ 193.514236] nix[1574]: building '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' on lb:50051...6775worker2 # [ 193.536678] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)6776worker1 # [ 194.068791] nix-daemon[855]: reaped child process 1809, status = succeeded6777worker1 # [ 194.157415] nix-daemon[855]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6778worker1 # [ 194.175736] nix-daemon[855]: reaped child process 1837, status = succeeded6779lb # [ 194.149734] niks3-server[1141]: 2026/09/23 04:45:35 INFO Received uploads request method=POST path=/api/pending_closures6780worker1 # [ 194.192380] nix-grpc-daemon[1576]: time=2026-09-23T04:45:35.710Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6781worker1 # [ 194.193883] nix-grpc-daemon[1576]: time=2026-09-23T04:45:35.710Z level=INFO msg="Uploading gjyi8j90pk5flrsqqdhj6h132pcb7n33-slow-q2 (120B)"6782lb # [ 194.193772] niks3-server[1141]: 2026/09/23 04:45:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6783worker1 # [ 194.234269] nix-grpc-daemon[1576]: time=2026-09-23T04:45:35.753Z level=INFO msg="Uploading 1 narinfos"6784lb # [ 194.208345] niks3-server[1141]: 2026/09/23 04:45:35 INFO Signed narinfos id=68 count=16785lb # [ 194.211142] niks3-server[1141]: 2026/09/23 04:45:35 INFO Registered completed upload object_key=gjyi8j90pk5flrsqqdhj6h132pcb7n33.ls6786lb # [ 194.223027] niks3-server[1141]: 2026/09/23 04:45:35 INFO Registered completed upload object_key=log/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv6787worker1 # [ 194.265353] nix-grpc-daemon[1576]: time=2026-09-23T04:45:35.784Z level=INFO msg="Upload complete. (216ms)"6788lb # [ 194.233386] niks3-server[1141]: 2026/09/23 04:45:35 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst6789lb # [ 194.242414] niks3-server[1141]: 2026/09/23 04:45:35 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6790worker1 # [ 194.274685] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv assign_id=9 outputs=16791lb # [ 194.246702] niks3-server[1141]: 2026/09/23 04:45:35 INFO Completed upload id=686792lb # [ 194.249061] niks3-server[1141]: 2026/09/23 04:45:35 INFO Registered completed upload object_key=gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo6793worker1 # [ 194.289865] nix-daemon[855]: reaped child process 1807, status = succeeded6794worker2 # [ 195.375123] nix-daemon[843]: reaped child process 2125, status = succeeded6795worker2 # [ 195.487714] nix-daemon[843]: accepted connection from pid 2150, user nix-grpc-daemon (trusted)6796worker2 # [ 195.503937] nix-daemon[843]: reaped child process 2153, status = succeeded6797lb # [ 195.466892] niks3-server[1141]: 2026/09/23 04:45:36 INFO Received uploads request method=POST path=/api/pending_closures6798worker2 # [ 195.520406] nix-grpc-daemon[2062]: time=2026-09-23T04:45:37.038Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6799worker2 # [ 195.522783] nix-grpc-daemon[2062]: time=2026-09-23T04:45:37.040Z level=INFO msg="Uploading l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx-slow-q1 (120B)"6800lb # [ 195.510793] niks3-server[1141]: 2026/09/23 04:45:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6801worker2 # [ 195.566118] nix-grpc-daemon[2062]: time=2026-09-23T04:45:37.084Z level=INFO msg="Uploading 1 narinfos"6802lb # [ 195.523651] niks3-server[1141]: 2026/09/23 04:45:37 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst6803lb # [ 195.534274] niks3-server[1141]: 2026/09/23 04:45:37 INFO Signed narinfos id=69 count=16804lb # [ 195.540604] niks3-server[1141]: 2026/09/23 04:45:37 INFO Registered completed upload object_key=l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.ls6805worker2 # [ 195.592074] nix-grpc-daemon[2062]: time=2026-09-23T04:45:37.110Z level=INFO msg="Upload complete. (245ms)"6806lb # [ 195.548527] niks3-server[1141]: 2026/09/23 04:45:37 INFO Registered completed upload object_key=log/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv6807lb # [ 195.557374] niks3-server[1141]: 2026/09/23 04:45:37 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6808lb # [ 195.562956] niks3-server[1141]: 2026/09/23 04:45:37 INFO Completed upload id=696809lb # [ 195.566842] niks3-server[1141]: 2026/09/23 04:45:37 INFO Registered completed upload object_key=l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo6810worker2 # [ 195.604713] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34810 duration_s=2 drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv assign_id=10 outputs=16811worker2 # [ 195.620463] nix-daemon[843]: reaped child process 2123, status = succeeded6812client # [ 195.627111] systemd[1]: burst.service: Deactivated successfully.6813client # [ 195.632212] systemd[1]: burst.service: Consumed 229ms CPU time over 6.673s wall clock time, 49.7M memory peak, 14K incoming IP traffic, 18.8K outgoing IP traffic.6814client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }6815client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.07 seconds)6816lb: must succeed: curl -sf localhost:9901/clusters6817lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6818lb: must succeed: curl -sf localhost:9901/clusters6819lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6820worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6821worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6822(finished: subtest: queue gauges show a burst while every build blocks, in 8.04 seconds)6823subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6824client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16825worker2 # [ 197.009892] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:348106826worker2 # [ 197.020201] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348106827worker1 # [ 197.053002] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:38Z level=debug event=want client=6 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=06828worker1 # [ 197.053308] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:38Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=16829worker1 # [ 197.053488] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:38Z level=debug event=want client=6 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=06830worker1 # [ 197.053609] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:38Z level=debug event=want client=6 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=06831worker1 # [ 197.097575] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486832worker1 # [ 197.113163] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486833worker1 # [ 197.127484] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328486834worker1 # [ 197.142350] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6835worker1 # [ 197.299055] nix-daemon[855]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6836worker1 # [ 197.317938] nix-daemon[855]: reaped child process 1857, status = succeeded6837lb # [ 197.294652] niks3-server[1141]: 2026/09/23 04:45:38 INFO Received uploads request method=POST path=/api/pending_closures6838worker1 # [ 197.338615] nix-grpc-daemon[1576]: time=2026-09-23T04:45:38.857Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6839worker1 # [ 197.341005] nix-grpc-daemon[1576]: time=2026-09-23T04:45:38.859Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"6840lb # [ 197.337658] niks3-server[1141]: 2026/09/23 04:45:38 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls6841worker1 # [ 197.379249] nix-grpc-daemon[1576]: time=2026-09-23T04:45:38.898Z level=INFO msg="Uploading 1 narinfos"6842lb # [ 197.347415] niks3-server[1141]: 2026/09/23 04:45:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign6843lb # [ 197.355585] niks3-server[1141]: 2026/09/23 04:45:38 INFO Signed narinfos id=70 count=16844lb # [ 197.363560] niks3-server[1141]: 2026/09/23 04:45:38 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst6845lb # [ 197.377777] niks3-server[1141]: 2026/09/23 04:45:38 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete6846lb # [ 197.383952] niks3-server[1141]: 2026/09/23 04:45:38 INFO Completed upload id=706847worker1 # [ 197.416219] nix-grpc-daemon[1576]: time=2026-09-23T04:45:38.935Z level=INFO msg="Upload complete. (257ms)"6848lb # [ 197.395916] niks3-server[1141]: 2026/09/23 04:45:38 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo6849worker1 # [ 197.428583] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=5126850worker1 # [ 197.444684] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486851worker1 # [ 197.454818] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6852worker1 # [ 197.459336] nix-daemon[855]: reaped child process 1852, status = succeeded6853worker1 # [ 197.471886] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6854worker1 # [ 198.556485] nix-daemon[855]: reaped child process 1861, status = succeeded6855worker1 # [ 198.660620] nix-daemon[855]: accepted connection from pid 1877, user nix-grpc-daemon (trusted)6856worker1 # [ 198.680832] nix-daemon[855]: reaped child process 1880, status = succeeded6857lb # [ 198.653467] niks3-server[1141]: 2026/09/23 04:45:40 INFO Received uploads request method=POST path=/api/pending_closures6858worker1 # [ 198.696200] nix-grpc-daemon[1576]: time=2026-09-23T04:45:40.214Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6859worker1 # [ 198.697973] nix-grpc-daemon[1576]: time=2026-09-23T04:45:40.214Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"6860lb # [ 198.696747] niks3-server[1141]: 2026/09/23 04:45:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign6861worker1 # [ 198.738082] nix-grpc-daemon[1576]: time=2026-09-23T04:45:40.257Z level=INFO msg="Uploading 1 narinfos"6862lb # [ 198.710824] niks3-server[1141]: 2026/09/23 04:45:40 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6863lb # [ 198.719972] niks3-server[1141]: 2026/09/23 04:45:40 INFO Signed narinfos id=71 count=16864lb # [ 198.724844] niks3-server[1141]: 2026/09/23 04:45:40 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv6865lb # [ 198.732475] niks3-server[1141]: 2026/09/23 04:45:40 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls6866worker1 # [ 198.765141] nix-grpc-daemon[1576]: time=2026-09-23T04:45:40.284Z level=INFO msg="Upload complete. (275ms)"6867lb # [ 198.735524] niks3-server[1141]: 2026/09/23 04:45:40 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete6868lb # [ 198.740226] niks3-server[1141]: 2026/09/23 04:45:40 INFO Completed upload id=716869lb # [ 198.742573] niks3-server[1141]: 2026/09/23 04:45:40 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo6870worker1 # [ 198.777195] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=11 outputs=16871worker1 # [ 198.800349] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:40Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=16872worker1 # [ 198.810965] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486873worker1 # [ 198.814883] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:40Z level=debug event=want client=6 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=06874worker1 # [ 198.818457] nix-daemon[855]: reaped child process 1859, status = succeeded6875worker1 # [ 198.832429] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486876worker1 # [ 198.845738] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328486877worker1 # [ 198.858412] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6878worker1 # [ 199.002894] nix-daemon[855]: accepted connection from pid 1886, user nix-grpc-daemon (trusted)6879worker1 # [ 199.021643] nix-daemon[855]: reaped child process 1889, status = succeeded6880lb # [ 198.990099] niks3-server[1141]: 2026/09/23 04:45:40 INFO Received uploads request method=POST path=/api/pending_closures6881worker1 # [ 199.030799] nix-grpc-daemon[1576]: time=2026-09-23T04:45:40.550Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6882worker1 # [ 199.032640] nix-grpc-daemon[1576]: time=2026-09-23T04:45:40.550Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"6883lb # [ 199.019149] niks3-server[1141]: 2026/09/23 04:45:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign6884worker1 # [ 199.057313] nix-grpc-daemon[1576]: time=2026-09-23T04:45:40.576Z level=INFO msg="Uploading 1 narinfos"6885lb # [ 199.032818] niks3-server[1141]: 2026/09/23 04:45:40 INFO Signed narinfos id=72 count=16886lb # [ 199.040441] niks3-server[1141]: 2026/09/23 04:45:40 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls6887worker1 # [ 199.083682] nix-grpc-daemon[1576]: time=2026-09-23T04:45:40.603Z level=INFO msg="Upload complete. (212ms)"6888lb # [ 199.052749] niks3-server[1141]: 2026/09/23 04:45:40 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst6889lb # [ 199.057626] niks3-server[1141]: 2026/09/23 04:45:40 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete6890worker1 # [ 199.092262] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=5126891lb # [ 199.063265] niks3-server[1141]: 2026/09/23 04:45:40 INFO Completed upload id=726892lb # [ 199.067354] niks3-server[1141]: 2026/09/23 04:45:40 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo6893worker1 # [ 199.105277] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486894worker1 # [ 199.110935] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6895worker1 # [ 199.115714] nix-daemon[855]: reaped child process 1884, status = succeeded6896worker1 # [ 199.125855] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6897lb # [ 200.191420] envoy[891]: conn peer=[2001:db8:1::1]:46316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9662 tx=5231 ms=64606898worker1 # [ 200.620419] nix-daemon[855]: reaped child process 1893, status = succeeded6899worker1 # [ 200.710830] nix-daemon[855]: accepted connection from pid 1909, user nix-grpc-daemon (trusted)6900worker1 # [ 200.731824] nix-daemon[855]: reaped child process 1912, status = succeeded6901lb # [ 200.703152] niks3-server[1141]: 2026/09/23 04:45:42 INFO Received uploads request method=POST path=/api/pending_closures6902worker1 # [ 200.748311] nix-grpc-daemon[1576]: time=2026-09-23T04:45:42.264Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6903worker1 # [ 200.750023] nix-grpc-daemon[1576]: time=2026-09-23T04:45:42.264Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"6904lb # [ 200.742048] niks3-server[1141]: 2026/09/23 04:45:42 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6905lb # [ 200.755366] niks3-server[1141]: 2026/09/23 04:45:42 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv6906worker1 # [ 200.798632] nix-grpc-daemon[1576]: time=2026-09-23T04:45:42.317Z level=INFO msg="Uploading 1 narinfos"6907lb # [ 200.768299] niks3-server[1141]: 2026/09/23 04:45:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign6908lb # [ 200.778041] niks3-server[1141]: 2026/09/23 04:45:42 INFO Signed narinfos id=73 count=16909lb # [ 200.783404] niks3-server[1141]: 2026/09/23 04:45:42 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls6910worker1 # [ 200.827397] nix-grpc-daemon[1576]: time=2026-09-23T04:45:42.346Z level=INFO msg="Upload complete. (289ms)"6911lb # [ 200.796351] niks3-server[1141]: 2026/09/23 04:45:42 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete6912lb # [ 200.799701] niks3-server[1141]: 2026/09/23 04:45:42 INFO Completed upload id=736913lb # [ 200.804723] niks3-server[1141]: 2026/09/23 04:45:42 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo6914worker1 # [ 200.845486] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=12 outputs=16915worker1 # [ 200.860326] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:42Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=16916worker1 # [ 200.867492] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486917worker1 # [ 200.871198] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:42Z level=debug event=want client=6 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=06918worker1 # [ 200.875286] nix-daemon[855]: reaped child process 1891, status = succeeded6919worker1 # [ 200.878682] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486920worker1 # [ 200.891149] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328486921worker1 # [ 200.902277] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6922worker1 # [ 201.040943] nix-daemon[855]: accepted connection from pid 1918, user nix-grpc-daemon (trusted)6923worker1 # [ 201.060528] nix-daemon[855]: reaped child process 1921, status = succeeded6924lb # [ 201.031571] niks3-server[1141]: 2026/09/23 04:45:42 INFO Received uploads request method=POST path=/api/pending_closures6925worker1 # [ 201.074533] nix-grpc-daemon[1576]: time=2026-09-23T04:45:42.593Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6926worker1 # [ 201.076484] nix-grpc-daemon[1576]: time=2026-09-23T04:45:42.593Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"6927lb # [ 201.062698] niks3-server[1141]: 2026/09/23 04:45:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign6928worker1 # [ 201.101319] nix-grpc-daemon[1576]: time=2026-09-23T04:45:42.620Z level=INFO msg="Uploading 1 narinfos"6929lb # [ 201.077015] niks3-server[1141]: 2026/09/23 04:45:42 INFO Signed narinfos id=74 count=16930lb # [ 201.084869] niks3-server[1141]: 2026/09/23 04:45:42 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst6931worker1 # [ 201.130476] nix-grpc-daemon[1576]: time=2026-09-23T04:45:42.649Z level=INFO msg="Upload complete. (215ms)"6932lb # [ 201.098291] niks3-server[1141]: 2026/09/23 04:45:42 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls6933lb # [ 201.103663] niks3-server[1141]: 2026/09/23 04:45:42 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete6934lb # [ 201.108779] niks3-server[1141]: 2026/09/23 04:45:42 INFO Completed upload id=746935worker1 # [ 201.140271] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=5126936lb # [ 201.114040] niks3-server[1141]: 2026/09/23 04:45:42 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo6937worker1 # [ 201.152274] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486938worker1 # [ 201.159061] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6939worker1 # [ 201.164263] nix-daemon[855]: reaped child process 1916, status = succeeded6940worker1 # [ 201.177146] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6941worker1 # [ 202.228657] nix-daemon[855]: reaped child process 1925, status = succeeded6942worker1 # [ 202.381611] nix-daemon[855]: accepted connection from pid 1941, user nix-grpc-daemon (trusted)6943worker1 # [ 202.405810] nix-daemon[855]: reaped child process 1944, status = succeeded6944lb # [ 202.375394] niks3-server[1141]: 2026/09/23 04:45:43 INFO Received uploads request method=POST path=/api/pending_closures6945worker1 # [ 202.416525] nix-grpc-daemon[1576]: time=2026-09-23T04:45:43.935Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6946worker1 # [ 202.418023] nix-grpc-daemon[1576]: time=2026-09-23T04:45:43.935Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"6947lb # [ 202.435507] niks3-server[1141]: 2026/09/23 04:45:43 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6948lb # [ 202.457186] niks3-server[1141]: 2026/09/23 04:45:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign6949worker1 # [ 202.495933] nix-grpc-daemon[1576]: time=2026-09-23T04:45:44.014Z level=INFO msg="Uploading 1 narinfos"6950lb # [ 202.469324] niks3-server[1141]: 2026/09/23 04:45:43 INFO Signed narinfos id=75 count=16951lb # [ 202.478144] niks3-server[1141]: 2026/09/23 04:45:44 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls6952lb # [ 202.495399] niks3-server[1141]: 2026/09/23 04:45:44 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete6953worker1 # [ 202.534706] nix-grpc-daemon[1576]: time=2026-09-23T04:45:44.054Z level=INFO msg="Upload complete. (344ms)"6954lb # [ 202.505864] niks3-server[1141]: 2026/09/23 04:45:44 INFO Completed upload id=756955lb # [ 202.518831] niks3-server[1141]: 2026/09/23 04:45:44 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo6956lb # [ 202.529535] niks3-server[1141]: 2026/09/23 04:45:44 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv6957worker1 # [ 202.562507] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=13 outputs=16958worker1 # [ 202.580751] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:44Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=16959worker1 # [ 202.594676] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486960worker1 # [ 202.604298] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:44Z level=debug event=want client=6 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=06961worker1 # [ 202.607675] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328486962worker1 # [ 202.614985] nix-daemon[855]: reaped child process 1923, status = succeeded6963worker1 # [ 202.618963] nix-grpc-daemon[1576]: time=2026-09-23T04:45:44.138Z level=INFO msg="All 1 paths already cached"6964worker1 # [ 202.632488] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328486965worker1 # [ 202.646480] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6966worker1 # [ 202.848408] nix-daemon[855]: accepted connection from pid 1950, user nix-grpc-daemon (trusted)6967worker1 # [ 202.871532] nix-daemon[855]: reaped child process 1953, status = succeeded6968lb # [ 202.843866] niks3-server[1141]: 2026/09/23 04:45:44 INFO Received uploads request method=POST path=/api/pending_closures6969worker1 # [ 202.888796] nix-grpc-daemon[1576]: time=2026-09-23T04:45:44.407Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6970worker1 # [ 202.890573] nix-grpc-daemon[1576]: time=2026-09-23T04:45:44.407Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6971lb # [ 202.890557] niks3-server[1141]: 2026/09/23 04:45:44 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6972worker1 # [ 202.937393] nix-grpc-daemon[1576]: time=2026-09-23T04:45:44.456Z level=INFO msg="Uploading 1 narinfos"6973lb # [ 202.910371] niks3-server[1141]: 2026/09/23 04:45:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign6974lb # [ 202.921313] niks3-server[1141]: 2026/09/23 04:45:44 INFO Signed narinfos id=76 count=16975lb # [ 202.927710] niks3-server[1141]: 2026/09/23 04:45:44 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6976lb # [ 202.951002] niks3-server[1141]: 2026/09/23 04:45:44 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete6977worker1 # [ 202.992591] nix-grpc-daemon[1576]: time=2026-09-23T04:45:44.511Z level=INFO msg="Upload complete. (328ms)"6978lb # [ 202.962406] niks3-server[1141]: 2026/09/23 04:45:44 INFO Completed upload id=766979lb # [ 202.965499] niks3-server[1141]: 2026/09/23 04:45:44 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6980worker1 # [ 203.004555] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=6246981worker1 # [ 203.020668] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328486982worker1 # [ 203.038479] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6983worker1 # [ 203.048341] nix-daemon[855]: reaped child process 1948, status = succeeded6984worker1 # [ 203.068414] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6985worker1 # [ 204.230419] nix-daemon[855]: reaped child process 1957, status = succeeded6986worker1 # [ 204.333073] nix-daemon[855]: accepted connection from pid 1973, user nix-grpc-daemon (trusted)6987worker1 # [ 204.358271] nix-daemon[855]: reaped child process 1976, status = succeeded6988lb # [ 204.335929] niks3-server[1141]: 2026/09/23 04:45:45 INFO Received uploads request method=POST path=/api/pending_closures6989worker1 # [ 204.378809] nix-grpc-daemon[1576]: time=2026-09-23T04:45:45.895Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6990worker1 # [ 204.382174] nix-grpc-daemon[1576]: time=2026-09-23T04:45:45.895Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6991lb # [ 204.393578] niks3-server[1141]: 2026/09/23 04:45:45 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6992lb # [ 204.405553] niks3-server[1141]: 2026/09/23 04:45:45 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6993lb # [ 204.413765] niks3-server[1141]: 2026/09/23 04:45:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign6994worker1 # [ 204.447269] nix-grpc-daemon[1576]: time=2026-09-23T04:45:45.965Z level=INFO msg="Uploading 1 narinfos"6995lb # [ 204.424930] niks3-server[1141]: 2026/09/23 04:45:45 INFO Signed narinfos id=77 count=16996lb # [ 204.431873] niks3-server[1141]: 2026/09/23 04:45:45 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6997lb # [ 204.448112] niks3-server[1141]: 2026/09/23 04:45:45 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete6998worker1 # [ 204.485737] nix-grpc-daemon[1576]: time=2026-09-23T04:45:46.004Z level=INFO msg="Upload complete. (395ms)"6999lb # [ 204.456186] niks3-server[1141]: 2026/09/23 04:45:45 INFO Completed upload id=777000lb # [ 204.459616] niks3-server[1141]: 2026/09/23 04:45:45 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo7001worker1 # [ 204.505400] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=14 outputs=17002worker1 # [ 204.528474] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:46Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=17003worker1 # [ 204.533817] nix-daemon[855]: reaped child process 1955, status = succeeded7004worker1 # [ 204.547978] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:46Z level=debug event=want client=6 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=07005worker1 # [ 204.554524] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328487006worker1 # [ 204.573167] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328487007worker1 # [ 204.590887] nix-grpc-daemon[1576]: time=2026-09-23T04:45:46.110Z level=INFO msg="All 1 paths already cached"7008worker1 # [ 204.604489] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328487009worker1 # [ 204.621494] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7010worker1 # [ 204.835502] nix-daemon[855]: accepted connection from pid 1982, user nix-grpc-daemon (trusted)7011worker1 # [ 204.863947] nix-daemon[855]: reaped child process 1985, status = succeeded7012lb # [ 204.828849] niks3-server[1141]: 2026/09/23 04:45:46 INFO Received uploads request method=POST path=/api/pending_closures7013worker1 # [ 204.872203] nix-grpc-daemon[1576]: time=2026-09-23T04:45:46.391Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7014worker1 # [ 204.873799] nix-grpc-daemon[1576]: time=2026-09-23T04:45:46.391Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"7015lb # [ 204.881662] niks3-server[1141]: 2026/09/23 04:45:46 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst7016worker1 # [ 204.923672] nix-grpc-daemon[1576]: time=2026-09-23T04:45:46.442Z level=INFO msg="Uploading 1 narinfos"7017lb # [ 204.896764] niks3-server[1141]: 2026/09/23 04:45:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign7018lb # [ 204.904495] niks3-server[1141]: 2026/09/23 04:45:46 INFO Signed narinfos id=78 count=17019lb # [ 204.914328] niks3-server[1141]: 2026/09/23 04:45:46 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls7020lb # [ 204.924454] niks3-server[1141]: 2026/09/23 04:45:46 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete7021worker1 # [ 204.963277] nix-grpc-daemon[1576]: time=2026-09-23T04:45:46.482Z level=INFO msg="Upload complete. (318ms)"7022lb # [ 204.935742] niks3-server[1141]: 2026/09/23 04:45:46 INFO Completed upload id=787023lb # [ 204.942281] niks3-server[1141]: 2026/09/23 04:45:46 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo7024worker1 # [ 204.976582] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=6247025worker1 # [ 204.993013] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328487026worker1 # [ 205.013263] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7027worker1 # [ 205.023335] nix-daemon[855]: reaped child process 1980, status = succeeded7028worker1 # [ 205.044544] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7029worker1 # [ 206.360712] nix-daemon[855]: reaped child process 1989, status = succeeded7030worker1 # [ 206.434767] nix-daemon[855]: accepted connection from pid 2005, user nix-grpc-daemon (trusted)7031worker1 # [ 206.453197] nix-daemon[855]: reaped child process 2008, status = succeeded7032lb # [ 206.429817] niks3-server[1141]: 2026/09/23 04:45:47 INFO Received uploads request method=POST path=/api/pending_closures7033worker1 # [ 206.473760] nix-grpc-daemon[1576]: time=2026-09-23T04:45:47.991Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7034worker1 # [ 206.476320] nix-grpc-daemon[1576]: time=2026-09-23T04:45:47.991Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"7035lb # [ 206.473990] niks3-server[1141]: 2026/09/23 04:45:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign7036worker1 # [ 206.516972] nix-grpc-daemon[1576]: time=2026-09-23T04:45:48.036Z level=INFO msg="Uploading 1 narinfos"7037lb # [ 206.488848] niks3-server[1141]: 2026/09/23 04:45:48 INFO Signed narinfos id=79 count=17038lb # [ 206.491297] niks3-server[1141]: 2026/09/23 04:45:48 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst7039lb # [ 206.506390] niks3-server[1141]: 2026/09/23 04:45:48 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv7040worker1 # [ 206.544335] nix-grpc-daemon[1576]: time=2026-09-23T04:45:48.063Z level=INFO msg="Upload complete. (280ms)"7041lb # [ 206.514231] niks3-server[1141]: 2026/09/23 04:45:48 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete7042lb # [ 206.519882] niks3-server[1141]: 2026/09/23 04:45:48 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls7043lb # [ 206.527333] niks3-server[1141]: 2026/09/23 04:45:48 INFO Completed upload id=797044lb # [ 206.530319] niks3-server[1141]: 2026/09/23 04:45:48 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo7045worker1 # [ 206.562015] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=15 outputs=17046worker1 # [ 206.585029] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:48Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=17047worker1 # [ 206.589930] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328487048worker1 # [ 206.595376] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:48Z level=debug event=want client=6 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=07049worker1 # [ 206.600347] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328487050worker1 # [ 206.605188] nix-daemon[855]: reaped child process 1987, status = succeeded7051worker1 # [ 206.606958] nix-grpc-daemon[1576]: time=2026-09-23T04:45:48.123Z level=INFO msg="All 1 paths already cached"7052worker1 # [ 206.610452] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328487053worker1 # [ 206.624234] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7054worker1 # [ 206.750666] nix-daemon[855]: accepted connection from pid 2014, user nix-grpc-daemon (trusted)7055worker1 # [ 206.768654] nix-daemon[855]: reaped child process 2017, status = succeeded7056lb # [ 206.743748] niks3-server[1141]: 2026/09/23 04:45:48 INFO Received uploads request method=POST path=/api/pending_closures7057worker1 # [ 206.785007] nix-grpc-daemon[1576]: time=2026-09-23T04:45:48.304Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7058worker1 # [ 206.786894] nix-grpc-daemon[1576]: time=2026-09-23T04:45:48.304Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"7059lb # [ 206.772927] niks3-server[1141]: 2026/09/23 04:45:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign7060worker1 # [ 206.810840] nix-grpc-daemon[1576]: time=2026-09-23T04:45:48.330Z level=INFO msg="Uploading 1 narinfos"7061lb # [ 206.788469] niks3-server[1141]: 2026/09/23 04:45:48 INFO Signed narinfos id=80 count=17062lb # [ 206.795116] niks3-server[1141]: 2026/09/23 04:45:48 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst7063lb # [ 206.809992] niks3-server[1141]: 2026/09/23 04:45:48 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete7064worker1 # [ 206.848879] nix-grpc-daemon[1576]: time=2026-09-23T04:45:48.368Z level=INFO msg="Upload complete. (218ms)"7065lb # [ 206.818323] niks3-server[1141]: 2026/09/23 04:45:48 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls7066worker1 # [ 206.856155] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=6247067lb # [ 206.826008] niks3-server[1141]: 2026/09/23 04:45:48 INFO Completed upload id=807068lb # [ 206.829165] niks3-server[1141]: 2026/09/23 04:45:48 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo7069worker1 # [ 206.870947] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328487070worker1 # [ 206.877368] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7071worker1 # [ 206.882488] nix-daemon[855]: reaped child process 2012, status = succeeded7072worker1 # [ 206.893404] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7073worker1 # [ 207.792254] nix-daemon[855]: reaped child process 2021, status = succeeded7074worker1 # [ 207.866628] nix-daemon[855]: accepted connection from pid 2037, user nix-grpc-daemon (trusted)7075worker1 # [ 207.885311] nix-daemon[855]: reaped child process 2040, status = succeeded7076lb # [ 207.861469] niks3-server[1141]: 2026/09/23 04:45:49 INFO Received uploads request method=POST path=/api/pending_closures7077worker1 # [ 207.904408] nix-grpc-daemon[1576]: time=2026-09-23T04:45:49.423Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7078worker1 # [ 207.906022] nix-grpc-daemon[1576]: time=2026-09-23T04:45:49.423Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"7079lb # [ 207.908777] niks3-server[1141]: 2026/09/23 04:45:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign7080worker1 # [ 207.948545] nix-grpc-daemon[1576]: time=2026-09-23T04:45:49.467Z level=INFO msg="Uploading 1 narinfos"7081lb # [ 207.919723] niks3-server[1141]: 2026/09/23 04:45:49 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv7082lb # [ 207.928741] niks3-server[1141]: 2026/09/23 04:45:49 INFO Signed narinfos id=81 count=17083lb # [ 207.934790] niks3-server[1141]: 2026/09/23 04:45:49 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst7084lb # [ 207.943732] niks3-server[1141]: 2026/09/23 04:45:49 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete7085lb # [ 207.948377] niks3-server[1141]: 2026/09/23 04:45:49 INFO Completed upload id=817086worker1 # [ 207.973744] nix-grpc-daemon[1576]: time=2026-09-23T04:45:49.493Z level=INFO msg="Upload complete. (268ms)"7087lb # [ 207.950526] niks3-server[1141]: 2026/09/23 04:45:49 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo7088lb # [ 207.955354] niks3-server[1141]: 2026/09/23 04:45:49 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls7089worker1 # [ 207.985278] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=16 outputs=17090worker1 # [ 208.004866] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:49Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=17091worker1 # [ 208.009850] nix-daemon[855]: reaped child process 2019, status = succeeded7092worker1 # [ 208.028806] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:49Z level=debug event=want client=6 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=07093worker1 # [ 208.036273] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328487094worker1 # [ 208.046584] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328487095worker1 # [ 208.060084] nix-grpc-daemon[1576]: time=2026-09-23T04:45:49.579Z level=INFO msg="All 2 paths already cached"7096worker1 # [ 208.069352] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328487097worker1 # [ 208.083003] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7098worker1 # [ 208.219106] nix-daemon[855]: accepted connection from pid 2046, user nix-grpc-daemon (trusted)7099worker1 # [ 208.238049] nix-daemon[855]: reaped child process 2049, status = succeeded7100lb # [ 208.211885] niks3-server[1141]: 2026/09/23 04:45:49 INFO Received uploads request method=POST path=/api/pending_closures7101worker1 # [ 208.252531] nix-grpc-daemon[1576]: time=2026-09-23T04:45:49.772Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7102worker1 # [ 208.254505] nix-grpc-daemon[1576]: time=2026-09-23T04:45:49.773Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"7103lb # [ 208.243565] niks3-server[1141]: 2026/09/23 04:45:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign7104worker1 # [ 208.281888] nix-grpc-daemon[1576]: time=2026-09-23T04:45:49.801Z level=INFO msg="Uploading 1 narinfos"7105lb # [ 208.257009] niks3-server[1141]: 2026/09/23 04:45:49 INFO Signed narinfos id=82 count=17106lb # [ 208.259698] niks3-server[1141]: 2026/09/23 04:45:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls7107lb # [ 208.274603] niks3-server[1141]: 2026/09/23 04:45:49 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete7108lb # [ 208.278133] niks3-server[1141]: 2026/09/23 04:45:49 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst7109lb # [ 208.283168] niks3-server[1141]: 2026/09/23 04:45:49 INFO Completed upload id=827110worker1 # [ 208.315194] nix-grpc-daemon[1576]: time=2026-09-23T04:45:49.834Z level=INFO msg="Upload complete. (219ms)"7111lb # [ 208.287803] niks3-server[1141]: 2026/09/23 04:45:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo7112worker1 # [ 208.323559] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=7527113worker1 # [ 208.339626] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328487114worker1 # [ 208.347616] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7115worker1 # [ 208.358547] nix-daemon[855]: reaped child process 2044, status = succeeded7116worker1 # [ 208.369510] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7117worker1 # [ 209.622079] nix-daemon[855]: reaped child process 2053, status = succeeded7118worker1 # [ 209.730056] nix-daemon[855]: accepted connection from pid 2069, user nix-grpc-daemon (trusted)7119worker1 # [ 209.748097] nix-daemon[855]: reaped child process 2072, status = succeeded7120lb # [ 209.723046] niks3-server[1141]: 2026/09/23 04:45:51 INFO Received uploads request method=POST path=/api/pending_closures7121worker1 # [ 209.766569] nix-grpc-daemon[1576]: time=2026-09-23T04:45:51.284Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7122worker1 # [ 209.768259] nix-grpc-daemon[1576]: time=2026-09-23T04:45:51.284Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"7123lb # [ 209.764767] niks3-server[1141]: 2026/09/23 04:45:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign7124worker1 # [ 209.806737] nix-grpc-daemon[1576]: time=2026-09-23T04:45:51.326Z level=INFO msg="Uploading 1 narinfos"7125lb # [ 209.777781] niks3-server[1141]: 2026/09/23 04:45:51 INFO Signed narinfos id=83 count=17126lb # [ 209.785731] niks3-server[1141]: 2026/09/23 04:45:51 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv7127lb # [ 209.793892] niks3-server[1141]: 2026/09/23 04:45:51 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst7128worker1 # [ 209.834099] nix-grpc-daemon[1576]: time=2026-09-23T04:45:51.353Z level=INFO msg="Upload complete. (251ms)"7129lb # [ 209.805252] niks3-server[1141]: 2026/09/23 04:45:51 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls7130lb # [ 209.810539] niks3-server[1141]: 2026/09/23 04:45:51 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete7131lb # [ 209.815475] niks3-server[1141]: 2026/09/23 04:45:51 INFO Completed upload id=837132lb # [ 209.817976] niks3-server[1141]: 2026/09/23 04:45:51 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo7133worker1 # [ 209.848725] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=17 outputs=17134worker1 # [ 209.863335] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:51Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=17135worker1 # [ 209.867851] nix-daemon[855]: reaped child process 2051, status = succeeded7136worker1 # [ 209.889172] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328487137worker1 # [ 209.903463] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328487138worker1 # [ 209.917715] nix-grpc-daemon[1576]: time=2026-09-23T04:45:51.437Z level=INFO msg="All 2 paths already cached"7139worker1 # [ 209.927471] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328487140worker1 # [ 209.941459] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7141worker1 # [ 210.094747] nix-daemon[855]: accepted connection from pid 2076, user nix-grpc-daemon (trusted)7142worker1 # [ 210.113491] nix-daemon[855]: reaped child process 2079, status = succeeded7143lb # [ 210.085667] niks3-server[1141]: 2026/09/23 04:45:51 INFO Received uploads request method=POST path=/api/pending_closures7144worker1 # [ 210.126629] nix-grpc-daemon[1576]: time=2026-09-23T04:45:51.645Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7145worker1 # [ 210.128321] nix-grpc-daemon[1576]: time=2026-09-23T04:45:51.645Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"7146lb # [ 210.114936] niks3-server[1141]: 2026/09/23 04:45:51 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst7147worker1 # [ 210.159007] nix-grpc-daemon[1576]: time=2026-09-23T04:45:51.678Z level=INFO msg="Uploading 1 narinfos"7148lb # [ 210.127384] niks3-server[1141]: 2026/09/23 04:45:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign7149lb # [ 210.139572] niks3-server[1141]: 2026/09/23 04:45:51 INFO Signed narinfos id=84 count=17150lb # [ 210.147446] niks3-server[1141]: 2026/09/23 04:45:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls7151lb # [ 210.155681] niks3-server[1141]: 2026/09/23 04:45:51 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete7152lb # [ 210.160487] niks3-server[1141]: 2026/09/23 04:45:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo7153worker1 # [ 210.192769] nix-grpc-daemon[1576]: time=2026-09-23T04:45:51.712Z level=INFO msg="Upload complete. (234ms)"7154lb # [ 210.163314] niks3-server[1141]: 2026/09/23 04:45:51 INFO Completed upload id=847155worker1 # [ 210.200212] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=7527156worker1 # [ 210.215977] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328487157worker1 # [ 210.224315] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7158worker1 # [ 210.229144] nix-daemon[855]: reaped child process 2074, status = succeeded7159worker1 # [ 210.243417] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7160worker1 # [ 211.530478] nix-daemon[855]: reaped child process 2083, status = succeeded7161worker1 # [ 211.598586] nix-daemon[855]: accepted connection from pid 2099, user nix-grpc-daemon (trusted)7162worker1 # [ 211.616948] nix-daemon[855]: reaped child process 2102, status = succeeded7163lb # [ 211.589785] niks3-server[1141]: 2026/09/23 04:45:53 INFO Received uploads request method=POST path=/api/pending_closures7164worker1 # [ 211.636414] nix-grpc-daemon[1576]: time=2026-09-23T04:45:53.153Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7165worker1 # [ 211.638137] nix-grpc-daemon[1576]: time=2026-09-23T04:45:53.153Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"7166lb # [ 211.643488] niks3-server[1141]: 2026/09/23 04:45:53 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv7167lb # [ 211.654058] niks3-server[1141]: 2026/09/23 04:45:53 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls7168worker1 # [ 211.695887] nix-grpc-daemon[1576]: time=2026-09-23T04:45:53.214Z level=INFO msg="Uploading 1 narinfos"7169lb # [ 211.663461] niks3-server[1141]: 2026/09/23 04:45:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign7170lb # [ 211.671890] niks3-server[1141]: 2026/09/23 04:45:53 INFO Signed narinfos id=85 count=17171lb # [ 211.679443] niks3-server[1141]: 2026/09/23 04:45:53 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst7172lb # [ 211.689052] niks3-server[1141]: 2026/09/23 04:45:53 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete7173lb # [ 211.694256] niks3-server[1141]: 2026/09/23 04:45:53 INFO Completed upload id=857174worker1 # [ 211.718063] nix-grpc-daemon[1576]: time=2026-09-23T04:45:53.237Z level=INFO msg="Upload complete. (260ms)"7175lb # [ 211.697714] niks3-server[1141]: 2026/09/23 04:45:53 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo7176worker1 # [ 211.731350] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=18 outputs=17177worker1 # [ 211.748359] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:53Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=17178worker1 # [ 211.754220] nix-daemon[855]: reaped child process 2081, status = succeeded7179worker1 # [ 211.772737] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328487180worker1 # [ 211.787622] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328487181worker1 # [ 211.802003] nix-grpc-daemon[1576]: time=2026-09-23T04:45:53.321Z level=INFO msg="All 2 paths already cached"7182worker1 # [ 211.812111] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:328487183worker1 # [ 211.825543] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7184worker1 # [ 211.973830] nix-daemon[855]: accepted connection from pid 2106, user nix-grpc-daemon (trusted)7185worker1 # [ 211.991034] nix-daemon[855]: reaped child process 2109, status = succeeded7186lb # [ 211.966336] niks3-server[1141]: 2026/09/23 04:45:53 INFO Received uploads request method=POST path=/api/pending_closures7187worker1 # [ 212.007714] nix-grpc-daemon[1576]: time=2026-09-23T04:45:53.526Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7188worker1 # [ 212.009542] nix-grpc-daemon[1576]: time=2026-09-23T04:45:53.526Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"7189lb # [ 211.994918] niks3-server[1141]: 2026/09/23 04:45:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/86/sign7190worker1 # [ 212.033278] nix-grpc-daemon[1576]: time=2026-09-23T04:45:53.552Z level=INFO msg="Uploading 1 narinfos"7191lb # [ 212.007582] niks3-server[1141]: 2026/09/23 04:45:53 INFO Signed narinfos id=86 count=17192lb # [ 212.017143] niks3-server[1141]: 2026/09/23 04:45:53 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls7193lb # [ 212.028961] niks3-server[1141]: 2026/09/23 04:45:53 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst7194worker1 # [ 212.068444] nix-grpc-daemon[1576]: time=2026-09-23T04:45:53.587Z level=INFO msg="Upload complete. (228ms)"7195lb # [ 212.036673] niks3-server[1141]: 2026/09/23 04:45:53 INFO Received complete upload request method=POST path=/api/pending_closures/86/complete7196lb # [ 212.045408] niks3-server[1141]: 2026/09/23 04:45:53 INFO Completed upload id=867197worker1 # [ 212.078160] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=0 paths=1 nar_bytes_in=7527198lb # [ 212.047899] niks3-server[1141]: 2026/09/23 04:45:53 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo7199worker1 # [ 212.092448] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:328487200worker1 # [ 212.098635] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7201worker1 # [ 212.103351] nix-daemon[855]: reaped child process 2104, status = succeeded7202worker1 # [ 212.113349] nix-daemon[855]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)7203worker1 # [ 212.974980] nix-daemon[855]: reaped child process 2113, status = succeeded7204worker1 # [ 213.108708] nix-daemon[855]: accepted connection from pid 2129, user nix-grpc-daemon (trusted)7205worker1 # [ 213.124431] nix-daemon[855]: reaped child process 2132, status = succeeded7206lb # [ 213.100834] niks3-server[1141]: 2026/09/23 04:45:54 INFO Received uploads request method=POST path=/api/pending_closures7207worker1 # [ 213.144194] nix-grpc-daemon[1576]: time=2026-09-23T04:45:54.662Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7208worker1 # [ 213.146089] nix-grpc-daemon[1576]: time=2026-09-23T04:45:54.662Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"7209lb # [ 213.141790] niks3-server[1141]: 2026/09/23 04:45:54 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv7210worker1 # [ 213.188081] nix-grpc-daemon[1576]: time=2026-09-23T04:45:54.707Z level=INFO msg="Uploading 1 narinfos"7211lb # [ 213.157289] niks3-server[1141]: 2026/09/23 04:45:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/87/sign7212lb # [ 213.165757] niks3-server[1141]: 2026/09/23 04:45:54 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst7213lb # [ 213.174294] niks3-server[1141]: 2026/09/23 04:45:54 INFO Signed narinfos id=87 count=17214lb # [ 213.177479] niks3-server[1141]: 2026/09/23 04:45:54 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls7215worker1 # [ 213.216126] nix-grpc-daemon[1576]: time=2026-09-23T04:45:54.735Z level=INFO msg="Upload complete. (292ms)"7216lb # [ 213.184882] niks3-server[1141]: 2026/09/23 04:45:54 INFO Received complete upload request method=POST path=/api/pending_closures/87/complete7217lb # [ 213.188608] niks3-server[1141]: 2026/09/23 04:45:54 INFO Completed upload id=877218lb # [ 213.191936] niks3-server[1141]: 2026/09/23 04:45:54 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo7219worker1 # [ 213.229946] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:32848 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=19 outputs=17220worker1 # [ 213.249240] nix-daemon[855]: reaped child process 2111, status = succeeded7221client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.53 seconds)7222worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7223worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)7224client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]'7225client # [ 213.425566] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features "[\"gpu\"]".7226client # Running as unit: gpu.service; invocation ID: b1ffe0dbd9234dfdbcc040b07b5a5ad27227client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds)7228lb: must succeed: curl -sf localhost:9901/clusters7229lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)7230lb: must succeed: curl -sf localhost:9901/clusters7231lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7232worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7233client # [ 213.632964] nix[1647]: don't know how to build these paths:7234client # [ 213.634257] nix[1647]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv7235worker1 # [ 213.640316] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:328487236worker2 # [ 213.659347] nix-grpc-daemon[2001]: ts=2026-09-23T04:45:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348107237worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)7238worker1 # [ 213.676142] nix-grpc-daemon[1475]: ts=2026-09-23T04:45:55Z level=debug event=want client=7 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=07239client # [ 213.676140] nix[1647]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}, waiting up to 30s for a worker7240lb: must succeed: curl -sf localhost:9901/clusters7241lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)7242lb: must succeed: curl -sf localhost:9901/clusters7243lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7244worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7245worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)7246client: waiting for success: systemctl show -p Result gpu | grep -q exit-code7247lb # [ 220.191180] envoy[891]: conn peer=[2001:db8:1::1]:51932 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27179 tx=12334 ms=162497248client # [ 243.683564] nix[1647]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}7249client # [ 243.698930] nix[1647]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed7250client # [ 243.730559] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE7251client # [ 243.738742] systemd[1]: gpu.service: Failed with result 'exit-code'.7252client # [ 243.742545] systemd[1]: gpu.service: Consumed 203ms CPU time over 30.310s wall clock time, 35.6M memory peak, 5.6K incoming IP traffic, 5.2K outgoing IP traffic.7253client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.08 seconds)7254client: must succeed: journalctl -u gpu -o cat7255client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)7256lb: must succeed: curl -sf localhost:9901/clusters7257lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)7258lb: must succeed: curl -sf localhost:9901/clusters7259lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7260worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7261worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)7262(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 47.34 seconds)7263subtest: low disk drains a worker and builds go to the other7264worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill7265worker1 # [ 245.101363] nix-grpc-daemon[1475]: ts=2026-09-23T04:46:26Z level=info event=unhealthy reason=min_free7266worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.14 seconds)7267worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'7268worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.03 seconds)7269client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&27270client # don't know how to build these paths:7271client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7272worker1 # [ 245.515942] nix-grpc-daemon[1475]: ts=2026-09-23T04:46:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:328487273worker1 # [ 245.525519] nix-grpc-daemon[1475]: ts=2026-09-23T04:46:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:328487274worker1 # [ 245.545180] nix-grpc-daemon[1475]: ts=2026-09-23T04:46:27Z level=debug event=want client=8 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=07275worker2 # [ 245.562494] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348107276worker1 # [ 245.551466] nix-grpc-daemon[1475]: ts=2026-09-23T04:46:27Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=17277worker2 # [ 245.578247] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348107278client # copying 1 paths to 'lb:50051'...7279client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...7280worker2 # [ 245.594309] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348107281worker2 # [ 245.611438] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)7282worker2 # [ 245.784903] nix-daemon[843]: accepted connection from pid 2161, user nix-grpc-daemon (trusted)7283worker2 # [ 245.803674] nix-daemon[843]: reaped child process 2164, status = succeeded7284lb # [ 245.767593] niks3-server[1141]: 2026/09/23 04:46:27 INFO Received uploads request method=POST path=/api/pending_closures7285worker2 # [ 245.824599] nix-grpc-daemon[2062]: time=2026-09-23T04:46:27.342Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7286worker2 # [ 245.826905] nix-grpc-daemon[2062]: time=2026-09-23T04:46:27.342Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"7287lb # [ 245.803665] niks3-server[1141]: 2026/09/23 04:46:27 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls7288lb # [ 245.818992] niks3-server[1141]: 2026/09/23 04:46:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/88/sign7289worker2 # [ 245.870657] nix-grpc-daemon[2062]: time=2026-09-23T04:46:27.388Z level=INFO msg="Uploading 1 narinfos"7290lb # [ 245.834003] niks3-server[1141]: 2026/09/23 04:46:27 INFO Signed narinfos id=88 count=17291lb # [ 245.837806] niks3-server[1141]: 2026/09/23 04:46:27 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst7292lb # [ 245.862240] niks3-server[1141]: 2026/09/23 04:46:27 INFO Received complete upload request method=POST path=/api/pending_closures/88/complete7293lb # [ 245.868578] niks3-server[1141]: 2026/09/23 04:46:27 INFO Completed upload id=887294worker2 # [ 245.911696] nix-grpc-daemon[2062]: time=2026-09-23T04:46:27.430Z level=INFO msg="Upload complete. (280ms)"7295lb # [ 245.873056] niks3-server[1141]: 2026/09/23 04:46:27 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo7296worker2 # [ 245.924292] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34810 duration_s=0 paths=1 nar_bytes_in=5127297worker2 # [ 245.940322] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348107298worker2 # [ 245.953619] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)7299worker2 # [ 245.957850] nix-daemon[843]: reaped child process 2159, status = succeeded7300client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...7301worker2 # [ 245.972612] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)7302client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7303client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds7304worker2 # [ 246.609472] nix-daemon[843]: reaped child process 2168, status = succeeded7305client # farm-a> LOG-farm-a-drain7306worker2 # [ 246.698834] nix-daemon[843]: accepted connection from pid 2184, user nix-grpc-daemon (trusted)7307worker2 # [ 246.719925] nix-daemon[843]: reaped child process 2187, status = succeeded7308lb # [ 246.679712] niks3-server[1141]: 2026/09/23 04:46:28 INFO Received uploads request method=POST path=/api/pending_closures7309worker2 # [ 246.737360] nix-grpc-daemon[2062]: time=2026-09-23T04:46:28.254Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7310worker2 # [ 246.738847] nix-grpc-daemon[2062]: time=2026-09-23T04:46:28.254Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"7311lb # [ 246.729323] niks3-server[1141]: 2026/09/23 04:46:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/89/sign7312worker2 # [ 246.779238] nix-grpc-daemon[2062]: time=2026-09-23T04:46:28.297Z level=INFO msg="Uploading 1 narinfos"7313lb # [ 246.740560] niks3-server[1141]: 2026/09/23 04:46:28 INFO Signed narinfos id=89 count=17314lb # [ 246.742588] niks3-server[1141]: 2026/09/23 04:46:28 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst7315lb # [ 246.753959] niks3-server[1141]: 2026/09/23 04:46:28 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7316lb # [ 246.758068] niks3-server[1141]: 2026/09/23 04:46:28 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls7317lb # [ 246.764809] niks3-server[1141]: 2026/09/23 04:46:28 INFO Received complete upload request method=POST path=/api/pending_closures/89/complete7318lb # [ 246.769762] niks3-server[1141]: 2026/09/23 04:46:28 INFO Completed upload id=897319worker2 # [ 246.812851] nix-grpc-daemon[2062]: time=2026-09-23T04:46:28.331Z level=INFO msg="Upload complete. (226ms)"7320lb # [ 246.771966] niks3-server[1141]: 2026/09/23 04:46:28 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo7321worker1 # [ 246.817245] nix-grpc-daemon[1475]: ts=2026-09-23T04:46:28Z level=debug event=want client=8 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=07322worker2 # [ 246.825085] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34810 duration_s=0 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=20 outputs=17323worker1 # [ 246.822997] nix-grpc-daemon[1475]: ts=2026-09-23T04:46:28Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=17324worker2 # [ 246.841483] nix-daemon[843]: reaped child process 2166, status = succeeded7325worker2 # [ 246.872943] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348107326worker2 # [ 246.888137] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348107327worker2 # [ 246.902830] nix-grpc-daemon[2062]: time=2026-09-23T04:46:28.420Z level=INFO msg="All 1 paths already cached"7328client # copying 1 paths to 'lb:50051'...7329client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...7330worker2 # [ 246.913516] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348107331worker2 # [ 246.928281] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)7332worker2 # [ 247.082820] nix-daemon[843]: accepted connection from pid 2191, user nix-grpc-daemon (trusted)7333worker2 # [ 247.103412] nix-daemon[843]: reaped child process 2194, status = succeeded7334lb # [ 247.062349] niks3-server[1141]: 2026/09/23 04:46:28 INFO Received uploads request method=POST path=/api/pending_closures7335worker2 # [ 247.115961] nix-grpc-daemon[2062]: time=2026-09-23T04:46:28.634Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7336worker2 # [ 247.117700] nix-grpc-daemon[2062]: time=2026-09-23T04:46:28.634Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"7337lb # [ 247.091415] niks3-server[1141]: 2026/09/23 04:46:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/90/sign7338worker2 # [ 247.141732] nix-grpc-daemon[2062]: time=2026-09-23T04:46:28.660Z level=INFO msg="Uploading 1 narinfos"7339lb # [ 247.104335] niks3-server[1141]: 2026/09/23 04:46:28 INFO Signed narinfos id=90 count=17340lb # [ 247.107227] niks3-server[1141]: 2026/09/23 04:46:28 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst7341worker2 # [ 247.167501] nix-grpc-daemon[2062]: time=2026-09-23T04:46:28.686Z level=INFO msg="Upload complete. (222ms)"7342lb # [ 247.124950] niks3-server[1141]: 2026/09/23 04:46:28 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls7343lb # [ 247.132114] niks3-server[1141]: 2026/09/23 04:46:28 INFO Received complete upload request method=POST path=/api/pending_closures/90/complete7344worker2 # [ 247.175261] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34810 duration_s=0 paths=1 nar_bytes_in=6327345lb # [ 247.135972] niks3-server[1141]: 2026/09/23 04:46:28 INFO Completed upload id=907346lb # [ 247.139889] niks3-server[1141]: 2026/09/23 04:46:28 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo7347worker2 # [ 247.189144] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348107348worker2 # [ 247.194704] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)7349worker2 # [ 247.199314] nix-daemon[843]: reaped child process 2189, status = succeeded7350client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...7351worker2 # [ 247.209732] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)7352client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7353client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds7354client # farm-b> LOG-farm-b-drain7355worker2 # [ 248.491050] nix-daemon[843]: reaped child process 2198, status = succeeded7356worker2 # [ 248.593362] nix-daemon[843]: accepted connection from pid 2214, user nix-grpc-daemon (trusted)7357worker2 # [ 248.615723] nix-daemon[843]: reaped child process 2217, status = succeeded7358lb # [ 248.571058] niks3-server[1141]: 2026/09/23 04:46:30 INFO Received uploads request method=POST path=/api/pending_closures7359worker2 # [ 248.627373] nix-grpc-daemon[2062]: time=2026-09-23T04:46:30.143Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7360worker2 # [ 248.629007] nix-grpc-daemon[2062]: time=2026-09-23T04:46:30.143Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"7361lb # [ 248.613358] niks3-server[1141]: 2026/09/23 04:46:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/91/sign7362worker2 # [ 248.666983] nix-grpc-daemon[2062]: time=2026-09-23T04:46:30.185Z level=INFO msg="Uploading 1 narinfos"7363lb # [ 248.627167] niks3-server[1141]: 2026/09/23 04:46:30 INFO Signed narinfos id=91 count=17364lb # [ 248.636644] niks3-server[1141]: 2026/09/23 04:46:30 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst7365lb # [ 248.647121] niks3-server[1141]: 2026/09/23 04:46:30 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7366lb # [ 248.653443] niks3-server[1141]: 2026/09/23 04:46:30 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls7367worker2 # [ 248.707876] nix-grpc-daemon[2062]: time=2026-09-23T04:46:30.226Z level=INFO msg="Upload complete. (285ms)"7368lb # [ 248.663649] niks3-server[1141]: 2026/09/23 04:46:30 INFO Received complete upload request method=POST path=/api/pending_closures/91/complete7369lb # [ 248.669029] niks3-server[1141]: 2026/09/23 04:46:30 INFO Completed upload id=917370lb # [ 248.672708] niks3-server[1141]: 2026/09/23 04:46:30 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo7371worker2 # [ 248.720772] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34810 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=21 outputs=17372worker1 # [ 248.718918] nix-grpc-daemon[1475]: ts=2026-09-23T04:46:30Z level=debug event=want client=8 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=07373worker1 # [ 248.725540] nix-grpc-daemon[1475]: ts=2026-09-23T04:46:30Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=17374worker2 # [ 248.742903] nix-daemon[843]: reaped child process 2196, status = succeeded7375worker2 # [ 248.776950] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348107376worker2 # [ 248.793160] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348107377worker2 # [ 248.808578] nix-grpc-daemon[2062]: time=2026-09-23T04:46:30.326Z level=INFO msg="All 2 paths already cached"7378client # copying 1 paths to 'lb:50051'...7379client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...7380worker2 # [ 248.819119] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348107381worker2 # [ 248.833045] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)7382worker2 # [ 248.986958] nix-daemon[843]: accepted connection from pid 2221, user nix-grpc-daemon (trusted)7383worker2 # [ 249.005467] nix-daemon[843]: reaped child process 2224, status = succeeded7384lb # [ 248.966445] niks3-server[1141]: 2026/09/23 04:46:30 INFO Received uploads request method=POST path=/api/pending_closures7385worker2 # [ 249.019762] nix-grpc-daemon[2062]: time=2026-09-23T04:46:30.538Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7386worker2 # [ 249.021630] nix-grpc-daemon[2062]: time=2026-09-23T04:46:30.538Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"7387lb # [ 248.995095] niks3-server[1141]: 2026/09/23 04:46:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/92/sign7388worker2 # [ 249.048417] nix-grpc-daemon[2062]: time=2026-09-23T04:46:30.566Z level=INFO msg="Uploading 1 narinfos"7389lb # [ 249.010584] niks3-server[1141]: 2026/09/23 04:46:30 INFO Signed narinfos id=92 count=17390lb # [ 249.017107] niks3-server[1141]: 2026/09/23 04:46:30 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst7391lb # [ 249.024908] niks3-server[1141]: 2026/09/23 04:46:30 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls7392lb # [ 249.034411] niks3-server[1141]: 2026/09/23 04:46:30 INFO Received complete upload request method=POST path=/api/pending_closures/92/complete7393lb # [ 249.041077] niks3-server[1141]: 2026/09/23 04:46:30 INFO Completed upload id=927394worker2 # [ 249.083975] nix-grpc-daemon[2062]: time=2026-09-23T04:46:30.602Z level=INFO msg="Upload complete. (233ms)"7395lb # [ 249.047840] niks3-server[1141]: 2026/09/23 04:46:30 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo7396worker2 # [ 249.093421] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34810 duration_s=0 paths=1 nar_bytes_in=7607397worker2 # [ 249.108292] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348107398worker2 # [ 249.117695] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)7399worker2 # [ 249.120324] nix-daemon[843]: reaped child process 2219, status = succeeded7400client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...7401worker2 # [ 249.133834] nix-daemon[843]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)7402client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7403client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds7404client # farm-top> LOG-farm-top-drain7405worker2 # [ 250.220764] nix-daemon[843]: reaped child process 2228, status = succeeded7406lb # [ 250.192691] envoy[891]: conn peer=[2001:db8:1::1]:54708 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=931 tx=613 ms=300777407worker2 # [ 250.311312] nix-daemon[843]: accepted connection from pid 2244, user nix-grpc-daemon (trusted)7408worker2 # [ 250.333825] nix-daemon[843]: reaped child process 2247, status = succeeded7409lb # [ 250.287780] niks3-server[1141]: 2026/09/23 04:46:31 INFO Received uploads request method=POST path=/api/pending_closures7410worker2 # [ 250.344407] nix-grpc-daemon[2062]: time=2026-09-23T04:46:31.861Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7411worker2 # [ 250.345949] nix-grpc-daemon[2062]: time=2026-09-23T04:46:31.861Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"7412lb # [ 250.327202] niks3-server[1141]: 2026/09/23 04:46:31 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7413lb # [ 250.347134] niks3-server[1141]: 2026/09/23 04:46:31 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst7414worker2 # [ 250.403871] nix-grpc-daemon[2062]: time=2026-09-23T04:46:31.922Z level=INFO msg="Uploading 1 narinfos"7415lb # [ 250.361517] niks3-server[1141]: 2026/09/23 04:46:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/93/sign7416lb # [ 250.371372] niks3-server[1141]: 2026/09/23 04:46:31 INFO Signed narinfos id=93 count=17417lb # [ 250.378328] niks3-server[1141]: 2026/09/23 04:46:31 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls7418lb # [ 250.388544] niks3-server[1141]: 2026/09/23 04:46:31 INFO Received complete upload request method=POST path=/api/pending_closures/93/complete7419lb # [ 250.395672] niks3-server[1141]: 2026/09/23 04:46:31 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo7420lb # [ 250.404209] niks3-server[1141]: 2026/09/23 04:46:31 INFO Completed upload id=937421worker2 # [ 250.448352] nix-grpc-daemon[2062]: time=2026-09-23T04:46:31.966Z level=INFO msg="Upload complete. (304ms)"7422worker2 # [ 250.461192] nix-grpc-daemon[2001]: ts=2026-09-23T04:46:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34810 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=22 outputs=17423worker2 # [ 250.479260] nix-daemon[843]: reaped child process 2226, status = succeeded7424client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2, in 5.20 seconds)7425client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath7426client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath, in 0.18 seconds)7427worker1: must succeed: rm /nix/.rw-store/fill7428worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)7429worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7430worker1 # [ 251.105322] nix-grpc-daemon[1475]: ts=2026-09-23T04:46:32Z level=info event=healthy reason=min_free7431worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)7432(finished: subtest: low disk drains a worker and builds go to the other, in 7.90 seconds)7433(finished: run the VM test script, in 252.99 seconds)7434test script finished in 253.23s7435cleanup7436kill QemuMachine (pid 50)7437client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7438client # [2026-09-23T04:46:33Z INFO virtiofsd] Client disconnected, shutting down7439client # [2026-09-23T04:46:33Z INFO virtiofsd] Client disconnected, shutting down7440client # [2026-09-23T04:46:33Z INFO virtiofsd] Client disconnected, shutting down7441kill QemuMachine (pid 49)7442lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7443lb # [2026-09-23T04:46:34Z INFO virtiofsd] Client disconnected, shutting down7444lb # [2026-09-23T04:46:34Z INFO virtiofsd] Client disconnected, shutting down7445lb # [2026-09-23T04:46:34Z INFO virtiofsd] Client disconnected, shutting down7446kill QemuMachine (pid 51)7447worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7448worker1 # [2026-09-23T04:46:34Z INFO virtiofsd] Client disconnected, shutting down7449worker1 # [2026-09-23T04:46:34Z INFO virtiofsd] Client disconnected, shutting down7450worker1 # [2026-09-23T04:46:34Z INFO virtiofsd] Client disconnected, shutting down7451kill QemuMachine (pid 52)7452worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7453worker2 # [2026-09-23T04:46:34Z INFO virtiofsd] Client disconnected, shutting down7454worker2 # [2026-09-23T04:46:34Z INFO virtiofsd] Client disconnected, shutting down7455worker2 # [2026-09-23T04:46:34Z INFO virtiofsd] Client disconnected, shutting down7456(finished: cleanup, in 1.61 seconds)7457additionally exposed symbols:7458 client, lb, worker1, worker2,7459 vlan1,7460 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh