vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #559
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2: QEMU running (pid 51)14worker2 # Formatting '/build/vm-state-worker2/tmp.t32dt1OQry', fmt=raw size=107374182415lb: QEMU running (pid 50)16worker1: QEMU running (pid 52)17client: QEMU running (pid 49)18worker2 # mke2fs 1.47.4 (6-Mar-2025)19client # Disk image does not exist, creating the virtualisation disk image...20lb # Disk image does not exist, creating the virtualisation disk image...21worker1 # Disk image does not exist, creating the virtualisation disk image...22worker2 # Discarding device blocks: 0/262144 done23(finished: start all VMs, in 0.44 seconds)24worker1 # Formatting '/build/vm-state-worker1/tmp.rmEEXq7x2a', fmt=raw size=107374182425worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes26client: waiting for unit network-addresses-eth1.service27worker1 # mke2fs 1.47.4 (6-Mar-2025)28worker2 # Filesystem UUID: 9d5fa7da-9528-4ff6-968d-582c2da3d29d29client: waiting for the VM to finish booting30worker1 # Discarding device blocks: 0/262144 done31worker2 # Superblock backups stored on blocks:32lb # Formatting '/build/vm-state-lb/tmp.dIGjxjQos5', fmt=raw size=107374182433client # Formatting '/build/vm-state-client/tmp.kwrUvEq5Bh', fmt=raw size=107374182434worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes35worker2 # 32768, 98304, 163840, 22937636lb # mke2fs 1.47.4 (6-Mar-2025)37client # mke2fs 1.47.4 (6-Mar-2025)38worker1 # Filesystem UUID: 8e88a746-35fd-4e78-aa86-3b7d9b46bbc139worker2 # 40lb # Discarding device blocks: 0/262144 done41client # Discarding device blocks: 0/262144 done42worker1 # Superblock backups stored on blocks:43worker2 # Allocating group tables: 0/8 done44lb # Creating filesystem with 262144 4k blocks and 65536 inodes45client # Creating filesystem with 262144 4k blocks and 65536 inodes46worker1 # 32768, 98304, 163840, 22937647worker2 # Writing inode tables: 0/8 done48lb # Filesystem UUID: efd02e61-93bd-4ce6-8f5d-1dd94af3332749client # Filesystem UUID: ed6e368c-ff5b-4f52-8a18-f67dfc67ab3650worker1 # 51worker2 # Creating journal (8192 blocks): done52lb # Superblock backups stored on blocks:53client # Superblock backups stored on blocks:54worker1 # Allocating group tables: 0/8 done55worker2 # Writing superblocks and filesystem accounting information: 0/8 done56lb # 32768, 98304, 163840, 22937657client # 32768, 98304, 163840, 22937658worker1 # Writing inode tables: 0/8 done59worker2 # 60lb # 61client # 62worker1 # Creating journal (8192 blocks): done63worker2 # Virtualisation disk image created.64lb # Allocating group tables: 0/8 done65client # Allocating group tables: 0/8 done66worker1 # Writing superblocks and filesystem accounting information: 0/8 done67worker2 # Starting virtiofs daemons...68lb # Writing inode tables: 0/8 done69client # Writing inode tables: 0/8 done70worker1 # 71worker2 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)72lb # Creating journal (8192 blocks): done73client # Creating journal (8192 blocks): done74worker1 # Virtualisation disk image created.75worker2 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether76lb # Writing superblocks and filesystem accounting information: 0/8 done77client # Writing superblocks and filesystem accounting information: 0/8 done78worker1 # Starting virtiofs daemons...79worker2 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)80lb # 81client # 82worker1 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)83worker2 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether84lb # Virtualisation disk image created.85client # Virtualisation disk image created.86worker1 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether87worker2 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)88lb # Starting virtiofs daemons...89client # Starting virtiofs daemons...90worker1 # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...91worker2 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether92lb # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)93client # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)94worker1 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)95worker2 # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...96lb # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether97client # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether98worker1 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether99worker2 # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...100lb # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...101client # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)102worker1 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)103worker2 # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...104lb # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)105client # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether106worker1 # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether107worker2 # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests108lb # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether109client # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...110worker1 # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...111worker2 # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests112lb # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)113client # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...114worker1 # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...115worker2 # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests116lb # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether117client # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)118lb # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...119client # [2026-09-25T16:31:24Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether120lb # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...121client # [2026-09-25T16:31:24Z INFO virtiofsd] Waiting for vhost-user socket connection...122lb # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests123client # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests124lb # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests125client # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests126lb # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests127client # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests128worker1 # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests129worker1 # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests130worker1 # [2026-09-25T16:31:24Z INFO virtiofsd] Client connected, servicing requests131worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]132worker2 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026133worker2 # [ 0.000000] KASLR enabled134worker2 # [ 0.000000] random: crng init done135worker2 # [ 0.000000] Machine model: linux,dummy-virt136worker2 # [ 0.000000] efi: UEFI not found.137client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]138worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT139worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]140client # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026141worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]142client # [ 0.000000] KASLR enabled143worker2 # [ 0.000000] Zone ranges:144client # [ 0.000000] random: crng init done145worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]146client # [ 0.000000] Machine model: linux,dummy-virt147worker2 # [ 0.000000] DMA32 empty148client # [ 0.000000] efi: UEFI not found.149worker2 # [ 0.000000] Normal empty150worker2 # [ 0.000000] Device empty151client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT152worker2 # [ 0.000000] Movable zone start for each node153worker2 # [ 0.000000] Early memory node ranges154client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]155worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]156client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]157client # [ 0.000000] Zone ranges:158worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]159client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]160worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000161client # [ 0.000000] DMA32 empty162client # [ 0.000000] Normal empty163worker2 # [ 0.000000] psci: probing for conduit method from DT.164client # [ 0.000000] Device empty165worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.166client # [ 0.000000] Movable zone start for each node167worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs168client # [ 0.000000] Early memory node ranges169worker2 # [ 0.000000] psci: Trusted OS migration not required170client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]171worker2 # [ 0.000000] psci: SMC Calling Convention v1.1172client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]173worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)174client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000175client # [ 0.000000] psci: probing for conduit method from DT.176worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296177client # [ 0.000000] psci: PSCIv1.3 detected in firmware.178worker2 # [ 0.000000] Detected PIPT I-cache on CPU0179client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs180worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)181client # [ 0.000000] psci: Trusted OS migration not required182worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]183worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface184client # [ 0.000000] psci: SMC Calling Convention v1.1185worker2 # [ 0.000000] CPU features: detected: Spectre-v4186worker2 # [ 0.000000] CPU features: detected: Spectre-BHB187client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)188worker1 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026189worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38190worker1 # [ 0.000000] KASLR enabled191client # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296192lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]193worker1 # [ 0.000000] random: crng init done194client # [ 0.000000] Detected PIPT I-cache on CPU0195worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23196worker1 # [ 0.000000] Machine model: linux,dummy-virt197worker2 # [ 0.000000] alternatives: applying boot alternatives198worker1 # [ 0.000000] efi: UEFI not found.199client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)200lb # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026201lb # [ 0.000000] KASLR enabled202client # [ 0.000000] CPU features: detected: GICv3 CPU interface203worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT204lb # [ 0.000000] random: crng init done205client # [ 0.000000] CPU features: detected: Spectre-v4206lb # [ 0.000000] Machine model: linux,dummy-virt207worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]208client # [ 0.000000] CPU features: detected: Spectre-BHB209lb # [ 0.000000] efi: UEFI not found.210worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]211client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38212worker1 # [ 0.000000] Zone ranges:213lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT214client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23215worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]216worker1 # [ 0.000000] DMA32 empty217lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]218worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b37f007l92np8mkvic6myfsdiphmnmm3-nixos-system-worker2-test/init regInfo=/nix/store/9xsfm4d8z17rj46ff3x47n21yp3h04if-closure-info/registration console=ttyAMA0,115200n8 console=tty0219client # [ 0.000000] alternatives: applying boot alternatives220worker1 # [ 0.000000] Normal empty221worker1 # [ 0.000000] Device empty222lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]223lb # [ 0.000000] Zone ranges:224worker1 # [ 0.000000] Movable zone start for each node225worker1 # [ 0.000000] Early memory node ranges226worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/9xsfm4d8z17rj46ff3x47n21yp3h04if-closure-info/registration", will be passed to user space.227lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]228lb # [ 0.000000] DMA32 empty229worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]230lb # [ 0.000000] Normal empty231worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes232lb # [ 0.000000] Device empty233worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]234lb # [ 0.000000] Movable zone start for each node235worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)236lb # [ 0.000000] Early memory node ranges237worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000238client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8vhgx1jk0jbr9l2yj28aq3gwa0vlhgv9-nixos-system-client-test/init regInfo=/nix/store/flbzqaxw8s02nj19vjymksbpdszg417a-closure-info/registration console=ttyAMA0,115200n8 console=tty0239worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)240lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]241worker1 # [ 0.000000] psci: probing for conduit method from DT.242worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.243worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB244lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]245worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs246worker2 # [ 0.000000] software IO TLB: area num 1.247client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/flbzqaxw8s02nj19vjymksbpdszg417a-closure-info/registration", will be passed to user space.248lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000249worker1 # [ 0.000000] psci: Trusted OS migration not required250worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB251lb # [ 0.000000] psci: probing for conduit method from DT.252client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes253worker1 # [ 0.000000] psci: SMC Calling Convention v1.1254lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.255worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)256client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)257lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs258worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)259worker2 # [ 0.000000] Fallback order for Node 0: 0260lb # [ 0.000000] psci: Trusted OS migration not required261client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)262worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296263worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216264lb # [ 0.000000] psci: SMC Calling Convention v1.1265worker2 # [ 0.000000] Policy zone: DMA266client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB267worker1 # [ 0.000000] Detected PIPT I-cache on CPU0268client # [ 0.000000] software IO TLB: area num 1.269lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)270worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off271client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB272worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1273lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296274worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)275lb # [ 0.000000] Detected PIPT I-cache on CPU0276worker2 # [ 0.000000] allocated 3145728 bytes of page_ext277worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface278client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)279worker2 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages280worker1 # [ 0.000000] CPU features: detected: Spectre-v4281client # [ 0.000000] Fallback order for Node 0: 0282lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)283worker1 # [ 0.000000] CPU features: detected: Spectre-BHB284worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups285lb # [ 0.000000] CPU features: detected: GICv3 CPU interface286client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216287worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.288worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38289client # [ 0.000000] Policy zone: DMA290lb # [ 0.000000] CPU features: detected: Spectre-v4291worker2 # [ 0.000000] rcu: RCU event tracing is enabled.292lb # [ 0.000000] CPU features: detected: Spectre-BHB293worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23294client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off295worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.296lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38297worker1 # [ 0.000000] alternatives: applying boot alternatives298client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1299worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.300client # [ 0.000000] allocated 3145728 bytes of page_ext301lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23302worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.303lb # [ 0.000000] alternatives: applying boot alternatives304client # [ 0.000000] ftrace: allocating 74950 entries in 294 pages305worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.306client # [ 0.000000] ftrace: allocated 294 pages with 4 groups307worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.308client # [ 0.000000] rcu: Hierarchical RCU implementation.309client # [ 0.000000] rcu: RCU event tracing is enabled.310worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1311worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w7r9mckldaanl8vzi2c1r1zjnvm9fcyf-nixos-system-worker1-test/init regInfo=/nix/store/8fkxggqmrgzjvrzc6mfbkdmrr9i3s6j7-closure-info/registration console=ttyAMA0,115200n8 console=tty0312client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.313worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.314client # [ 0.000000] Trampoline variant of Tasks RCU enabled.315client # [ 0.000000] Rude variant of Tasks RCU enabled.316lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5hmvppg1fs8xkiccvl0m50n4dxjz92fr-nixos-system-lb-test/init regInfo=/nix/store/4s18yqhkjka9yjskv51fw7r9nw16dgfd-closure-info/registration console=ttyAMA0,115200n8 console=tty0317worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.318worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/8fkxggqmrgzjvrzc6mfbkdmrr9i3s6j7-closure-info/registration", will be passed to user space.319client # [ 0.000000] Tracing variant of Tasks RCU enabled.320worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes321worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.322client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.323worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0324worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)325client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1326lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/4s18yqhkjka9yjskv51fw7r9nw16dgfd-closure-info/registration", will be passed to user space.327worker2 # [ 0.000000] GICv3: 256 SPIs implemented328worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)329worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented330lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes331client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.332worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq333worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB334lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)335worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI336worker1 # [ 0.000000] software IO TLB: area num 1.337client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.338worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0339worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB340lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)341client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.342worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000343lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB344worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)345worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]346client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0347lb # [ 0.000000] software IO TLB: area num 1.348worker1 # [ 0.000000] Fallback order for Node 0: 0349client # [ 0.000000] GICv3: 256 SPIs implemented350lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB351client # [ 0.000000] GICv3: 0 Extended SPIs implemented352worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)353worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216354worker1 # [ 0.000000] Policy zone: DMA355client # [ 0.000000] Root IRQ handler: gic_handle_irq356lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)357client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI358worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off359worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)360lb # [ 0.000000] Fallback order for Node 0: 0361client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0362worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000363worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1364lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216365client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000366worker1 # [ 0.000000] allocated 3145728 bytes of page_ext367lb # [ 0.000000] Policy zone: DMA368worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000369client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]370worker1 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages371lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off372worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.373worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups374lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1375client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)376worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.377lb # [ 0.000000] allocated 3145728 bytes of page_ext378worker1 # [ 0.000000] rcu: RCU event tracing is enabled.379worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns380lb # [ 0.000000] ftrace: allocating 74950 entries in 294 pages381client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)382worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).383worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.384lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups385client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000386worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.387lb # [ 0.000000] rcu: Hierarchical RCU implementation.388worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.389client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000390worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns391lb # [ 0.000000] rcu: RCU event tracing is enabled.392worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.393client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.394lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.395worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns396worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.397worker2 # [ 0.000033] arm-pv: using stolen time PV398lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.399client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns400lb # [ 0.000000] Rude variant of Tasks RCU enabled.401worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1402lb # [ 0.000000] Tracing variant of Tasks RCU enabled.403worker2 # [ 0.000529] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)404client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).405worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.406worker2 # [ 0.000713] Console: colour dummy device 80x25407lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.408worker2 # [ 0.000720] printk: legacy console [tty0] enabled409client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns410worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.411lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1412client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns413worker2 # [ 0.000908] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)414worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.415lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.416client # [ 0.000032] arm-pv: using stolen time PV417worker2 # [ 0.000915] pid_max: default: 32768 minimum: 301418worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0419worker2 # [ 0.001017] LSM: initializing lsm=capability,landlock,yama,bpf,ima420worker1 # [ 0.000000] GICv3: 256 SPIs implemented421lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.422client # [ 0.000514] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)423worker2 # [ 0.001169] landlock: Up and running.424worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented425client # [ 0.000685] Console: colour dummy device 80x25426worker2 # [ 0.001172] Yama: becoming mindful.427worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq428lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.429worker2 # [ 0.001713] LSM support for eBPF active430client # [ 0.000693] printk: legacy console [tty0] enabled431worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI432lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0433worker2 # [ 0.001863] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)434worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0435lb # [ 0.000000] GICv3: 256 SPIs implemented436client # [ 0.000917] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)437lb # [ 0.000000] GICv3: 0 Extended SPIs implemented438worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000439worker2 # [ 0.001900] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)440client # [ 0.000924] pid_max: default: 32768 minimum: 301441lb # [ 0.000000] Root IRQ handler: gic_handle_irq442worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]443worker2 # [ 0.003890] rcu: Hierarchical SRCU implementation.444lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI445client # [ 0.001007] LSM: initializing lsm=capability,landlock,yama,bpf,ima446worker2 # [ 0.003894] rcu: Max phase no-delay instances is 1000.447client # [ 0.001150] landlock: Up and running.448lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0449worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)450client # [ 0.001153] Yama: becoming mindful.451worker2 # [ 0.005241] fsl-mc MSI: its@8080000 domain created452client # [ 0.001744] LSM support for eBPF active453lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000454worker2 # [ 0.005332] EFI services will not be available.455lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]456worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)457worker2 # [ 0.005428] smp: Bringing up secondary CPUs ...458client # [ 0.001949] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)459worker2 # [ 0.005437] smp: Brought up 1 node, 1 CPU460worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000461lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)462worker2 # [ 0.005440] SMP: Total of 1 processors activated.463client # [ 0.001986] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)464worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000465worker2 # [ 0.005445] CPU: All CPU(s) started at EL1466client # [ 0.003981] rcu: Hierarchical SRCU implementation.467lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)468worker2 # [ 0.005455] CPU features: detected: Branch Target Identification469worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.470client # [ 0.003987] rcu: Max phase no-delay instances is 1000.471lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000472client # [ 0.005510] fsl-mc MSI: its@8080000 domain created473worker2 # [ 0.005460] CPU features: detected: ARMv8.4 Translation Table Level474worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns475client # [ 0.005601] EFI services will not be available.476lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000477client # [ 0.005674] smp: Bringing up secondary CPUs ...478worker2 # [ 0.005463] CPU features: detected: Instruction cache invalidation not required for I/D coherence479worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).480lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.481client # [ 0.005682] smp: Brought up 1 node, 1 CPU482client # [ 0.005685] SMP: Total of 1 processors activated.483worker2 # [ 0.005466] CPU features: detected: Data cache clean to the PoU not required for I/D coherence484worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns485client # [ 0.005691] CPU: All CPU(s) started at EL1486lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns487worker2 # [ 0.005470] CPU features: detected: Common not Private translations488client # [ 0.005702] CPU features: detected: Branch Target Identification489worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns490lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).491worker2 # [ 0.005473] CPU features: detected: CRC32 instructions492worker1 # [ 0.000029] arm-pv: using stolen time PV493client # [ 0.005707] CPU features: detected: ARMv8.4 Translation Table Level494worker2 # [ 0.005476] CPU features: detected: Data cache clean to Point of Deep Persistence495lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns496worker1 # [ 0.000392] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)497client # [ 0.005710] CPU features: detected: Instruction cache invalidation not required for I/D coherence498worker2 # [ 0.005480] CPU features: detected: Data cache clean to Point of Persistence499worker1 # [ 0.000566] Console: colour dummy device 80x25500lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns501worker2 # [ 0.005483] CPU features: detected: Data independent timing control (DIT)502worker1 # [ 0.000573] printk: legacy console [tty0] enabled503lb # [ 0.000030] arm-pv: using stolen time PV504client # [ 0.005714] CPU features: detected: Data cache clean to the PoU not required for I/D coherence505worker2 # [ 0.005486] CPU features: detected: E0PD506client # [ 0.005717] CPU features: detected: Common not Private translations507worker2 # [ 0.005489] CPU features: detected: Enhanced Counter Virtualization508lb # [ 0.000404] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)509worker1 # [ 0.000767] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)510client # [ 0.005721] CPU features: detected: CRC32 instructions511lb # [ 0.000578] Console: colour dummy device 80x25512worker1 # [ 0.000774] pid_max: default: 32768 minimum: 301513worker2 # [ 0.005492] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)514lb # [ 0.000586] printk: legacy console [tty0] enabled515client # [ 0.005724] CPU features: detected: Data cache clean to Point of Deep Persistence516worker1 # [ 0.000855] LSM: initializing lsm=capability,landlock,yama,bpf,ima517worker2 # [ 0.005495] CPU features: detected: Enhanced Virtualization Traps518worker1 # [ 0.000971] landlock: Up and running.519client # [ 0.005727] CPU features: detected: Data cache clean to Point of Persistence520worker2 # [ 0.005498] CPU features: detected: Fine Grained Traps521worker1 # [ 0.000973] Yama: becoming mindful.522lb # [ 0.000801] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)523worker1 # [ 0.001407] LSM support for eBPF active524client # [ 0.005730] CPU features: detected: Data independent timing control (DIT)525lb # [ 0.000808] pid_max: default: 32768 minimum: 301526worker2 # [ 0.005502] CPU features: detected: Generic authentication (architected QARMA5 algorithm)527client # [ 0.005733] CPU features: detected: E0PD528worker1 # [ 0.001530] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)529lb # [ 0.000892] LSM: initializing lsm=capability,landlock,yama,bpf,ima530worker2 # [ 0.005507] CPU features: detected: RCpc load-acquire (LDAPR)531client # [ 0.005736] CPU features: detected: Enhanced Counter Virtualization532lb # [ 0.001031] landlock: Up and running.533worker2 # [ 0.005510] CPU features: detected: LSE atomic instructions534lb # [ 0.001034] Yama: becoming mindful.535worker1 # [ 0.001569] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)536client # [ 0.005739] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)537lb # [ 0.001482] LSM support for eBPF active538worker2 # [ 0.005513] CPU features: detected: Privileged Access Never539worker1 # [ 0.003427] rcu: Hierarchical SRCU implementation.540worker2 # [ 0.005515] CPU features: detected: PMUv3541client # [ 0.005743] CPU features: detected: Enhanced Virtualization Traps542lb # [ 0.001631] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)543worker1 # [ 0.003432] rcu: Max phase no-delay instances is 1000.544client # [ 0.005746] CPU features: detected: Fine Grained Traps545worker2 # [ 0.005518] CPU features: detected: RAS Extension Support546worker1 # [ 0.004793] fsl-mc MSI: its@8080000 domain created547lb # [ 0.001669] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)548worker2 # [ 0.005521] CPU features: detected: RASv1p1 Extension Support549worker1 # [ 0.004880] EFI services will not be available.550client # [ 0.005749] CPU features: detected: Generic authentication (architected QARMA5 algorithm)551lb # [ 0.003636] rcu: Hierarchical SRCU implementation.552worker1 # [ 0.004945] smp: Bringing up secondary CPUs ...553worker2 # [ 0.005523] CPU features: detected: Random Number Generator554client # [ 0.005754] CPU features: detected: RCpc load-acquire (LDAPR)555worker1 # [ 0.004953] smp: Brought up 1 node, 1 CPU556lb # [ 0.003641] rcu: Max phase no-delay instances is 1000.557worker2 # [ 0.005526] CPU features: detected: Speculation barrier (SB)558worker1 # [ 0.004956] SMP: Total of 1 processors activated.559lb # [ 0.004948] fsl-mc MSI: its@8080000 domain created560client # [ 0.005757] CPU features: detected: LSE atomic instructions561worker2 # [ 0.005529] CPU features: detected: Stage-2 Force Write-Back562worker1 # [ 0.004962] CPU: All CPU(s) started at EL1563lb # [ 0.005043] EFI services will not be available.564client # [ 0.005760] CPU features: detected: Privileged Access Never565lb # [ 0.005124] smp: Bringing up secondary CPUs ...566worker2 # [ 0.005532] CPU features: detected: TLB range maintenance instructions567client # [ 0.005762] CPU features: detected: PMUv3568worker1 # [ 0.004973] CPU features: detected: Branch Target Identification569lb # [ 0.005132] smp: Brought up 1 node, 1 CPU570client # [ 0.005765] CPU features: detected: RAS Extension Support571worker1 # [ 0.004978] CPU features: detected: ARMv8.4 Translation Table Level572worker2 # [ 0.005537] CPU features: detected: Speculative Store Bypassing Safe (SSBS)573lb # [ 0.005135] SMP: Total of 1 processors activated.574client # [ 0.005768] CPU features: detected: RASv1p1 Extension Support575worker2 # [ 0.005579] alternatives: applying system-wide alternatives576lb # [ 0.005140] CPU: All CPU(s) started at EL1577worker1 # [ 0.004981] CPU features: detected: Instruction cache invalidation not required for I/D coherence578client # [ 0.005770] CPU features: detected: Random Number Generator579lb # [ 0.005150] CPU features: detected: Branch Target Identification580worker2 # [ 0.008753] CPU features: detected: BBM Level 2 without TLB conflict abort581client # [ 0.005773] CPU features: detected: Speculation barrier (SB)582worker1 # [ 0.004984] CPU features: detected: Data cache clean to the PoU not required for I/D coherence583lb # [ 0.005154] CPU features: detected: ARMv8.4 Translation Table Level584client # [ 0.005776] CPU features: detected: Stage-2 Force Write-Back585worker1 # [ 0.004988] CPU features: detected: Common not Private translations586worker2 # [ 0.008988] Memory: 1405712K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124632K reserved, 32768K cma-reserved)587lb # [ 0.005157] CPU features: detected: Instruction cache invalidation not required for I/D coherence588client # [ 0.005779] CPU features: detected: TLB range maintenance instructions589worker1 # [ 0.004991] CPU features: detected: CRC32 instructions590worker2 # [ 0.009379] devtmpfs: initialized591lb # [ 0.005161] CPU features: detected: Data cache clean to the PoU not required for I/D coherence592client # [ 0.005783] CPU features: detected: Speculative Store Bypassing Safe (SSBS)593worker1 # [ 0.004994] CPU features: detected: Data cache clean to Point of Deep Persistence594worker2 # [ 0.011275] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)595client # [ 0.005825] alternatives: applying system-wide alternatives596lb # [ 0.005164] CPU features: detected: Common not Private translations597worker1 # [ 0.004998] CPU features: detected: Data cache clean to Point of Persistence598worker2 # [ 0.011299] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).599client # [ 0.008853] CPU features: detected: BBM Level 2 without TLB conflict abort600lb # [ 0.005167] CPU features: detected: CRC32 instructions601worker1 # [ 0.005001] CPU features: detected: Data independent timing control (DIT)602worker2 # [ 0.011471] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL603worker1 # [ 0.005004] CPU features: detected: E0PD604lb # [ 0.005170] CPU features: detected: Data cache clean to Point of Deep Persistence605worker2 # [ 0.011475] 0 pages in range for non-PLT usage606worker1 # [ 0.005006] CPU features: detected: Enhanced Counter Virtualization607worker2 # [ 0.011476] 508272 pages in range for PLT usage608lb # [ 0.005174] CPU features: detected: Data cache clean to Point of Persistence609client # [ 0.009079] Memory: 1405672K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124660K reserved, 32768K cma-reserved)610worker2 # [ 0.011589] pinctrl core: initialized pinctrl subsystem611worker1 # [ 0.005009] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)612lb # [ 0.005177] CPU features: detected: Data independent timing control (DIT)613worker2 # [ 0.012409] DMI not present or invalid.614client # [ 0.009485] devtmpfs: initialized615lb # [ 0.005180] CPU features: detected: E0PD616worker1 # [ 0.005013] CPU features: detected: Enhanced Virtualization Traps617worker2 # [ 0.015722] NET: Registered PF_NETLINK/PF_ROUTE protocol family618client # [ 0.011387] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)619worker1 # [ 0.005016] CPU features: detected: Fine Grained Traps620lb # [ 0.005182] CPU features: detected: Enhanced Counter Virtualization621worker2 # [ 0.018281] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations622lb # [ 0.005186] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)623client # [ 0.011410] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).624worker1 # [ 0.005020] CPU features: detected: Generic authentication (architected QARMA5 algorithm)625worker2 # [ 0.018478] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations626lb # [ 0.005189] CPU features: detected: Enhanced Virtualization Traps627client # [ 0.011604] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL628lb # [ 0.005192] CPU features: detected: Fine Grained Traps629client # [ 0.011609] 0 pages in range for non-PLT usage630worker2 # [ 0.018676] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations631client # [ 0.011610] 508272 pages in range for PLT usage632lb # [ 0.005195] CPU features: detected: Generic authentication (architected QARMA5 algorithm)633client # [ 0.011715] pinctrl core: initialized pinctrl subsystem634worker2 # [ 0.018698] audit: initializing netlink subsys (disabled)635lb # [ 0.005200] CPU features: detected: RCpc load-acquire (LDAPR)636client # [ 0.012579] DMI not present or invalid.637worker2 # [ 0.019292] thermal_sys: Registered thermal governor 'fair_share'638client # [ 0.015721] NET: Registered PF_NETLINK/PF_ROUTE protocol family639lb # [ 0.005203] CPU features: detected: LSE atomic instructions640worker2 # [ 0.019294] thermal_sys: Registered thermal governor 'bang_bang'641lb # [ 0.005205] CPU features: detected: Privileged Access Never642client # [ 0.018157] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations643lb # [ 0.005208] CPU features: detected: PMUv3644worker2 # [ 0.019297] thermal_sys: Registered thermal governor 'step_wise'645client # [ 0.018358] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations646lb # [ 0.005211] CPU features: detected: RAS Extension Support647worker2 # [ 0.019300] thermal_sys: Registered thermal governor 'user_space'648lb # [ 0.005214] CPU features: detected: RASv1p1 Extension Support649client # [ 0.018557] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations650worker2 # [ 0.019305] thermal_sys: Registered thermal governor 'power_allocator'651lb # [ 0.005216] CPU features: detected: Random Number Generator652client # [ 0.018578] audit: initializing netlink subsys (disabled)653worker2 # [ 0.019330] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1654lb # [ 0.005219] CPU features: detected: Speculation barrier (SB)655client # [ 0.019155] thermal_sys: Registered thermal governor 'fair_share'656worker2 # [ 0.019338] cpuidle: using governor ladder657lb # [ 0.005221] CPU features: detected: Stage-2 Force Write-Back658worker1 # [ 0.005025] CPU features: detected: RCpc load-acquire (LDAPR)659worker2 # [ 0.019344] cpuidle: using governor menu660client # [ 0.019157] thermal_sys: Registered thermal governor 'bang_bang'661worker1 # [ 0.005028] CPU features: detected: LSE atomic instructions662lb # [ 0.005224] CPU features: detected: TLB range maintenance instructions663client # [ 0.019161] thermal_sys: Registered thermal governor 'step_wise'664worker2 # [ 0.019523] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.665worker1 # [ 0.005030] CPU features: detected: Privileged Access Never666worker2 # [ 0.019539] ASID allocator initialised with 65536 entries667lb # [ 0.005229] CPU features: detected: Speculative Store Bypassing Safe (SSBS)668client # [ 0.019163] thermal_sys: Registered thermal governor 'user_space'669worker1 # [ 0.005033] CPU features: detected: PMUv3670worker2 # [ 0.020878] Serial: AMBA PL011 UART driver671lb # [ 0.005265] alternatives: applying system-wide alternatives672worker1 # [ 0.005036] CPU features: detected: RAS Extension Support673client # [ 0.019169] thermal_sys: Registered thermal governor 'power_allocator'674worker2 # [ 0.026100] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1675lb # [ 0.008133] CPU features: detected: BBM Level 2 without TLB conflict abort676worker1 # [ 0.005039] CPU features: detected: RASv1p1 Extension Support677client # [ 0.019200] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1678worker2 # [ 0.026227] printk: console [ttyAMA0] enabled679worker1 # [ 0.005042] CPU features: detected: Random Number Generator680client # [ 0.019209] cpuidle: using governor ladder681client # [ 0.019215] cpuidle: using governor menu682worker1 # [ 0.005045] CPU features: detected: Speculation barrier (SB)683client # [ 0.019393] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.684worker1 # [ 0.005047] CPU features: detected: Stage-2 Force Write-Back685client # [ 0.019409] ASID allocator initialised with 65536 entries686worker1 # [ 0.005050] CPU features: detected: TLB range maintenance instructions687client # [ 0.020660] Serial: AMBA PL011 UART driver688worker1 # [ 0.005054] CPU features: detected: Speculative Store Bypassing Safe (SSBS)689client # [ 0.025903] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1690worker1 # [ 0.005091] alternatives: applying system-wide alternatives691client # [ 0.026033] printk: console [ttyAMA0] enabled692worker1 # [ 0.007966] CPU features: detected: BBM Level 2 without TLB conflict abort693worker1 # [ 0.008182] Memory: 1405672K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124664K reserved, 32768K cma-reserved)694worker1 # [ 0.008608] devtmpfs: initialized695worker2 # [ 0.151321] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages696worker1 # [ 0.010433] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)697worker2 # [ 0.151337] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page698worker2 # [ 0.151343] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages699worker1 # [ 0.010455] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).700lb # [ 0.008323] Memory: 1405736K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124636K reserved, 32768K cma-reserved)701lb # [ 0.008703] devtmpfs: initialized702worker2 # [ 0.151347] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page703worker1 # [ 0.010632] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL704lb # [ 0.010597] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)705worker1 # [ 0.010636] 0 pages in range for non-PLT usage706worker2 # [ 0.151352] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages707worker1 # [ 0.010637] 508272 pages in range for PLT usage708worker2 # [ 0.151356] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page709lb # [ 0.010619] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).710worker1 # [ 0.010759] pinctrl core: initialized pinctrl subsystem711client # [ 0.151359] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages712worker1 # [ 0.011518] DMI not present or invalid.713worker2 # [ 0.151361] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages714lb # [ 0.010809] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL715client # [ 0.151380] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page716lb # [ 0.010813] 0 pages in range for non-PLT usage717worker1 # [ 0.014759] NET: Registered PF_NETLINK/PF_ROUTE protocol family718worker2 # [ 0.151365] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page719client # [ 0.151385] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages720lb # [ 0.010814] 508272 pages in range for PLT usage721worker1 # [ 0.017236] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations722lb # [ 0.010919] pinctrl core: initialized pinctrl subsystem723client # [ 0.151390] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page724lb # [ 0.011638] DMI not present or invalid.725worker1 # [ 0.017429] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations726client # [ 0.151395] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages727worker2 # [ 0.159146] fbcon: Taking over console728lb # [ 0.014996] NET: Registered PF_NETLINK/PF_ROUTE protocol family729worker2 # [ 0.159161] ACPI: Interpreter disabled.730worker1 # [ 0.017627] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations731client # [ 0.151399] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page732lb # [ 0.017251] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations733worker1 # [ 0.017650] audit: initializing netlink subsys (disabled)734client # [ 0.151404] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages735lb # [ 0.017420] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations736worker1 # [ 0.018192] thermal_sys: Registered thermal governor 'fair_share'737client # [ 0.151408] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page738worker1 # [ 0.018194] thermal_sys: Registered thermal governor 'bang_bang'739lb # [ 0.017611] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations740worker1 # [ 0.018198] thermal_sys: Registered thermal governor 'step_wise'741lb # [ 0.017631] audit: initializing netlink subsys (disabled)742worker1 # [ 0.018201] thermal_sys: Registered thermal governor 'user_space'743client # [ 0.159102] fbcon: Taking over console744lb # [ 0.018263] thermal_sys: Registered thermal governor 'fair_share'745client # [ 0.159117] ACPI: Interpreter disabled.746worker1 # [ 0.018206] thermal_sys: Registered thermal governor 'power_allocator'747lb # [ 0.018265] thermal_sys: Registered thermal governor 'bang_bang'748lb # [ 0.018269] thermal_sys: Registered thermal governor 'step_wise'749worker1 # [ 0.018231] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1750worker1 # [ 0.018239] cpuidle: using governor ladder751lb # [ 0.018272] thermal_sys: Registered thermal governor 'user_space'752worker1 # [ 0.018245] cpuidle: using governor menu753lb # [ 0.018277] thermal_sys: Registered thermal governor 'power_allocator'754worker1 # [ 0.018426] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.755lb # [ 0.018302] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1756worker2 # [ 0.167805] iommu: Default domain type: Translated757worker1 # [ 0.018440] ASID allocator initialised with 65536 entries758lb # [ 0.018311] cpuidle: using governor ladder759worker1 # [ 0.019643] Serial: AMBA PL011 UART driver760worker2 # [ 0.167815] iommu: DMA domain TLB invalidation policy: strict mode761lb # [ 0.018317] cpuidle: using governor menu762worker2 # [ 0.168164] SCSI subsystem initialized763worker1 # [ 0.024872] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1764lb # [ 0.018494] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.765worker1 # [ 0.024996] printk: console [ttyAMA0] enabled766lb # [ 0.018508] ASID allocator initialised with 65536 entries767worker2 # [ 0.170268] usbcore: registered new interface driver usbfs768lb # [ 0.019715] Serial: AMBA PL011 UART driver769worker2 # [ 0.170299] usbcore: registered new interface driver hub770worker1 # [ 0.151483] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages771worker2 # [ 0.170314] usbcore: registered new device driver usb772lb # [ 0.025002] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1773worker1 # [ 0.151500] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page774worker2 # [ 0.170596] pps_core: LinuxPPS API ver. 1 registered775lb # [ 0.025155] printk: console [ttyAMA0] enabled776client # [ 0.168115] iommu: Default domain type: Translated777worker1 # [ 0.151506] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages778client # [ 0.168126] iommu: DMA domain TLB invalidation policy: strict mode779worker2 # [ 0.170603] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>780client # [ 0.168483] SCSI subsystem initialized781lb # [ 0.151684] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages782worker1 # [ 0.151510] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page783worker2 # [ 0.170622] PTP clock support registered784worker2 # [ 0.170671] EDAC MC: Ver: 3.0.0785lb # [ 0.151700] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page786worker1 # [ 0.151514] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages787client # [ 0.170502] usbcore: registered new interface driver usbfs788worker2 # [ 0.175565] scmi_core: SCMI protocol bus registered789lb # [ 0.151705] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages790worker1 # [ 0.151519] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page791client # [ 0.170534] usbcore: registered new interface driver hub792lb # [ 0.151709] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page793client # [ 0.170557] usbcore: registered new device driver usb794worker2 # [ 0.176577] FPGA manager framework795worker1 # [ 0.151523] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages796worker2 # [ 0.177528] vgaarb: loaded797client # [ 0.170822] pps_core: LinuxPPS API ver. 1 registered798lb # [ 0.151713] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages799worker1 # [ 0.151527] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page800lb # [ 0.151718] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page801worker2 # [ 0.178158] clocksource: Switched to clocksource arch_sys_counter802client # [ 0.170828] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>803client # [ 0.170838] PTP clock support registered804lb # [ 0.151722] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages805client # [ 0.170885] EDAC MC: Ver: 3.0.0806worker1 # [ 0.159226] fbcon: Taking over console807lb # [ 0.151726] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page808worker1 # [ 0.159241] ACPI: Interpreter disabled.809client # [ 0.175826] scmi_core: SCMI protocol bus registered810worker1 # [ 0.161146] iommu: Default domain type: Translated811client # [ 0.176873] FPGA manager framework812lb # [ 0.159519] fbcon: Taking over console813worker1 # [ 0.161156] iommu: DMA domain TLB invalidation policy: strict mode814client # [ 0.177863] vgaarb: loaded815lb # [ 0.159533] ACPI: Interpreter disabled.816worker1 # [ 0.162896] SCSI subsystem initialized817client # [ 0.178503] clocksource: Switched to clocksource arch_sys_counter818lb # [ 0.161473] iommu: Default domain type: Translated819worker1 # [ 0.163602] usbcore: registered new interface driver usbfs820worker2 # [ 0.184319] VFS: Disk quotas dquot_6.6.0821lb # [ 0.161483] iommu: DMA domain TLB invalidation policy: strict mode822worker1 # [ 0.163634] usbcore: registered new interface driver hub823worker2 # [ 0.184366] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)824worker1 # [ 0.163650] usbcore: registered new device driver usb825lb # [ 0.163242] SCSI subsystem initialized826worker2 # [ 0.186130] netfs: FS-Cache loaded827worker2 # [ 0.186713] pnp: PnP ACPI: disabled828client # [ 0.182384] VFS: Disk quotas dquot_6.6.0829client # [ 0.182419] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)830client # [ 0.186192] netfs: FS-Cache loaded831lb # [ 0.168171] usbcore: registered new interface driver usbfs832client # [ 0.186316] pnp: PnP ACPI: disabled833lb # [ 0.168203] usbcore: registered new interface driver hub834lb # [ 0.168225] usbcore: registered new device driver usb835worker1 # [ 0.171995] pps_core: LinuxPPS API ver. 1 registered836lb # [ 0.168501] pps_core: LinuxPPS API ver. 1 registered837worker1 # [ 0.172004] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>838worker1 # [ 0.172015] PTP clock support registered839lb # [ 0.168508] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>840worker2 # [ 0.190154] NET: Registered PF_INET protocol family841worker1 # [ 0.172066] EDAC MC: Ver: 3.0.0842lb # [ 0.168518] PTP clock support registered843client # [ 0.190430] NET: Registered PF_INET protocol family844lb # [ 0.168567] EDAC MC: Ver: 3.0.0845worker2 # [ 0.190450] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)846worker1 # [ 0.174976] scmi_core: SCMI protocol bus registered847lb # [ 0.173476] scmi_core: SCMI protocol bus registered848worker1 # [ 0.175972] FPGA manager framework849worker1 # [ 0.176952] vgaarb: loaded850lb # [ 0.174480] FPGA manager framework851lb # [ 0.175425] vgaarb: loaded852worker1 # [ 0.177597] clocksource: Switched to clocksource arch_sys_counter853lb # [ 0.176042] clocksource: Switched to clocksource arch_sys_counter854client # [ 0.191349] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)855worker1 # [ 0.182151] VFS: Disk quotas dquot_6.6.0856worker1 # [ 0.182194] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)857worker1 # [ 0.183910] netfs: FS-Cache loaded858worker1 # [ 0.184032] pnp: PnP ACPI: disabled859lb # [ 0.182367] VFS: Disk quotas dquot_6.6.0860lb # [ 0.182403] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)861lb # [ 0.184094] netfs: FS-Cache loaded862lb # [ 0.184208] pnp: PnP ACPI: disabled863worker1 # [ 0.187868] NET: Registered PF_INET protocol family864worker1 # [ 0.188193] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)865lb # [ 0.188068] NET: Registered PF_INET protocol family866lb # [ 0.188331] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)867worker2 # [ 0.220290] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)868worker2 # [ 0.220333] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)869worker2 # [ 0.220361] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)870worker2 # [ 0.220428] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)871worker2 # [ 0.220572] TCP: Hash tables configured (established 16384 bind 16384)872worker2 # [ 0.220651] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)873client # [ 0.219652] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)874worker2 # [ 0.220686] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)875client # [ 0.219697] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)876worker2 # [ 0.220721] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)877client # [ 0.219722] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)878worker2 # [ 0.220808] NET: Registered PF_UNIX/PF_LOCAL protocol family879client # [ 0.219808] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)880worker2 # [ 0.220828] NET: Registered PF_XDP protocol family881worker2 # [ 0.220844] PCI: CLS 0 bytes, default 64882client # [ 0.219951] TCP: Hash tables configured (established 16384 bind 16384)883worker2 # [ 0.221087] Trying to unpack rootfs image as initramfs...884client # [ 0.220027] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)885client # [ 0.220063] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)886client # [ 0.220099] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)887client # [ 0.220187] NET: Registered PF_UNIX/PF_LOCAL protocol family888client # [ 0.220240] NET: Registered PF_XDP protocol family889client # [ 0.220257] PCI: CLS 0 bytes, default 64890client # [ 0.220482] Trying to unpack rootfs image as initramfs...891worker1 # [ 0.217726] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)892lb # [ 0.217340] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)893client # [ 0.236742] kvm [1]: HYP mode not available894worker1 # [ 0.217766] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)895lb # [ 0.217381] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)896worker1 # [ 0.217792] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)897lb # [ 0.217407] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)898worker1 # [ 0.217862] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)899lb # [ 0.217476] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)900worker1 # [ 0.218004] TCP: Hash tables configured (established 16384 bind 16384)901worker2 # [ 0.242180] kvm [1]: HYP mode not available902lb # [ 0.217619] TCP: Hash tables configured (established 16384 bind 16384)903worker1 # [ 0.218080] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)904lb # [ 0.217695] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)905worker1 # [ 0.218114] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)906lb # [ 0.217731] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)907worker1 # [ 0.218149] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)908lb # [ 0.217766] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)909worker1 # [ 0.218238] NET: Registered PF_UNIX/PF_LOCAL protocol family910lb # [ 0.217863] NET: Registered PF_UNIX/PF_LOCAL protocol family911worker1 # [ 0.218263] NET: Registered PF_XDP protocol family912worker1 # [ 0.218282] PCI: CLS 0 bytes, default 64913lb # [ 0.217896] NET: Registered PF_XDP protocol family914lb # [ 0.217913] PCI: CLS 0 bytes, default 64915worker1 # [ 0.218503] Trying to unpack rootfs image as initramfs...916lb # [ 0.218216] Trying to unpack rootfs image as initramfs...917lb # [ 0.234275] kvm [1]: HYP mode not available918worker1 # [ 0.241628] kvm [1]: HYP mode not available919worker2 # [ 0.327005] Initialise system trusted keyrings920client # [ 0.327061] Initialise system trusted keyrings921client # [ 0.327825] workingset: timestamp_bits=42 max_order=19 bucket_order=0922client # [ 0.329126] squashfs: version 4.0 (2009/01/31) Phillip Lougher923worker2 # [ 0.334207] workingset: timestamp_bits=42 max_order=19 bucket_order=0924client # [ 0.329919] 9p: Installing v9fs 9p2000 file system support925worker2 # [ 0.335594] squashfs: version 4.0 (2009/01/31) Phillip Lougher926worker2 # [ 0.336488] 9p: Installing v9fs 9p2000 file system support927worker1 # [ 0.326738] Initialise system trusted keyrings928worker1 # [ 0.327487] workingset: timestamp_bits=42 max_order=19 bucket_order=0929lb # [ 0.327237] Initialise system trusted keyrings930lb # [ 0.327974] workingset: timestamp_bits=42 max_order=19 bucket_order=0931lb # [ 0.329245] squashfs: version 4.0 (2009/01/31) Phillip Lougher932worker1 # [ 0.333899] squashfs: version 4.0 (2009/01/31) Phillip Lougher933lb # [ 0.330095] 9p: Installing v9fs 9p2000 file system support934worker2 # [ 0.357272] Key type asymmetric registered935worker2 # [ 0.357292] Asymmetric key parser 'x509' registered936worker2 # [ 0.357361] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)937worker1 # [ 0.334749] 9p: Installing v9fs 9p2000 file system support938client # [ 0.358641] Key type asymmetric registered939client # [ 0.358669] Asymmetric key parser 'x509' registered940client # [ 0.358739] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)941client # [ 0.361248] io scheduler mq-deadline registered942client # [ 0.361261] io scheduler kyber registered943worker2 # [ 0.366225] io scheduler mq-deadline registered944worker2 # [ 0.366244] io scheduler kyber registered945worker2 # [ 0.371284] pl061_gpio 9030000.pl061: PL061 GPIO chip registered946worker2 # [ 0.372642] ledtrig-cpu: registered to indicate activity on CPUs947worker1 # [ 0.354740] Key type asymmetric registered948worker2 # [ 0.373061] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:949worker1 # [ 0.354759] Asymmetric key parser 'x509' registered950client # [ 0.370646] pl061_gpio 9030000.pl061: PL061 GPIO chip registered951worker2 # [ 0.373079] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000952lb # [ 0.354170] Key type asymmetric registered953worker1 # [ 0.354825] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)954lb # [ 0.354196] Asymmetric key parser 'x509' registered955worker2 # [ 0.373091] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000956lb # [ 0.354266] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)957worker2 # [ 0.373100] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000958lb # [ 0.356521] io scheduler mq-deadline registered959client # [ 0.372087] ledtrig-cpu: registered to indicate activity on CPUs960lb # [ 0.356530] io scheduler kyber registered961worker2 # [ 0.373120] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits962client # [ 0.372484] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:963worker2 # [ 0.373141] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]964client # [ 0.372503] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000965worker1 # [ 0.361654] io scheduler mq-deadline registered966worker2 # [ 0.373210] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00967worker1 # [ 0.361670] io scheduler kyber registered968client # [ 0.372516] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000969worker2 # [ 0.373220] pci_bus 0000:00: root bus resource [bus 00-ff]970worker2 # [ 0.373226] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]971client # [ 0.372524] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000972worker2 # [ 0.373231] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]973client # [ 0.372552] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits974worker2 # [ 0.373236] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]975client # [ 0.372577] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]976worker2 # [ 0.373292] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint977client # [ 0.372654] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00978client # [ 0.372663] pci_bus 0000:00: root bus resource [bus 00-ff]979worker2 # [ 0.373735] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint980worker1 # [ 0.366884] pl061_gpio 9030000.pl061: PL061 GPIO chip registered981worker2 # [ 0.373928] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]982client # [ 0.372669] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]983worker2 # [ 0.373944] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]984client # [ 0.372675] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]985worker2 # [ 0.373974] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]986client # [ 0.372681] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]987worker2 # [ 0.373990] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]988client # [ 0.372738] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint989client # [ 0.373193] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint990client # [ 0.373386] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]991client # [ 0.373403] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]992client # [ 0.373433] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]993client # [ 0.373449] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]994client # [ 0.373923] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint995client # [ 0.374114] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]996client # [ 0.374130] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]997worker1 # [ 0.373629] ledtrig-cpu: registered to indicate activity on CPUs998worker2 # [ 0.394533] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint999client # [ 0.374160] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1000worker1 # [ 0.374110] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1001worker2 # [ 0.394739] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1002worker1 # [ 0.374129] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001003worker2 # [ 0.394756] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1004worker2 # [ 0.394787] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1005worker1 # [ 0.374141] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001006worker2 # [ 0.395274] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1007worker1 # [ 0.374150] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001008lb # [ 0.372203] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1009worker2 # [ 0.395465] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1010lb # [ 0.372878] ledtrig-cpu: registered to indicate activity on CPUs1011worker1 # [ 0.374172] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1012client # [ 0.394986] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1013worker2 # [ 0.395481] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1014client # [ 0.395179] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1015lb # [ 0.373255] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1016worker2 # [ 0.395512] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1017worker1 # [ 0.374198] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1018client # [ 0.395195] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1019lb # [ 0.373272] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001020worker1 # [ 0.374273] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001021worker2 # [ 0.395979] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1022client # [ 0.395225] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1023worker1 # [ 0.374283] pci_bus 0000:00: root bus resource [bus 00-ff]1024worker2 # [ 0.396170] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1025lb # [ 0.373283] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001026worker1 # [ 0.374289] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1027worker2 # [ 0.396249] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1028client # [ 0.395692] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1029client # [ 0.395886] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1030lb # [ 0.373292] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001031worker1 # [ 0.374295] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1032worker2 # [ 0.396281] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1033client # [ 0.395902] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1034worker2 # [ 0.396300] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1035worker1 # [ 0.374300] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1036lb # [ 0.373319] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1037client # [ 0.395932] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1038worker2 # [ 0.396777] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1039worker1 # [ 0.374410] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1040lb # [ 0.373345] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1041client # [ 0.395951] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1042worker2 # [ 0.396972] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1043lb # [ 0.373416] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001044worker1 # [ 0.374863] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1045client # [ 0.396439] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1046worker2 # [ 0.397003] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1047lb # [ 0.373425] pci_bus 0000:00: root bus resource [bus 00-ff]1048worker1 # [ 0.375057] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1049client # [ 0.396631] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1050worker1 # [ 0.375074] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1051worker2 # [ 0.397473] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1052lb # [ 0.373431] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1053client # [ 0.396661] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1054worker1 # [ 0.375104] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1055worker2 # [ 0.397668] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1056lb # [ 0.373436] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1057client # [ 0.397125] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1058worker1 # [ 0.375121] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1059worker2 # [ 0.397698] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1060lb # [ 0.373442] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1061client # [ 0.397317] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1062worker1 # [ 0.375591] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1063worker2 # [ 0.398107] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1064lb # [ 0.373548] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1065client # [ 0.397348] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1066worker1 # [ 0.375781] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1067lb # [ 0.374026] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1068worker1 # [ 0.375797] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1069client # [ 0.397791] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1070lb # [ 0.374219] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1071worker1 # [ 0.375827] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1072client # [ 0.397979] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1073lb # [ 0.374235] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1074worker1 # [ 0.376307] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1075client # [ 0.398233] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1076lb # [ 0.374266] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1077worker1 # [ 0.376496] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1078client # [ 0.398424] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1079lb # [ 0.374282] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1080worker1 # [ 0.376513] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1081client # [ 0.398455] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1082lb # [ 0.374753] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1083worker1 # [ 0.376543] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084lb # [ 0.374943] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1085lb # [ 0.374959] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1086worker1 # [ 0.377026] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1087worker1 # [ 0.377217] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1088lb # [ 0.374989] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1089worker2 # [ 0.418330] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1090worker1 # [ 0.377233] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1091lb # [ 0.375451] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1092worker2 # [ 0.418622] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1093worker1 # [ 0.377264] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1094lb # [ 0.375640] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1095worker2 # [ 0.418820] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1096worker1 # [ 0.377283] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1097lb # [ 0.375656] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1098worker2 # [ 0.418851] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1099lb # [ 0.375686] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1100worker2 # [ 0.419334] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1101worker1 # [ 0.404954] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1102lb # [ 0.376168] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1103worker1 # [ 0.405154] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1104worker2 # [ 0.419527] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1105lb # [ 0.376358] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1106worker1 # [ 0.405186] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1107lb # [ 0.376374] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1108worker2 # [ 0.419558] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1109lb # [ 0.376404] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1110worker2 # [ 0.420023] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1111lb # [ 0.376422] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1112worker2 # [ 0.420272] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1113worker1 # [ 0.408314] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1114lb # [ 0.377083] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1115worker2 # [ 0.420304] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1116worker1 # [ 0.408511] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1117lb # [ 0.377283] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1118worker2 # [ 0.420781] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1119worker1 # [ 0.408542] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1120lb # [ 0.377313] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1121worker2 # [ 0.421053] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1122worker1 # [ 0.408944] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1123worker2 # [ 0.421070] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1124lb # [ 0.377774] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1125worker1 # [ 0.409132] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1126worker2 # [ 0.421100] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1127lb # [ 0.377968] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1128worker1 # [ 0.409423] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1129lb # [ 0.377998] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130worker2 # [ 0.421575] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1131worker2 # [ 0.421765] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1132lb # [ 0.378403] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1133worker2 # [ 0.421782] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1134lb # [ 0.378590] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1135worker2 # [ 0.421813] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1136lb # [ 0.378869] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1137lb # [ 0.379062] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1138client # [ 0.427055] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1139lb # [ 0.379092] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1140client # [ 0.427283] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1141lb # [ 0.379554] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1142client # [ 0.427316] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1143lb # [ 0.379746] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1144client # [ 0.427833] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1145lb # [ 0.379776] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1146client # [ 0.428029] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1147client # [ 0.428060] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1148client # [ 0.428532] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1149client # [ 0.428831] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1150client # [ 0.428848] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1151worker2 # [ 0.442536] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1152client # [ 0.428878] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1153worker2 # [ 0.442557] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1154client # [ 0.429351] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1155worker2 # [ 0.442563] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1156client # [ 0.429541] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1157worker1 # [ 0.421689] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1158client # [ 0.429557] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1159worker2 # [ 0.442616] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1160worker1 # [ 0.421732] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1161client # [ 0.429588] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1162worker2 # [ 0.442666] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1163client # [ 0.430177] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1164worker1 # [ 0.422259] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1165worker2 # [ 0.442716] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1166worker1 # [ 0.422460] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1167client # [ 0.430188] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1168worker2 # [ 0.442766] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1169worker1 # [ 0.422491] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1170client # [ 0.430193] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1171worker2 # [ 0.442815] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1172worker1 # [ 0.422967] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1173client # [ 0.430240] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1174worker1 # [ 0.423161] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1175worker2 # [ 0.442865] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1176client # [ 0.430289] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1177worker1 # [ 0.423192] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1178worker2 # [ 0.442914] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1179client # [ 0.430338] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1180worker1 # [ 0.423674] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1181worker2 # [ 0.442962] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1182lb # [ 0.428371] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1183client # [ 0.430388] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1184worker1 # [ 0.423929] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1185worker2 # [ 0.443012] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1186lb # [ 0.428589] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1187worker1 # [ 0.423946] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1188client # [ 0.430436] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1189lb # [ 0.428621] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1190worker2 # [ 0.443116] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1191worker1 # [ 0.423977] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1192client # [ 0.430485] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1193worker2 # [ 0.443167] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1194lb # [ 0.429103] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1195worker1 # [ 0.424466] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1196client # [ 0.430558] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1197lb # [ 0.429387] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1198worker2 # [ 0.443189] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1199worker1 # [ 0.424655] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1200lb # [ 0.429405] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1201worker1 # [ 0.424671] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1202worker2 # [ 0.443212] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1203client # [ 0.430606] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1204lb # [ 0.429435] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1205worker1 # [ 0.424702] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1206worker2 # [ 0.443233] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1207client # [ 0.430653] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1208worker1 # [ 0.425284] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1209worker2 # [ 0.443255] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1210lb # [ 0.429909] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1211client # [ 0.430728] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1212lb # [ 0.430160] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1213worker1 # [ 0.425295] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1214worker2 # [ 0.443277] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1215client # [ 0.430774] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1216lb # [ 0.430177] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1217worker2 # [ 0.443300] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1218worker1 # [ 0.425301] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1219client # [ 0.430796] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1220lb # [ 0.430207] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1221worker2 # [ 0.443328] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1222worker1 # [ 0.425348] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1223client # [ 0.430817] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1224lb # [ 0.430800] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1225worker2 # [ 0.443350] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1226client # [ 0.430839] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1227worker1 # [ 0.425398] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1228lb # [ 0.430812] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1229worker2 # [ 0.443373] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1230client # [ 0.430860] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1231worker1 # [ 0.425447] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1232worker2 # [ 0.443397] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1233lb # [ 0.430817] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1234client # [ 0.430882] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1235worker2 # [ 0.443419] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1236worker1 # [ 0.425497] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1237lb # [ 0.430864] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1238client # [ 0.430903] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1239worker2 # [ 0.443441] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1240worker1 # [ 0.425546] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1241client # [ 0.430929] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1242lb # [ 0.430913] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1243worker2 # [ 0.443462] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1244worker1 # [ 0.425596] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1245client # [ 0.430951] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1246worker2 # [ 0.443485] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1247lb # [ 0.430961] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1248worker2 # [ 0.443506] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1249client # [ 0.430974] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1250worker1 # [ 0.425660] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1251lb # [ 0.431010] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1252worker2 # [ 0.443528] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1253client # [ 0.430996] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1254worker1 # [ 0.425708] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1255lb # [ 0.431059] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1256worker2 # [ 0.443549] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1257client # [ 0.431019] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1258worker1 # [ 0.425755] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1259worker2 # [ 0.443577] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1260lb # [ 0.431108] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1261client # [ 0.431040] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1262worker2 # [ 0.443587] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1263worker1 # [ 0.425826] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1264client # [ 0.431061] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1265lb # [ 0.431157] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1266worker2 # [ 0.443592] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1267worker1 # [ 0.425874] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1268client # [ 0.431082] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1269lb # [ 0.431205] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1270worker2 # [ 0.444506] pci 0000:00:07.0: enabling device (0000 -> 0002)1271worker1 # [ 0.425896] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1272client # [ 0.431103] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1273lb # [ 0.431253] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1274client # [ 0.431124] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1275worker1 # [ 0.425918] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1276lb # [ 0.431324] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1277client # [ 0.431145] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1278worker1 # [ 0.425940] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1279client # [ 0.431171] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1280lb # [ 0.431371] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1281worker1 # [ 0.425962] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1282client # [ 0.431181] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1283lb # [ 0.431393] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1284worker1 # [ 0.425983] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1285client # [ 0.431185] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1286lb # [ 0.431414] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1287worker1 # [ 0.426005] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1288client # [ 0.432049] pci 0000:00:07.0: enabling device (0000 -> 0002)1289lb # [ 0.431436] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1290worker1 # [ 0.426032] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1291lb # [ 0.431458] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1292worker1 # [ 0.426054] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1293lb # [ 0.431479] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1294worker1 # [ 0.426076] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1295worker1 # [ 0.426099] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1296lb # [ 0.431506] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1297worker1 # [ 0.426121] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1298lb # [ 0.431534] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1299worker1 # [ 0.426143] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1300lb # [ 0.431556] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1301worker1 # [ 0.426165] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1302lb # [ 0.431579] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1303worker1 # [ 0.426186] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1304lb # [ 0.431601] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1305worker1 # [ 0.426207] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1306lb # [ 0.431623] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1307worker1 # [ 0.426228] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1308lb # [ 0.431645] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1309worker1 # [ 0.426250] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1310lb # [ 0.431669] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1311worker1 # [ 0.426277] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1312lb # [ 0.431693] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1313worker1 # [ 0.426286] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1314lb # [ 0.431718] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1315worker1 # [ 0.426291] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1316lb # [ 0.431744] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1317worker1 # [ 0.427140] pci 0000:00:07.0: enabling device (0000 -> 0002)1318lb # [ 0.431770] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1319lb # [ 0.431800] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1320lb # [ 0.431810] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1321lb # [ 0.431815] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1322lb # [ 0.432686] pci 0000:00:07.0: enabling device (0000 -> 0002)1323worker2 # [ 0.500771] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1324client # [ 0.496056] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1325client # [ 0.498187] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1326worker2 # [ 0.506785] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1327worker2 # [ 0.508875] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1328client # [ 0.508805] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1329worker1 # [ 0.500017] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1330lb # [ 0.498752] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1331worker2 # [ 0.519119] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1332worker2 # [ 0.521166] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1333lb # [ 0.501749] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1334worker1 # [ 0.503105] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1335worker1 # [ 0.505189] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1336worker2 # [ 0.531131] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1337client # [ 0.522706] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1338worker2 # [ 0.533119] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1339client # [ 0.524801] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1340client # [ 0.527073] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1341worker1 # [ 0.514990] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1342client # [ 0.529119] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1343worker2 # [ 0.536704] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1344worker1 # [ 0.517039] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1345lb # [ 0.512278] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1346lb # [ 0.514460] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1347worker1 # [ 0.520660] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1348lb # [ 0.518127] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1349worker2 # [ 0.542353] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1350client # [ 0.539098] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1351worker2 # [ 0.545137] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1352client # [ 0.541049] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1353lb # [ 0.524180] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1354worker1 # [ 0.527682] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1355lb # [ 0.526379] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1356worker1 # [ 0.529542] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1357worker2 # [ 0.556007] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1358client # [ 0.551028] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1359worker1 # [ 0.539326] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1360client # [ 0.553458] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1361worker1 # [ 0.541183] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1362lb # [ 0.536222] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1363lb # [ 0.538139] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1364lb # [ 0.539899] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1365client # [ 0.563717] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1366client # [ 0.566297] msm_serial: driver initialized1367client # [ 0.566448] SuperH (H)SCI(F) driver initialized1368worker2 # [ 0.570795] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1369worker1 # [ 0.551406] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1370worker2 # [ 0.573530] msm_serial: driver initialized1371lb # [ 0.549498] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1372worker2 # [ 0.573674] SuperH (H)SCI(F) driver initialized1373worker2 # [ 0.573728] STM32 USART driver initialized1374worker1 # [ 0.560308] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1375lb # [ 0.562530] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1376client # [ 0.574562] STM32 USART driver initialized1377worker1 # [ 0.566871] msm_serial: driver initialized1378lb # [ 0.565009] msm_serial: driver initialized1379worker1 # [ 0.567026] SuperH (H)SCI(F) driver initialized1380worker1 # [ 0.567082] STM32 USART driver initialized1381lb # [ 0.565162] SuperH (H)SCI(F) driver initialized1382lb # [ 0.565218] STM32 USART driver initialized1383worker2 # [ 0.604933] loop: module loaded1384worker2 # [ 0.605113] virtio_blk virtio2: 1/0/0 default/read/poll queues1385worker2 # [ 0.605893] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1386client # [ 0.602761] loop: module loaded1387client # [ 0.602942] virtio_blk virtio2: 1/0/0 default/read/poll queues1388client # [ 0.603941] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1389worker2 # [ 0.610727] megasas: 07.734.00.00-rc11390worker2 # [ 0.611372] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1391worker2 # [ 0.613799] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001392worker2 # [ 0.613824] Intel/Sharp Extended Query Table at 0x00311393worker1 # [ 0.598669] loop: module loaded1394lb # [ 0.597065] loop: module loaded1395worker1 # [ 0.598853] virtio_blk virtio2: 1/0/0 default/read/poll queues1396lb # [ 0.597257] virtio_blk virtio2: 1/0/0 default/read/poll queues1397worker1 # [ 0.599676] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1398lb # [ 0.598119] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1399client # [ 0.611088] megasas: 07.734.00.00-rc11400client # [ 0.611819] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1401client # [ 0.617269] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001402client # [ 0.617330] Intel/Sharp Extended Query Table at 0x00311403worker2 # [ 0.624058] Using buffer write method1404worker2 # [ 0.624127] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1405worker1 # [ 0.610206] megasas: 07.734.00.00-rc11406worker1 # [ 0.610909] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1407client # [ 0.627158] Using buffer write method1408worker1 # [ 0.612967] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001409client # [ 0.627221] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1410worker1 # [ 0.612995] Intel/Sharp Extended Query Table at 0x00311411client # [ 0.628978] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001412worker2 # [ 0.634199] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001413client # [ 0.629015] Intel/Sharp Extended Query Table at 0x00311414worker2 # [ 0.634225] Intel/Sharp Extended Query Table at 0x00311415lb # [ 0.608653] megasas: 07.734.00.00-rc11416worker2 # [ 0.636754] Using buffer write method1417worker2 # [ 0.636799] Concatenating MTD devices:1418lb # [ 0.609362] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1419worker2 # [ 0.636803] (0): "0.flash"1420worker2 # [ 0.636807] (1): "0.flash"1421worker2 # [ 0.636814] into device "0.flash"1422lb # [ 0.611165] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001423lb # [ 0.611213] Intel/Sharp Extended Query Table at 0x00311424lb # [ 0.612930] Using buffer write method1425lb # [ 0.612980] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1426lb # [ 0.614807] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001427lb # [ 0.614828] Intel/Sharp Extended Query Table at 0x00311428worker1 # [ 0.622644] Using buffer write method1429worker1 # [ 0.622725] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1430client # [ 0.642545] Using buffer write method1431client # [ 0.642569] Concatenating MTD devices:1432client # [ 0.642573] (0): "0.flash"1433worker1 # [ 0.624458] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001434client # [ 0.642577] (1): "0.flash"1435client # [ 0.642584] into device "0.flash"1436worker1 # [ 0.624489] Intel/Sharp Extended Query Table at 0x00311437worker1 # [ 0.629914] Using buffer write method1438worker1 # [ 0.629945] Concatenating MTD devices:1439lb # [ 0.628592] Using buffer write method1440worker1 # [ 0.629949] (0): "0.flash"1441worker1 # [ 0.629954] (1): "0.flash"1442lb # [ 0.628625] Concatenating MTD devices:1443lb # [ 0.628629] (0): "0.flash"1444lb # [ 0.628633] (1): "0.flash"1445worker1 # [ 0.629963] into device "0.flash"1446lb # [ 0.628641] into device "0.flash"1447worker2 # [ 0.889742] Freeing initrd memory: 26944K1448worker2 # [ 0.895812] tun: Universal TUN/TAP device driver, 1.61449client # [ 0.890966] Freeing initrd memory: 26972K1450client # [ 0.897062] tun: Universal TUN/TAP device driver, 1.61451worker2 # [ 0.899685] thunder_xcv, ver 1.01452worker2 # [ 0.899733] thunder_bgx, ver 1.01453worker2 # [ 0.899756] nicpf, ver 1.01454worker2 # [ 0.900342] e1000: Intel(R) PRO/1000 Network Driver1455lb # [ 0.880943] Freeing initrd memory: 26948K1456worker2 # [ 0.900350] e1000: Copyright (c) 1999-2006 Intel Corporation.1457worker2 # [ 0.900373] e1000e: Intel(R) PRO/1000 Network Driver1458worker2 # [ 0.900381] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1459client # [ 0.900907] thunder_xcv, ver 1.01460client # [ 0.900954] thunder_bgx, ver 1.01461worker2 # [ 0.900412] igb: Intel(R) Gigabit Ethernet Network Driver1462client # [ 0.900978] nicpf, ver 1.01463worker2 # [ 0.900417] igb: Copyright (c) 2007-2014 Intel Corporation.1464client # [ 0.901536] e1000: Intel(R) PRO/1000 Network Driver1465worker2 # [ 0.900441] igbvf: Intel(R) Gigabit Virtual Function Network Driver1466client # [ 0.901543] e1000: Copyright (c) 1999-2006 Intel Corporation.1467lb # [ 0.887064] tun: Universal TUN/TAP device driver, 1.61468client # [ 0.901567] e1000e: Intel(R) PRO/1000 Network Driver1469worker1 # [ 0.888351] Freeing initrd memory: 26976K1470worker2 # [ 0.900447] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1471worker2 # [ 0.900589] sky2: driver version 1.301472client # [ 0.901575] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1473worker2 # [ 0.902145] usbcore: registered new interface driver usb-storage1474client # [ 0.901605] igb: Intel(R) Gigabit Ethernet Network Driver1475worker2 # [ 0.903021] ehci-pci 0000:00:07.0: EHCI Host Controller1476client # [ 0.901610] igb: Copyright (c) 2007-2014 Intel Corporation.1477worker2 # [ 0.903050] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11478client # [ 0.901634] igbvf: Intel(R) Gigabit Virtual Function Network Driver1479worker2 # [ 0.903262] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001480client # [ 0.901640] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1481client # [ 0.901772] sky2: driver version 1.301482lb # [ 0.890806] thunder_xcv, ver 1.01483lb # [ 0.890850] thunder_bgx, ver 1.01484worker1 # [ 0.894586] tun: Universal TUN/TAP device driver, 1.61485lb # [ 0.890873] nicpf, ver 1.01486worker2 # [ 0.914067] usbcore: registered new interface driver usbserial_generic1487lb # [ 0.891435] e1000: Intel(R) PRO/1000 Network Driver1488worker2 # [ 0.914087] usbserial: USB Serial support registered for generic1489lb # [ 0.891443] e1000: Copyright (c) 1999-2006 Intel Corporation.1490worker2 # [ 0.914201] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001491lb # [ 0.891472] e1000e: Intel(R) PRO/1000 Network Driver1492worker2 # [ 0.914509] hub 1-0:1.0: USB hub found1493lb # [ 0.891480] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1494worker2 # [ 0.914530] hub 1-0:1.0: 6 ports detected1495client # [ 0.910983] usbcore: registered new interface driver usb-storage1496lb # [ 0.891512] igb: Intel(R) Gigabit Ethernet Network Driver1497client # [ 0.911041] usbcore: registered new interface driver usbserial_generic1498lb # [ 0.891518] igb: Copyright (c) 2007-2014 Intel Corporation.1499client # [ 0.911054] usbserial: USB Serial support registered for generic1500worker2 # [ 0.918922] hv_vmbus: registering driver hyperv_keyboard1501lb # [ 0.891560] igbvf: Intel(R) Gigabit Virtual Function Network Driver1502client # [ 0.911638] hv_vmbus: registering driver hyperv_keyboard1503lb # [ 0.891566] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1504client # [ 0.912933] ehci-pci 0000:00:07.0: EHCI Host Controller1505lb # [ 0.891700] sky2: driver version 1.301506worker2 # [ 0.920554] rtc-pl031 9010000.pl031: registered as rtc01507client # [ 0.912959] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11508client # [ 0.913168] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001509worker1 # [ 0.898557] thunder_xcv, ver 1.01510worker2 # [ 0.920582] rtc-pl031 9010000.pl031: setting system clock to 2026-09-25T16:31:26 UTC (1790353886)1511worker1 # [ 0.898602] thunder_bgx, ver 1.01512worker1 # [ 0.898624] nicpf, ver 1.01513worker2 # [ 0.920888] i2c_dev: i2c /dev entries driver1514worker1 # [ 0.899213] e1000: Intel(R) PRO/1000 Network Driver1515client # [ 0.918857] rtc-pl031 9010000.pl031: registered as rtc01516lb # [ 0.900792] usbcore: registered new interface driver usb-storage1517worker1 # [ 0.899220] e1000: Copyright (c) 1999-2006 Intel Corporation.1518worker1 # [ 0.899249] e1000e: Intel(R) PRO/1000 Network Driver1519lb # [ 0.900913] usbcore: registered new interface driver usbserial_generic1520client # [ 0.918885] rtc-pl031 9010000.pl031: setting system clock to 2026-09-25T16:31:26 UTC (1790353886)1521worker1 # [ 0.899257] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1522lb # [ 0.900927] usbserial: USB Serial support registered for generic1523client # [ 0.919215] i2c_dev: i2c /dev entries driver1524worker1 # [ 0.899287] igb: Intel(R) Gigabit Ethernet Network Driver1525lb # [ 0.901536] hv_vmbus: registering driver hyperv_keyboard1526worker1 # [ 0.899293] igb: Copyright (c) 2007-2014 Intel Corporation.1527worker1 # [ 0.899316] igbvf: Intel(R) Gigabit Virtual Function Network Driver1528lb # [ 0.906019] ehci-pci 0000:00:07.0: EHCI Host Controller1529worker1 # [ 0.899322] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1530lb # [ 0.906048] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11531worker1 # [ 0.899462] sky2: driver version 1.301532worker2 # [ 0.926503] sdhci: Secure Digital Host Controller Interface driver1533lb # [ 0.906247] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001534worker1 # [ 0.901185] usbcore: registered new interface driver usb-storage1535worker2 # [ 0.926518] sdhci: Copyright(c) Pierre Ossman1536client # [ 0.924701] sdhci: Secure Digital Host Controller Interface driver1537worker1 # [ 0.901240] usbcore: registered new interface driver usbserial_generic1538worker2 # [ 0.926779] Synopsys Designware Multimedia Card Interface Driver1539client # [ 0.924713] sdhci: Copyright(c) Pierre Ossman1540worker1 # [ 0.901253] usbserial: USB Serial support registered for generic1541worker2 # [ 0.927141] sdhci-pltfm: SDHCI platform and OF driver helper1542lb # [ 0.908963] rtc-pl031 9010000.pl031: registered as rtc01543client # [ 0.924969] Synopsys Designware Multimedia Card Interface Driver1544worker1 # [ 0.902287] ehci-pci 0000:00:07.0: EHCI Host Controller1545worker2 # [ 0.928661] hid: raw HID events driver (C) Jiri Kosina1546client # [ 0.925329] sdhci-pltfm: SDHCI platform and OF driver helper1547lb # [ 0.908990] rtc-pl031 9010000.pl031: setting system clock to 2026-09-25T16:31:26 UTC (1790353886)1548worker2 # [ 0.928900] usbcore: registered new interface driver usbhid1549worker1 # [ 0.902317] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11550lb # [ 0.909320] i2c_dev: i2c /dev entries driver1551client # [ 0.929345] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001552worker2 # [ 0.928909] usbhid: USB HID core driver1553client # [ 0.930398] hub 1-0:1.0: USB hub found1554worker1 # [ 0.902604] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001555worker1 # [ 0.914179] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001556client # [ 0.930965] hub 1-0:1.0: 6 ports detected1557worker1 # [ 0.914542] hub 1-0:1.0: USB hub found1558worker1 # [ 0.914557] hub 1-0:1.0: 6 ports detected1559worker2 # [ 0.934735] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1560worker2 # [ 0.936252] drop_monitor: Initializing network drop monitor service1561client # [ 0.932188] hid: raw HID events driver (C) Jiri Kosina1562lb # [ 0.914906] sdhci: Secure Digital Host Controller Interface driver1563worker2 # [ 0.936410] NET: Registered PF_INET6 protocol family1564worker1 # [ 0.917831] hv_vmbus: registering driver hyperv_keyboard1565client # [ 0.932444] usbcore: registered new interface driver usbhid1566lb # [ 0.914917] sdhci: Copyright(c) Pierre Ossman1567client # [ 0.932452] usbhid: USB HID core driver1568lb # [ 0.915198] Synopsys Designware Multimedia Card Interface Driver1569worker2 # [ 0.939722] Segment Routing with IPv61570worker2 # [ 0.939756] In-situ OAM (IOAM) with IPv61571lb # [ 0.915577] sdhci-pltfm: SDHCI platform and OF driver helper1572worker1 # [ 0.919472] rtc-pl031 9010000.pl031: registered as rtc01573worker2 # [ 0.939782] NET: Registered PF_PACKET protocol family1574lb # [ 0.918987] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001575worker1 # [ 0.919505] rtc-pl031 9010000.pl031: setting system clock to 2026-09-25T16:31:26 UTC (1790353886)1576worker2 # [ 0.941561] 9pnet: Installing 9P2000 support1577lb # [ 0.920071] hub 1-0:1.0: USB hub found1578client # [ 0.935486] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1579worker1 # [ 0.919840] i2c_dev: i2c /dev entries driver1580worker2 # [ 0.941610] Key type dns_resolver registered1581lb # [ 0.920568] hub 1-0:1.0: 6 ports detected1582client # [ 0.937041] drop_monitor: Initializing network drop monitor service1583client # [ 0.937170] NET: Registered PF_INET6 protocol family1584client # [ 0.940394] Segment Routing with IPv61585client # [ 0.940413] In-situ OAM (IOAM) with IPv61586worker1 # [ 0.925408] sdhci: Secure Digital Host Controller Interface driver1587client # [ 0.940444] NET: Registered PF_PACKET protocol family1588lb # [ 0.922571] hid: raw HID events driver (C) Jiri Kosina1589worker1 # [ 0.925422] sdhci: Copyright(c) Pierre Ossman1590lb # [ 0.922814] usbcore: registered new interface driver usbhid1591client # [ 0.942172] 9pnet: Installing 9P2000 support1592lb # [ 0.922820] usbhid: USB HID core driver1593client # [ 0.942222] Key type dns_resolver registered1594worker1 # [ 0.927093] Synopsys Designware Multimedia Card Interface Driver1595worker2 # [ 0.948538] registered taskstats version 11596lb # [ 0.925865] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1597worker1 # [ 0.927485] sdhci-pltfm: SDHCI platform and OF driver helper1598worker2 # [ 0.948690] Loading compiled-in X.509 certificates1599worker1 # [ 0.929192] hid: raw HID events driver (C) Jiri Kosina1600lb # [ 0.927440] drop_monitor: Initializing network drop monitor service1601lb # [ 0.927592] NET: Registered PF_INET6 protocol family1602worker1 # [ 0.929440] usbcore: registered new interface driver usbhid1603worker1 # [ 0.929448] usbhid: USB HID core driver1604lb # [ 0.930817] Segment Routing with IPv61605lb # [ 0.930836] In-situ OAM (IOAM) with IPv61606lb # [ 0.930867] NET: Registered PF_PACKET protocol family1607worker1 # [ 0.934028] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1608worker1 # [ 0.935583] drop_monitor: Initializing network drop monitor service1609worker2 # [ 0.957283] Demotion targets for Node 0: null1610lb # [ 0.932632] 9pnet: Installing 9P2000 support1611worker1 # [ 0.935782] NET: Registered PF_INET6 protocol family1612worker2 # [ 0.957389] Key type .fscrypt registered1613lb # [ 0.932673] Key type dns_resolver registered1614worker2 # [ 0.957395] Key type fscrypt-provisioning registered1615client # [ 0.948878] registered taskstats version 11616worker1 # [ 0.939140] Segment Routing with IPv61617worker2 # [ 0.957482] ima: No TPM chip found, activating TPM-bypass!1618client # [ 0.949049] Loading compiled-in X.509 certificates1619worker1 # [ 0.939164] In-situ OAM (IOAM) with IPv61620worker2 # [ 0.957501] ima: Allocated hash algorithm: sha11621worker1 # [ 0.939192] NET: Registered PF_PACKET protocol family1622worker2 # [ 0.957521] ima: No architecture policies found1623worker1 # [ 0.940961] 9pnet: Installing 9P2000 support1624worker1 # [ 0.941014] Key type dns_resolver registered1625lb # [ 0.939709] registered taskstats version 11626worker2 # [ 0.961817] input: gpio-keys as /devices/platform/gpio-keys/input/input01627client # [ 0.957665] Demotion targets for Node 0: null1628lb # [ 0.939868] Loading compiled-in X.509 certificates1629client # [ 0.957770] Key type .fscrypt registered1630client # [ 0.957777] Key type fscrypt-provisioning registered1631client # [ 0.957872] ima: No TPM chip found, activating TPM-bypass!1632client # [ 0.957891] ima: Allocated hash algorithm: sha11633client # [ 0.957912] ima: No architecture policies found1634client # [ 0.962377] input: gpio-keys as /devices/platform/gpio-keys/input/input01635worker1 # [ 0.947916] registered taskstats version 11636worker1 # [ 0.948068] Loading compiled-in X.509 certificates1637lb # [ 0.948686] Demotion targets for Node 0: null1638lb # [ 0.948794] Key type .fscrypt registered1639lb # [ 0.948800] Key type fscrypt-provisioning registered1640lb # [ 0.948890] ima: No TPM chip found, activating TPM-bypass!1641lb # [ 0.948909] ima: Allocated hash algorithm: sha11642lb # [ 0.948934] ima: No architecture policies found1643lb # [ 0.953113] input: gpio-keys as /devices/platform/gpio-keys/input/input01644worker1 # [ 0.956775] Demotion targets for Node 0: null1645worker1 # [ 0.956902] Key type .fscrypt registered1646worker1 # [ 0.956909] Key type fscrypt-provisioning registered1647worker1 # [ 0.957011] ima: No TPM chip found, activating TPM-bypass!1648worker1 # [ 0.957030] ima: Allocated hash algorithm: sha11649worker1 # [ 0.957052] ima: No architecture policies found1650worker2 # [ 0.979684] clk: Disabling unused clocks1651worker1 # [ 0.961404] input: gpio-keys as /devices/platform/gpio-keys/input/input01652worker2 # [ 0.979717] PM: genpd: Disabling unused power domains1653worker2 # [ 0.983931] Freeing unused kernel memory: 4736K1654worker2 # [ 0.984136] Run /init as init process1655client # [ 0.980735] clk: Disabling unused clocks1656client # [ 0.980763] PM: genpd: Disabling unused power domains1657client # [ 0.984965] Freeing unused kernel memory: 4736K1658client # [ 0.985186] Run /init as init process1659lb # [ 0.970550] clk: Disabling unused clocks1660lb # [ 0.970576] PM: genpd: Disabling unused power domains1661lb # [ 0.974778] Freeing unused kernel memory: 4736K1662lb # [ 0.974969] Run /init as init process1663worker2 # [ 1.000468] systemd[1]: Successfully made /usr/ read-only.1664worker1 # [ 0.979598] clk: Disabling unused clocks1665worker1 # [ 0.979632] PM: genpd: Disabling unused power domains1666worker1 # [ 0.983962] Freeing unused kernel memory: 4736K1667worker1 # [ 0.984194] Run /init as init process1668client # [ 1.000888] systemd[1]: Successfully made /usr/ read-only.1669lb # [ 0.990383] systemd[1]: Successfully made /usr/ read-only.1670worker1 # [ 0.999821] systemd[1]: Successfully made /usr/ read-only.1671worker2 # [ 1.162202] usb 1-1: new high-speed USB device number 2 using ehci-pci1672worker1 # [ 1.161644] usb 1-1: new high-speed USB device number 2 using ehci-pci1673client # [ 1.178547] usb 1-1: new high-speed USB device number 2 using ehci-pci1674lb # [ 1.172088] usb 1-1: new high-speed USB device number 2 using ehci-pci1675worker2 # [ 1.311840] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11676worker1 # [ 1.311353] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11677client # [ 1.328258] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11678worker2 # [ 1.335186] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1679worker2 # [ 1.341622] systemd[1]: Detected virtualization qemu.1680worker2 # [ 1.342731] systemd[1]: Detected architecture arm64.1681worker2 # [ 1.343777] systemd[1]: Running in initrd.1682client # [ 1.335575] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1683worker2 # [ 1.345268] systemd[1]: Initializing machine ID from random generator.1684lb # [ 1.321752] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11685worker2 # [ 1.346815] systemd[1]: Hostname set to <worker2>.1686client # [ 1.342280] systemd[1]: Detected virtualization qemu.1687client # [ 1.342336] systemd[1]: Detected architecture arm64.1688client # [ 1.342349] systemd[1]: Running in initrd.1689client # [ 1.342892] systemd[1]: Initializing machine ID from random generator.1690client # [ 1.343044] systemd[1]: Hostname set to <client>.1691lb # [ 1.325043] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1692lb # [ 1.331601] systemd[1]: Detected virtualization qemu.1693lb # [ 1.332822] systemd[1]: Detected architecture arm64.1694lb # [ 1.333890] systemd[1]: Running in initrd.1695lb # [ 1.335322] systemd[1]: Initializing machine ID from random generator.1696lb # [ 1.336888] systemd[1]: Hostname set to <lb>.1697worker1 # [ 1.334555] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1698worker1 # [ 1.340577] systemd[1]: Detected virtualization qemu.1699worker1 # [ 1.341627] systemd[1]: Detected architecture arm64.1700worker1 # [ 1.342547] systemd[1]: Running in initrd.1701worker1 # [ 1.343776] systemd[1]: Initializing machine ID from random generator.1702worker1 # [ 1.345069] systemd[1]: Hostname set to <worker1>.1703worker2 # [ 1.390328] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01704worker1 # [ 1.393809] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01705client # [ 1.414690] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01706lb # [ 1.404225] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01707worker2 # [ 1.510225] usb 1-2: new high-speed USB device number 3 using ehci-pci1708worker1 # [ 1.513647] usb 1-2: new high-speed USB device number 3 using ehci-pci1709client # [ 1.534544] usb 1-2: new high-speed USB device number 3 using ehci-pci1710lb # [ 1.524092] usb 1-2: new high-speed USB device number 3 using ehci-pci1711worker2 # [ 1.592637] systemd[1]: bpf-restrict-fs: LSM BPF program attached1712client # [ 1.604456] systemd[1]: bpf-restrict-fs: LSM BPF program attached1713lb # [ 1.595051] systemd[1]: bpf-restrict-fs: LSM BPF program attached1714worker1 # [ 1.613914] systemd[1]: bpf-restrict-fs: LSM BPF program attached1715worker2 # [ 1.663193] systemd[1]: Queued start job for default target Initrd Default Target.1716worker2 # [ 1.669803] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21717worker2 # [ 1.674978] systemd[1]: Created slice Slice /system/modprobe.1718worker2 # [ 1.676328] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1719worker2 # [ 1.676376] systemd[1]: Expecting device /dev/disk/by-label/nixos...1720worker2 # [ 1.676407] systemd[1]: Reached target Path Units.1721client # [ 1.676126] systemd[1]: Queued start job for default target Initrd Default Target.1722worker2 # [ 1.676427] systemd[1]: Reached target Slice Units.1723worker2 # [ 1.676446] systemd[1]: Reached target Swaps.1724worker2 # [ 1.676464] systemd[1]: Reached target Timer Units.1725worker2 # [ 1.676824] systemd[1]: Listening on D-Bus System Message Bus Socket.1726worker2 # [ 1.677023] systemd[1]: Listening on Journal Socket (/dev/log).1727worker2 # [ 1.677177] systemd[1]: Listening on Journal Sockets.1728worker2 # [ 1.677312] systemd[1]: Listening on udev Control Socket.1729lb # [ 1.664524] systemd[1]: Queued start job for default target Initrd Default Target.1730worker2 # [ 1.677427] systemd[1]: Listening on udev Kernel Socket.1731client # [ 1.682084] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21732worker2 # [ 1.677452] systemd[1]: Reached target Socket Units.1733worker2 # [ 1.689336] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01734worker1 # [ 1.670242] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21735worker2 # [ 1.692480] systemd[1]: Starting Create List of Static Device Nodes...1736worker1 # [ 1.672163] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01737client # [ 1.687162] systemd[1]: Created slice Slice /system/modprobe.1738worker2 # [ 1.693707] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1739client # [ 1.687373] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1740worker1 # [ 1.675962] systemd[1]: Queued start job for default target Initrd Default Target.1741client # [ 1.687410] systemd[1]: Expecting device /dev/disk/by-label/nixos...1742lb # [ 1.674624] systemd[1]: Created slice Slice /system/modprobe.1743client # [ 1.687436] systemd[1]: Reached target Path Units.1744client # [ 1.687456] systemd[1]: Reached target Slice Units.1745lb # [ 1.675912] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1746client # [ 1.687474] systemd[1]: Reached target Swaps.1747client # [ 1.687493] systemd[1]: Reached target Timer Units.1748lb # [ 1.677696] systemd[1]: Expecting device /dev/disk/by-label/nixos...1749client # [ 1.687645] systemd[1]: Listening on D-Bus System Message Bus Socket.1750client # [ 1.687905] systemd[1]: Listening on Journal Socket (/dev/log).1751lb # [ 1.679139] systemd[1]: Reached target Path Units.1752client # [ 1.688059] systemd[1]: Listening on Journal Sockets.1753lb # [ 1.679168] systemd[1]: Reached target Slice Units.1754client # [ 1.688195] systemd[1]: Listening on udev Control Socket.1755worker1 # [ 1.683736] systemd[1]: Created slice Slice /system/modprobe.1756lb # [ 1.679188] systemd[1]: Reached target Swaps.1757client # [ 1.688306] systemd[1]: Listening on udev Kernel Socket.1758worker2 # [ 1.702340] systemd[1]: Mounting Kernel Configuration File System...1759lb # [ 1.679209] systemd[1]: Reached target Timer Units.1760worker1 # [ 1.684799] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1761client # [ 1.688329] systemd[1]: Reached target Socket Units.1762lb # [ 1.679387] systemd[1]: Listening on D-Bus System Message Bus Socket.1763worker1 # [ 1.686018] systemd[1]: Expecting device /dev/disk/by-label/nixos...1764worker1 # [ 1.686927] systemd[1]: Reached target Path Units.1765lb # [ 1.679583] systemd[1]: Listening on Journal Socket (/dev/log).1766client # [ 1.701717] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01767worker1 # [ 1.687621] systemd[1]: Reached target Slice Units.1768lb # [ 1.679742] systemd[1]: Listening on Journal Sockets.1769worker1 # [ 1.688373] systemd[1]: Reached target Swaps.1770worker1 # [ 1.689008] systemd[1]: Reached target Timer Units.1771lb # [ 1.679884] systemd[1]: Listening on udev Control Socket.1772client # [ 1.704145] systemd[1]: Starting Create List of Static Device Nodes...1773lb # [ 1.680000] systemd[1]: Listening on udev Kernel Socket.1774worker1 # [ 1.689890] systemd[1]: Listening on D-Bus System Message Bus Socket.1775worker2 # [ 1.710445] systemd[1]: Starting Journal Service...1776lb # [ 1.680025] systemd[1]: Reached target Socket Units.1777worker1 # [ 1.690943] systemd[1]: Listening on Journal Socket (/dev/log).1778client # [ 1.704219] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1779worker1 # [ 1.691909] systemd[1]: Listening on Journal Sockets.1780worker1 # [ 1.692810] systemd[1]: Listening on udev Control Socket.1781worker1 # [ 1.693705] systemd[1]: Listening on udev Kernel Socket.1782lb # [ 1.691512] systemd[1]: Starting Create List of Static Device Nodes...1783worker1 # [ 1.694485] systemd[1]: Reached target Socket Units.1784worker1 # [ 1.696569] systemd[1]: Starting Create List of Static Device Nodes...1785lb # [ 1.692831] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1786worker1 # [ 1.697651] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1787client # [ 1.714581] systemd[1]: Mounting Kernel Configuration File System...1788lb # [ 1.697288] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21789lb # [ 1.699865] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01790worker1 # [ 1.705746] systemd[1]: Mounting Kernel Configuration File System...1791lb # [ 1.704519] systemd[1]: Mounting Kernel Configuration File System...1792client # [ 1.722909] systemd[1]: Starting Journal Service...1793worker2 # [ 1.734418] systemd[1]: Starting Load Kernel Modules...1794worker1 # [ 1.714607] systemd[1]: Starting Journal Service...1795worker2 # [ 1.735304] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1796client # [ 1.738212] systemd[1]: Starting Load Kernel Modules...1797client # [ 1.739209] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1798worker1 # [ 1.727079] systemd[1]: Starting Load Kernel Modules...1799lb # [ 1.724995] systemd[1]: Starting Journal Service...1800worker1 # [ 1.727191] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1801lb # [ 1.728387] systemd[1]: Starting Load Kernel Modules...1802lb # [ 1.729296] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1803worker2 # [ 1.753909] systemd-journald[72]: Collecting audit messages is disabled.1804client # [ 1.752811] systemd[1]: Starting Coldplug All udev Devices...1805worker2 # [ 1.762502] systemd[1]: Starting Coldplug All udev Devices...1806lb # [ 1.744425] systemd[1]: Starting Coldplug All udev Devices...1807worker2 # [ 1.770351] systemd[1]: Finished Create List of Static Device Nodes.1808lb # [ 1.757729] systemd-journald[72]: Collecting audit messages is disabled.1809client # [ 1.774645] systemd[1]: Finished Create List of Static Device Nodes.1810client # [ 1.775551] systemd[1]: Mounted Kernel Configuration File System.1811worker1 # [ 1.757738] systemd[1]: Starting Coldplug All udev Devices...1812worker1 # [ 1.759256] systemd[1]: Finished Create List of Static Device Nodes.1813worker1 # [ 1.759938] systemd[1]: Mounted Kernel Configuration File System.1814worker2 # [ 1.786571] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1815worker2 # [ 1.786847] systemd[1]: Mounted Kernel Configuration File System.1816lb # [ 1.764215] systemd[1]: Finished Create List of Static Device Nodes.1817client # [ 1.784372] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1818lb # [ 1.777294] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1819worker1 # [ 1.779641] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1820worker1 # [ 1.781693] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1821client # [ 1.797723] systemd-journald[72]: Collecting audit messages is disabled.1822worker1 # [ 1.787257] systemd-journald[72]: Collecting audit messages is disabled.1823lb # [ 1.792414] systemd[1]: Mounted Kernel Configuration File System.1824worker2 # [ 1.810796] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1825client # [ 1.811310] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1826client # [ 1.813229] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1827lb # [ 1.806081] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1828worker2 # [ 1.830244] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1829client # [ 1.828093] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01830worker1 # [ 1.805946] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1831client # [ 1.828353] [drm] features: -virgl +edid -resource_blob -host_visible1832worker1 # [ 1.811918] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01833client # [ 1.828370] [drm] features: -context_init1834worker1 # [ 1.812247] [drm] features: -virgl +edid -resource_blob -host_visible1835client # [ 1.829104] [drm] number of scanouts: 11836worker1 # [ 1.812258] [drm] features: -context_init1837client # [ 1.829122] [drm] number of cap sets: 01838worker1 # [ 1.812985] [drm] number of scanouts: 11839worker1 # [ 1.813005] [drm] number of cap sets: 01840lb # [ 1.812463] systemd[1]: Starting Create Static Device Nodes in /dev...1841worker2 # [ 1.839928] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01842worker2 # [ 1.840193] [drm] features: -virgl +edid -resource_blob -host_visible1843worker2 # [ 1.840203] [drm] features: -context_init1844worker2 # [ 1.840931] [drm] number of scanouts: 11845worker2 # [ 1.840950] [drm] number of cap sets: 01846worker2 # [ 1.845132] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1847worker1 # [ 1.830301] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1848client # [ 1.847158] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1849worker1 # [ 1.833992] systemd[1]: Starting Create Static Device Nodes in /dev...1850client # [ 1.849760] systemd[1]: Starting Create Static Device Nodes in /dev...1851worker2 # [ 1.854820] systemd[1]: Starting Create Static Device Nodes in /dev...1852worker1 # [ 1.842075] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1853worker1 # [ 1.842091] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01854client # [ 1.858967] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1855worker2 # [ 1.866631] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1856client # [ 1.858983] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01857worker2 # [ 1.866648] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01858lb # [ 1.852674] systemd[1]: Finished Create Static Device Nodes in /dev.1859lb # [ 1.852851] systemd[1]: Reached target Preparation for Local File Systems.1860lb # [ 1.852878] systemd[1]: Reached target Local File Systems.1861lb # [ 1.862208] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1862lb # [ 1.862728] systemd[1]: Starting Rule-based Manager for Device Events and Files...1863client # [ 1.882873] Console: switching to colour frame buffer device 160x501864worker1 # [ 1.869937] Console: switching to colour frame buffer device 160x501865lb # [ 1.871514] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1866worker1 # [ 1.874072] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1867worker2 # [ 1.898089] Console: switching to colour frame buffer device 160x501868lb # [ 1.878932] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01869lb # [ 1.879171] [drm] features: -virgl +edid -resource_blob -host_visible1870lb # [ 1.879181] [drm] features: -context_init1871lb # [ 1.879913] [drm] number of scanouts: 11872worker2 # [ 1.902979] systemd[1]: Finished Create Static Device Nodes in /dev.1873lb # [ 1.879931] [drm] number of cap sets: 01874worker2 # [ 1.903170] systemd[1]: Reached target Preparation for Local File Systems.1875worker2 # [ 1.903194] systemd[1]: Reached target Local File Systems.1876client # [ 1.900972] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1877client # [ 1.903898] systemd[1]: Finished Create Static Device Nodes in /dev.1878client # [ 1.905002] systemd[1]: Reached target Preparation for Local File Systems.1879client # [ 1.907409] systemd[1]: Reached target Local File Systems.1880worker2 # [ 1.910512] systemd[1]: Starting Rule-based Manager for Device Events and Files...1881worker1 # [ 1.894261] systemd[1]: Finished Load Kernel Modules.1882worker1 # [ 1.897162] systemd[1]: Starting Apply Kernel Variables...1883worker2 # [ 1.918738] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1884client # [ 1.915014] systemd[1]: Starting Rule-based Manager for Device Events and Files...1885lb # [ 1.904403] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1886lb # [ 1.904423] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01887worker2 # [ 1.930732] systemd[1]: Finished Load Kernel Modules.1888client # [ 1.926722] systemd[1]: Finished Load Kernel Modules.1889worker1 # [ 1.910878] systemd[1]: Finished Create Static Device Nodes in /dev.1890worker1 # [ 1.913027] systemd[1]: Reached target Preparation for Local File Systems.1891worker1 # [ 1.913072] systemd[1]: Reached target Local File Systems.1892client # [ 1.930870] systemd[1]: Starting Apply Kernel Variables...1893worker2 # [ 1.919404] systemd-modules-load[74]: Inserted module 'dm_mod'1894worker2 # [ 1.924291] systemd-modules-load[74]: Module 'virtio_balloon' is built in1895worker2 # [ 1.950570] systemd[1]: Starting Apply Kernel Variables...1896worker2 # [ 1.950715] systemd[1]: Started Journal Service.1897worker1 # [ 1.930021] systemd[1]: Starting Rule-based Manager for Device Events and Files...1898worker2 # [ 1.939820] systemd-modules-load[74]: Module 'virtio_console' is built in1899worker2 # [ 1.941255] systemd-modules-load[74]: Inserted module 'virtio_gpu'1900lb # [ 1.936374] Console: switching to colour frame buffer device 160x501901worker2 # [ 1.945074] systemd-modules-load[74]: Module 'virtio_rng' is built in1902lb # [ 1.942143] systemd[1]: Started Journal Service.1903worker1 # [ 1.947655] systemd[1]: Finished Apply Kernel Variables.1904lb # [ 1.932453] systemd-modules-load[74]: Inserted module 'dm_mod'1905lb # [ 1.936421] systemd-modules-load[74]: Module 'virtio_balloon' is built in1906lb # [ 1.937687] systemd-modules-load[74]: Module 'virtio_console' is built in1907worker1 # [ 1.944382] systemd-modules-load[73]: Inserted module 'dm_mod'1908worker1 # [ 1.945518] systemd-modules-load[73]: Module 'virtio_balloon' is built in1909lb # [ 1.956646] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1910worker1 # [ 1.946653] systemd-modules-load[73]: Module 'virtio_console' is built in1911worker1 # [ 1.947734] systemd-modules-load[73]: Inserted module 'virtio_gpu'1912worker1 # [ 1.962326] systemd[1]: Started Journal Service.1913lb # [ 1.943974] systemd[1]: Starting Create System Files and Directories...1914worker2 # [ 1.968642] systemd[1]: Starting Create System Files and Directories...1915client # [ 1.983163] systemd[1]: Finished Apply Kernel Variables.1916client # [ 1.967484] systemd-modules-load[73]: Inserted module 'dm_mod'1917worker1 # [ 1.957175] systemd-modules-load[73]: Module 'virtio_rng' is built in1918worker2 # [ 1.973850] systemd[1]: Finished Apply Kernel Variables.1919worker1 # [ 1.958250] systemd[1]: Starting Create System Files and Directories...1920client # [ 1.987121] systemd[1]: Started Journal Service.1921lb # [ 1.956257] systemd-modules-load[74]: Inserted module 'virtio_gpu'1922client # [ 1.972239] systemd-modules-load[73]: Module 'virtio_balloon' is built in1923lb # [ 1.958772] systemd-modules-load[74]: Module 'virtio_rng' is built in1924lb # [ 1.961173] systemd[1]: Finished Load Kernel Modules.1925client # [ 1.984119] systemd-modules-load[73]: Module 'virtio_console' is built in1926client # [ 1.985409] systemd-modules-load[73]: Inserted module 'virtio_gpu'1927client # [ 1.986433] systemd-modules-load[73]: Module 'virtio_rng' is built in1928client # [ 1.987472] systemd[1]: Starting Create System Files and Directories...1929lb # [ 1.972709] systemd-udevd[78]: Using default interface naming scheme 'v261'.1930lb # [ 1.980125] systemd[1]: Starting Apply Kernel Variables...1931worker2 # [ 2.001274] systemd-udevd[79]: Using default interface naming scheme 'v261'.1932worker1 # [ 1.990000] systemd[1]: Finished Create System Files and Directories.1933worker2 # [ 2.013171] systemd[1]: Finished Create System Files and Directories.1934lb # [ 1.993320] systemd[1]: Finished Create System Files and Directories.1935client # [ 2.017356] systemd-udevd[79]: Using default interface naming scheme 'v261'.1936worker1 # [ 2.009460] systemd-udevd[79]: Using default interface naming scheme 'v261'.1937client # [ 2.025564] systemd[1]: Finished Create System Files and Directories.1938worker2 # [ 2.033132] systemd[1]: Started Rule-based Manager for Device Events and Files.1939lb # [ 2.018281] systemd[1]: Finished Apply Kernel Variables.1940lb # [ 2.024362] systemd[1]: Started Rule-based Manager for Device Events and Files.1941client # [ 2.050649] systemd[1]: Started Rule-based Manager for Device Events and Files.1942worker1 # [ 2.040638] systemd[1]: Started Rule-based Manager for Device Events and Files.1943lb # [ 2.088585] systemd[1]: Starting Virtual Console Setup...1944worker1 # [ 2.096129] systemd[1]: Starting Virtual Console Setup...1945worker2 # [ 2.120080] systemd[1]: Starting Virtual Console Setup...1946client # [ 2.125841] systemd[1]: Starting Virtual Console Setup...1947worker1 # [ 2.148498] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones.1948worker1 # [ 2.152055] systemd[1]: Finished Virtual Console Setup.1949worker2 # [ 2.168522] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1950worker2 # [ 2.172066] systemd[1]: Finished Virtual Console Setup.1951lb # [ 2.160489] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1952lb # [ 2.168156] systemd[1]: Finished Virtual Console Setup.1953client # [ 2.184497] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1954client # [ 2.187962] systemd[1]: Finished Virtual Console Setup.1955worker1 # [ 2.744539] systemd[1]: Finished Coldplug All udev Devices.1956worker1 # [ 2.745610] systemd[1]: Reached target System Initialization.1957worker1 # [ 2.746439] systemd[1]: Reached target Basic System.1958worker2 # [ 2.777544] systemd[1]: Finished Coldplug All udev Devices.1959worker2 # [ 2.778587] systemd[1]: Reached target System Initialization.1960worker2 # [ 2.779426] systemd[1]: Reached target Basic System.1961client # [ 2.789848] systemd[1]: Finished Coldplug All udev Devices.1962client # [ 2.792649] systemd[1]: Reached target System Initialization.1963client # [ 2.793629] systemd[1]: Reached target Basic System.1964lb # [ 2.809020] systemd[1]: Finished Coldplug All udev Devices.1965lb # [ 2.810379] systemd[1]: Reached target System Initialization.1966lb # [ 2.812392] systemd[1]: Reached target Basic System.1967worker1 # [ 2.900466] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1968worker1 # [ 2.919690] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1969worker2 # [ 2.941299] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1970worker2 # [ 2.946265] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1971worker1 # [ 2.937642] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1972worker2 # [ 2.955095] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1973client # [ 2.959617] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line.1974client # [ 2.973029] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1975client # [ 2.977637] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1976lb # [ 2.963554] (udev-worker)[90]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1977lb # [ 2.983540] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1978lb # [ 2.993692] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line.1979worker2 # [ 3.016843] systemd[1]: Found device /dev/disk/by-label/nixos.1980worker2 # [ 3.024700] systemd[1]: Reached target Initrd Root Device.1981worker2 # [ 3.029483] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1982client # [ 3.033773] systemd[1]: Found device /dev/disk/by-label/nixos.1983client # [ 3.036892] systemd[1]: Reached target Initrd Root Device.1984client # [ 3.040580] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1985worker1 # [ 3.033265] systemd[1]: Found device /dev/disk/by-label/nixos.1986worker1 # [ 3.036820] systemd[1]: Reached target Initrd Root Device.1987worker1 # [ 3.039332] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1988worker2 # [ 3.081177] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1989worker2 # [ 3.087143] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1990worker2 # [ 3.089753] systemd[1]: Mounting /sysroot...1991client # [ 3.092882] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1992worker1 # [ 3.085343] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks1993lb # [ 3.081342] systemd[1]: Found device /dev/disk/by-label/nixos.1994client # [ 3.097847] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1995lb # [ 3.084900] systemd[1]: Reached target Initrd Root Device.1996worker1 # [ 3.092179] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1997lb # [ 3.088650] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1998client # [ 3.104675] systemd[1]: Mounting /sysroot...1999worker1 # [ 3.095129] systemd[1]: Mounting /sysroot...2000worker2 # [ 3.140620] EXT4-fs (vda): mounted filesystem 9d5fa7da-9528-4ff6-968d-582c2da3d29d r/w with ordered data mode. Quota mode: none.
loading 1,998 hidden lines…
3999lb: must succeed: curl -sf localhost:9901/clusters4000lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4001worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4002worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4003client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&24004worker1 # [ 55.222476] nix-grpc-daemon[486]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:557144005client # don't know how to build these paths:4006client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4007worker2 # [ 55.245894] nix-grpc-daemon[769]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644008worker1 # [ 55.239728] nix-grpc-daemon[486]: ts=2026-09-25T16:32:20Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04009worker1 # [ 55.244880] nix-grpc-daemon[486]: ts=2026-09-25T16:32:20Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14010worker1 # [ 55.249465] nix-grpc-daemon[486]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144011worker1 # [ 55.253631] nix-grpc-daemon[486]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557144012client # copying 1 paths to 'lb:50051'...4013worker1 # [ 55.261136] nix-grpc-daemon[869]: time=2026-09-25T16:32:20.853Z level=INFO msg="All 2 paths already cached"4014client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4015worker1 # [ 55.264087] nix-grpc-daemon[486]: ts=2026-09-25T16:32:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:557144016worker1 # [ 55.272668] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4017worker1 # [ 55.394731] nix-daemon[855]: accepted connection from pid 1010, user nix-grpc-daemon (trusted)4018worker1 # [ 55.415169] nix-daemon[855]: reaped child process 1013, status = succeeded4019lb # [ 55.415582] niks3-server[994]: 2026/09/25 16:32:21 INFO Received push request method=POST path=/api/pushes4020worker1 # [ 55.425799] nix-grpc-daemon[869]: time=2026-09-25T16:32:21.019Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4021worker1 # [ 55.427338] nix-grpc-daemon[869]: time=2026-09-25T16:32:21.019Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4022lb # [ 55.432918] niks3-server[994]: 2026/09/25 16:32:21 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign4023worker1 # [ 55.441488] nix-grpc-daemon[869]: time=2026-09-25T16:32:21.035Z level=INFO msg="Uploading 1 narinfos"4024lb # [ 55.440167] niks3-server[994]: 2026/09/25 16:32:21 INFO Signed narinfos id=7 count=14025lb # [ 55.444212] niks3-server[994]: 2026/09/25 16:32:21 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4026lb # [ 55.452859] niks3-server[994]: 2026/09/25 16:32:21 INFO Received complete push request method=POST path=/api/pushes/7/complete4027worker1 # [ 55.463325] nix-grpc-daemon[869]: time=2026-09-25T16:32:21.057Z level=INFO msg="Upload complete. (181ms)"4028lb # [ 55.459340] niks3-server[994]: 2026/09/25 16:32:21 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4029worker1 # [ 55.468174] nix-grpc-daemon[486]: ts=2026-09-25T16:32:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=1 nar_bytes_in=7524030lb # [ 55.468733] niks3-server[994]: 2026/09/25 16:32:21 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4031worker1 # [ 55.479274] nix-grpc-daemon[486]: ts=2026-09-25T16:32:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144032worker1 # [ 55.483796] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4033worker1 # [ 55.487561] nix-daemon[855]: reaped child process 1008, status = succeeded4034client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4035client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4036worker1 # [ 55.497986] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4037client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4038client # farm-top> LOG-farm-top-t1b4039worker1 # [ 56.336316] nix-daemon[855]: reaped child process 1017, status = succeeded4040worker1 # [ 56.434128] nix-daemon[855]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)4041lb # [ 56.446868] niks3-server[994]: 2026/09/25 16:32:22 INFO Received push request method=POST path=/api/pushes4042worker1 # [ 56.455238] nix-daemon[855]: reaped child process 1036, status = succeeded4043worker1 # [ 56.528737] nix-grpc-daemon[869]: time=2026-09-25T16:32:22.119Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4044worker1 # [ 56.532569] nix-grpc-daemon[869]: time=2026-09-25T16:32:22.119Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4045lb # [ 56.543907] niks3-server[994]: 2026/09/25 16:32:22 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign4046worker1 # [ 56.553108] nix-grpc-daemon[869]: time=2026-09-25T16:32:22.146Z level=INFO msg="Uploading 1 narinfos"4047lb # [ 56.554021] niks3-server[994]: 2026/09/25 16:32:22 INFO Signed narinfos id=8 count=14048lb # [ 56.560808] niks3-server[994]: 2026/09/25 16:32:22 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4049lb # [ 56.567699] niks3-server[994]: 2026/09/25 16:32:22 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4050lb # [ 56.577113] niks3-server[994]: 2026/09/25 16:32:22 INFO Received complete push request method=POST path=/api/pushes/8/complete4051worker1 # [ 56.587298] nix-grpc-daemon[869]: time=2026-09-25T16:32:22.181Z level=INFO msg="Upload complete. (282ms)"4052lb # [ 56.583710] niks3-server[994]: 2026/09/25 16:32:22 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4053lb # [ 56.589199] niks3-server[994]: 2026/09/25 16:32:22 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4054worker1 # [ 56.596695] nix-grpc-daemon[486]: ts=2026-09-25T16:32:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=04055worker1 # [ 56.608425] nix-daemon[855]: reaped child process 1015, status = succeeded4056client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.57 seconds)4057client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath4058client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.14 seconds)4059lb: must succeed: curl -sf localhost:9901/clusters4060lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4061lb: must succeed: curl -sf localhost:9901/clusters4062lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4063worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4064worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4065(finished: subtest: inputs already in the cache are not sent to the scheduler, in 1.91 seconds)4066subtest: outputs read back through any worker carry the cache signature4067client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&24068client # don't know how to build these paths:4069client # /nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4070worker2 # [ 57.048725] nix-grpc-daemon[769]: ts=2026-09-25T16:32:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519644071worker1 # [ 57.035771] nix-grpc-daemon[486]: ts=2026-09-25T16:32:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557144072worker1 # [ 57.051199] nix-grpc-daemon[486]: ts=2026-09-25T16:32:22Z level=debug event=want client=4 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv cached=04073worker2 # [ 57.069053] nix-grpc-daemon[769]: ts=2026-09-25T16:32:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644074worker1 # [ 57.054457] nix-grpc-daemon[486]: ts=2026-09-25T16:32:22Z level=debug event=assigned drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker=192.168.1.4:50051 clients=14075worker2 # [ 57.078218] nix-grpc-daemon[769]: ts=2026-09-25T16:32:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644076client # copying 1 paths to 'lb:50051'...4077client # copying path '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' to 'lb:50051'...4078worker2 # [ 57.087342] nix-grpc-daemon[769]: ts=2026-09-25T16:32:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519644079worker2 # [ 57.096694] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4080worker2 # [ 57.116941] nix-grpc-daemon[769]: ts=2026-09-25T16:32:22Z level=info event=niks3_push_started pid=8744081worker2 # [ 57.261558] nix-grpc-daemon[874]: time=2026-09-25T16:32:22.857Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""4082worker2 # [ 57.368196] nix-daemon[840]: accepted connection from pid 886, user nix-grpc-daemon (trusted)4083lb # [ 57.368112] niks3-server[994]: 2026/09/25 16:32:22 INFO Received push request method=POST path=/api/pushes4084worker2 # [ 57.392125] nix-daemon[840]: reaped child process 889, status = succeeded4085worker2 # [ 57.395616] nix-grpc-daemon[874]: time=2026-09-25T16:32:22.991Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4086worker2 # [ 57.399703] nix-grpc-daemon[874]: time=2026-09-25T16:32:22.991Z level=INFO msg="Uploading 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv (512B)"4087lb # [ 57.395498] niks3-server[994]: 2026/09/25 16:32:23 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign4088worker2 # [ 57.420025] nix-grpc-daemon[874]: time=2026-09-25T16:32:23.016Z level=INFO msg="Uploading 1 narinfos"4089lb # [ 57.403843] niks3-server[994]: 2026/09/25 16:32:23 INFO Signed narinfos id=9 count=14090lb # [ 57.407974] niks3-server[994]: 2026/09/25 16:32:23 INFO Registered completed upload object_key=nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst4091lb # [ 57.411254] niks3-server[994]: 2026/09/25 16:32:23 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls4092lb # [ 57.422479] niks3-server[994]: 2026/09/25 16:32:23 INFO Received complete push request method=POST path=/api/pushes/9/complete4093worker2 # [ 57.448813] nix-grpc-daemon[874]: time=2026-09-25T16:32:23.046Z level=INFO msg="Upload complete. (184ms)"4094lb # [ 57.429508] niks3-server[994]: 2026/09/25 16:32:23 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo4095worker2 # [ 57.453750] nix-grpc-daemon[769]: ts=2026-09-25T16:32:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_in=5124096worker2 # [ 57.465119] nix-grpc-daemon[769]: ts=2026-09-25T16:32:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644097worker2 # [ 57.469889] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4098worker2 # [ 57.473722] nix-daemon[840]: reaped child process 872, status = succeeded4099client # building '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' on lb:50051...4100client # farm-a> worker2: building 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4101worker2 # [ 57.483800] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4102lb # [ 57.470172] envoy[894]: conn peer=[2001:db8:1::1]:41084 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=399 ms=16264103lb # [ 57.473392] envoy[894]: conn peer=[2001:db8:1::1]:41094 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=363 ms=434104lb # [ 57.475966] envoy[894]: conn peer=[2001:db8:1::1]:41110 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=84105lb # [ 57.478420] envoy[894]: conn peer=[2001:db8:1::1]:41124 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=94106lb # [ 57.480948] envoy[894]: conn peer=[2001:db8:1::1]:41130 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9476 tx=4354 ms=52244107lb # [ 57.483481] envoy[894]: conn peer=[2001:db8:1::1]:54552 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=454108lb # [ 57.485999] envoy[894]: conn peer=[2001:db8:1::1]:54568 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4168 tx=1871 ms=13874109client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4110client # farm-a> LOG-farm-a-sig4111worker2 # [ 58.350102] nix-daemon[840]: reaped child process 893, status = succeeded4112worker2 # [ 58.407977] nix-daemon[840]: accepted connection from pid 909, user nix-grpc-daemon (trusted)4113worker2 # [ 58.427808] nix-daemon[840]: reaped child process 912, status = succeeded4114lb # [ 58.408825] niks3-server[994]: 2026/09/25 16:32:24 INFO Received push request method=POST path=/api/pushes4115worker2 # [ 58.436472] nix-grpc-daemon[874]: time=2026-09-25T16:32:24.031Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4116worker2 # [ 58.438060] nix-grpc-daemon[874]: time=2026-09-25T16:32:24.031Z level=INFO msg="Uploading 2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a (128B)"4117lb # [ 58.426703] niks3-server[994]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4118lb # [ 58.437702] niks3-server[994]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4119worker2 # [ 58.467143] nix-grpc-daemon[874]: time=2026-09-25T16:32:24.064Z level=INFO msg="Uploading 1 narinfos"4120lb # [ 58.443679] niks3-server[994]: 2026/09/25 16:32:24 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign4121lb # [ 58.450287] niks3-server[994]: 2026/09/25 16:32:24 INFO Signed narinfos id=10 count=14122lb # [ 58.451953] niks3-server[994]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.ls4123lb # [ 58.463954] niks3-server[994]: 2026/09/25 16:32:24 INFO Received complete push request method=POST path=/api/pushes/10/complete4124lb # [ 58.471796] niks3-server[994]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo4125worker2 # [ 58.495874] nix-grpc-daemon[874]: time=2026-09-25T16:32:24.093Z level=INFO msg="Upload complete. (204ms)"4126worker1 # [ 58.490308] nix-grpc-daemon[486]: ts=2026-09-25T16:32:24Z level=debug event=want client=4 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv cached=04127worker2 # [ 58.504843] nix-grpc-daemon[769]: ts=2026-09-25T16:32:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=1 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv assign_id=5 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04128worker1 # [ 58.493546] nix-grpc-daemon[486]: ts=2026-09-25T16:32:24Z level=debug event=assigned drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker=192.168.1.4:50051 clients=14129worker2 # [ 58.517370] nix-grpc-daemon[769]: ts=2026-09-25T16:32:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644130worker2 # [ 58.521571] nix-daemon[840]: reaped child process 891, status = succeeded4131worker2 # [ 58.526539] nix-grpc-daemon[769]: ts=2026-09-25T16:32:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644132worker2 # [ 58.534796] nix-grpc-daemon[874]: time=2026-09-25T16:32:24.132Z level=INFO msg="All 1 paths already cached"4133client # copying 1 paths to 'lb:50051'...4134client # copying path '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' to 'lb:50051'...4135worker2 # [ 58.540856] nix-grpc-daemon[769]: ts=2026-09-25T16:32:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519644136worker2 # [ 58.548842] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4137worker2 # [ 58.670386] nix-daemon[840]: accepted connection from pid 916, user nix-grpc-daemon (trusted)4138lb # [ 58.668897] niks3-server[994]: 2026/09/25 16:32:24 INFO Received push request method=POST path=/api/pushes4139worker2 # [ 58.693067] nix-daemon[840]: reaped child process 919, status = succeeded4140worker2 # [ 58.742332] nix-grpc-daemon[874]: time=2026-09-25T16:32:24.339Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4141worker2 # [ 58.744791] nix-grpc-daemon[874]: time=2026-09-25T16:32:24.339Z level=INFO msg="Uploading z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv (624B)"4142lb # [ 58.733454] niks3-server[994]: 2026/09/25 16:32:24 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign4143worker2 # [ 58.759186] nix-grpc-daemon[874]: time=2026-09-25T16:32:24.356Z level=INFO msg="Uploading 1 narinfos"4144lb # [ 58.740122] niks3-server[994]: 2026/09/25 16:32:24 INFO Signed narinfos id=11 count=14145lb # [ 58.745839] niks3-server[994]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.ls4146lb # [ 58.751604] niks3-server[994]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst4147lb # [ 58.760691] niks3-server[994]: 2026/09/25 16:32:24 INFO Received complete push request method=POST path=/api/pushes/11/complete4148worker2 # [ 58.785926] nix-grpc-daemon[874]: time=2026-09-25T16:32:24.383Z level=INFO msg="Upload complete. (227ms)"4149lb # [ 58.767125] niks3-server[994]: 2026/09/25 16:32:24 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo4150worker2 # [ 58.791696] nix-grpc-daemon[769]: ts=2026-09-25T16:32:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_in=6244151worker2 # [ 58.803174] nix-grpc-daemon[769]: ts=2026-09-25T16:32:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644152worker2 # [ 58.810149] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4153worker2 # [ 58.814598] nix-daemon[840]: reaped child process 914, status = succeeded4154client # building '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' on lb:50051...4155client # farm-b> worker2: building z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4156worker2 # [ 58.824394] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4157client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4158client # farm-b> LOG-farm-b-sig4159worker2 # [ 60.472756] nix-daemon[840]: reaped child process 923, status = succeeded4160worker2 # [ 60.565111] nix-daemon[840]: accepted connection from pid 939, user nix-grpc-daemon (trusted)4161worker2 # [ 60.584207] nix-daemon[840]: reaped child process 942, status = succeeded4162lb # [ 60.568169] niks3-server[994]: 2026/09/25 16:32:26 INFO Received push request method=POST path=/api/pushes4163worker2 # [ 60.594604] nix-grpc-daemon[874]: time=2026-09-25T16:32:26.191Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4164worker2 # [ 60.596346] nix-grpc-daemon[874]: time=2026-09-25T16:32:26.191Z level=INFO msg="Uploading h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b (176B)"4165lb # [ 60.589590] niks3-server[994]: 2026/09/25 16:32:26 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign4166worker2 # [ 60.615177] nix-grpc-daemon[874]: time=2026-09-25T16:32:26.212Z level=INFO msg="Uploading 1 narinfos"4167lb # [ 60.598212] niks3-server[994]: 2026/09/25 16:32:26 INFO Signed narinfos id=12 count=14168lb # [ 60.602555] niks3-server[994]: 2026/09/25 16:32:26 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls4169lb # [ 60.608830] niks3-server[994]: 2026/09/25 16:32:26 INFO Registered completed upload object_key=nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst4170lb # [ 60.619941] niks3-server[994]: 2026/09/25 16:32:26 INFO Registered completed upload object_key=log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4171worker2 # [ 60.643488] nix-grpc-daemon[874]: time=2026-09-25T16:32:26.240Z level=INFO msg="Upload complete. (207ms)"4172lb # [ 60.624849] niks3-server[994]: 2026/09/25 16:32:26 INFO Received complete push request method=POST path=/api/pushes/12/complete4173lb # [ 60.628567] niks3-server[994]: 2026/09/25 16:32:26 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo4174worker2 # [ 60.652715] nix-grpc-daemon[769]: ts=2026-09-25T16:32:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=1 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv assign_id=6 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=04175worker1 # [ 60.640725] nix-grpc-daemon[486]: ts=2026-09-25T16:32:26Z level=debug event=want client=4 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv cached=04176worker1 # [ 60.643972] nix-grpc-daemon[486]: ts=2026-09-25T16:32:26Z level=debug event=assigned drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker=192.168.1.4:50051 clients=14177worker2 # [ 60.664105] nix-grpc-daemon[769]: ts=2026-09-25T16:32:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644178worker2 # [ 60.668122] nix-daemon[840]: reaped child process 921, status = succeeded4179worker2 # [ 60.673115] nix-grpc-daemon[769]: ts=2026-09-25T16:32:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644180worker2 # [ 60.681688] nix-grpc-daemon[874]: time=2026-09-25T16:32:26.279Z level=INFO msg="All 2 paths already cached"4181client # copying 1 paths to 'lb:50051'...4182client # copying path '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' to 'lb:50051'...4183worker2 # [ 60.688074] nix-grpc-daemon[769]: ts=2026-09-25T16:32:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519644184worker2 # [ 60.696791] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4185worker2 # [ 60.817625] nix-daemon[840]: accepted connection from pid 946, user nix-grpc-daemon (trusted)4186worker2 # [ 60.838804] nix-daemon[840]: reaped child process 949, status = succeeded4187lb # [ 60.819444] niks3-server[994]: 2026/09/25 16:32:26 INFO Received push request method=POST path=/api/pushes4188worker2 # [ 60.845386] nix-grpc-daemon[874]: time=2026-09-25T16:32:26.442Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4189worker2 # [ 60.846986] nix-grpc-daemon[874]: time=2026-09-25T16:32:26.442Z level=INFO msg="Uploading knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv (752B)"4190lb # [ 60.836353] niks3-server[994]: 2026/09/25 16:32:26 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign4191worker2 # [ 60.862208] nix-grpc-daemon[874]: time=2026-09-25T16:32:26.459Z level=INFO msg="Uploading 1 narinfos"4192lb # [ 60.845034] niks3-server[994]: 2026/09/25 16:32:26 INFO Signed narinfos id=13 count=14193lb # [ 60.846861] niks3-server[994]: 2026/09/25 16:32:26 INFO Registered completed upload object_key=nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst4194lb # [ 60.858730] niks3-server[994]: 2026/09/25 16:32:26 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls4195worker2 # [ 60.884619] nix-grpc-daemon[874]: time=2026-09-25T16:32:26.482Z level=INFO msg="Upload complete. (178ms)"4196lb # [ 60.865421] niks3-server[994]: 2026/09/25 16:32:26 INFO Received complete push request method=POST path=/api/pushes/13/complete4197lb # [ 60.869499] niks3-server[994]: 2026/09/25 16:32:26 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo4198worker2 # [ 60.892186] nix-grpc-daemon[769]: ts=2026-09-25T16:32:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_in=7524199worker2 # [ 60.896207] nix-grpc-daemon[769]: ts=2026-09-25T16:32:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644200worker2 # [ 60.906877] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4201worker2 # [ 60.908592] nix-daemon[840]: reaped child process 944, status = succeeded4202client # building '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' on lb:50051...4203client # farm-top> worker2: building knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4204worker2 # [ 60.919132] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4205client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4206client # farm-top> LOG-farm-top-sig4207worker2 # [ 62.149040] nix-daemon[840]: reaped child process 953, status = succeeded4208worker2 # [ 62.256497] nix-daemon[840]: accepted connection from pid 969, user nix-grpc-daemon (trusted)4209worker2 # [ 62.278842] nix-daemon[840]: reaped child process 972, status = succeeded4210lb # [ 62.257340] niks3-server[994]: 2026/09/25 16:32:27 INFO Received push request method=POST path=/api/pushes4211worker2 # [ 62.284401] nix-grpc-daemon[874]: time=2026-09-25T16:32:27.880Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4212worker2 # [ 62.285978] nix-grpc-daemon[874]: time=2026-09-25T16:32:27.880Z level=INFO msg="Uploading 4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top (232B)"4213lb # [ 62.279325] niks3-server[994]: 2026/09/25 16:32:27 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls4214lb # [ 62.286205] niks3-server[994]: 2026/09/25 16:32:27 INFO Registered completed upload object_key=log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4215worker2 # [ 62.313120] nix-grpc-daemon[874]: time=2026-09-25T16:32:27.910Z level=INFO msg="Uploading 1 narinfos"4216lb # [ 62.295074] niks3-server[994]: 2026/09/25 16:32:27 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign4217lb # [ 62.300458] niks3-server[994]: 2026/09/25 16:32:27 INFO Signed narinfos id=14 count=14218lb # [ 62.302173] niks3-server[994]: 2026/09/25 16:32:27 INFO Registered completed upload object_key=nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst4219lb # [ 62.311136] niks3-server[994]: 2026/09/25 16:32:27 INFO Received complete push request method=POST path=/api/pushes/14/complete4220worker2 # [ 62.338232] nix-grpc-daemon[874]: time=2026-09-25T16:32:27.935Z level=INFO msg="Upload complete. (211ms)"4221lb # [ 62.319682] niks3-server[994]: 2026/09/25 16:32:27 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo4222worker2 # [ 62.344692] nix-grpc-daemon[769]: ts=2026-09-25T16:32:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=1 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv assign_id=7 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=04223worker2 # [ 62.357468] nix-daemon[840]: reaped child process 951, status = succeeded4224client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&2, in 5.49 seconds)4225client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath4226client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath, in 0.14 seconds)4227client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4228worker1 # [ 62.622465] nix-grpc-daemon[486]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:445824229client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):4230client # /nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a4231client # /nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b4232client # /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4233worker1 # [ 62.640938] nix-grpc-daemon[486]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:445824234worker1 # [ 62.645962] nix-grpc-daemon[486]: copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'http://lb:5751'...4235worker1 # [ 62.656066] nix-grpc-daemon[486]: copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'http://lb:5751'...4236worker1 # [ 62.664196] nix-grpc-daemon[486]: copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'http://lb:5751'...4237client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.19 seconds)4238client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4239worker2 # [ 62.841231] nix-grpc-daemon[769]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:473644240worker2 # [ 62.845765] nix-grpc-daemon[769]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:473644241client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.16 seconds)4242client: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4243client # finding garbage collector roots...4244client # removing stale temporary roots file "/nix/var/nix/temproots/790"4245client # removing stale temporary roots file "/nix/var/nix/temproots/859"4246client # removing stale temporary roots file "/nix/var/nix/temproots/867"4247client # removing stale temporary roots file "/nix/var/nix/temproots/838"4248client # removing stale temporary roots file "/nix/var/nix/temproots/826"4249client # removing stale temporary roots file "/nix/var/nix/temproots/846"4250client # removing stale temporary roots file "/nix/var/nix/temproots/805"4251client # removing stale temporary roots file "/nix/var/nix/temproots/882"4252client # deleting specified paths...4253client # deleting '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top'4254client # deleting unused links...4255client # note: hard linking is currently saving 0.0 KiB4256worker1 # [ 63.114387] nix-grpc-daemon[486]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:557144257worker2 # [ 63.135723] nix-grpc-daemon[769]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644258worker2 # [ 63.141775] nix-grpc-daemon[874]: time=2026-09-25T16:32:28.739Z level=INFO msg="All 1 paths already cached"4259worker1 # [ 63.131287] nix-grpc-daemon[486]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:557144260worker1 # [ 63.136579] nix-grpc-daemon[486]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:557144261client # copying 3 paths...4262worker2 # [ 63.160912] nix-grpc-daemon[769]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:519644263client # copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'grpc://lb:50051'...4264worker1 # [ 63.161046] nix-grpc-daemon[486]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:557144265worker1 # [ 63.165107] nix-grpc-daemon[486]: ts=2026-09-25T16:32:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=1 nar_bytes_out=2324266worker2 # [ 63.185144] nix-grpc-daemon[769]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:519644267worker2 # [ 63.189278] nix-grpc-daemon[769]: ts=2026-09-25T16:32:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_out=1764268worker2 # [ 63.193975] nix-grpc-daemon[769]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:519644269client # copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'grpc://lb:50051'...4270worker2 # [ 63.196562] nix-grpc-daemon[769]: ts=2026-09-25T16:32:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_out=1284271client # copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'grpc://lb:50051'...4272client: (finished: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.36 seconds)4273(finished: subtest: outputs read back through any worker carry the cache signature, in 6.34 seconds)4274subtest: two clients wanting the same drv build it once4275client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4276client # [ 63.247186] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4277client # Running as unit: dedup1.service; invocation ID: 9114f1646c354f7692aca385f96c10024278client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 0.04 seconds)4279client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4280worker1 # [ 63.394800] nix-grpc-daemon[486]: ts=2026-09-25T16:32:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:557144281client # [ 63.410543] nix[935]: don't know how to build these paths:4282client # [ 63.411470] nix[935]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4283worker1 # [ 63.404721] nix-grpc-daemon[486]: ts=2026-09-25T16:32:28Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04284worker1 # [ 63.409762] nix-grpc-daemon[486]: ts=2026-09-25T16:32:28Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14285worker1 # [ 63.414533] nix-grpc-daemon[486]: ts=2026-09-25T16:32:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144286worker1 # [ 63.418699] nix-grpc-daemon[486]: ts=2026-09-25T16:32:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557144287client # [ 63.435328] nix[935]: copying 1 paths to 'lb:50051'...4288client # [ 63.436501] nix[935]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4289worker1 # [ 63.424682] nix-grpc-daemon[486]: ts=2026-09-25T16:32:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:557144290worker1 # [ 63.433249] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4291worker1 # [ 63.555670] nix-daemon[855]: accepted connection from pid 1056, user nix-grpc-daemon (trusted)4292lb # [ 63.570653] niks3-server[994]: 2026/09/25 16:32:29 INFO Received push request method=POST path=/api/pushes4293worker1 # [ 63.578267] nix-daemon[855]: reaped child process 1059, status = succeeded4294worker1 # [ 63.581615] nix-grpc-daemon[869]: time=2026-09-25T16:32:29.174Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4295worker1 # [ 63.583154] nix-grpc-daemon[869]: time=2026-09-25T16:32:29.175Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4296lb # [ 63.590781] niks3-server[994]: 2026/09/25 16:32:29 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4297worker1 # [ 63.603623] nix-grpc-daemon[869]: time=2026-09-25T16:32:29.197Z level=INFO msg="Uploading 1 narinfos"4298lb # [ 63.598936] niks3-server[994]: 2026/09/25 16:32:29 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign4299lb # [ 63.603671] niks3-server[994]: 2026/09/25 16:32:29 INFO Signed narinfos id=15 count=14300lb # [ 63.607545] niks3-server[994]: 2026/09/25 16:32:29 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4301lb # [ 63.615955] niks3-server[994]: 2026/09/25 16:32:29 INFO Received complete push request method=POST path=/api/pushes/15/complete4302worker1 # [ 63.624713] nix-grpc-daemon[869]: time=2026-09-25T16:32:29.218Z level=INFO msg="Upload complete. (182ms)"4303lb # [ 63.622985] niks3-server[994]: 2026/09/25 16:32:29 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4304worker1 # [ 63.632211] nix-grpc-daemon[486]: ts=2026-09-25T16:32:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=1 nar_bytes_in=4324305worker1 # [ 63.634962] nix-grpc-daemon[486]: ts=2026-09-25T16:32:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144306worker1 # [ 63.642125] nix-daemon[855]: reaped child process 1054, status = succeeded4307worker1 # [ 63.647106] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4308client # [ 63.665385] nix[935]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4309worker1 # [ 63.656857] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4310client # [ 64.307895] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4311client # Running as unit: dedup2.service; invocation ID: 675f9f695e82440890ae4510ddaa61714312client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 1.07 seconds)4313worker2 # [ 64.499555] nix-grpc-daemon[769]: ts=2026-09-25T16:32:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519644314client # [ 64.499345] nix[951]: don't know how to build these paths:4315client # [ 64.500329] nix[951]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4316worker1 # [ 64.495479] nix-grpc-daemon[486]: ts=2026-09-25T16:32:30Z level=debug event=want client=6 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04317worker1 # [ 64.499420] nix-grpc-daemon[486]: ts=2026-09-25T16:32:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144318client # [ 64.512874] nix[951]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4319client: must succeed: sleep 24320lb # [ 67.472847] envoy[894]: conn peer=[2001:db8:1::1]:54582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9498 tx=4356 ms=53124321lb # [ 67.475940] envoy[894]: conn peer=[2001:db8:1::1]:56436 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1034 tx=2868 ms=834322lb # [ 67.478655] envoy[894]: conn peer=[2001:db8:1::1]:56468 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=329 ms=194323lb # [ 67.481141] envoy[894]: conn peer=[2001:db8:1::1]:56462 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=375 ms=274324lb # [ 67.483595] envoy[894]: conn peer=[2001:db8:1::1]:56446 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=384 tx=409 ms=364325client: (finished: must succeed: sleep 2, in 2.03 seconds)4326client: waiting for success: ! systemctl is-active dedup1 dedup24327worker1 # [ 67.716702] nix-daemon[855]: reaped child process 1063, status = succeeded4328worker1 # [ 67.797534] nix-daemon[855]: accepted connection from pid 1095, user nix-grpc-daemon (trusted)4329lb # [ 67.808984] niks3-server[994]: 2026/09/25 16:32:33 INFO Received push request method=POST path=/api/pushes4330worker1 # [ 67.816269] nix-daemon[855]: reaped child process 1098, status = succeeded4331worker1 # [ 67.820386] nix-grpc-daemon[869]: time=2026-09-25T16:32:33.413Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4332worker1 # [ 67.821884] nix-grpc-daemon[869]: time=2026-09-25T16:32:33.413Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4333lb # [ 67.840846] niks3-server[994]: 2026/09/25 16:32:33 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign4334worker1 # [ 67.850763] nix-grpc-daemon[869]: time=2026-09-25T16:32:33.444Z level=INFO msg="Uploading 1 narinfos"4335lb # [ 67.849374] niks3-server[994]: 2026/09/25 16:32:33 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4336lb # [ 67.855755] niks3-server[994]: 2026/09/25 16:32:33 INFO Signed narinfos id=16 count=14337lb # [ 67.861794] niks3-server[994]: 2026/09/25 16:32:33 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4338lb # [ 67.869494] niks3-server[994]: 2026/09/25 16:32:33 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4339worker1 # [ 67.878184] nix-grpc-daemon[869]: time=2026-09-25T16:32:33.472Z level=INFO msg="Upload complete. (212ms)"4340lb # [ 67.874225] niks3-server[994]: 2026/09/25 16:32:33 INFO Received complete push request method=POST path=/api/pushes/16/complete4341lb # [ 67.879734] niks3-server[994]: 2026/09/25 16:32:33 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4342worker1 # [ 67.888675] nix-grpc-daemon[486]: ts=2026-09-25T16:32:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04343worker1 # [ 67.897925] nix-grpc-daemon[486]: ts=2026-09-25T16:32:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04344worker1 # [ 67.903329] nix-daemon[855]: reaped child process 1061, status = succeeded4345client # [ 67.932359] systemd[1]: dedup2.service: Deactivated successfully.4346client # [ 67.935011] systemd[1]: dedup2.service: Consumed 177ms CPU time over 3.626s wall clock time, 33.2M memory peak, 6.3K incoming IP traffic, 5.9K outgoing IP traffic.4347client # [ 67.942250] systemd[1]: dedup1.service: Deactivated successfully.4348client # [ 67.943661] systemd[1]: dedup1.service: Consumed 145ms CPU time over 4.692s wall clock time, 41.5M memory peak, 7.1K incoming IP traffic, 8.3K outgoing IP traffic.4349client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.07 seconds)4350client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4351client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.05 seconds)4352worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4353worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)4354worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4355worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)4356worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4357worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4358worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4359worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4360(finished: subtest: two clients wanting the same drv build it once, in 5.67 seconds)4361subtest: --timeout and --max-silent-time reach the builder4362worker2 # [ 69.072959] nix-grpc-daemon[769]: ts=2026-09-25T16:32:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519644363worker1 # [ 69.064332] nix-grpc-daemon[486]: ts=2026-09-25T16:32:34Z level=debug event=want client=7 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=04364worker2 # [ 69.080968] nix-grpc-daemon[769]: ts=2026-09-25T16:32:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644365worker1 # [ 69.067295] nix-grpc-daemon[486]: ts=2026-09-25T16:32:34Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.4:50051 clients=14366worker2 # [ 69.090124] nix-grpc-daemon[769]: ts=2026-09-25T16:32:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644367worker2 # [ 69.098345] nix-grpc-daemon[769]: ts=2026-09-25T16:32:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519644368worker2 # [ 69.107017] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4369worker2 # [ 69.236716] nix-daemon[840]: accepted connection from pid 997, user nix-grpc-daemon (trusted)4370lb # [ 69.234316] niks3-server[994]: 2026/09/25 16:32:34 INFO Received push request method=POST path=/api/pushes4371worker2 # [ 69.256557] nix-daemon[840]: reaped child process 1000, status = succeeded4372worker2 # [ 69.260293] nix-grpc-daemon[874]: time=2026-09-25T16:32:34.857Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4373worker2 # [ 69.261897] nix-grpc-daemon[874]: time=2026-09-25T16:32:34.857Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)"4374lb # [ 69.251222] niks3-server[994]: 2026/09/25 16:32:34 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst4375worker2 # [ 69.278770] nix-grpc-daemon[874]: time=2026-09-25T16:32:34.876Z level=INFO msg="Uploading 1 narinfos"4376lb # [ 69.258847] niks3-server[994]: 2026/09/25 16:32:34 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign4377lb # [ 69.264905] niks3-server[994]: 2026/09/25 16:32:34 INFO Signed narinfos id=17 count=14378lb # [ 69.269270] niks3-server[994]: 2026/09/25 16:32:34 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls4379lb # [ 69.274643] niks3-server[994]: 2026/09/25 16:32:34 INFO Received complete push request method=POST path=/api/pushes/17/complete4380worker2 # [ 69.303741] nix-grpc-daemon[874]: time=2026-09-25T16:32:34.901Z level=INFO msg="Upload complete. (187ms)"4381lb # [ 69.283937] niks3-server[994]: 2026/09/25 16:32:34 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo4382worker2 # [ 69.312202] nix-grpc-daemon[769]: ts=2026-09-25T16:32:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_in=4244383worker2 # [ 69.315560] nix-grpc-daemon[769]: ts=2026-09-25T16:32:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644384worker2 # [ 69.327306] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4385worker2 # [ 69.329581] nix-daemon[840]: reaped child process 995, status = succeeded4386worker2 # [ 69.340297] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4387worker2 # [ 75.553292] nix-grpc-daemon[769]: ts=2026-09-25T16:32:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=9 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04388worker2 # [ 75.578323] nix-daemon[840]: reaped child process 1002, status = succeeded4389worker2 # [ 75.580261] nix-daemon[840]: reaped child process 1004, status = succeeded4390worker1 # [ 75.751090] nix-grpc-daemon[486]: ts=2026-09-25T16:32:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:557144391worker1 # [ 75.761612] nix-grpc-daemon[486]: ts=2026-09-25T16:32:41Z level=debug event=want client=8 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=04392worker1 # [ 75.766834] nix-grpc-daemon[486]: ts=2026-09-25T16:32:41Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.3:50051 clients=14393worker1 # [ 75.771767] nix-grpc-daemon[486]: ts=2026-09-25T16:32:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144394worker1 # [ 75.776351] nix-grpc-daemon[486]: ts=2026-09-25T16:32:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557144395worker1 # [ 75.782314] nix-grpc-daemon[486]: ts=2026-09-25T16:32:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:557144396worker1 # [ 75.791562] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4397worker1 # [ 75.916112] nix-daemon[855]: accepted connection from pid 1115, user nix-grpc-daemon (trusted)4398worker1 # [ 75.933828] nix-daemon[855]: reaped child process 1118, status = succeeded4399lb # [ 75.933928] niks3-server[994]: 2026/09/25 16:32:41 INFO Received push request method=POST path=/api/pushes4400worker1 # [ 75.944257] nix-grpc-daemon[869]: time=2026-09-25T16:32:41.537Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4401worker1 # [ 75.945744] nix-grpc-daemon[869]: time=2026-09-25T16:32:41.537Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)"4402lb # [ 75.950862] niks3-server[994]: 2026/09/25 16:32:41 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst4403lb # [ 75.963294] niks3-server[994]: 2026/09/25 16:32:41 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign4404worker1 # [ 75.971044] nix-grpc-daemon[869]: time=2026-09-25T16:32:41.564Z level=INFO msg="Uploading 1 narinfos"4405lb # [ 75.968210] niks3-server[994]: 2026/09/25 16:32:41 INFO Signed narinfos id=18 count=14406lb # [ 75.975306] niks3-server[994]: 2026/09/25 16:32:41 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls4407lb # [ 75.985530] niks3-server[994]: 2026/09/25 16:32:41 INFO Received complete push request method=POST path=/api/pushes/18/complete4408worker1 # [ 75.996261] nix-grpc-daemon[869]: time=2026-09-25T16:32:41.590Z level=INFO msg="Upload complete. (195ms)"4409lb # [ 75.993717] niks3-server[994]: 2026/09/25 16:32:41 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo4410worker1 # [ 76.004566] nix-grpc-daemon[486]: ts=2026-09-25T16:32:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=1 nar_bytes_in=4244411worker1 # [ 76.007966] nix-grpc-daemon[486]: ts=2026-09-25T16:32:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144412worker1 # [ 76.018133] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4413worker1 # [ 76.022167] nix-daemon[855]: reaped child process 1113, status = succeeded4414worker1 # [ 76.032135] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4415lb # [ 77.470717] envoy[894]: conn peer=[2001:db8:1::1]:56486 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1473 tx=1399 ms=34194416lb # [ 77.473480] envoy[894]: conn peer=[2001:db8:1::1]:56480 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3001 tx=1543 ms=45014417lb # [ 77.476556] envoy[894]: conn peer=[2001:db8:1::1]:56490 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2971 tx=934 ms=64994418worker1 # [ 82.447316] nix-grpc-daemon[486]: ts=2026-09-25T16:32:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=6 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=10 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04419worker1 # [ 82.465492] nix-daemon[855]: reaped child process 1120, status = succeeded4420worker1 # [ 82.466631] nix-daemon[855]: reaped child process 1122, status = succeeded4421worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4422worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4423worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4424worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4425(finished: subtest: --timeout and --max-silent-time reach the builder, in 13.73 seconds)4426subtest: a failing build is counted with its own reason4427worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4428worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4429worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4430worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4431worker1 # [ 82.854682] nix-grpc-daemon[486]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:557144432worker1 # [ 82.864105] nix-grpc-daemon[486]: ts=2026-09-25T16:32:48Z level=debug event=want client=9 drv=j4rjl229w5xzbr9614xcipiv7652fdka-fail-boom.drv cached=04433worker2 # [ 82.882030] nix-grpc-daemon[769]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644434worker1 # [ 82.867002] nix-grpc-daemon[486]: ts=2026-09-25T16:32:48Z level=debug event=assigned drv=j4rjl229w5xzbr9614xcipiv7652fdka-fail-boom.drv worker=192.168.1.4:50051 clients=14435worker2 # [ 82.892348] nix-grpc-daemon[769]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644436worker2 # [ 82.900979] nix-grpc-daemon[769]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519644437worker2 # [ 82.909657] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4438worker2 # [ 83.030699] nix-daemon[840]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)4439worker2 # [ 83.051396] nix-daemon[840]: reaped child process 1036, status = succeeded4440lb # [ 83.032476] niks3-server[994]: 2026/09/25 16:32:48 INFO Received push request method=POST path=/api/pushes4441worker2 # [ 83.059472] nix-grpc-daemon[874]: time=2026-09-25T16:32:48.656Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4442worker2 # [ 83.061235] nix-grpc-daemon[874]: time=2026-09-25T16:32:48.656Z level=INFO msg="Uploading j4rjl229w5xzbr9614xcipiv7652fdka-fail-boom.drv (400B)"4443lb # [ 83.048066] niks3-server[994]: 2026/09/25 16:32:48 INFO Registered completed upload object_key=nar/0d79vqzwc4s1agk431w3csq2p4brahnzmanwj14fjf383ld797i6.nar.zst4444lb # [ 83.060189] niks3-server[994]: 2026/09/25 16:32:48 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign4445worker2 # [ 83.084082] nix-grpc-daemon[874]: time=2026-09-25T16:32:48.681Z level=INFO msg="Uploading 1 narinfos"4446lb # [ 83.066875] niks3-server[994]: 2026/09/25 16:32:48 INFO Signed narinfos id=19 count=14447lb # [ 83.071403] niks3-server[994]: 2026/09/25 16:32:48 INFO Registered completed upload object_key=j4rjl229w5xzbr9614xcipiv7652fdka.ls4448lb # [ 83.080196] niks3-server[994]: 2026/09/25 16:32:48 INFO Received complete push request method=POST path=/api/pushes/19/complete4449worker2 # [ 83.107471] nix-grpc-daemon[874]: time=2026-09-25T16:32:48.704Z level=INFO msg="Upload complete. (188ms)"4450lb # [ 83.088158] niks3-server[994]: 2026/09/25 16:32:48 INFO Registered completed upload object_key=j4rjl229w5xzbr9614xcipiv7652fdka.narinfo4451worker2 # [ 83.113648] nix-grpc-daemon[769]: ts=2026-09-25T16:32:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_in=4004452worker2 # [ 83.120242] nix-grpc-daemon[769]: ts=2026-09-25T16:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644453worker2 # [ 83.130756] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4454worker2 # [ 83.132692] nix-daemon[840]: reaped child process 1031, status = succeeded4455worker2 # [ 83.144241] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4456worker2 # [ 83.752614] nix-grpc-daemon[769]: ts=2026-09-25T16:32:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 drv=j4rjl229w5xzbr9614xcipiv7652fdka-fail-boom.drv assign_id=11 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04457worker2 # [ 83.775947] nix-daemon[840]: reaped child process 1038, status = succeeded4458worker2 # [ 83.777842] nix-daemon[840]: reaped child process 1040, status = succeeded4459worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4460worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4461worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4462worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4463worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4464worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4465worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4466worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4467worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4468worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4469worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4470worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4471worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4472worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4473worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4474worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4475(finished: subtest: a failing build is counted with its own reason, in 1.43 seconds)4476subtest: the first client leaving does not fail the second4477client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4478client # [ 84.088642] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4479client # Running as unit: share1.service; invocation ID: 63abae5a45c548629c8c05e4cd8f08ab4480client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 0.05 seconds)4481client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4482client # [ 84.269172] nix[1039]: don't know how to build these paths:4483worker2 # [ 84.273511] nix-grpc-daemon[769]: ts=2026-09-25T16:32:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519644484client # [ 84.271107] nix[1039]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4485worker1 # [ 84.266327] nix-grpc-daemon[486]: ts=2026-09-25T16:32:49Z level=debug event=want client=10 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04486worker1 # [ 84.271001] nix-grpc-daemon[486]: ts=2026-09-25T16:32:49Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.3:50051 clients=14487worker1 # [ 84.275926] nix-grpc-daemon[486]: ts=2026-09-25T16:32:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144488worker1 # [ 84.280202] nix-grpc-daemon[486]: ts=2026-09-25T16:32:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557144489client # [ 84.296076] nix[1039]: copying 1 paths to 'lb:50051'...4490client # [ 84.296988] nix[1039]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'...4491worker1 # [ 84.285693] nix-grpc-daemon[486]: ts=2026-09-25T16:32:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:557144492worker1 # [ 84.294172] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4493worker1 # [ 84.419501] nix-daemon[855]: accepted connection from pid 1167, user nix-grpc-daemon (trusted)4494worker1 # [ 84.436226] nix-daemon[855]: reaped child process 1170, status = succeeded4495lb # [ 84.436810] niks3-server[994]: 2026/09/25 16:32:50 INFO Received push request method=POST path=/api/pushes4496worker1 # [ 84.447191] nix-grpc-daemon[869]: time=2026-09-25T16:32:50.040Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4497worker1 # [ 84.448908] nix-grpc-daemon[869]: time=2026-09-25T16:32:50.040Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)"4498lb # [ 84.453331] niks3-server[994]: 2026/09/25 16:32:50 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst4499worker1 # [ 84.463821] nix-grpc-daemon[869]: time=2026-09-25T16:32:50.057Z level=INFO msg="Uploading 1 narinfos"4500lb # [ 84.460191] niks3-server[994]: 2026/09/25 16:32:50 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign4501lb # [ 84.462544] niks3-server[994]: 2026/09/25 16:32:50 INFO Signed narinfos id=20 count=14502lb # [ 84.469638] niks3-server[994]: 2026/09/25 16:32:50 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls4503lb # [ 84.478552] niks3-server[994]: 2026/09/25 16:32:50 INFO Received complete push request method=POST path=/api/pushes/20/complete4504worker1 # [ 84.486812] nix-grpc-daemon[869]: time=2026-09-25T16:32:50.080Z level=INFO msg="Upload complete. (183ms)"4505lb # [ 84.483112] niks3-server[994]: 2026/09/25 16:32:50 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo4506worker1 # [ 84.492231] nix-grpc-daemon[486]: ts=2026-09-25T16:32:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=1 nar_bytes_in=4324507worker1 # [ 84.503188] nix-grpc-daemon[486]: ts=2026-09-25T16:32:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144508worker1 # [ 84.506294] nix-daemon[855]: reaped child process 1165, status = succeeded4509worker1 # [ 84.512327] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4510client # [ 84.531470] nix[1039]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4511worker1 # [ 84.521864] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4512client # [ 85.167537] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4513client # Running as unit: share2.service; invocation ID: edb27f8d3ae040f3a49f10a54868b77d4514client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 1.08 seconds)4515worker2 # [ 85.346145] nix-grpc-daemon[769]: ts=2026-09-25T16:32:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519644516client # [ 85.346622] nix[1055]: don't know how to build these paths:4517client # [ 85.347734] nix[1055]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4518worker1 # [ 85.340702] nix-grpc-daemon[486]: ts=2026-09-25T16:32:50Z level=debug event=want client=11 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04519client # [ 85.355856] nix[1055]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4520worker1 # [ 85.344822] nix-grpc-daemon[486]: ts=2026-09-25T16:32:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144521client: must succeed: sleep 2; systemctl kill -s INT share14522lb # [ 87.470493] envoy[894]: conn peer=[2001:db8:1::1]:36402 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2972 tx=932 ms=67114523lb # [ 87.473351] envoy[894]: conn peer=[2001:db8:1::1]:45446 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2868 tx=1247 ms=8994524client # [ 88.400930] systemd[1]: share1.service: Sent signal SIGINT to main process 1039 (nix) on client request.4525client # [ 88.406640] nix[1039]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)4526client # [ 88.408879] nix[1039]: error: interrupted by the user4527client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.05 seconds)4528client: waiting for success: ! systemctl is-active share14529client # [ 88.459422] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE4530client # [ 88.462934] systemd[1]: share1.service: Failed with result 'exit-code'.4531client # [ 88.464746] systemd[1]: share1.service: Consumed 153ms CPU time over 4.373s wall clock time, 39.4M memory peak, 6K incoming IP traffic, 8.1K outgoing IP traffic.4532client: (finished: waiting for success: ! systemctl is-active share1, in 1.07 seconds)4533client: waiting for success: ! systemctl is-active share24534worker1 # [ 89.791083] nix-daemon[855]: reaped child process 1174, status = succeeded4535worker1 # [ 89.872334] nix-daemon[855]: accepted connection from pid 1210, user nix-grpc-daemon (trusted)4536lb # [ 89.884575] niks3-server[994]: 2026/09/25 16:32:55 INFO Received push request method=POST path=/api/pushes4537worker1 # [ 89.891051] nix-daemon[855]: reaped child process 1213, status = succeeded4538worker1 # [ 89.895662] nix-grpc-daemon[869]: time=2026-09-25T16:32:55.488Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4539worker1 # [ 89.897358] nix-grpc-daemon[869]: time=2026-09-25T16:32:55.488Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)"4540lb # [ 89.910006] niks3-server[994]: 2026/09/25 16:32:55 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign4541worker1 # [ 89.917986] nix-grpc-daemon[869]: time=2026-09-25T16:32:55.511Z level=INFO msg="Uploading 1 narinfos"4542lb # [ 89.915927] niks3-server[994]: 2026/09/25 16:32:55 INFO Signed narinfos id=21 count=14543lb # [ 89.921947] niks3-server[994]: 2026/09/25 16:32:55 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst4544lb # [ 89.928356] niks3-server[994]: 2026/09/25 16:32:55 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4545lb # [ 89.934564] niks3-server[994]: 2026/09/25 16:32:55 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls4546lb # [ 89.943764] niks3-server[994]: 2026/09/25 16:32:55 INFO Received complete push request method=POST path=/api/pushes/21/complete4547lb # [ 89.947658] niks3-server[994]: 2026/09/25 16:32:55 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo4548worker1 # [ 89.956175] nix-grpc-daemon[869]: time=2026-09-25T16:32:55.550Z level=INFO msg="Upload complete. (219ms)"4549worker1 # [ 89.964599] nix-grpc-daemon[486]: ts=2026-09-25T16:32:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=5 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04550worker1 # [ 89.975053] nix-grpc-daemon[486]: ts=2026-09-25T16:32:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=4 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04551worker1 # [ 89.980301] nix-daemon[855]: reaped child process 1172, status = succeeded4552client # [ 89.995112] systemd[1]: share2.service: Deactivated successfully.4553client # [ 89.997475] systemd[1]: share2.service: Consumed 159ms CPU time over 4.829s wall clock time, 35.3M memory peak, 6.6K incoming IP traffic, 6.1K outgoing IP traffic.4554client: (finished: waiting for success: ! systemctl is-active share2, in 1.06 seconds)4555client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }4556client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.04 seconds)4557(finished: subtest: the first client leaving does not fail the second, in 6.72 seconds)4558subtest: build hook: nix-daemon with builders = grpc://lb4559client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log4560client # [ 90.892385] systemd[1]: Started Nix Daemon.4561client # [ 91.002067] nix-daemon[1107]: accepted connection from pid 1104, user root (trusted)4562worker1 # [ 91.124379] nix-grpc-daemon[486]: ts=2026-09-25T16:32:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:557144563worker2 # [ 91.146926] nix-grpc-daemon[769]: ts=2026-09-25T16:32:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644564worker1 # [ 91.143164] nix-grpc-daemon[486]: ts=2026-09-25T16:32:56Z level=debug event=want client=12 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04565worker2 # [ 91.161141] nix-grpc-daemon[769]: ts=2026-09-25T16:32:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644566worker1 # [ 91.146579] nix-grpc-daemon[486]: ts=2026-09-25T16:32:56Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14567worker2 # [ 91.171061] nix-grpc-daemon[769]: ts=2026-09-25T16:32:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644568worker2 # [ 91.180186] nix-grpc-daemon[769]: ts=2026-09-25T16:32:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519644569worker2 # [ 91.188786] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4570worker2 # [ 91.314393] nix-daemon[840]: accepted connection from pid 1086, user nix-grpc-daemon (trusted)4571worker2 # [ 91.332242] nix-daemon[840]: reaped child process 1089, status = succeeded4572lb # [ 91.317573] niks3-server[994]: 2026/09/25 16:32:56 INFO Received push request method=POST path=/api/pushes4573worker2 # [ 91.343631] nix-grpc-daemon[874]: time=2026-09-25T16:32:56.940Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4574worker2 # [ 91.345393] nix-grpc-daemon[874]: time=2026-09-25T16:32:56.940Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4575lb # [ 91.334424] niks3-server[994]: 2026/09/25 16:32:56 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign4576worker2 # [ 91.359162] nix-grpc-daemon[874]: time=2026-09-25T16:32:56.956Z level=INFO msg="Uploading 1 narinfos"4577lb # [ 91.341307] niks3-server[994]: 2026/09/25 16:32:56 INFO Signed narinfos id=22 count=14578lb # [ 91.346233] niks3-server[994]: 2026/09/25 16:32:56 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4579lb # [ 91.357619] niks3-server[994]: 2026/09/25 16:32:56 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4580lb # [ 91.363512] niks3-server[994]: 2026/09/25 16:32:56 INFO Received complete push request method=POST path=/api/pushes/22/complete4581worker2 # [ 91.386816] nix-grpc-daemon[874]: time=2026-09-25T16:32:56.984Z level=INFO msg="Upload complete. (188ms)"4582lb # [ 91.367845] niks3-server[994]: 2026/09/25 16:32:56 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4583worker2 # [ 91.392243] nix-grpc-daemon[769]: ts=2026-09-25T16:32:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_in=5124584worker2 # [ 91.403542] nix-grpc-daemon[769]: ts=2026-09-25T16:32:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644585worker2 # [ 91.406639] nix-daemon[840]: reaped child process 1084, status = succeeded4586worker2 # [ 91.412181] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4587worker2 # [ 91.423809] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4588worker2 # [ 92.445810] nix-daemon[840]: reaped child process 1093, status = succeeded4589worker2 # [ 92.562991] nix-daemon[840]: accepted connection from pid 1109, user nix-grpc-daemon (trusted)4590worker2 # [ 92.581075] nix-daemon[840]: reaped child process 1112, status = succeeded4591lb # [ 92.560192] niks3-server[994]: 2026/09/25 16:32:58 INFO Received push request method=POST path=/api/pushes4592worker2 # [ 92.588450] nix-grpc-daemon[874]: time=2026-09-25T16:32:58.183Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4593worker2 # [ 92.590010] nix-grpc-daemon[874]: time=2026-09-25T16:32:58.183Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4594lb # [ 92.591883] niks3-server[994]: 2026/09/25 16:32:58 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign4595worker2 # [ 92.617077] nix-grpc-daemon[874]: time=2026-09-25T16:32:58.214Z level=INFO msg="Uploading 1 narinfos"4596lb # [ 92.600324] niks3-server[994]: 2026/09/25 16:32:58 INFO Signed narinfos id=23 count=14597lb # [ 92.602102] niks3-server[994]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4598worker2 # [ 92.632344] nix-grpc-daemon[874]: time=2026-09-25T16:32:58.229Z level=INFO msg="Upload complete. (200ms)"4599lb # [ 92.612392] niks3-server[994]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4600lb # [ 92.614940] niks3-server[994]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4601lb # [ 92.622205] niks3-server[994]: 2026/09/25 16:32:58 INFO Received complete push request method=POST path=/api/pushes/23/complete4602worker2 # [ 92.640556] nix-grpc-daemon[769]: ts=2026-09-25T16:32:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=13 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04603lb # [ 92.626214] niks3-server[994]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4604worker2 # [ 92.651212] nix-grpc-daemon[769]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:519644605worker2 # [ 92.654734] nix-daemon[840]: reaped child process 1091, status = succeeded4606worker1 # [ 92.653574] nix-grpc-daemon[486]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:557144607worker1 # [ 92.661099] nix-grpc-daemon[486]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4608worker1 # [ 92.670476] nix-grpc-daemon[486]: ts=2026-09-25T16:32:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=1 nar_bytes_out=1284609worker1 # [ 92.859225] nix-grpc-daemon[486]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:557144610worker2 # [ 92.877758] nix-grpc-daemon[769]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644611worker2 # [ 92.883211] nix-grpc-daemon[874]: time=2026-09-25T16:32:58.480Z level=INFO msg="All 1 paths already cached"4612worker1 # [ 92.878592] nix-grpc-daemon[486]: ts=2026-09-25T16:32:58Z level=debug event=want client=13 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04613worker1 # [ 92.882043] nix-grpc-daemon[486]: ts=2026-09-25T16:32:58Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14614worker2 # [ 92.899506] nix-grpc-daemon[769]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644615worker2 # [ 92.908422] nix-grpc-daemon[769]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644616worker2 # [ 92.916255] nix-grpc-daemon[874]: time=2026-09-25T16:32:58.513Z level=INFO msg="All 1 paths already cached"4617worker2 # [ 92.921763] nix-grpc-daemon[769]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519644618worker2 # [ 92.929673] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4619worker2 # [ 93.050405] nix-daemon[840]: accepted connection from pid 1116, user nix-grpc-daemon (trusted)4620worker2 # [ 93.065740] nix-daemon[840]: reaped child process 1119, status = succeeded4621lb # [ 93.050929] niks3-server[994]: 2026/09/25 16:32:58 INFO Received push request method=POST path=/api/pushes4622worker2 # [ 93.076161] nix-grpc-daemon[874]: time=2026-09-25T16:32:58.673Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4623worker2 # [ 93.078439] nix-grpc-daemon[874]: time=2026-09-25T16:32:58.673Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4624lb # [ 93.066543] niks3-server[994]: 2026/09/25 16:32:58 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign4625worker2 # [ 93.089638] nix-grpc-daemon[874]: time=2026-09-25T16:32:58.686Z level=INFO msg="Uploading 1 narinfos"4626lb # [ 93.072646] niks3-server[994]: 2026/09/25 16:32:58 INFO Signed narinfos id=24 count=14627lb # [ 93.078216] niks3-server[994]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4628lb # [ 93.083429] niks3-server[994]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4629lb # [ 93.091513] niks3-server[994]: 2026/09/25 16:32:58 INFO Received complete push request method=POST path=/api/pushes/24/complete4630lb # [ 93.097058] niks3-server[994]: 2026/09/25 16:32:58 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4631worker2 # [ 93.114800] nix-grpc-daemon[874]: time=2026-09-25T16:32:58.712Z level=INFO msg="Upload complete. (175ms)"4632worker2 # [ 93.120329] nix-grpc-daemon[769]: ts=2026-09-25T16:32:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_in=6244633worker2 # [ 93.130125] nix-grpc-daemon[769]: ts=2026-09-25T16:32:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644634worker2 # [ 93.137084] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4635worker2 # [ 93.139355] nix-daemon[840]: reaped child process 1114, status = succeeded4636worker2 # [ 93.150311] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4637worker2 # [ 94.583810] nix-daemon[840]: reaped child process 1123, status = succeeded4638worker2 # [ 94.695951] nix-daemon[840]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4639worker2 # [ 94.715349] nix-daemon[840]: reaped child process 1142, status = succeeded4640lb # [ 94.697541] niks3-server[994]: 2026/09/25 16:33:00 INFO Received push request method=POST path=/api/pushes4641worker2 # [ 94.724470] nix-grpc-daemon[874]: time=2026-09-25T16:33:00.321Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4642worker2 # [ 94.726027] nix-grpc-daemon[874]: time=2026-09-25T16:33:00.321Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4643lb # [ 94.725747] niks3-server[994]: 2026/09/25 16:33:00 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign4644worker2 # [ 94.751161] nix-grpc-daemon[874]: time=2026-09-25T16:33:00.348Z level=INFO msg="Uploading 1 narinfos"4645lb # [ 94.732700] niks3-server[994]: 2026/09/25 16:33:00 INFO Signed narinfos id=25 count=14646lb # [ 94.742193] niks3-server[994]: 2026/09/25 16:33:00 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4647lb # [ 94.749076] niks3-server[994]: 2026/09/25 16:33:00 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4648lb # [ 94.753218] niks3-server[994]: 2026/09/25 16:33:00 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4649lb # [ 94.760392] niks3-server[994]: 2026/09/25 16:33:00 INFO Received complete push request method=POST path=/api/pushes/25/complete4650lb # [ 94.766929] niks3-server[994]: 2026/09/25 16:33:00 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4651worker2 # [ 94.786091] nix-grpc-daemon[874]: time=2026-09-25T16:33:00.383Z level=INFO msg="Upload complete. (227ms)"4652worker1 # [ 94.781023] nix-grpc-daemon[486]: ts=2026-09-25T16:33:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:557144653worker2 # [ 94.794577] nix-grpc-daemon[769]: ts=2026-09-25T16:33:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=14 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=04654worker1 # [ 94.787981] nix-grpc-daemon[486]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4655worker2 # [ 94.806075] nix-daemon[840]: reaped child process 1121, status = succeeded4656worker1 # [ 94.809476] nix-grpc-daemon[486]: ts=2026-09-25T16:33:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:557144657worker1 # [ 94.813273] nix-grpc-daemon[486]: ts=2026-09-25T16:33:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=1 nar_bytes_out=1764658worker2 # [ 95.020746] nix-grpc-daemon[769]: ts=2026-09-25T16:33:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:519644659worker2 # [ 95.025052] nix-grpc-daemon[769]: ts=2026-09-25T16:33:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644660worker2 # [ 95.029398] nix-grpc-daemon[874]: time=2026-09-25T16:33:00.625Z level=INFO msg="All 2 paths already cached"4661worker1 # [ 95.022714] nix-grpc-daemon[486]: ts=2026-09-25T16:33:00Z level=debug event=want client=14 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04662worker1 # [ 95.026224] nix-grpc-daemon[486]: ts=2026-09-25T16:33:00Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14663worker2 # [ 95.044214] nix-grpc-daemon[769]: ts=2026-09-25T16:33:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644664worker2 # [ 95.053355] nix-grpc-daemon[769]: ts=2026-09-25T16:33:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644665worker2 # [ 95.061634] nix-grpc-daemon[874]: time=2026-09-25T16:33:00.659Z level=INFO msg="All 2 paths already cached"4666worker2 # [ 95.067366] nix-grpc-daemon[769]: ts=2026-09-25T16:33:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519644667worker2 # [ 95.075499] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4668worker2 # [ 95.200131] nix-daemon[840]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)4669lb # [ 95.195802] niks3-server[994]: 2026/09/25 16:33:00 INFO Received push request method=POST path=/api/pushes4670worker2 # [ 95.219907] nix-daemon[840]: reaped child process 1149, status = succeeded4671worker2 # [ 95.221951] nix-grpc-daemon[874]: time=2026-09-25T16:33:00.819Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4672worker2 # [ 95.223448] nix-grpc-daemon[874]: time=2026-09-25T16:33:00.819Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4673lb # [ 95.211511] niks3-server[994]: 2026/09/25 16:33:00 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign4674worker2 # [ 95.236046] nix-grpc-daemon[874]: time=2026-09-25T16:33:00.833Z level=INFO msg="Uploading 1 narinfos"4675lb # [ 95.218083] niks3-server[994]: 2026/09/25 16:33:00 INFO Signed narinfos id=26 count=14676lb # [ 95.223353] niks3-server[994]: 2026/09/25 16:33:00 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4677lb # [ 95.229700] niks3-server[994]: 2026/09/25 16:33:00 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4678lb # [ 95.233982] niks3-server[994]: 2026/09/25 16:33:00 INFO Received complete push request method=POST path=/api/pushes/26/complete4679worker2 # [ 95.263270] nix-grpc-daemon[874]: time=2026-09-25T16:33:00.860Z level=INFO msg="Upload complete. (177ms)"4680lb # [ 95.244222] niks3-server[994]: 2026/09/25 16:33:00 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4681worker2 # [ 95.270328] nix-grpc-daemon[769]: ts=2026-09-25T16:33:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_in=7524682worker2 # [ 95.278556] nix-grpc-daemon[769]: ts=2026-09-25T16:33:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644683worker2 # [ 95.283728] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4684worker2 # [ 95.287454] nix-daemon[840]: reaped child process 1144, status = succeeded4685worker2 # [ 95.296202] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4686worker2 # [ 96.555758] nix-daemon[840]: reaped child process 1153, status = succeeded4687worker2 # [ 96.625890] nix-daemon[840]: accepted connection from pid 1169, user nix-grpc-daemon (trusted)4688worker2 # [ 96.645488] nix-daemon[840]: reaped child process 1172, status = succeeded4689lb # [ 96.632754] niks3-server[994]: 2026/09/25 16:33:02 INFO Received push request method=POST path=/api/pushes4690worker2 # [ 96.660072] nix-grpc-daemon[874]: time=2026-09-25T16:33:02.256Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4691worker2 # [ 96.661748] nix-grpc-daemon[874]: time=2026-09-25T16:33:02.256Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4692lb # [ 96.661966] niks3-server[994]: 2026/09/25 16:33:02 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4693lb # [ 96.669761] niks3-server[994]: 2026/09/25 16:33:02 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4694worker2 # [ 96.696209] nix-grpc-daemon[874]: time=2026-09-25T16:33:02.293Z level=INFO msg="Uploading 1 narinfos"4695lb # [ 96.676695] niks3-server[994]: 2026/09/25 16:33:02 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign4696lb # [ 96.679080] niks3-server[994]: 2026/09/25 16:33:02 INFO Signed narinfos id=27 count=14697lb # [ 96.686680] niks3-server[994]: 2026/09/25 16:33:02 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4698lb # [ 96.696941] niks3-server[994]: 2026/09/25 16:33:02 INFO Received complete push request method=POST path=/api/pushes/27/complete4699worker2 # [ 96.720740] nix-grpc-daemon[874]: time=2026-09-25T16:33:02.318Z level=INFO msg="Upload complete. (215ms)"4700lb # [ 96.702507] niks3-server[994]: 2026/09/25 16:33:02 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4701worker2 # [ 96.728854] nix-grpc-daemon[769]: ts=2026-09-25T16:33:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=15 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=04702worker2 # [ 96.742995] nix-grpc-daemon[769]: ts=2026-09-25T16:33:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:519644703worker2 # [ 96.747062] nix-daemon[840]: reaped child process 1151, status = succeeded4704worker1 # [ 96.746368] nix-grpc-daemon[486]: ts=2026-09-25T16:33:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:557144705worker1 # [ 96.754786] nix-grpc-daemon[486]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4706worker1 # [ 96.765456] nix-grpc-daemon[486]: ts=2026-09-25T16:33:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=1 nar_bytes_out=2324707client # [ 96.849242] nix-daemon[1107]: reaped child process 1109, status = succeeded4708client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.09 seconds)4709client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4710client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.02 seconds)4711client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4712client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4713client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4714client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4715(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.17 seconds)4716subtest: an input only one worker has still reaches the builder4717client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only4718client # this derivation will be built:4719client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4720client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4721client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only, in 0.28 seconds)4722client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4723client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.11 seconds)4724worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4725worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.15 seconds)4726worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4727lb # [ 97.475229] envoy[894]: conn peer=[2001:db8:1::1]:45462 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2986 tx=768 ms=41554728lb # [ 97.478331] envoy[894]: conn peer=[2001:db8:1::1]:45464 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1499 tx=1399 ms=46404729lb # [ 97.481659] envoy[894]: conn peer=[2001:db8:1::1]:52488 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3398 tx=1921 ms=15574730lb # [ 97.484186] envoy[894]: conn peer=[2001:db8:1::1]:52492 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=294731lb # [ 97.486640] envoy[894]: conn peer=[2001:db8:1::1]:52516 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=154732worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.02 seconds)4733lb # [ 97.489184] envoy[894]: conn peer=[2001:db8:1::1]:52500 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3871 tx=2139 ms=19644734client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&24735lb # [ 97.491642] envoy[894]: conn peer=[2001:db8:1::1]:52542 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=407 ms=374736lb # [ 97.494216] envoy[894]: conn peer=[2001:db8:1::1]:52528 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4322 tx=2371 ms=17774737client # [ 97.641453] nix-daemon[1107]: accepted connection from pid 1190, user root (trusted)4738client # this derivation will be built:4739client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4740worker2 # [ 97.786341] nix-grpc-daemon[769]: ts=2026-09-25T16:33:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:519644741client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...4742worker1 # [ 97.774811] nix-grpc-daemon[486]: ts=2026-09-25T16:33:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557144743worker1 # [ 97.903415] nix-daemon[855]: accepted connection from pid 1229, user nix-grpc-daemon (trusted)4744lb # [ 97.920560] niks3-server[994]: 2026/09/25 16:33:03 INFO Received push request method=POST path=/api/pushes4745worker1 # [ 97.926570] nix-daemon[855]: reaped child process 1232, status = succeeded4746worker1 # [ 97.931192] nix-grpc-daemon[869]: time=2026-09-25T16:33:03.524Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4747worker1 # [ 97.933112] nix-grpc-daemon[869]: time=2026-09-25T16:33:03.524Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4748lb # [ 97.941237] niks3-server[994]: 2026/09/25 16:33:03 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4749worker1 # [ 97.952988] nix-grpc-daemon[869]: time=2026-09-25T16:33:03.546Z level=INFO msg="Uploading 1 narinfos"4750lb # [ 97.949825] niks3-server[994]: 2026/09/25 16:33:03 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign4751lb # [ 97.956686] niks3-server[994]: 2026/09/25 16:33:03 INFO Signed narinfos id=28 count=14752lb # [ 97.961480] niks3-server[994]: 2026/09/25 16:33:03 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4753lb # [ 97.969025] niks3-server[994]: 2026/09/25 16:33:03 INFO Received complete push request method=POST path=/api/pushes/28/complete4754worker1 # [ 97.980269] nix-grpc-daemon[869]: time=2026-09-25T16:33:03.574Z level=INFO msg="Upload complete. (206ms)"4755lb # [ 97.976716] niks3-server[994]: 2026/09/25 16:33:03 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4756worker1 # [ 97.996073] nix-grpc-daemon[486]: ts=2026-09-25T16:33:03Z level=debug event=want client=15 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04757worker1 # [ 97.999968] nix-grpc-daemon[486]: ts=2026-09-25T16:33:03Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14758worker1 # [ 98.005174] nix-grpc-daemon[486]: ts=2026-09-25T16:33:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144759worker1 # [ 98.011589] nix-grpc-daemon[486]: ts=2026-09-25T16:33:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557144760client # copying 2 paths to 'lb:50051'...4761client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4762worker1 # [ 98.022820] nix-grpc-daemon[486]: ts=2026-09-25T16:33:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:557144763client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4764worker1 # [ 98.030921] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4765worker1 # [ 98.154956] nix-daemon[855]: accepted connection from pid 1238, user nix-grpc-daemon (trusted)4766lb # [ 98.167805] niks3-server[994]: 2026/09/25 16:33:03 INFO Received push request method=POST path=/api/pushes4767worker1 # [ 98.175018] nix-daemon[855]: reaped child process 1241, status = succeeded4768worker1 # [ 98.178999] nix-grpc-daemon[869]: time=2026-09-25T16:33:03.771Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4769worker1 # [ 98.180943] nix-grpc-daemon[869]: time=2026-09-25T16:33:03.771Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4770worker1 # [ 98.182801] nix-grpc-daemon[869]: time=2026-09-25T16:33:03.771Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4771lb # [ 98.191381] niks3-server[994]: 2026/09/25 16:33:03 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4772lb # [ 98.199016] niks3-server[994]: 2026/09/25 16:33:03 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4773worker1 # [ 98.212674] nix-grpc-daemon[869]: time=2026-09-25T16:33:03.806Z level=INFO msg="Uploading 2 narinfos"4774lb # [ 98.207615] niks3-server[994]: 2026/09/25 16:33:03 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign4775lb # [ 98.214501] niks3-server[994]: 2026/09/25 16:33:03 INFO Signed narinfos id=29 count=24776lb # [ 98.218902] niks3-server[994]: 2026/09/25 16:33:03 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4777lb # [ 98.226136] niks3-server[994]: 2026/09/25 16:33:03 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4778lb # [ 98.235748] niks3-server[994]: 2026/09/25 16:33:03 INFO Received complete push request method=POST path=/api/pushes/29/complete4779worker1 # [ 98.246321] nix-grpc-daemon[869]: time=2026-09-25T16:33:03.840Z level=INFO msg="Upload complete. (204ms)"4780lb # [ 98.242413] niks3-server[994]: 2026/09/25 16:33:03 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4781lb # [ 98.248300] niks3-server[994]: 2026/09/25 16:33:03 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4782worker1 # [ 98.253057] nix-grpc-daemon[486]: ts=2026-09-25T16:33:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=2 nar_bytes_in=9844783worker1 # [ 98.260681] nix-grpc-daemon[486]: ts=2026-09-25T16:33:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144784worker1 # [ 98.271456] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4785worker1 # [ 98.273466] nix-daemon[855]: reaped child process 1236, status = succeeded4786client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4787client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4788worker1 # [ 98.284447] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4789client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds4790worker1 # [ 99.122069] nix-daemon[855]: reaped child process 1245, status = succeeded4791worker1 # [ 99.227724] nix-daemon[855]: accepted connection from pid 1261, user nix-grpc-daemon (trusted)4792lb # [ 99.240322] niks3-server[994]: 2026/09/25 16:33:04 INFO Received push request method=POST path=/api/pushes4793worker1 # [ 99.247452] nix-daemon[855]: reaped child process 1264, status = succeeded4794worker1 # [ 99.252397] nix-grpc-daemon[869]: time=2026-09-25T16:33:04.844Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4795lb # [ 99.258525] niks3-server[994]: 2026/09/25 16:33:04 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4796worker1 # [ 99.270367] nix-grpc-daemon[869]: time=2026-09-25T16:33:04.864Z level=INFO msg="Uploading 1 narinfos"4797lb # [ 99.266126] niks3-server[994]: 2026/09/25 16:33:04 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign4798lb # [ 99.272210] niks3-server[994]: 2026/09/25 16:33:04 INFO Signed narinfos id=30 count=14799lb # [ 99.275901] niks3-server[994]: 2026/09/25 16:33:04 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4800worker1 # [ 99.289043] nix-grpc-daemon[869]: time=2026-09-25T16:33:04.883Z level=INFO msg="Upload complete. (195ms)"4801lb # [ 99.284940] niks3-server[994]: 2026/09/25 16:33:04 INFO Received complete push request method=POST path=/api/pushes/30/complete4802lb # [ 99.290357] niks3-server[994]: 2026/09/25 16:33:04 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4803worker1 # [ 99.296529] nix-grpc-daemon[486]: ts=2026-09-25T16:33:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=16 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=04804client # copying 1 paths...4805worker1 # [ 99.308090] nix-daemon[855]: reaped child process 1243, status = succeeded4806worker2 # [ 99.324934] nix-grpc-daemon[769]: ts=2026-09-25T16:33:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:519644807worker2 # [ 99.332816] nix-grpc-daemon[769]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4808client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4809worker2 # [ 99.356956] nix-grpc-daemon[769]: ts=2026-09-25T16:33:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:519644810worker2 # [ 99.360861] nix-grpc-daemon[769]: ts=2026-09-25T16:33:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_out=1204811client # [ 99.418023] nix-daemon[1107]: reaped child process 1193, status = succeeded4812client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2, in 1.92 seconds)4813client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&24814client # [ 99.544315] nix-daemon[1107]: accepted connection from pid 1212, user root (trusted)4815client # this derivation will be built:4816client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4817worker2 # [ 99.684289] nix-grpc-daemon[769]: ts=2026-09-25T16:33:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:519644818client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...4819worker2 # [ 99.688355] nix-grpc-daemon[769]: ts=2026-09-25T16:33:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644820worker1 # [ 99.684061] nix-grpc-daemon[486]: ts=2026-09-25T16:33:05Z level=debug event=want client=16 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04821worker1 # [ 99.687873] nix-grpc-daemon[486]: ts=2026-09-25T16:33:05Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14822worker2 # [ 99.705260] nix-grpc-daemon[769]: ts=2026-09-25T16:33:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644823worker2 # [ 99.713480] nix-grpc-daemon[769]: ts=2026-09-25T16:33:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644824client # copying 1 paths to 'lb:50051'...4825client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4826worker2 # [ 99.723547] nix-grpc-daemon[769]: ts=2026-09-25T16:33:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519644827worker2 # [ 99.732278] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4828worker2 # [ 99.744882] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 1/5)4829worker2 # [ 99.794703] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 120 ms (attempt 2/5)4830worker2 # [ 99.915744] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 338 ms (attempt 3/5)4831worker2 # [ 100.254754] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 4/5)4832worker2 # [ 100.325434] nix-grpc-daemon[769]: disabling binary cache 'https://cache.nixos.org' for 60 seconds4833worker2 # [ 100.329612] nix-grpc-daemon[769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4834worker2 # [ 100.333291] nix-grpc-daemon[769]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4835worker2 # [ 100.470676] nix-daemon[840]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)4836worker2 # [ 100.491928] nix-daemon[840]: reaped child process 1188, status = succeeded4837lb # [ 100.475241] niks3-server[994]: 2026/09/25 16:33:06 INFO Received push request method=POST path=/api/pushes4838worker2 # [ 100.501451] nix-grpc-daemon[874]: time=2026-09-25T16:33:06.098Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4839worker2 # [ 100.502941] nix-grpc-daemon[874]: time=2026-09-25T16:33:06.098Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4840lb # [ 100.492088] niks3-server[994]: 2026/09/25 16:33:06 INFO Received sign narinfos request method=POST path=/api/pushes/31/sign4841worker2 # [ 100.516119] nix-grpc-daemon[874]: time=2026-09-25T16:33:06.113Z level=INFO msg="Uploading 1 narinfos"4842lb # [ 100.498978] niks3-server[994]: 2026/09/25 16:33:06 INFO Signed narinfos id=31 count=14843lb # [ 100.503232] niks3-server[994]: 2026/09/25 16:33:06 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4844lb # [ 100.509324] niks3-server[994]: 2026/09/25 16:33:06 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4845lb # [ 100.519334] niks3-server[994]: 2026/09/25 16:33:06 INFO Received complete push request method=POST path=/api/pushes/31/complete4846worker2 # [ 100.543095] nix-grpc-daemon[874]: time=2026-09-25T16:33:06.140Z level=INFO msg="Upload complete. (199ms)"4847lb # [ 100.523025] niks3-server[994]: 2026/09/25 16:33:06 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4848worker2 # [ 100.549556] nix-grpc-daemon[769]: ts=2026-09-25T16:33:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_in=5684849worker2 # [ 100.555468] nix-grpc-daemon[769]: ts=2026-09-25T16:33:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519644850worker2 # [ 100.564727] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4851worker2 # [ 100.568866] nix-daemon[840]: reaped child process 1178, status = succeeded4852worker2 # [ 100.576445] nix-grpc-daemon[769]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4853client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4854worker2 # [ 100.586986] nix-daemon[840]: accepted connection from pid 769, user nix-grpc-daemon (trusted)4855client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4856client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds4857worker2 # [ 101.836382] nix-daemon[840]: reaped child process 1193, status = succeeded4858worker2 # [ 101.935036] nix-daemon[840]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)4859worker2 # [ 101.953925] nix-daemon[840]: reaped child process 1212, status = succeeded4860lb # [ 101.932914] niks3-server[994]: 2026/09/25 16:33:07 INFO Received push request method=POST path=/api/pushes4861worker2 # [ 101.960471] nix-grpc-daemon[874]: time=2026-09-25T16:33:07.556Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4862worker2 # [ 101.974639] nix-grpc-daemon[874]: time=2026-09-25T16:33:07.571Z level=INFO msg="Uploading 1 narinfos"4863lb # [ 101.949963] niks3-server[994]: 2026/09/25 16:33:07 INFO Received sign narinfos request method=POST path=/api/pushes/32/sign4864lb # [ 101.958276] niks3-server[994]: 2026/09/25 16:33:07 INFO Signed narinfos id=32 count=14865lb # [ 101.962905] niks3-server[994]: 2026/09/25 16:33:07 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4866worker2 # [ 101.996724] nix-grpc-daemon[874]: time=2026-09-25T16:33:07.594Z level=INFO msg="Upload complete. (200ms)"4867lb # [ 101.971807] niks3-server[994]: 2026/09/25 16:33:07 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4868lb # [ 101.979426] niks3-server[994]: 2026/09/25 16:33:07 INFO Received complete push request method=POST path=/api/pushes/32/complete4869lb # [ 101.982971] niks3-server[994]: 2026/09/25 16:33:07 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4870client # copying 1 paths...4871worker2 # [ 102.004647] nix-grpc-daemon[769]: ts=2026-09-25T16:33:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=17 outputs=1 inputs=1 inputs_fetched=1 input_bytes=120 input_s=04872worker2 # [ 102.014679] nix-grpc-daemon[769]: ts=2026-09-25T16:33:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:519644873worker2 # [ 102.018110] nix-daemon[840]: reaped child process 1190, status = succeeded4874client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4875worker2 # [ 102.032292] nix-grpc-daemon[769]: ts=2026-09-25T16:33:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:519644876worker2 # [ 102.035978] nix-grpc-daemon[769]: ts=2026-09-25T16:33:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51964 duration_s=0 paths=1 nar_bytes_out=1204877client # [ 102.091702] nix-daemon[1107]: reaped child process 1215, status = succeeded4878client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.67 seconds)4879client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&24880client # [ 102.226335] nix-daemon[1107]: accepted connection from pid 1234, user root (trusted)4881client # this derivation will be built:4882client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4883worker2 # [ 102.366784] nix-grpc-daemon[769]: ts=2026-09-25T16:33:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:519644884client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...4885worker2 # [ 102.371102] nix-grpc-daemon[769]: ts=2026-09-25T16:33:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519644886worker2 # [ 102.374528] nix-grpc-daemon[874]: time=2026-09-25T16:33:07.972Z level=INFO msg="All 1 paths already cached"4887worker1 # [ 102.370652] nix-grpc-daemon[486]: ts=2026-09-25T16:33:07Z level=debug event=want client=17 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04888worker1 # [ 102.375618] nix-grpc-daemon[486]: ts=2026-09-25T16:33:07Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14889worker1 # [ 102.379423] nix-grpc-daemon[486]: ts=2026-09-25T16:33:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144890worker1 # [ 102.385553] nix-grpc-daemon[486]: ts=2026-09-25T16:33:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557144891worker1 # [ 102.393580] nix-grpc-daemon[869]: time=2026-09-25T16:33:07.987Z level=INFO msg="All 1 paths already cached"4892client # copying 1 paths to 'lb:50051'...4893client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4894worker1 # [ 102.399589] nix-grpc-daemon[486]: ts=2026-09-25T16:33:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:557144895worker1 # [ 102.408415] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4896worker1 # [ 102.533369] nix-daemon[855]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)4897worker1 # [ 102.553947] nix-daemon[855]: reaped child process 1275, status = succeeded4898lb # [ 102.552028] niks3-server[994]: 2026/09/25 16:33:08 INFO Received push request method=POST path=/api/pushes4899worker1 # [ 102.562221] nix-grpc-daemon[869]: time=2026-09-25T16:33:08.155Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4900worker1 # [ 102.563718] nix-grpc-daemon[869]: time=2026-09-25T16:33:08.155Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4901lb # [ 102.570459] niks3-server[994]: 2026/09/25 16:33:08 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4902worker1 # [ 102.581298] nix-grpc-daemon[869]: time=2026-09-25T16:33:08.175Z level=INFO msg="Uploading 1 narinfos"4903lb # [ 102.578617] niks3-server[994]: 2026/09/25 16:33:08 INFO Received sign narinfos request method=POST path=/api/pushes/33/sign4904lb # [ 102.583743] niks3-server[994]: 2026/09/25 16:33:08 INFO Signed narinfos id=33 count=14905lb # [ 102.587744] niks3-server[994]: 2026/09/25 16:33:08 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4906lb # [ 102.596479] niks3-server[994]: 2026/09/25 16:33:08 INFO Received complete push request method=POST path=/api/pushes/33/complete4907worker1 # [ 102.604363] nix-grpc-daemon[869]: time=2026-09-25T16:33:08.198Z level=INFO msg="Upload complete. (186ms)"4908lb # [ 102.600767] niks3-server[994]: 2026/09/25 16:33:08 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4909worker1 # [ 102.610820] nix-grpc-daemon[486]: ts=2026-09-25T16:33:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=1 nar_bytes_in=5684910worker1 # [ 102.621136] nix-grpc-daemon[486]: ts=2026-09-25T16:33:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557144911worker1 # [ 102.627413] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4912worker1 # [ 102.629296] nix-daemon[855]: reaped child process 1270, status = succeeded4913client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4914worker1 # [ 102.637987] nix-daemon[855]: accepted connection from pid 486, user nix-grpc-daemon (trusted)4915client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4916client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds4917worker1 # [ 103.880501] nix-daemon[855]: reaped child process 1279, status = succeeded4918worker1 # [ 103.979191] nix-daemon[855]: accepted connection from pid 1295, user nix-grpc-daemon (trusted)4919worker1 # [ 103.995620] nix-daemon[855]: reaped child process 1298, status = succeeded4920lb # [ 103.997249] niks3-server[994]: 2026/09/25 16:33:09 INFO Received push request method=POST path=/api/pushes4921worker1 # [ 104.007656] nix-grpc-daemon[869]: time=2026-09-25T16:33:09.600Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4922lb # [ 104.011222] niks3-server[994]: 2026/09/25 16:33:09 INFO Received sign narinfos request method=POST path=/api/pushes/34/sign4923worker1 # [ 104.021272] nix-grpc-daemon[869]: time=2026-09-25T16:33:09.615Z level=INFO msg="Uploading 1 narinfos"4924lb # [ 104.018259] niks3-server[994]: 2026/09/25 16:33:09 INFO Signed narinfos id=34 count=14925lb # [ 104.023528] niks3-server[994]: 2026/09/25 16:33:09 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4926lb # [ 104.032354] niks3-server[994]: 2026/09/25 16:33:09 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4927lb # [ 104.034929] niks3-server[994]: 2026/09/25 16:33:09 INFO Received complete push request method=POST path=/api/pushes/34/complete4928worker1 # [ 104.044069] nix-grpc-daemon[869]: time=2026-09-25T16:33:09.638Z level=INFO msg="Upload complete. (197ms)"4929lb # [ 104.041317] niks3-server[994]: 2026/09/25 16:33:09 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4930client # copying 1 paths...4931worker1 # [ 104.051621] nix-grpc-daemon[486]: ts=2026-09-25T16:33:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=18 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=04932worker1 # [ 104.063922] nix-grpc-daemon[486]: ts=2026-09-25T16:33:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:557144933worker1 # [ 104.067491] nix-daemon[855]: reaped child process 1277, status = succeeded4934client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4935worker1 # [ 104.081573] nix-grpc-daemon[486]: ts=2026-09-25T16:33:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:557144936worker1 # [ 104.085416] nix-grpc-daemon[486]: ts=2026-09-25T16:33:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55714 duration_s=0 paths=1 nar_bytes_out=1204937client # [ 104.156545] nix-daemon[1107]: reaped child process 1237, status = succeeded4938client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.06 seconds)4939(finished: subtest: an input only one worker has still reaches the builder, in 7.22 seconds)4940subtest: upload whose reference the worker lacks is completed from the cache4941client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache4942client # this derivation will be built:4943client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4944client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4945client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache, in 0.29 seconds)4946client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache4947client # this derivation will be built:4948client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4949client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4950client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache, in 0.26 seconds)4951client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4952client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.11 seconds)4953worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4954worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.15 seconds)4955worker2 # [ 105.012350] systemd[1]: Stopping Nix worker-protocol over gRPC...4956worker2 # [ 105.516433] nix-grpc-daemon[769]: ts=2026-09-25T16:33:11Z level=info event=signal_exit4957worker1 # [ 106.918995] nix-grpc-daemon[486]: ts=2026-09-25T16:33:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:511444958worker1 # [ 106.923966] nix-grpc-daemon[486]: ts=2026-09-25T16:33:12Z level=info event=worker_gone addr=192.168.1.4:500514959worker2 # [ 106.950351] nix-grpc-daemon[769]: ts=2026-09-25T16:33:12Z level=info event=scheduler_restarting4960worker2 # [ 106.953736] nix-grpc-daemon[769]: ts=2026-09-25T16:33:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4961worker2 # [ 106.963515] nix-daemon[840]: reaped child process 842, status = succeeded4962lb # [ 107.473013] envoy[894]: conn peer=[2001:db8:1::1]:52564 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=144963lb # [ 107.475591] envoy[894]: conn peer=[2001:db8:1::1]:52558 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3861 tx=2039 ms=15864964lb # [ 107.478227] envoy[894]: conn peer=[2001:db8:1::1]:52576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3740 tx=2096 ms=23614965lb # [ 107.480748] envoy[894]: conn peer=[2001:db8:1::1]:52030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=154966lb # [ 107.483214] envoy[894]: conn peer=[2001:db8:1::1]:52054 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=144967lb # [ 107.486316] envoy[894]: conn peer=[2001:db8:1::1]:52044 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3724 tx=2105 ms=17444968lb # [ 107.488898] envoy[894]: conn peer=192.168.1.4:43860 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2846 tx=1004 ms=721204969worker2 # [ 108.090852] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4970worker2 # [ 108.091791] systemd[1]: Stopped Nix worker-protocol over gRPC.4971worker2 # [ 108.093227] systemd[1]: nix-grpc-daemon.service: Consumed 2.486s CPU time over 1min 29.756s wall clock time, 60.2M memory peak, 172.4K incoming IP traffic, 312.4K outgoing IP traffic.4972lb: waiting until exactly ['worker1'] are healthy members of aarch64-linux4973lb: must succeed: curl -sf localhost:9901/clusters4974lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4975lb: (finished: waiting until exactly ['worker1'] are healthy members of aarch64-linux, in 0.04 seconds)4976client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24977worker1 # [ 108.302893] nix-grpc-daemon[486]: ts=2026-09-25T16:33:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:557144978client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4979worker1 # [ 108.307961] nix-grpc-daemon[486]: ts=2026-09-25T16:33:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:557144980client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.19 seconds)4981worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4982worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.02 seconds)4983worker2 # [ 108.391217] systemd[1]: Starting scheduler-token.service...4984worker2 # [ 108.447028] systemd[1]: scheduler-token.service: Deactivated successfully.4985worker2 # [ 108.450541] systemd[1]: Finished scheduler-token.service.4986worker2 # [ 108.451789] systemd[1]: scheduler-token.service: Consumed 32ms CPU time over 58ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4987worker2 # [ 108.464472] systemd[1]: Starting Nix worker-protocol over gRPC...4988worker2 # [ 108.567351] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:14Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4989worker2 # [ 108.569711] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4990worker2 # [ 108.573558] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14991worker2 # [ 108.578712] nix-grpc-daemon[1236]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4992worker2 # [ 108.581611] nix-grpc-daemon[1236]: E0000 00:00:1790353994.175389 1236 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.4993worker2 # [ 108.584153] nix-grpc-daemon[1236]: E0000 00:00:1790353994.178930 1236 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.4994worker2 # [ 108.608168] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:14Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket4995worker1 # [ 108.612342] systemd[1]: Stopping Nix worker-protocol over gRPC...4996worker2 # [ 108.610056] nix-grpc-daemon[1236]: E0000 00:00:1790353994.193874 1276 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.4997worker2 # [ 108.631854] systemd[1]: Started Nix worker-protocol over gRPC.4998worker2 # [ 108.632929] nix-grpc-daemon[1236]: E0000 00:00:1790353994.213564 1276 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.4999worker2 # [ 108.638334] nix-grpc-daemon[1236]: E0000 00:00:1790353994.213753 1276 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5000worker2 # [ 108.642568] nix-grpc-daemon[1236]: E0000 00:00:1790353994.228062 1276 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5001worker1 # [ 108.627742] nix-grpc-daemon[486]: ts=2026-09-25T16:33:14Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:511445002worker2 # [ 108.645236] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:14Z level=info event=scheduler_connected addr=lb:500515003worker1 # [ 108.632031] nix-grpc-daemon[486]: ts=2026-09-25T16:33:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05004worker1 # [ 108.936283] nix-grpc-daemon[486]: ts=2026-09-25T16:33:14Z level=info event=signal_exit5005lb # [ 109.917805] niks3-server[994]: 2026/09/25 16:33:15 INFO lead: released remote=192.168.1.3:590365006worker1 # [ 110.918207] nix-grpc-daemon[486]: ts=2026-09-25T16:33:16Z level=info event=scheduler_restarting5007worker2 # [ 110.935730] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:16Z level=info event=scheduler_restarting addr=lb:500515008lb # [ 110.913859] envoy[894]: [2026-09-25 16:33:16.520][894][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream}5009worker1 # [ 110.921782] nix-grpc-daemon[486]: ts=2026-09-25T16:33:16Z level=info event=scheduler_restarting addr=lb:500515010worker1 # [ 110.928184] nix-grpc-daemon[486]: ts=2026-09-25T16:33:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:511445011worker1 # [ 110.930694] nix-grpc-daemon[486]: ts=2026-09-25T16:33:16Z level=info event=worker_gone addr=192.168.1.4:500515012worker1 # [ 110.934034] nix-grpc-daemon[486]: ts=2026-09-25T16:33:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:511445013worker1 # [ 110.936649] nix-grpc-daemon[486]: ts=2026-09-25T16:33:16Z level=info event=worker_gone addr=192.168.1.3:500515014worker1 # [ 110.951674] nix-daemon[855]: reaped child process 857, status = succeeded5015worker2 # [ 111.136003] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:16Z level=info event=scheduler_connected addr=lb:500515016worker2 # [ 111.139136] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5017worker1 # [ 111.135744] nix-grpc-daemon[486]: ts=2026-09-25T16:33:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5018worker2 # [ 111.339699] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:16Z level=info event=scheduler_connected addr=lb:500515019worker2 # [ 111.342581] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5020worker2 # [ 111.543335] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=info event=scheduler_connected addr=lb:500515021worker2 # [ 111.546397] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5022worker2 # [ 111.747140] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=info event=scheduler_connected addr=lb:500515023worker2 # [ 111.750164] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5024worker2 # [ 111.951893] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=info event=scheduler_connected addr=lb:500515025worker2 # [ 111.954373] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5026worker1 # [ 112.053853] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5027worker1 # [ 112.058060] systemd[1]: Stopped Nix worker-protocol over gRPC.5028worker1 # [ 112.059447] systemd[1]: nix-grpc-daemon.service: Consumed 2.826s CPU time over 1min 42.425s wall clock time, 70.3M memory peak, 447.2K incoming IP traffic, 446.7K outgoing IP traffic.5029lb: waiting until exactly ['worker2'] are healthy members of aarch64-linux5030lb: must succeed: curl -sf localhost:9901/clusters5031lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5032lb: (finished: waiting until exactly ['worker2'] are healthy members of aarch64-linux, in 0.04 seconds)5033client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&25034worker2 # [ 112.152526] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=info event=scheduler_connected addr=lb:500515035worker2 # [ 112.155482] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5036worker2 # [ 112.304105] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:384045037worker2 # [ 112.312974] nix-daemon[840]: accepted connection from pid 1236, user nix-grpc-daemon (trusted)5038worker2 # [ 112.326646] nix-grpc-daemon[1236]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5)5039worker2 # [ 112.356266] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=info event=scheduler_connected addr=lb:500515040worker2 # [ 112.359118] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5041worker2 # [ 112.410635] nix-grpc-daemon[1236]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 2/5)5042worker2 # [ 112.495704] nix-grpc-daemon[1236]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 342 ms (attempt 3/5)5043worker2 # [ 112.559882] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=scheduler_connected addr=lb:500515044worker2 # [ 112.562850] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5045worker2 # [ 112.763660] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=scheduler_connected addr=lb:500515046worker2 # [ 112.766479] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5047worker2 # [ 112.838725] nix-grpc-daemon[1236]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 209 ms (attempt 4/5)5048worker2 # [ 112.968114] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=scheduler_connected addr=lb:500515049worker2 # [ 112.970264] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5050worker2 # [ 113.048912] nix-grpc-daemon[1236]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5051worker2 # [ 113.052458] nix-grpc-daemon[1236]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5052client # copying 2 paths...5053client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...5054worker2 # [ 113.065098] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:384045055client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...5056worker2 # [ 113.074831] nix-daemon[840]: accepted connection from pid 1236, user nix-grpc-daemon (trusted)5057worker2 # [ 113.090716] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=niks3_push_started pid=12965058worker2 # [ 113.172592] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=scheduler_connected addr=lb:500515059worker2 # [ 113.191515] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5060worker2 # [ 113.221086] nix-grpc-daemon[1296]: time=2026-09-25T16:33:18.817Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""5061worker2 # [ 113.319864] nix-daemon[840]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5062worker2 # [ 113.335098] nix-daemon[840]: reaped child process 1311, status = succeeded5063lb # [ 113.321176] niks3-server[994]: 2026/09/25 16:33:18 INFO Received push request method=POST path=/api/pushes5064worker2 # [ 113.348115] nix-grpc-daemon[1296]: time=2026-09-25T16:33:18.944Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5065worker2 # [ 113.349700] nix-grpc-daemon[1296]: time=2026-09-25T16:33:18.944Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"5066worker2 # [ 113.351483] nix-grpc-daemon[1296]: time=2026-09-25T16:33:18.944Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"5067worker2 # [ 113.377006] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=scheduler_connected addr=lb:500515068worker2 # [ 113.380941] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5069lb # [ 113.362929] niks3-server[994]: 2026/09/25 16:33:18 INFO Received sign narinfos request method=POST path=/api/pushes/35/sign5070lb # [ 113.376942] niks3-server[994]: 2026/09/25 16:33:18 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst5071lb # [ 113.389095] niks3-server[994]: 2026/09/25 16:33:18 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls5072lb # [ 113.391630] niks3-server[994]: 2026/09/25 16:33:18 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5073worker2 # [ 113.418869] nix-grpc-daemon[1296]: time=2026-09-25T16:33:19.014Z level=INFO msg="Uploading 2 narinfos"5074lb # [ 113.401957] niks3-server[994]: 2026/09/25 16:33:18 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls5075lb # [ 113.406666] niks3-server[994]: 2026/09/25 16:33:19 INFO Signed narinfos id=35 count=25076lb # [ 113.413177] niks3-server[994]: 2026/09/25 16:33:19 INFO Received complete push request method=POST path=/api/pushes/35/complete5077lb # [ 113.420770] niks3-server[994]: 2026/09/25 16:33:19 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo5078lb # [ 113.424343] niks3-server[994]: 2026/09/25 16:33:19 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5079worker2 # [ 113.453289] nix-grpc-daemon[1296]: time=2026-09-25T16:33:19.050Z level=INFO msg="Upload complete. (229ms)"5080worker2 # [ 113.460107] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38404 duration_s=0 paths=2 nar_bytes_in=3125081worker2 # [ 113.468710] nix-daemon[840]: reaped child process 1294, status = succeeded5082client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.35 seconds)5083worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache5084worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.02 seconds)5085worker1 # [ 113.521479] systemd[1]: Starting Nix worker-protocol over gRPC...5086worker2 # [ 113.580197] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:19Z level=info event=scheduler_connected addr=lb:500515087worker2 # [ 113.583038] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5088lb # [ 113.576811] niks3-server[994]: 2026/09/25 16:33:19 INFO lead: acquired remote=192.168.1.4:332165089worker2 # [ 113.599320] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:19Z level=info event=scheduler_take_over5090worker1 # [ 113.637166] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5091worker1 # [ 113.639375] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5092worker1 # [ 113.643485] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15093worker1 # [ 113.647908] nix-grpc-daemon[1321]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5094worker1 # [ 113.672463] nix-grpc-daemon[1321]: E0000 00:00:1790353999.241937 1321 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5095lb: waiting until exactly ['worker1', 'worker2'] are healthy members of aarch64-linux5096lb: must succeed: curl -sf localhost:9901/clusters5097worker1 # [ 113.674894] nix-grpc-daemon[1321]: E0000 00:00:1790353999.245876 1321 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5098worker1 # [ 113.698013] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:19Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket5099worker1 # [ 113.699835] nix-grpc-daemon[1321]: E0000 00:00:1790353999.252788 1363 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5100worker1 # [ 113.702672] systemd[1]: Started Nix worker-protocol over gRPC.5101worker1 # [ 113.703516] nix-grpc-daemon[1321]: E0000 00:00:1790353999.275195 1363 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5102worker1 # [ 113.709103] nix-grpc-daemon[1321]: E0000 00:00:1790353999.275362 1363 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5103worker1 # [ 113.713435] nix-grpc-daemon[1321]: E0000 00:00:1790353999.290742 1363 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5104worker1 # [ 113.715999] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:19Z level=info event=scheduler_connected addr=lb:500515105worker2 # [ 113.732183] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:19Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:384165106worker2 # [ 113.735175] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05107lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5108worker2 # [ 113.783523] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:19Z level=info event=scheduler_connected addr=lb:500515109worker2 # [ 113.791092] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:19Z level=info event=oidc_jwks provider=mock keys=15110worker2 # [ 113.793507] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:19Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:384165111worker2 # [ 113.796273] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05112lb: must succeed: curl -sf localhost:9901/clusters5113lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5114lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of aarch64-linux, in 1.09 seconds)5115(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.62 seconds)5116subtest: a niks3 restart does not cost the leader its role5117lb: must succeed: curl -sf localhost:9901/clusters5118lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5119lb: must succeed: curl -sf localhost:9901/clusters5120lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5121lb # [ 114.849969] niks3-server[994]: 2026/09/25 16:33:20 INFO Shutdown signal received, draining in-flight requests timeout=10s5122lb # [ 114.850450] systemd[1]: Stopping niks3 server...5123worker1 # [ 114.859286] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:20Z level=info event=scheduler_lock_lost status=2005124worker2 # [ 114.877317] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:20Z level=info event=scheduler_lock_lost status=2005125lb # [ 114.859912] niks3-server[994]: 2026/09/25 16:33:20 INFO lead: released remote=192.168.1.4:332165126lb # [ 114.876164] systemd[1]: niks3.service: Deactivated successfully.5127lb # [ 114.878441] systemd[1]: Stopped niks3 server.5128lb # [ 114.879167] systemd[1]: niks3.service: Consumed 420ms CPU time over 1min 29.203s wall clock time, 27.9M memory peak, 97.2K incoming IP traffic, 140.3K outgoing IP traffic.5129lb # [ 114.888435] systemd[1]: Starting niks3 server...5130lb # [ 114.951231] niks3-server[1167]: 2026/09/25 16:33:20 goose: no migrations to run. current version: 202609231200005131lb # [ 114.956588] niks3-server[1167]: 2026/09/25 16:33:20 OK 1_commit_pending_closure.sql (6.77ms)5132lb # [ 114.959616] niks3-server[1167]: 2026/09/25 16:33:20 OK 2_object_stats_trigger.sql (2.98ms)5133lb # [ 114.962746] niks3-server[1167]: 2026/09/25 16:33:20 OK 3_commit_push.sql (2.78ms)5134lb # [ 114.964610] niks3-server[1167]: 2026/09/25 16:33:20 goose: up to current file version: 35135lb # [ 114.966161] niks3-server[1167]: 2026/09/25 16:33:20 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key5136lb # [ 114.975880] niks3-server[1167]: 2026/09/25 16:33:20 INFO Read proxy enabled — serving cache objects from S35137lb # [ 114.982031] niks3-server[1167]: 2026/09/25 16:33:20 INFO Using socket-activated listener address=0.0.0.0:57515138lb # [ 114.983403] niks3-server[1167]: 2026/09/25 16:33:20 INFO systemd watchdog enabled interval=15s5139lb # [ 114.985138] niks3-server[1167]: 2026/09/25 16:33:20 INFO Starting HTTP server address=0.0.0.0:57515140lb # [ 114.986620] systemd[1]: Started niks3 server.5141lb: waiting for unit niks3.service5142lb: (finished: waiting for unit niks3.service, in 0.03 seconds)5143lb: must succeed: curl -sf localhost:9901/clusters5144lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5145worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5146worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5147lb: must succeed: curl -sf localhost:9901/clusters5148lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5149lb: must succeed: curl -sf localhost:9901/clusters5150lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5151worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5152worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.04 seconds)5153client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&25154worker2 # [ 115.228306] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:20Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:384265155worker1 # [ 115.356093] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:597545156worker1 # [ 115.365173] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5157client # don't know how to build these paths:5158client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5159worker2 # [ 115.395477] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:384045160worker2 # [ 115.414393] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:21Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=05161worker2 # [ 115.417713] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:21Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.3:50051 clients=15162worker1 # [ 115.404329] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545163worker1 # [ 115.413161] nix-grpc-daemon[1321]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 1/5)5164worker1 # [ 115.482182] nix-grpc-daemon[1321]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 123 ms (attempt 2/5)5165worker1 # [ 115.610619] nix-grpc-daemon[1321]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 169 ms (attempt 3/5)5166worker1 # [ 115.780761] nix-grpc-daemon[1321]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 525 ms (attempt 4/5)5167lb # [ 115.859733] niks3-server[1167]: 2026/09/25 16:33:21 INFO lead: acquired remote=192.168.1.4:401265168worker1 # [ 116.307867] nix-grpc-daemon[1321]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5169worker1 # [ 116.311665] nix-grpc-daemon[1321]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5170worker1 # [ 116.323040] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:597545171client # copying 1 paths to 'lb:50051'...5172client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'...5173worker1 # [ 116.332281] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:597545174worker1 # [ 116.340846] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5175worker1 # [ 116.357035] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:21Z level=info event=niks3_push_started pid=13835176worker1 # [ 116.486389] nix-grpc-daemon[1383]: time=2026-09-25T16:33:22.079Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""5177worker1 # [ 116.600282] nix-daemon[855]: accepted connection from pid 1395, user nix-grpc-daemon (trusted)5178worker1 # [ 116.619616] nix-daemon[855]: reaped child process 1398, status = succeeded5179lb # [ 116.617567] niks3-server[1167]: 2026/09/25 16:33:22 INFO Received push request method=POST path=/api/pushes5180worker1 # [ 116.631741] nix-grpc-daemon[1383]: time=2026-09-25T16:33:22.224Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5181worker1 # [ 116.635239] nix-grpc-daemon[1383]: time=2026-09-25T16:33:22.224Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)"5182lb # [ 116.651448] niks3-server[1167]: 2026/09/25 16:33:22 INFO Received sign narinfos request method=POST path=/api/pushes/36/sign5183lb # [ 116.672473] niks3-server[1167]: 2026/09/25 16:33:22 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst5184lb # [ 116.683763] niks3-server[1167]: 2026/09/25 16:33:22 INFO Signed narinfos id=36 count=15185worker1 # [ 116.693313] nix-grpc-daemon[1383]: time=2026-09-25T16:33:22.286Z level=INFO msg="Uploading 1 narinfos"5186lb # [ 116.695779] niks3-server[1167]: 2026/09/25 16:33:22 INFO Received complete push request method=POST path=/api/pushes/36/complete5187lb # [ 116.706929] niks3-server[1167]: 2026/09/25 16:33:22 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo5188lb # [ 116.713437] niks3-server[1167]: 2026/09/25 16:33:22 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls5189worker1 # [ 116.723222] nix-grpc-daemon[1383]: time=2026-09-25T16:33:22.317Z level=INFO msg="Upload complete. (233ms)"5190worker1 # [ 116.729924] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=0 paths=1 nar_bytes_in=5445191worker1 # [ 116.736222] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545192worker1 # [ 116.748122] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5193worker1 # [ 116.750557] nix-daemon[855]: reaped child process 1381, status = succeeded5194client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051...5195client # farm-a> node-a: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5196worker1 # [ 116.760363] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5197lb # [ 117.474931] envoy[894]: conn peer=[2001:db8:1::1]:52058 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=155198lb # [ 117.477692] envoy[894]: conn peer=[2001:db8:1::3]:60414 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2623 tx=1172 ms=751015199lb # [ 117.480308] envoy[894]: conn peer=[2001:db8:1::1]:52594 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=282 ms=11665200client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5201client # farm-a> LOG-farm-a-after-niks3-restart5202worker1 # [ 118.195888] nix-daemon[855]: reaped child process 1402, status = succeeded5203worker1 # [ 118.306419] nix-daemon[855]: accepted connection from pid 1418, user nix-grpc-daemon (trusted)5204worker1 # [ 118.323484] nix-daemon[855]: reaped child process 1421, status = succeeded5205lb # [ 118.323266] niks3-server[1167]: 2026/09/25 16:33:23 INFO Received push request method=POST path=/api/pushes5206worker1 # [ 118.336374] nix-grpc-daemon[1383]: time=2026-09-25T16:33:23.928Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5207worker1 # [ 118.339454] nix-grpc-daemon[1383]: time=2026-09-25T16:33:23.928Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)"5208lb # [ 118.346781] niks3-server[1167]: 2026/09/25 16:33:23 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5209lb # [ 118.359354] niks3-server[1167]: 2026/09/25 16:33:23 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls5210worker1 # [ 118.371216] nix-grpc-daemon[1383]: time=2026-09-25T16:33:23.964Z level=INFO msg="Uploading 1 narinfos"5211lb # [ 118.367226] niks3-server[1167]: 2026/09/25 16:33:23 INFO Received sign narinfos request method=POST path=/api/pushes/37/sign5212lb # [ 118.372849] niks3-server[1167]: 2026/09/25 16:33:23 INFO Signed narinfos id=37 count=15213lb # [ 118.377000] niks3-server[1167]: 2026/09/25 16:33:23 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5214worker1 # [ 118.390343] nix-grpc-daemon[1383]: time=2026-09-25T16:33:23.984Z level=INFO msg="Upload complete. (219ms)"5215lb # [ 118.387171] niks3-server[1167]: 2026/09/25 16:33:23 INFO Received complete push request method=POST path=/api/pushes/37/complete5216lb # [ 118.392907] niks3-server[1167]: 2026/09/25 16:33:23 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo5217worker2 # [ 118.419309] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:24Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=05218worker1 # [ 118.403346] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05219worker2 # [ 118.422644] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:24Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.3:50051 clients=15220worker1 # [ 118.410312] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545221worker1 # [ 118.414366] nix-daemon[855]: reaped child process 1400, status = succeeded5222worker1 # [ 118.419931] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:597545223worker1 # [ 118.428279] nix-grpc-daemon[1383]: time=2026-09-25T16:33:24.022Z level=INFO msg="All 1 paths already cached"5224client # copying 1 paths to 'lb:50051'...5225client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'...5226worker1 # [ 118.434602] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:597545227worker1 # [ 118.442363] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5228worker1 # [ 118.553676] nix-daemon[855]: accepted connection from pid 1426, user nix-grpc-daemon (trusted)5229worker1 # [ 118.572763] nix-daemon[855]: reaped child process 1429, status = succeeded5230lb # [ 118.570632] niks3-server[1167]: 2026/09/25 16:33:24 INFO Received push request method=POST path=/api/pushes5231worker1 # [ 118.582232] nix-grpc-daemon[1383]: time=2026-09-25T16:33:24.175Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5232worker1 # [ 118.583739] nix-grpc-daemon[1383]: time=2026-09-25T16:33:24.175Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)"5233lb # [ 118.586456] niks3-server[1167]: 2026/09/25 16:33:24 INFO Received sign narinfos request method=POST path=/api/pushes/38/sign5234worker1 # [ 118.594591] nix-grpc-daemon[1383]: time=2026-09-25T16:33:24.188Z level=INFO msg="Uploading 1 narinfos"5235lb # [ 118.594074] niks3-server[1167]: 2026/09/25 16:33:24 INFO Signed narinfos id=38 count=15236lb # [ 118.600571] niks3-server[1167]: 2026/09/25 16:33:24 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls5237lb # [ 118.609805] niks3-server[1167]: 2026/09/25 16:33:24 INFO Received complete push request method=POST path=/api/pushes/38/complete5238lb # [ 118.616109] niks3-server[1167]: 2026/09/25 16:33:24 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo5239lb # [ 118.622707] niks3-server[1167]: 2026/09/25 16:33:24 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst5240worker1 # [ 118.632071] nix-grpc-daemon[1383]: time=2026-09-25T16:33:24.226Z level=INFO msg="Upload complete. (180ms)"5241worker1 # [ 118.637878] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=0 paths=1 nar_bytes_in=6565242worker1 # [ 118.644682] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545243worker1 # [ 118.655588] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5244worker1 # [ 118.658628] nix-daemon[855]: reaped child process 1424, status = succeeded5245client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051...5246client # farm-b> node-a: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5247worker1 # [ 118.667041] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5248client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5249client # farm-b> LOG-farm-b-after-niks3-restart5250worker1 # [ 120.308500] nix-daemon[855]: reaped child process 1433, status = succeeded5251worker1 # [ 120.415711] nix-daemon[855]: accepted connection from pid 1449, user nix-grpc-daemon (trusted)5252worker1 # [ 120.432272] nix-daemon[855]: reaped child process 1452, status = succeeded5253lb # [ 120.433983] niks3-server[1167]: 2026/09/25 16:33:26 INFO Received push request method=POST path=/api/pushes5254worker1 # [ 120.445038] nix-grpc-daemon[1383]: time=2026-09-25T16:33:26.037Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5255worker1 # [ 120.446710] nix-grpc-daemon[1383]: time=2026-09-25T16:33:26.038Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)"5256lb # [ 120.458388] niks3-server[1167]: 2026/09/25 16:33:26 INFO Received sign narinfos request method=POST path=/api/pushes/39/sign5257worker1 # [ 120.469961] nix-grpc-daemon[1383]: time=2026-09-25T16:33:26.063Z level=INFO msg="Uploading 1 narinfos"5258lb # [ 120.468955] niks3-server[1167]: 2026/09/25 16:33:26 INFO Signed narinfos id=39 count=15259lb # [ 120.473024] niks3-server[1167]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls5260lb # [ 120.480744] niks3-server[1167]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst5261lb # [ 120.487609] niks3-server[1167]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5262lb # [ 120.498236] niks3-server[1167]: 2026/09/25 16:33:26 INFO Received complete push request method=POST path=/api/pushes/39/complete5263worker1 # [ 120.506085] nix-grpc-daemon[1383]: time=2026-09-25T16:33:26.100Z level=INFO msg="Upload complete. (226ms)"5264lb # [ 120.501333] niks3-server[1167]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo5265worker1 # [ 120.512628] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05266worker2 # [ 120.531152] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:26Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=05267worker2 # [ 120.534462] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:26Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.3:50051 clients=15268worker1 # [ 120.525775] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545269worker1 # [ 120.529723] nix-daemon[855]: reaped child process 1431, status = succeeded5270worker1 # [ 120.534875] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:597545271worker1 # [ 120.543525] nix-grpc-daemon[1383]: time=2026-09-25T16:33:26.137Z level=INFO msg="All 2 paths already cached"5272client # copying 1 paths to 'lb:50051'...5273client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'...5274worker1 # [ 120.550544] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:597545275worker1 # [ 120.558119] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5276worker1 # [ 120.676695] nix-daemon[855]: accepted connection from pid 1456, user nix-grpc-daemon (trusted)5277worker1 # [ 120.692464] nix-daemon[855]: reaped child process 1459, status = succeeded5278lb # [ 120.693453] niks3-server[1167]: 2026/09/25 16:33:26 INFO Received push request method=POST path=/api/pushes5279worker1 # [ 120.703653] nix-grpc-daemon[1383]: time=2026-09-25T16:33:26.297Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5280worker1 # [ 120.705331] nix-grpc-daemon[1383]: time=2026-09-25T16:33:26.297Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)"5281lb # [ 120.713035] niks3-server[1167]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst5282worker1 # [ 120.725896] nix-grpc-daemon[1383]: time=2026-09-25T16:33:26.319Z level=INFO msg="Uploading 1 narinfos"5283lb # [ 120.721756] niks3-server[1167]: 2026/09/25 16:33:26 INFO Received sign narinfos request method=POST path=/api/pushes/40/sign5284lb # [ 120.726832] niks3-server[1167]: 2026/09/25 16:33:26 INFO Signed narinfos id=40 count=15285lb # [ 120.731035] niks3-server[1167]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls5286lb # [ 120.739793] niks3-server[1167]: 2026/09/25 16:33:26 INFO Received complete push request method=POST path=/api/pushes/40/complete5287worker1 # [ 120.750004] nix-grpc-daemon[1383]: time=2026-09-25T16:33:26.344Z level=INFO msg="Upload complete. (182ms)"5288lb # [ 120.746038] niks3-server[1167]: 2026/09/25 16:33:26 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo5289worker1 # [ 120.756288] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=0 paths=1 nar_bytes_in=7845290worker1 # [ 120.759600] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545291worker1 # [ 120.770606] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5292worker1 # [ 120.774495] nix-daemon[855]: reaped child process 1454, status = succeeded5293client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051...5294client # farm-top> node-a: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5295worker1 # [ 120.785398] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5296client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5297client # farm-top> LOG-farm-top-after-niks3-restart5298worker1 # [ 122.232909] nix-daemon[855]: reaped child process 1463, status = succeeded5299worker1 # [ 122.323992] nix-daemon[855]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5300worker1 # [ 122.341576] nix-daemon[855]: reaped child process 1482, status = succeeded5301lb # [ 122.342393] niks3-server[1167]: 2026/09/25 16:33:27 INFO Received push request method=POST path=/api/pushes5302worker1 # [ 122.354424] nix-grpc-daemon[1383]: time=2026-09-25T16:33:27.946Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5303worker1 # [ 122.355964] nix-grpc-daemon[1383]: time=2026-09-25T16:33:27.946Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)"5304lb # [ 122.365815] niks3-server[1167]: 2026/09/25 16:33:27 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls5305worker1 # [ 122.376739] nix-grpc-daemon[1383]: time=2026-09-25T16:33:27.970Z level=INFO msg="Uploading 1 narinfos"5306lb # [ 122.373372] niks3-server[1167]: 2026/09/25 16:33:27 INFO Received sign narinfos request method=POST path=/api/pushes/41/sign5307lb # [ 122.375733] niks3-server[1167]: 2026/09/25 16:33:27 INFO Signed narinfos id=41 count=15308lb # [ 122.383757] niks3-server[1167]: 2026/09/25 16:33:27 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5309lb # [ 122.393418] niks3-server[1167]: 2026/09/25 16:33:27 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst5310worker1 # [ 122.402569] nix-grpc-daemon[1383]: time=2026-09-25T16:33:27.996Z level=INFO msg="Upload complete. (209ms)"5311lb # [ 122.398793] niks3-server[1167]: 2026/09/25 16:33:27 INFO Received complete push request method=POST path=/api/pushes/41/complete5312lb # [ 122.401481] niks3-server[1167]: 2026/09/25 16:33:28 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo5313worker1 # [ 122.415276] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=05314worker1 # [ 122.420732] nix-daemon[855]: reaped child process 1461, status = succeeded5315client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2, in 7.26 seconds)5316client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath5317client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath, in 0.14 seconds)5318(finished: subtest: a niks3 restart does not cost the leader its role, in 7.81 seconds)5319subtest: scheduler down: the other node takes the lock and keeps it5320lb: must succeed: curl -sf localhost:9901/clusters5321lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5322lb: must succeed: curl -sf localhost:9901/clusters5323lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5324lb: must succeed: curl -sf localhost:9901/clusters5325lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5326lb: must succeed: curl -sf localhost:9901/clusters5327lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5328worker2 # [ 122.758276] systemd[1]: Stopping Nix worker-protocol over gRPC...5329worker2 # [ 123.592484] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:29Z level=info event=signal_exit5330lb # [ 123.869367] niks3-server[1167]: 2026/09/25 16:33:29 INFO lead: released remote=192.168.1.4:401265331worker2 # [ 124.885484] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:30Z level=info event=scheduler_restarting5332worker1 # [ 124.872201] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:30Z level=info event=scheduler_restarting addr=lb:500515333lb # [ 124.865601] envoy[894]: [2026-09-25 16:33:30.471][894][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream}5334worker2 # [ 124.889122] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:30Z level=info event=scheduler_restarting addr=lb:500515335worker2 # [ 124.894707] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:384165336worker2 # [ 124.897609] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:30Z level=info event=worker_gone addr=192.168.1.3:500515337worker2 # [ 124.900183] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:384165338worker2 # [ 124.902545] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:30Z level=info event=worker_gone addr=192.168.1.4:500515339worker2 # [ 124.917644] nix-daemon[840]: reaped child process 1288, status = succeeded5340worker1 # [ 125.072628] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:30Z level=info event=scheduler_connected addr=lb:500515341worker1 # [ 125.076220] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5342worker2 # [ 125.099570] nix-grpc-daemon[1236]: ts=2026-09-25T16:33:30Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5343worker2 # [ 125.128625] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5344worker2 # [ 125.130914] systemd[1]: Stopped Nix worker-protocol over gRPC.5345worker2 # [ 125.135680] systemd[1]: nix-grpc-daemon.service: Consumed 462ms CPU time over 16.672s wall clock time, 33.6M memory peak, 166.1K incoming IP traffic, 73.9K outgoing IP traffic.5346worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5347worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.04 seconds)5348worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5349worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)5350worker1 # [ 125.276873] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:30Z level=info event=scheduler_connected addr=lb:500515351worker1 # [ 125.280370] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5352worker1 # [ 125.480835] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_connected addr=lb:500515353worker1 # [ 125.483814] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5354worker1 # [ 125.684424] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_connected addr=lb:500515355worker1 # [ 125.687745] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5356worker1 # [ 125.862608] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_take_over5357lb # [ 125.858486] niks3-server[1167]: 2026/09/25 16:33:31 INFO lead: acquired remote=192.168.1.3:537165358worker1 # [ 125.889115] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_connected addr=lb:500515359worker1 # [ 125.891604] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5360worker1 # [ 126.092331] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_connected addr=lb:500515361worker1 # [ 126.095601] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5362worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5363worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5364worker1 # [ 126.296294] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_connected addr=lb:500515365worker1 # [ 126.299596] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5366worker1 # [ 126.500438] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:32Z level=info event=scheduler_connected addr=lb:500515367worker1 # [ 126.503705] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5368worker1 # [ 126.704215] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:32Z level=info event=scheduler_connected addr=lb:500515369worker1 # [ 126.714730] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:32Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:416505370worker1 # [ 126.717675] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:32Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05371worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5372worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)5373client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&25374worker1 # [ 127.450927] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:597545375client # don't know how to build these paths:5376client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5377worker1 # [ 127.457644] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:597545378worker1 # [ 127.472074] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:33Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05379worker1 # [ 127.475597] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:33Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=15380lb # [ 127.474568] envoy[894]: conn peer=[2001:db8:1::1]:52608 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9753 tx=4505 ms=70715381worker1 # [ 127.481108] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545382lb # [ 127.474832] envoy[894]: conn peer=[2001:db8:1::4]:40718 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=11854 tx=713 ms=164595383worker1 # [ 127.489483] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:597545384client # copying 1 paths to 'lb:50051'...5385client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5386worker1 # [ 127.497948] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:597545387worker1 # [ 127.506253] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5388worker1 # [ 127.630622] nix-daemon[855]: accepted connection from pid 1503, user nix-grpc-daemon (trusted)5389lb # [ 127.644500] niks3-server[1167]: 2026/09/25 16:33:33 INFO Received push request method=POST path=/api/pushes5390worker1 # [ 127.650377] nix-daemon[855]: reaped child process 1506, status = succeeded5391worker1 # [ 127.655368] nix-grpc-daemon[1383]: time=2026-09-25T16:33:33.248Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5392worker1 # [ 127.657177] nix-grpc-daemon[1383]: time=2026-09-25T16:33:33.248Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5393worker1 # [ 127.671112] nix-grpc-daemon[1383]: time=2026-09-25T16:33:33.265Z level=INFO msg="Uploading 1 narinfos"5394lb # [ 127.662251] niks3-server[1167]: 2026/09/25 16:33:33 INFO Received sign narinfos request method=POST path=/api/pushes/42/sign5395lb # [ 127.669724] niks3-server[1167]: 2026/09/25 16:33:33 INFO Signed narinfos id=42 count=15396lb # [ 127.677709] niks3-server[1167]: 2026/09/25 16:33:33 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5397lb # [ 127.684303] niks3-server[1167]: 2026/09/25 16:33:33 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5398lb # [ 127.693527] niks3-server[1167]: 2026/09/25 16:33:33 INFO Received complete push request method=POST path=/api/pushes/42/complete5399worker1 # [ 127.703132] nix-grpc-daemon[1383]: time=2026-09-25T16:33:33.297Z level=INFO msg="Upload complete. (187ms)"5400lb # [ 127.699940] niks3-server[1167]: 2026/09/25 16:33:33 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5401worker1 # [ 127.708201] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=0 paths=1 nar_bytes_in=5205402worker1 # [ 127.718798] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545403worker1 # [ 127.724315] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5404worker1 # [ 127.729631] nix-daemon[855]: reaped child process 1501, status = succeeded5405client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5406client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5407worker1 # [ 127.739817] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5408client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5409client # farm-a> LOG-farm-a-on-standby5410worker1 # [ 128.996793] nix-daemon[855]: reaped child process 1510, status = succeeded5411worker1 # [ 129.079185] nix-daemon[855]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)5412worker1 # [ 129.097519] nix-daemon[855]: reaped child process 1529, status = succeeded5413lb # [ 129.091916] niks3-server[1167]: 2026/09/25 16:33:34 INFO Received push request method=POST path=/api/pushes5414worker1 # [ 129.104452] nix-grpc-daemon[1383]: time=2026-09-25T16:33:34.696Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5415worker1 # [ 129.106299] nix-grpc-daemon[1383]: time=2026-09-25T16:33:34.696Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5416lb # [ 129.122860] niks3-server[1167]: 2026/09/25 16:33:34 INFO Received sign narinfos request method=POST path=/api/pushes/43/sign5417worker1 # [ 129.132204] nix-grpc-daemon[1383]: time=2026-09-25T16:33:34.726Z level=INFO msg="Uploading 1 narinfos"5418lb # [ 129.132423] niks3-server[1167]: 2026/09/25 16:33:34 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5419lb # [ 129.141020] niks3-server[1167]: 2026/09/25 16:33:34 INFO Signed narinfos id=43 count=15420lb # [ 129.142740] niks3-server[1167]: 2026/09/25 16:33:34 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5421lb # [ 129.159234] niks3-server[1167]: 2026/09/25 16:33:34 INFO Received complete push request method=POST path=/api/pushes/43/complete5422worker1 # [ 129.168090] nix-grpc-daemon[1383]: time=2026-09-25T16:33:34.762Z level=INFO msg="Upload complete. (220ms)"5423lb # [ 129.167658] niks3-server[1167]: 2026/09/25 16:33:34 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5424lb # [ 129.171517] niks3-server[1167]: 2026/09/25 16:33:34 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5425worker1 # [ 129.179570] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05426worker1 # [ 129.192535] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:34Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05427worker1 # [ 129.195251] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:34Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15428worker1 # [ 129.199677] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545429worker1 # [ 129.203943] nix-daemon[855]: reaped child process 1508, status = succeeded5430worker1 # [ 129.207100] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:597545431worker1 # [ 129.213363] nix-grpc-daemon[1383]: time=2026-09-25T16:33:34.807Z level=INFO msg="All 1 paths already cached"5432client # copying 1 paths to 'lb:50051'...5433client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5434worker1 # [ 129.219551] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:597545435worker1 # [ 129.227796] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5436worker1 # [ 129.342647] nix-daemon[855]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5437worker1 # [ 129.360698] nix-daemon[855]: reaped child process 1538, status = succeeded5438lb # [ 129.359961] niks3-server[1167]: 2026/09/25 16:33:34 INFO Received push request method=POST path=/api/pushes5439worker1 # [ 129.371600] nix-grpc-daemon[1383]: time=2026-09-25T16:33:34.965Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5440worker1 # [ 129.373280] nix-grpc-daemon[1383]: time=2026-09-25T16:33:34.965Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5441lb # [ 129.378481] niks3-server[1167]: 2026/09/25 16:33:34 INFO Received sign narinfos request method=POST path=/api/pushes/44/sign5442worker1 # [ 129.387016] nix-grpc-daemon[1383]: time=2026-09-25T16:33:34.980Z level=INFO msg="Uploading 1 narinfos"5443lb # [ 129.387250] niks3-server[1167]: 2026/09/25 16:33:34 INFO Signed narinfos id=44 count=15444lb # [ 129.391550] niks3-server[1167]: 2026/09/25 16:33:34 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5445lb # [ 129.401323] niks3-server[1167]: 2026/09/25 16:33:34 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5446lb # [ 129.408777] niks3-server[1167]: 2026/09/25 16:33:35 INFO Received complete push request method=POST path=/api/pushes/44/complete5447lb # [ 129.411576] niks3-server[1167]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5448worker1 # [ 129.419563] nix-grpc-daemon[1383]: time=2026-09-25T16:33:35.013Z level=INFO msg="Upload complete. (183ms)"5449worker1 # [ 129.425037] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=0 paths=1 nar_bytes_in=6405450worker1 # [ 129.434681] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545451worker1 # [ 129.442097] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5452worker1 # [ 129.443941] nix-daemon[855]: reaped child process 1533, status = succeeded5453client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5454client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5455worker1 # [ 129.453344] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5456client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5457client # farm-b> LOG-farm-b-on-standby5458worker1 # [ 130.119608] nix-daemon[855]: reaped child process 1542, status = succeeded5459worker1 # [ 130.177622] nix-daemon[855]: accepted connection from pid 1558, user nix-grpc-daemon (trusted)5460worker1 # [ 130.197136] nix-daemon[855]: reaped child process 1561, status = succeeded5461lb # [ 130.197189] niks3-server[1167]: 2026/09/25 16:33:35 INFO Received push request method=POST path=/api/pushes5462worker1 # [ 130.208497] nix-grpc-daemon[1383]: time=2026-09-25T16:33:35.800Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5463worker1 # [ 130.210102] nix-grpc-daemon[1383]: time=2026-09-25T16:33:35.800Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5464lb # [ 130.228373] niks3-server[1167]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5465worker1 # [ 130.238991] nix-grpc-daemon[1383]: time=2026-09-25T16:33:35.832Z level=INFO msg="Uploading 1 narinfos"5466lb # [ 130.237105] niks3-server[1167]: 2026/09/25 16:33:35 INFO Received sign narinfos request method=POST path=/api/pushes/45/sign5467lb # [ 130.239529] niks3-server[1167]: 2026/09/25 16:33:35 INFO Signed narinfos id=45 count=15468lb # [ 130.250579] niks3-server[1167]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5469worker1 # [ 130.259849] nix-grpc-daemon[1383]: time=2026-09-25T16:33:35.853Z level=INFO msg="Upload complete. (197ms)"5470lb # [ 130.256386] niks3-server[1167]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5471lb # [ 130.260872] niks3-server[1167]: 2026/09/25 16:33:35 INFO Received complete push request method=POST path=/api/pushes/45/complete5472lb # [ 130.263393] niks3-server[1167]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5473worker1 # [ 130.268600] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=0 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05474worker1 # [ 130.283200] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:35Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05475worker1 # [ 130.287241] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:35Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15476worker1 # [ 130.290772] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545477worker1 # [ 130.294606] nix-daemon[855]: reaped child process 1540, status = succeeded5478worker1 # [ 130.297312] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:597545479worker1 # [ 130.303030] nix-grpc-daemon[1383]: time=2026-09-25T16:33:35.897Z level=INFO msg="All 2 paths already cached"5480client # copying 1 paths to 'lb:50051'...5481client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5482worker1 # [ 130.308942] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:597545483worker1 # [ 130.316295] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5484worker1 # [ 130.427734] nix-daemon[855]: accepted connection from pid 1567, user nix-grpc-daemon (trusted)5485worker1 # [ 130.444440] nix-daemon[855]: reaped child process 1570, status = succeeded5486lb # [ 130.444610] niks3-server[1167]: 2026/09/25 16:33:36 INFO Received push request method=POST path=/api/pushes5487worker1 # [ 130.454602] nix-grpc-daemon[1383]: time=2026-09-25T16:33:36.048Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5488worker1 # [ 130.456221] nix-grpc-daemon[1383]: time=2026-09-25T16:33:36.048Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5489lb # [ 130.461150] niks3-server[1167]: 2026/09/25 16:33:36 INFO Received sign narinfos request method=POST path=/api/pushes/46/sign5490worker1 # [ 130.470220] nix-grpc-daemon[1383]: time=2026-09-25T16:33:36.064Z level=INFO msg="Uploading 1 narinfos"5491lb # [ 130.469828] niks3-server[1167]: 2026/09/25 16:33:36 INFO Signed narinfos id=46 count=15492lb # [ 130.474290] niks3-server[1167]: 2026/09/25 16:33:36 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5493lb # [ 130.483958] niks3-server[1167]: 2026/09/25 16:33:36 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5494lb # [ 130.486898] niks3-server[1167]: 2026/09/25 16:33:36 INFO Received complete push request method=POST path=/api/pushes/46/complete5495worker1 # [ 130.496618] nix-grpc-daemon[1383]: time=2026-09-25T16:33:36.090Z level=INFO msg="Upload complete. (171ms)"5496lb # [ 130.493010] niks3-server[1167]: 2026/09/25 16:33:36 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5497worker1 # [ 130.503683] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=0 paths=1 nar_bytes_in=7685498worker1 # [ 130.508530] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545499worker1 # [ 130.516095] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5500worker1 # [ 130.519807] nix-daemon[855]: reaped child process 1565, status = succeeded5501client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5502worker1 # [ 130.527932] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5503client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5504client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5505client # farm-top> LOG-farm-top-on-standby5506worker1 # [ 131.353016] nix-daemon[855]: reaped child process 1574, status = succeeded5507worker1 # [ 131.460423] nix-daemon[855]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)5508worker1 # [ 131.477889] nix-daemon[855]: reaped child process 1593, status = succeeded5509lb # [ 131.478367] niks3-server[1167]: 2026/09/25 16:33:37 INFO Received push request method=POST path=/api/pushes5510worker1 # [ 131.489563] nix-grpc-daemon[1383]: time=2026-09-25T16:33:37.082Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5511worker1 # [ 131.491077] nix-grpc-daemon[1383]: time=2026-09-25T16:33:37.082Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5512lb # [ 131.500423] niks3-server[1167]: 2026/09/25 16:33:37 INFO Received sign narinfos request method=POST path=/api/pushes/47/sign5513worker1 # [ 131.510140] nix-grpc-daemon[1383]: time=2026-09-25T16:33:37.103Z level=INFO msg="Uploading 1 narinfos"5514lb # [ 131.507831] niks3-server[1167]: 2026/09/25 16:33:37 INFO Signed narinfos id=47 count=15515lb # [ 131.513893] niks3-server[1167]: 2026/09/25 16:33:37 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5516lb # [ 131.520202] niks3-server[1167]: 2026/09/25 16:33:37 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5517lb # [ 131.528784] niks3-server[1167]: 2026/09/25 16:33:37 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5518lb # [ 131.531799] niks3-server[1167]: 2026/09/25 16:33:37 INFO Received complete push request method=POST path=/api/pushes/47/complete5519worker1 # [ 131.539826] nix-grpc-daemon[1383]: time=2026-09-25T16:33:37.133Z level=INFO msg="Upload complete. (203ms)"5520lb # [ 131.537138] niks3-server[1167]: 2026/09/25 16:33:37 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5521worker1 # [ 131.546988] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=05522worker1 # [ 131.559836] nix-daemon[855]: reaped child process 1572, status = succeeded5523client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2, in 4.30 seconds)5524client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath5525client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath, in 0.14 seconds)5526worker2 # [ 131.773999] systemd[1]: Starting scheduler-token.service...5527worker2 # [ 131.828462] systemd[1]: scheduler-token.service: Deactivated successfully.5528worker2 # [ 131.832282] systemd[1]: Finished scheduler-token.service.5529worker2 # [ 131.833504] systemd[1]: scheduler-token.service: Consumed 34ms CPU time over 57ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5530worker2 # [ 131.841107] systemd[1]: Starting Nix worker-protocol over gRPC...5531worker2 # [ 131.949984] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:37Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5532worker2 # [ 131.952581] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5533worker2 # [ 131.956497] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15534worker2 # [ 131.963088] nix-grpc-daemon[1351]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5535worker2 # [ 131.984161] nix-grpc-daemon[1351]: E0000 00:00:1790354017.558325 1351 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5536worker2 # [ 131.986612] nix-grpc-daemon[1351]: E0000 00:00:1790354017.560437 1351 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5537lb: must succeed: curl -sf localhost:9901/clusters5538worker2 # [ 132.011286] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:37Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket5539worker2 # [ 132.013701] nix-grpc-daemon[1351]: E0000 00:00:1790354017.568444 1391 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5540worker2 # [ 132.019031] nix-grpc-daemon[1351]: E0000 00:00:1790354017.591296 1391 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5541worker2 # [ 132.023442] nix-grpc-daemon[1351]: E0000 00:00:1790354017.591491 1391 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5542worker2 # [ 132.026366] nix-grpc-daemon[1351]: E0000 00:00:1790354017.607841 1391 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5543worker2 # [ 132.029022] systemd[1]: Started Nix worker-protocol over gRPC.5544worker2 # [ 132.029866] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:37Z level=info event=scheduler_connected addr=lb:500515545worker1 # [ 132.013814] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:37Z level=info event=oidc_jwks provider=mock keys=15546worker1 # [ 132.016283] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:37Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:416505547worker1 # [ 132.019097] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:37Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05548lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5549worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5550worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5551lb: must succeed: curl -sf localhost:9901/clusters5552lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5553lb: must succeed: curl -sf localhost:9901/clusters5554lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5555worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5556worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5557(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 9.60 seconds)5558subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5559client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs5560client # [ 132.224215] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs.5561client # Running as unit: rs.service; invocation ID: baed83a527824fec9b198fec9683278d5562client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs, in 0.05 seconds)5563client # [ 132.416508] nix[1360]: don't know how to build these paths:5564worker1 # [ 132.403957] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:597545565client # [ 132.417483] nix[1360]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5566worker1 # [ 132.412984] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:38Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05567worker1 # [ 132.416817] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:38Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15568worker1 # [ 132.422302] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545569worker1 # [ 132.428606] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:597545570client # [ 132.447758] nix[1360]: copying 1 paths to 'lb:50051'...5571worker1 # [ 132.436827] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:597545572client # [ 132.449384] nix[1360]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5573worker1 # [ 132.445660] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5574worker1 # [ 132.494856] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:38Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:517265575worker1 # [ 132.573424] nix-daemon[855]: accepted connection from pid 1606, user nix-grpc-daemon (trusted)5576lb # [ 132.587352] niks3-server[1167]: 2026/09/25 16:33:38 INFO Received push request method=POST path=/api/pushes5577worker1 # [ 132.594694] nix-daemon[855]: reaped child process 1609, status = succeeded5578worker1 # [ 132.598020] nix-grpc-daemon[1383]: time=2026-09-25T16:33:38.191Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5579worker1 # [ 132.599523] nix-grpc-daemon[1383]: time=2026-09-25T16:33:38.191Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5580lb # [ 132.604949] niks3-server[1167]: 2026/09/25 16:33:38 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5581worker1 # [ 132.618492] nix-grpc-daemon[1383]: time=2026-09-25T16:33:38.212Z level=INFO msg="Uploading 1 narinfos"5582lb # [ 132.610501] niks3-server[1167]: 2026/09/25 16:33:38 INFO Received sign narinfos request method=POST path=/api/pushes/48/sign5583lb # [ 132.616329] niks3-server[1167]: 2026/09/25 16:33:38 INFO Signed narinfos id=48 count=15584lb # [ 132.621013] niks3-server[1167]: 2026/09/25 16:33:38 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5585lb # [ 132.629506] niks3-server[1167]: 2026/09/25 16:33:38 INFO Received complete push request method=POST path=/api/pushes/48/complete5586worker1 # [ 132.643123] nix-grpc-daemon[1383]: time=2026-09-25T16:33:38.237Z level=INFO msg="Upload complete. (188ms)"5587lb # [ 132.638784] niks3-server[1167]: 2026/09/25 16:33:38 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5588worker1 # [ 132.650631] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=0 paths=1 nar_bytes_in=4165589worker1 # [ 132.662634] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:597545590worker1 # [ 132.667115] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5591worker1 # [ 132.671144] nix-daemon[855]: reaped child process 1604, status = succeeded5592client # [ 132.689461] nix[1360]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5593worker1 # [ 132.681167] nix-daemon[855]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5594lb: must succeed: curl -sf localhost:9901/clusters5595lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5596lb: must succeed: curl -sf localhost:9901/clusters5597lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5598lb: must succeed: curl -sf localhost:9901/clusters5599lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5600lb: must succeed: curl -sf localhost:9901/clusters5601lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5602worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5603worker2 # [ 134.794776] systemd-journald[272]: Received client request to rotate journal, rotating.5604worker2 # [ 134.805478] systemd-journald[272]: Vacuuming done, freed 0B of archived journals from /var/log/journal/da4148f4d62041de850c37b76da7b4a5.5605worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.05 seconds)5606worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5607worker1 # [ 134.821224] systemd[1]: Stopping Nix worker-protocol over gRPC...5608worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5609client: must succeed: sleep 5.05610worker1 # [ 135.663844] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:41Z level=info event=draining5611lb # [ 137.470148] envoy[894]: conn peer=[2001:db8:1::1]:34958 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9529 tx=4334 ms=41075612client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5613worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5614worker1 # [ 140.123833] nix-daemon[855]: reaped child process 1613, status = succeeded5615worker1 # [ 140.223890] nix-daemon[855]: accepted connection from pid 1654, user nix-grpc-daemon (trusted)5616worker1 # [ 140.239883] nix-daemon[855]: reaped child process 1657, status = succeeded5617lb # [ 140.241047] niks3-server[1167]: 2026/09/25 16:33:45 INFO Received push request method=POST path=/api/pushes5618worker1 # [ 140.252385] nix-grpc-daemon[1383]: time=2026-09-25T16:33:45.845Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5619worker1 # [ 140.253999] nix-grpc-daemon[1383]: time=2026-09-25T16:33:45.845Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5620lb # [ 140.275505] niks3-server[1167]: 2026/09/25 16:33:45 INFO Received sign narinfos request method=POST path=/api/pushes/49/sign5621worker1 # [ 140.284559] nix-grpc-daemon[1383]: time=2026-09-25T16:33:45.878Z level=INFO msg="Uploading 1 narinfos"5622lb # [ 140.282723] niks3-server[1167]: 2026/09/25 16:33:45 INFO Signed narinfos id=49 count=15623lb # [ 140.288228] niks3-server[1167]: 2026/09/25 16:33:45 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5624lb # [ 140.290944] niks3-server[1167]: 2026/09/25 16:33:45 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5625lb # [ 140.300206] niks3-server[1167]: 2026/09/25 16:33:45 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5626lb # [ 140.308909] niks3-server[1167]: 2026/09/25 16:33:45 INFO Received complete push request method=POST path=/api/pushes/49/complete5627worker1 # [ 140.318451] nix-grpc-daemon[1383]: time=2026-09-25T16:33:45.912Z level=INFO msg="Upload complete. (223ms)"5628lb # [ 140.314399] niks3-server[1167]: 2026/09/25 16:33:45 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5629worker1 # [ 140.328633] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59754 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05630worker1 # [ 140.338267] nix-daemon[855]: reaped child process 1611, status = succeeded5631client # [ 140.358936] systemd[1]: rs.service: Deactivated successfully.5632client # [ 140.361417] systemd[1]: rs.service: Consumed 179ms CPU time over 8.137s wall clock time, 41.2M memory peak, 7.1K incoming IP traffic, 8.2K outgoing IP traffic.5633worker1 # [ 140.665014] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:46Z level=info event=signal_exit5634lb # [ 140.862914] niks3-server[1167]: 2026/09/25 16:33:46 INFO lead: released remote=192.168.1.3:537165635worker1 # [ 141.863996] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:47Z level=info event=scheduler_restarting5636lb # [ 141.859404] envoy[894]: [2026-09-25 16:33:47.465][894][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream}5637worker1 # [ 141.869743] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:47Z level=info event=scheduler_restarting addr=lb:500515638worker2 # [ 141.886161] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:47Z level=info event=scheduler_restarting addr=lb:500515639worker1 # [ 141.875374] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:416505640worker1 # [ 141.878643] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:47Z level=info event=worker_gone addr=192.168.1.3:500515641worker1 # [ 141.881010] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:416505642worker1 # [ 141.883301] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:47Z level=info event=worker_gone addr=192.168.1.4:500515643worker1 # [ 141.899487] nix-daemon[855]: reaped child process 1373, status = succeeded5644lb # [ 141.960001] niks3-server[1167]: 2026/09/25 16:33:47 INFO lead: acquired remote=192.168.1.4:378485645worker2 # [ 141.982634] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:47Z level=info event=scheduler_take_over5646worker2 # [ 142.086338] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:47Z level=info event=scheduler_connected addr=lb:500515647worker2 # [ 142.089319] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5648worker1 # [ 142.084354] nix-grpc-daemon[1321]: ts=2026-09-25T16:33:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5649worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.10 seconds)5650client: waiting for success: ! systemctl is-active rs5651client: (finished: waiting for success: ! systemctl is-active rs, in 0.03 seconds)5652client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5653client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5654client: must fail: journalctl -u rs | grep -q 'reconnecting'5655client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5656lb: must succeed: curl -sf localhost:9901/clusters5657worker2 # [ 142.290177] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:47Z level=info event=scheduler_connected addr=lb:500515658lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5659worker2 # [ 142.293132] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5660worker2 # [ 142.493871] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:48Z level=info event=scheduler_connected addr=lb:500515661worker2 # [ 142.496695] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5662worker2 # [ 142.697553] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:48Z level=info event=scheduler_connected addr=lb:500515663worker2 # [ 142.700364] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5664worker2 # [ 142.902846] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:48Z level=info event=scheduler_connected addr=lb:500515665worker2 # [ 142.910778] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:48Z level=info event=oidc_jwks provider=mock keys=15666worker2 # [ 142.913227] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:48Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:500925667worker2 # [ 142.915952] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:48Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05668lb: must succeed: curl -sf localhost:9901/clusters5669lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5670worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5671worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)5672worker2 # [ 143.788981] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:49Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:500985673worker1 # [ 144.101497] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5674worker1 # [ 144.102503] systemd[1]: Stopped Nix worker-protocol over gRPC.5675worker1 # [ 144.102822] systemd[1]: nix-grpc-daemon.service: Consumed 1.986s CPU time over 30.581s wall clock time, 46.5M memory peak, 305.8K incoming IP traffic, 221.5K outgoing IP traffic.5676worker1 # [ 144.118040] systemd[1]: Starting Nix worker-protocol over gRPC...5677worker1 # [ 144.232949] nix-grpc-daemon[1665]: ts=2026-09-25T16:33:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5678worker1 # [ 144.235051] nix-grpc-daemon[1665]: ts=2026-09-25T16:33:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5679worker1 # [ 144.239144] nix-grpc-daemon[1665]: ts=2026-09-25T16:33:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15680worker1 # [ 144.244052] nix-grpc-daemon[1665]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5681worker1 # [ 144.245600] nix-grpc-daemon[1665]: E0000 00:00:1790354029.837559 1665 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5682worker1 # [ 144.249762] nix-grpc-daemon[1665]: E0000 00:00:1790354029.843654 1665 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5683worker1 # [ 144.288990] nix-grpc-daemon[1665]: ts=2026-09-25T16:33:49Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket5684worker1 # [ 144.290808] nix-grpc-daemon[1665]: E0000 00:00:1790354029.851789 1708 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5685worker1 # [ 144.296164] nix-grpc-daemon[1665]: E0000 00:00:1790354029.867361 1708 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5686worker1 # [ 144.298529] nix-grpc-daemon[1665]: E0000 00:00:1790354029.867511 1708 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5687worker1 # [ 144.301330] nix-grpc-daemon[1665]: E0000 00:00:1790354029.881922 1708 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5688worker1 # [ 144.305446] systemd[1]: Started Nix worker-protocol over gRPC.5689worker1 # [ 144.306410] nix-grpc-daemon[1665]: ts=2026-09-25T16:33:49Z level=info event=scheduler_connected addr=lb:500515690worker2 # [ 144.322098] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:49Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:500925691worker2 # [ 144.325665] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05692lb: must succeed: curl -sf localhost:9901/clusters5693lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5694worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5695worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5696(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.24 seconds)5697subtest: scheduler restart mid-build: build finishes, no double build5698client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid5699client # [ 144.466156] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid.5700client # Running as unit: mid.service; invocation ID: b6e5e85d37304e4c88e1ae08139b34405701client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid, in 0.05 seconds)5702worker2 # [ 144.652943] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:501145703worker2 # [ 144.661358] nix-daemon[840]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5704client # [ 144.667055] nix[1396]: don't know how to build these paths:5705client # [ 144.669275] nix[1396]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5706worker2 # [ 144.678921] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:50Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05707worker2 # [ 144.686499] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:50Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15708worker2 # [ 144.691887] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:501145709worker2 # [ 144.695029] nix-grpc-daemon[1351]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 1/5)5710worker2 # [ 144.758343] nix-grpc-daemon[1351]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 2/5)5711worker2 # [ 144.798229] nix-grpc-daemon[1351]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 283 ms (attempt 3/5)5712worker2 # [ 145.082358] nix-grpc-daemon[1351]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 293 ms (attempt 4/5)5713worker2 # [ 145.377762] nix-grpc-daemon[1351]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5714worker2 # [ 145.379700] nix-grpc-daemon[1351]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5715worker2 # [ 145.391994] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:501145716client # [ 145.395891] nix[1396]: copying 1 paths to 'lb:50051'...5717worker2 # [ 145.400387] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:501145718client # [ 145.396295] nix[1396]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5719worker2 # [ 145.408421] nix-daemon[840]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5720worker2 # [ 145.431195] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:51Z level=info event=niks3_push_started pid=14735721worker2 # [ 145.548584] nix-grpc-daemon[1473]: time=2026-09-25T16:33:51.145Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""5722worker2 # [ 145.661158] nix-daemon[840]: accepted connection from pid 1485, user nix-grpc-daemon (trusted)5723lb # [ 145.664268] niks3-server[1167]: 2026/09/25 16:33:51 INFO Received push request method=POST path=/api/pushes5724worker2 # [ 145.695456] nix-daemon[840]: reaped child process 1491, status = succeeded5725worker2 # [ 145.700182] nix-grpc-daemon[1473]: time=2026-09-25T16:33:51.288Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5726worker2 # [ 145.701733] nix-grpc-daemon[1473]: time=2026-09-25T16:33:51.288Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5727lb # [ 145.692250] niks3-server[1167]: 2026/09/25 16:33:51 INFO Received sign narinfos request method=POST path=/api/pushes/50/sign5728lb # [ 145.702364] niks3-server[1167]: 2026/09/25 16:33:51 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5729lb # [ 145.710781] niks3-server[1167]: 2026/09/25 16:33:51 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5730lb # [ 145.718029] niks3-server[1167]: 2026/09/25 16:33:51 INFO Signed narinfos id=50 count=15731worker2 # [ 145.738561] nix-grpc-daemon[1473]: time=2026-09-25T16:33:51.335Z level=INFO msg="Uploading 1 narinfos"5732lb # [ 145.728239] niks3-server[1167]: 2026/09/25 16:33:51 INFO Received complete push request method=POST path=/api/pushes/50/complete5733worker2 # [ 145.756909] nix-grpc-daemon[1473]: time=2026-09-25T16:33:51.354Z level=INFO msg="Upload complete. (204ms)"5734worker2 # [ 145.762466] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50114 duration_s=0 paths=1 nar_bytes_in=4245735lb # [ 145.742721] niks3-server[1167]: 2026/09/25 16:33:51 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5736worker2 # [ 145.771406] nix-grpc-daemon[1351]: ts=2026-09-25T16:33:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:501145737worker2 # [ 145.774168] nix-daemon[840]: reaped child process 1471, status = succeeded5738worker2 # [ 145.778778] nix-daemon[840]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5739client # [ 145.781777] nix[1396]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5740worker2 # [ 145.788235] nix-daemon[840]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5741lb: must succeed: curl -sf localhost:9901/clusters5742lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5743lb: must succeed: curl -sf localhost:9901/clusters5744lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5745worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5746worker2 # [ 147.009100] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1351 (nix-grpc-daemon) on client request.5747worker2 # [ 147.010665] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5748lb # [ 147.006631] niks3-server[1167]: 2026/09/25 16:33:52 INFO lead: released remote=192.168.1.4:378485749client # [ 147.026768] nix[1396]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5750lb # [ 147.010252] envoy[894]: [2026-09-25 16:33:52.612][894][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 13, upstream_reset_after_response_started{connection_termination}5751worker1 # [ 147.016105] nix-grpc-daemon[1665]: ts=2026-09-25T16:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5752worker2 # [ 147.035553] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5753client # [ 147.030375] nix[1396]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5754worker2 # [ 147.043480] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5755worker2 # [ 147.055646] systemd[1]: nix-grpc-daemon.service: Consumed 439ms CPU time over 15.191s wall clock time, 35M memory peak, 217.2K incoming IP traffic, 56.6K outgoing IP traffic.5756worker2 # [ 147.060236] systemd[1]: Starting scheduler-token.service...5757worker2 # [ 147.086108] nix-daemon[840]: reaped child process 1494, status = succeeded5758worker2 # [ 147.087086] nix-daemon[840]: reaped child process 1463, status = succeeded5759worker2 # [ 147.092401] nix-daemon[1496]: unexpected Nix daemon error: error: interrupted by the user5760worker2 # [ 147.099332] nix-daemon[840]: reaped child process 1496, status = failed with exit code 15761worker2 # [ 147.120343] systemd[1]: scheduler-token.service: Deactivated successfully.5762worker2 # [ 147.122802] systemd[1]: Finished scheduler-token.service.5763worker2 # [ 147.123603] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 74ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5764worker2 # [ 147.132142] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.5765worker2 # [ 147.133752] systemd[1]: Starting scheduler-token.service...5766worker2 # [ 147.167211] systemd[1]: scheduler-token.service: Deactivated successfully.5767worker2 # [ 147.171191] systemd[1]: Finished scheduler-token.service.5768worker2 # [ 147.171977] systemd[1]: scheduler-token.service: Consumed 21ms CPU time over 40ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5769worker2 # [ 147.175233] systemd[1]: Starting Nix worker-protocol over gRPC...5770worker1 # [ 147.216341] nix-grpc-daemon[1665]: ts=2026-09-25T16:33:52Z level=info event=scheduler_connected addr=lb:500515771worker2 # [ 147.267674] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5772worker2 # [ 147.270107] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5773worker2 # [ 147.273825] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15774worker2 # [ 147.279017] nix-grpc-daemon[1535]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5775worker2 # [ 147.281811] nix-grpc-daemon[1535]: E0000 00:00:1790354032.875593 1535 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5776lb # [ 147.270255] niks3-server[1167]: 2026/09/25 16:33:52 INFO lead: acquired remote=192.168.1.4:548765777worker2 # [ 147.304078] nix-grpc-daemon[1535]: E0000 00:00:1790354032.879102 1535 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5778worker2 # [ 147.306436] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket5779worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.34 seconds)5780client: must succeed: sleep 5.05781worker2 # [ 147.332191] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=scheduler_take_over5782worker2 # [ 147.333824] nix-grpc-daemon[1535]: E0000 00:00:1790354032.888809 1576 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5783worker2 # [ 147.338983] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:501365784worker2 # [ 147.343434] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05785worker2 # [ 147.346077] systemd[1]: Started Nix worker-protocol over gRPC.5786worker2 # [ 147.347774] nix-grpc-daemon[1535]: E0000 00:00:1790354032.914362 1576 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5787worker2 # [ 147.352119] nix-grpc-daemon[1535]: E0000 00:00:1790354032.914495 1576 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5788worker2 # [ 147.354546] nix-grpc-daemon[1535]: E0000 00:00:1790354032.928953 1576 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5789worker2 # [ 147.356977] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=scheduler_connected addr=lb:500515790worker2 # [ 147.358272] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=oidc_jwks provider=mock keys=15791worker2 # [ 147.359512] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:501365792worker2 # [ 147.361311] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05793worker2 # [ 147.450007] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:53Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:501445794lb # [ 147.470955] envoy[894]: conn peer=[2001:db8:1::1]:49744 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1519 ms=79315795lb # [ 147.473775] envoy[894]: conn peer=[2001:db8:1::3]:45642 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3159 tx=1169 ms=283725796lb # [ 147.476348] envoy[894]: conn peer=[2001:db8:1::4]:58444 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4992 tx=500 ms=150165797worker2 # [ 147.537763] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:53Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05798worker2 # [ 147.541226] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:53Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15799worker1 # [ 147.532088] nix-grpc-daemon[1665]: ts=2026-09-25T16:33:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492965800worker1 # [ 147.540881] nix-daemon[855]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)5801worker1 # [ 147.554383] nix-grpc-daemon[1665]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5)5802worker1 # [ 147.658344] nix-grpc-daemon[1665]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 2/5)5803worker1 # [ 147.714212] nix-grpc-daemon[1665]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 180 ms (attempt 3/5)5804worker1 # [ 147.901534] nix-grpc-daemon[1665]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 4/5)5805worker1 # [ 147.932675] nix-grpc-daemon[1665]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5806worker1 # [ 147.936119] nix-grpc-daemon[1665]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5807worker1 # [ 147.944748] nix-grpc-daemon[1665]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5808worker1 # [ 147.960367] nix-daemon[855]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)5809client # [ 147.980334] nix[1396]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5810worker1 # [ 147.970614] nix-daemon[855]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)5811client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5812client: waiting for success: ! systemctl is-active mid5813worker1 # [ 152.593324] nix-grpc-daemon[1665]: ts=2026-09-25T16:33:58Z level=info event=niks3_push_started pid=17675814worker1 # [ 152.626040] nix-daemon[855]: reaped child process 1742, status = succeeded5815worker1 # [ 152.737389] nix-grpc-daemon[1767]: time=2026-09-25T16:33:58.330Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""5816worker1 # [ 152.836104] nix-daemon[855]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)5817worker1 # [ 152.851657] nix-daemon[855]: reaped child process 1782, status = succeeded5818lb # [ 152.854071] niks3-server[1167]: 2026/09/25 16:33:58 INFO Received push request method=POST path=/api/pushes5819worker1 # [ 152.866878] nix-grpc-daemon[1767]: time=2026-09-25T16:33:58.458Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5820worker1 # [ 152.870507] nix-grpc-daemon[1767]: time=2026-09-25T16:33:58.459Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5821lb # [ 152.885650] niks3-server[1167]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5822lb # [ 152.898783] niks3-server[1167]: 2026/09/25 16:33:58 INFO Received sign narinfos request method=POST path=/api/pushes/51/sign5823lb # [ 152.908148] niks3-server[1167]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5824lb # [ 152.920473] niks3-server[1167]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5825lb # [ 152.925492] niks3-server[1167]: 2026/09/25 16:33:58 INFO Signed narinfos id=51 count=15826worker1 # [ 152.931288] nix-grpc-daemon[1767]: time=2026-09-25T16:33:58.524Z level=INFO msg="Uploading 1 narinfos"5827lb # [ 152.935664] niks3-server[1167]: 2026/09/25 16:33:58 INFO Received complete push request method=POST path=/api/pushes/51/complete5828worker1 # [ 152.946913] nix-grpc-daemon[1767]: time=2026-09-25T16:33:58.540Z level=INFO msg="Upload complete. (205ms)"5829lb # [ 152.950283] niks3-server[1167]: 2026/09/25 16:33:58 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5830worker1 # [ 152.955189] nix-grpc-daemon[1665]: ts=2026-09-25T16:33:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49296 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05831worker1 # [ 152.965964] nix-daemon[855]: reaped child process 1740, status = succeeded5832client # [ 152.987012] systemd[1]: mid.service: Deactivated successfully.5833client # [ 152.989383] systemd[1]: mid.service: Consumed 171ms CPU time over 8.523s wall clock time, 39.5M memory peak, 8.9K incoming IP traffic, 10.5K outgoing IP traffic.5834client: (finished: waiting for success: ! systemctl is-active mid, in 1.07 seconds)5835client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5836client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5837(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.19 seconds)5838subtest: interrupting the client stops the build on the worker5839client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr5840client # [ 153.655163] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr.5841client # Running as unit: intr.service; invocation ID: f87f02f92bf948d594b657becf6d783b5842client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr, in 0.04 seconds)5843worker2 # [ 153.820417] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:454265844worker2 # [ 153.828520] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5845client # [ 153.833676] nix[1432]: don't know how to build these paths:5846client # [ 153.834691] nix[1432]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5847worker2 # [ 153.847843] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:59Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05848worker2 # [ 153.851785] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:59Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15849worker2 # [ 153.861387] nix-grpc-daemon[1535]: ts=2026-09-25T16:33:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454265850worker2 # [ 153.864104] nix-grpc-daemon[1535]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 1/5)5851worker2 # [ 153.909512] nix-grpc-daemon[1535]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 147 ms (attempt 2/5)5852worker2 # [ 154.057588] nix-grpc-daemon[1535]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 390 ms (attempt 3/5)5853worker2 # [ 154.448613] nix-grpc-daemon[1535]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 725 ms (attempt 4/5)5854worker2 # [ 155.175721] nix-grpc-daemon[1535]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5855worker2 # [ 155.178883] nix-grpc-daemon[1535]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5856worker2 # [ 155.190687] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454265857client # [ 155.194141] nix[1432]: copying 1 paths to 'lb:50051'...5858client # [ 155.196520] nix[1432]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5859worker2 # [ 155.200779] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454265860worker2 # [ 155.210427] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5861worker2 # [ 155.225580] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:00Z level=info event=niks3_push_started pid=16155862worker2 # [ 155.349043] nix-grpc-daemon[1615]: time=2026-09-25T16:34:00.946Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""5863worker2 # [ 155.449498] nix-daemon[840]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5864lb # [ 155.446264] niks3-server[1167]: 2026/09/25 16:34:01 INFO Received push request method=POST path=/api/pushes5865worker2 # [ 155.468999] nix-daemon[840]: reaped child process 1630, status = succeeded5866worker2 # [ 155.475554] nix-grpc-daemon[1615]: time=2026-09-25T16:34:01.071Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5867worker2 # [ 155.479660] nix-grpc-daemon[1615]: time=2026-09-25T16:34:01.071Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5868lb # [ 155.477498] niks3-server[1167]: 2026/09/25 16:34:01 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5869worker2 # [ 155.503103] nix-grpc-daemon[1615]: time=2026-09-25T16:34:01.099Z level=INFO msg="Uploading 1 narinfos"5870lb # [ 155.485562] niks3-server[1167]: 2026/09/25 16:34:01 INFO Received sign narinfos request method=POST path=/api/pushes/52/sign5871lb # [ 155.488003] niks3-server[1167]: 2026/09/25 16:34:01 INFO Signed narinfos id=52 count=15872lb # [ 155.494988] niks3-server[1167]: 2026/09/25 16:34:01 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5873lb # [ 155.506094] niks3-server[1167]: 2026/09/25 16:34:01 INFO Received complete push request method=POST path=/api/pushes/52/complete5874lb # [ 155.511881] niks3-server[1167]: 2026/09/25 16:34:01 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5875worker2 # [ 155.536751] nix-grpc-daemon[1615]: time=2026-09-25T16:34:01.134Z level=INFO msg="Upload complete. (184ms)"5876worker2 # [ 155.543168] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=0 paths=1 nar_bytes_in=4245877worker2 # [ 155.554019] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454265878worker2 # [ 155.558812] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5879worker2 # [ 155.562600] nix-daemon[840]: reaped child process 1613, status = succeeded5880client # [ 155.565368] nix[1432]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5881worker2 # [ 155.571079] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5882client: must succeed: systemctl kill -s INT intr5883client # [ 157.037975] systemd[1]: intr.service: Sent signal SIGINT to main process 1432 (nix) on client request.5884worker2 # [ 157.045395] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:02Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5885client # [ 157.043435] nix[1432]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5886client # [ 157.050722] nix[1432]: error: interrupted by the user5887client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds)5888client # [ 157.068174] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5889client # [ 157.072481] systemd[1]: intr.service: Failed with result 'exit-code'.5890client # [ 157.074360] systemd[1]: intr.service: Consumed 150ms CPU time over 3.415s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic.5891worker2 # [ 157.195165] nix-daemon[1634]: unexpected Nix daemon error: error: interrupted by the user5892worker2 # [ 157.201104] nix-daemon[840]: reaped child process 1632, status = succeeded5893worker2 # [ 157.204763] nix-daemon[840]: reaped child process 1634, status = failed with exit code 15894lb # [ 157.470141] envoy[894]: conn peer=[2001:db8:1::1]:57648 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3940 tx=1988 ms=83355895lb # [ 157.472886] envoy[894]: conn peer=[2001:db8:1::1]:53524 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3000 tx=828 ms=32455896(finished: subtest: interrupting the client stops the build on the worker, in 4.59 seconds)5897subtest: a deploy mid-build drains: the build finishes, the new generation takes over5898client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw5899client # [ 158.254699] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw.5900client # Running as unit: sw.service; invocation ID: fcc4c8725eb548a5b6b11838c5f395055901client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw, in 0.05 seconds)5902worker1 # [ 158.417240] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492965903client # [ 158.433446] nix[1453]: don't know how to build these paths:5904client # [ 158.434396] nix[1453]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5905worker2 # [ 158.444566] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:04Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05906worker1 # [ 158.430519] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492965907worker2 # [ 158.447568] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:04Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15908worker1 # [ 158.440287] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492965909client # [ 158.458833] nix[1453]: copying 1 paths to 'lb:50051'...5910client # [ 158.460055] nix[1453]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5911worker1 # [ 158.448220] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492965912worker1 # [ 158.456709] nix-daemon[855]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)5913worker1 # [ 158.582111] nix-daemon[855]: accepted connection from pid 1814, user nix-grpc-daemon (trusted)5914lb # [ 158.593658] niks3-server[1167]: 2026/09/25 16:34:04 INFO Received push request method=POST path=/api/pushes5915worker1 # [ 158.601474] nix-daemon[855]: reaped child process 1817, status = succeeded5916worker1 # [ 158.604358] nix-grpc-daemon[1767]: time=2026-09-25T16:34:04.197Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5917worker1 # [ 158.605917] nix-grpc-daemon[1767]: time=2026-09-25T16:34:04.197Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5918lb # [ 158.612058] niks3-server[1167]: 2026/09/25 16:34:04 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5919worker1 # [ 158.624940] nix-grpc-daemon[1767]: time=2026-09-25T16:34:04.218Z level=INFO msg="Uploading 1 narinfos"5920lb # [ 158.620227] niks3-server[1167]: 2026/09/25 16:34:04 INFO Received sign narinfos request method=POST path=/api/pushes/53/sign5921lb # [ 158.626600] niks3-server[1167]: 2026/09/25 16:34:04 INFO Signed narinfos id=53 count=15922lb # [ 158.630772] niks3-server[1167]: 2026/09/25 16:34:04 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5923lb # [ 158.640436] niks3-server[1167]: 2026/09/25 16:34:04 INFO Received complete push request method=POST path=/api/pushes/53/complete5924lb # [ 158.645724] niks3-server[1167]: 2026/09/25 16:34:04 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5925worker1 # [ 158.656110] nix-grpc-daemon[1767]: time=2026-09-25T16:34:04.250Z level=INFO msg="Upload complete. (190ms)"5926worker1 # [ 158.664092] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49296 duration_s=0 paths=1 nar_bytes_in=4165927worker1 # [ 158.667364] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492965928worker1 # [ 158.677085] nix-daemon[855]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)5929worker1 # [ 158.681862] nix-daemon[855]: reaped child process 1812, status = succeeded5930client # [ 158.700469] nix[1453]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5931worker1 # [ 158.692799] nix-daemon[855]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)5932worker1: must succeed: systemctl reload nix-grpc-daemon.service5933worker1 # [ 160.647786] systemd[1]: Reloading Nix worker-protocol over gRPC...5934worker1 # [ 160.681636] systemd[1]: Reloaded Nix worker-protocol over gRPC.5935worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.08 seconds)5936worker1: must succeed: pgrep -f 'read -t [9]0 x'5937worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds)5938client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&25939worker2 # [ 160.918386] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:454265940client # don't know how to build these paths:5941client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5942worker1 # [ 160.912567] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492965943worker2 # [ 160.943165] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:06Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05944worker2 # [ 160.949172] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:06Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15945worker2 # [ 160.954158] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454265946worker2 # [ 160.958990] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454265947client # copying 1 paths to 'lb:50051'...5948worker2 # [ 160.967542] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454265949client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5950worker2 # [ 160.980821] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5951worker2 # [ 161.108680] nix-daemon[840]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)5952worker2 # [ 161.126186] nix-daemon[840]: reaped child process 1692, status = succeeded5953lb # [ 161.109931] niks3-server[1167]: 2026/09/25 16:34:06 INFO Received push request method=POST path=/api/pushes5954worker2 # [ 161.138842] nix-grpc-daemon[1615]: time=2026-09-25T16:34:06.735Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5955worker2 # [ 161.140491] nix-grpc-daemon[1615]: time=2026-09-25T16:34:06.735Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5956lb # [ 161.132138] niks3-server[1167]: 2026/09/25 16:34:06 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5957worker2 # [ 161.157453] nix-grpc-daemon[1615]: time=2026-09-25T16:34:06.754Z level=INFO msg="Uploading 1 narinfos"5958lb # [ 161.138141] niks3-server[1167]: 2026/09/25 16:34:06 INFO Received sign narinfos request method=POST path=/api/pushes/54/sign5959lb # [ 161.144312] niks3-server[1167]: 2026/09/25 16:34:06 INFO Signed narinfos id=54 count=15960lb # [ 161.148665] niks3-server[1167]: 2026/09/25 16:34:06 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5961lb # [ 161.164574] niks3-server[1167]: 2026/09/25 16:34:06 INFO Received complete push request method=POST path=/api/pushes/54/complete5962worker2 # [ 161.191096] nix-grpc-daemon[1615]: time=2026-09-25T16:34:06.788Z level=INFO msg="Upload complete. (201ms)"5963lb # [ 161.171153] niks3-server[1167]: 2026/09/25 16:34:06 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5964worker2 # [ 161.197840] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=0 paths=1 nar_bytes_in=5285965worker2 # [ 161.206804] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454265966worker2 # [ 161.213970] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5967worker2 # [ 161.216531] nix-daemon[840]: reaped child process 1687, status = succeeded5968client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5969client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5970worker2 # [ 161.226799] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5971worker1 # [ 161.258469] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:06Z level=info event=draining5972client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5973client # farm-a> LOG-farm-a-during-drain5974worker2 # [ 162.268436] nix-daemon[840]: reaped child process 1696, status = succeeded5975worker2 # [ 162.372187] nix-daemon[840]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)5976worker2 # [ 162.391267] nix-daemon[840]: reaped child process 1715, status = succeeded5977lb # [ 162.374515] niks3-server[1167]: 2026/09/25 16:34:07 INFO Received push request method=POST path=/api/pushes5978worker2 # [ 162.403050] nix-grpc-daemon[1615]: time=2026-09-25T16:34:07.997Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5979worker2 # [ 162.405779] nix-grpc-daemon[1615]: time=2026-09-25T16:34:07.997Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5980lb # [ 162.393659] niks3-server[1167]: 2026/09/25 16:34:08 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5981lb # [ 162.402382] niks3-server[1167]: 2026/09/25 16:34:08 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5982worker2 # [ 162.428023] nix-grpc-daemon[1615]: time=2026-09-25T16:34:08.025Z level=INFO msg="Uploading 1 narinfos"5983lb # [ 162.408672] niks3-server[1167]: 2026/09/25 16:34:08 INFO Received sign narinfos request method=POST path=/api/pushes/55/sign5984lb # [ 162.411043] niks3-server[1167]: 2026/09/25 16:34:08 INFO Signed narinfos id=55 count=15985lb # [ 162.420137] niks3-server[1167]: 2026/09/25 16:34:08 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5986lb # [ 162.428526] niks3-server[1167]: 2026/09/25 16:34:08 INFO Received complete push request method=POST path=/api/pushes/55/complete5987worker2 # [ 162.452384] nix-grpc-daemon[1615]: time=2026-09-25T16:34:08.049Z level=INFO msg="Upload complete. (215ms)"5988lb # [ 162.433360] niks3-server[1167]: 2026/09/25 16:34:08 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5989worker2 # [ 162.461868] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05990worker2 # [ 162.475186] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:08Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05991worker2 # [ 162.479413] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:08Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15992worker2 # [ 162.483986] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454265993worker2 # [ 162.488189] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454265994worker2 # [ 162.491809] nix-daemon[840]: reaped child process 1694, status = succeeded5995worker2 # [ 162.493878] nix-grpc-daemon[1615]: time=2026-09-25T16:34:08.091Z level=INFO msg="All 1 paths already cached"5996client # copying 1 paths to 'lb:50051'...5997worker2 # [ 162.499950] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454265998client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5999worker2 # [ 162.513097] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6000worker2 # [ 162.626050] nix-daemon[840]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6001lb # [ 162.623152] niks3-server[1167]: 2026/09/25 16:34:08 INFO Received push request method=POST path=/api/pushes6002worker2 # [ 162.645042] nix-daemon[840]: reaped child process 1724, status = succeeded6003worker2 # [ 162.648067] nix-grpc-daemon[1615]: time=2026-09-25T16:34:08.245Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6004worker2 # [ 162.649566] nix-grpc-daemon[1615]: time=2026-09-25T16:34:08.245Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"6005lb # [ 162.640365] niks3-server[1167]: 2026/09/25 16:34:08 INFO Received sign narinfos request method=POST path=/api/pushes/56/sign6006worker2 # [ 162.664870] nix-grpc-daemon[1615]: time=2026-09-25T16:34:08.262Z level=INFO msg="Uploading 1 narinfos"6007lb # [ 162.648338] niks3-server[1167]: 2026/09/25 16:34:08 INFO Signed narinfos id=56 count=16008lb # [ 162.652858] niks3-server[1167]: 2026/09/25 16:34:08 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst6009lb # [ 162.663284] niks3-server[1167]: 2026/09/25 16:34:08 INFO Received complete push request method=POST path=/api/pushes/56/complete6010lb # [ 162.668051] niks3-server[1167]: 2026/09/25 16:34:08 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls6011worker2 # [ 162.691108] nix-grpc-daemon[1615]: time=2026-09-25T16:34:08.288Z level=INFO msg="Upload complete. (169ms)"6012lb # [ 162.671831] niks3-server[1167]: 2026/09/25 16:34:08 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo6013worker2 # [ 162.697510] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=0 paths=1 nar_bytes_in=6406014worker2 # [ 162.706321] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266015worker2 # [ 162.713254] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6016worker2 # [ 162.715463] nix-daemon[840]: reaped child process 1719, status = succeeded6017client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...6018worker2 # [ 162.723767] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6019client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6020client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6021client # farm-b> LOG-farm-b-during-drain6022worker2 # [ 163.550490] nix-daemon[840]: reaped child process 1728, status = succeeded6023worker2 # [ 163.659390] nix-daemon[840]: accepted connection from pid 1744, user nix-grpc-daemon (trusted)6024worker2 # [ 163.678532] nix-daemon[840]: reaped child process 1747, status = succeeded6025lb # [ 163.661391] niks3-server[1167]: 2026/09/25 16:34:09 INFO Received push request method=POST path=/api/pushes6026worker2 # [ 163.688908] nix-grpc-daemon[1615]: time=2026-09-25T16:34:09.285Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6027worker2 # [ 163.690428] nix-grpc-daemon[1615]: time=2026-09-25T16:34:09.285Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"6028lb # [ 163.692469] niks3-server[1167]: 2026/09/25 16:34:09 INFO Received sign narinfos request method=POST path=/api/pushes/57/sign6029worker2 # [ 163.718188] nix-grpc-daemon[1615]: time=2026-09-25T16:34:09.315Z level=INFO msg="Uploading 1 narinfos"6030lb # [ 163.700805] niks3-server[1167]: 2026/09/25 16:34:09 INFO Signed narinfos id=57 count=16031lb # [ 163.706341] niks3-server[1167]: 2026/09/25 16:34:09 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls6032lb # [ 163.711729] niks3-server[1167]: 2026/09/25 16:34:09 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst6033lb # [ 163.721997] niks3-server[1167]: 2026/09/25 16:34:09 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6034lb # [ 163.725401] niks3-server[1167]: 2026/09/25 16:34:09 INFO Received complete push request method=POST path=/api/pushes/57/complete6035worker2 # [ 163.749270] nix-grpc-daemon[1615]: time=2026-09-25T16:34:09.346Z level=INFO msg="Upload complete. (216ms)"6036lb # [ 163.729651] niks3-server[1167]: 2026/09/25 16:34:09 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo6037worker2 # [ 163.757535] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=06038worker2 # [ 163.772352] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:09Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=06039worker2 # [ 163.775190] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:09Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=16040worker2 # [ 163.779735] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266041worker2 # [ 163.784046] nix-daemon[840]: reaped child process 1726, status = succeeded6042worker2 # [ 163.786209] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454266043worker2 # [ 163.793676] nix-grpc-daemon[1615]: time=2026-09-25T16:34:09.391Z level=INFO msg="All 2 paths already cached"6044client # copying 1 paths to 'lb:50051'...6045client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...6046worker2 # [ 163.800263] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454266047worker2 # [ 163.809278] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6048worker2 # [ 163.920099] nix-daemon[840]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)6049worker2 # [ 163.938942] nix-daemon[840]: reaped child process 1756, status = succeeded6050lb # [ 163.919389] niks3-server[1167]: 2026/09/25 16:34:09 INFO Received push request method=POST path=/api/pushes6051worker2 # [ 163.944702] nix-grpc-daemon[1615]: time=2026-09-25T16:34:09.541Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6052worker2 # [ 163.946203] nix-grpc-daemon[1615]: time=2026-09-25T16:34:09.541Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"6053lb # [ 163.935590] niks3-server[1167]: 2026/09/25 16:34:09 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst6054worker2 # [ 163.961632] nix-grpc-daemon[1615]: time=2026-09-25T16:34:09.558Z level=INFO msg="Uploading 1 narinfos"6055lb # [ 163.942210] niks3-server[1167]: 2026/09/25 16:34:09 INFO Received sign narinfos request method=POST path=/api/pushes/58/sign6056lb # [ 163.947163] niks3-server[1167]: 2026/09/25 16:34:09 INFO Signed narinfos id=58 count=16057lb # [ 163.951604] niks3-server[1167]: 2026/09/25 16:34:09 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls6058lb # [ 163.961923] niks3-server[1167]: 2026/09/25 16:34:09 INFO Received complete push request method=POST path=/api/pushes/58/complete6059worker2 # [ 163.986904] nix-grpc-daemon[1615]: time=2026-09-25T16:34:09.584Z level=INFO msg="Upload complete. (170ms)"6060lb # [ 163.967084] niks3-server[1167]: 2026/09/25 16:34:09 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo6061worker2 # [ 163.992171] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=0 paths=1 nar_bytes_in=7686062worker2 # [ 164.002058] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266063worker2 # [ 164.007307] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6064worker2 # [ 164.011362] nix-daemon[840]: reaped child process 1751, status = succeeded6065client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...6066worker2 # [ 164.019892] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6067client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6068client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6069client # farm-top> LOG-farm-top-during-drain6070worker2 # [ 165.456499] nix-daemon[840]: reaped child process 1760, status = succeeded6071worker2 # [ 165.563631] nix-daemon[840]: accepted connection from pid 1776, user nix-grpc-daemon (trusted)6072worker2 # [ 165.578781] nix-daemon[840]: reaped child process 1779, status = succeeded6073lb # [ 165.565126] niks3-server[1167]: 2026/09/25 16:34:11 INFO Received push request method=POST path=/api/pushes6074worker2 # [ 165.592317] nix-grpc-daemon[1615]: time=2026-09-25T16:34:11.188Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6075worker2 # [ 165.593891] nix-grpc-daemon[1615]: time=2026-09-25T16:34:11.188Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"6076lb # [ 165.582084] niks3-server[1167]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls6077worker2 # [ 165.613741] nix-grpc-daemon[1615]: time=2026-09-25T16:34:11.211Z level=INFO msg="Uploading 1 narinfos"6078lb # [ 165.593441] niks3-server[1167]: 2026/09/25 16:34:11 INFO Received sign narinfos request method=POST path=/api/pushes/59/sign6079lb # [ 165.599775] niks3-server[1167]: 2026/09/25 16:34:11 INFO Signed narinfos id=59 count=16080lb # [ 165.605616] niks3-server[1167]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst6081lb # [ 165.611977] niks3-server[1167]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6082lb # [ 165.620246] niks3-server[1167]: 2026/09/25 16:34:11 INFO Received complete push request method=POST path=/api/pushes/59/complete6083worker2 # [ 165.644813] nix-grpc-daemon[1615]: time=2026-09-25T16:34:11.242Z level=INFO msg="Upload complete. (215ms)"6084lb # [ 165.625327] niks3-server[1167]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo6085worker2 # [ 165.652626] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=06086worker2 # [ 165.663564] nix-daemon[840]: reaped child process 1758, status = succeeded6087client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2, in 4.93 seconds)6088client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath6089client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath, in 0.14 seconds)6090worker1: must succeed: pkill -f 'read -t [9]0 x'6091worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6092client: waiting for success: ! systemctl is-active sw6093worker1 # [ 165.969619] nix-daemon[855]: reaped child process 1821, status = succeeded6094worker1 # [ 166.028981] nix-daemon[855]: accepted connection from pid 1863, user nix-grpc-daemon (trusted)6095worker1 # [ 166.044352] nix-daemon[855]: reaped child process 1866, status = succeeded6096lb # [ 166.045244] niks3-server[1167]: 2026/09/25 16:34:11 INFO Received push request method=POST path=/api/pushes6097worker1 # [ 166.055870] nix-grpc-daemon[1767]: time=2026-09-25T16:34:11.648Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6098worker1 # [ 166.057682] nix-grpc-daemon[1767]: time=2026-09-25T16:34:11.649Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"6099lb # [ 166.067902] niks3-server[1167]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls6100worker1 # [ 166.078891] nix-grpc-daemon[1767]: time=2026-09-25T16:34:11.672Z level=INFO msg="Uploading 1 narinfos"6101lb # [ 166.076682] niks3-server[1167]: 2026/09/25 16:34:11 INFO Received sign narinfos request method=POST path=/api/pushes/60/sign6102lb # [ 166.079033] niks3-server[1167]: 2026/09/25 16:34:11 INFO Signed narinfos id=60 count=16103worker1 # [ 166.093569] nix-grpc-daemon[1767]: time=2026-09-25T16:34:11.687Z level=INFO msg="Upload complete. (187ms)"6104lb # [ 166.088935] niks3-server[1167]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6105lb # [ 166.091652] niks3-server[1167]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6106lb # [ 166.100604] niks3-server[1167]: 2026/09/25 16:34:11 INFO Received complete push request method=POST path=/api/pushes/60/complete6107worker1 # [ 166.100498] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49296 duration_s=7 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06108lb # [ 166.103784] niks3-server[1167]: 2026/09/25 16:34:11 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo6109worker1 # [ 166.111291] nix-daemon[855]: reaped child process 1819, status = succeeded6110client # [ 166.137406] systemd[1]: sw.service: Deactivated successfully.6111client # [ 166.140486] systemd[1]: sw.service: Consumed 161ms CPU time over 7.883s wall clock time, 41.2M memory peak, 7K incoming IP traffic, 8.2K outgoing IP traffic.6112worker1 # [ 166.259616] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:11Z level=info event=signal_exit6113client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds)6114client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6115client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6116worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6117lb # [ 167.475539] envoy[894]: conn peer=[2001:db8:1::1]:35002 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9591 tx=4380 ms=47456118lb # [ 167.478456] envoy[894]: conn peer=[2001:db8:1::1]:53538 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2948 tx=1497 ms=77006119worker1 # [ 168.269525] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:13Z level=info event=scheduler_restarting6120worker2 # [ 168.284721] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:501366121worker2 # [ 168.289087] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:13Z level=info event=worker_gone addr=192.168.1.3:500516122worker1 # [ 168.283544] nix-grpc-daemon[1665]: ts=2026-09-25T16:34:13Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6123worker1 # [ 168.299398] nix-daemon[855]: reaped child process 1733, status = succeeded6124worker1 # [ 170.287688] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6125worker1 # [ 170.288843] systemd[1]: nix-grpc-daemon.service: Consumed 699ms CPU time over 26.170s wall clock time, 36M memory peak, 48.4K incoming IP traffic, 57.1K outgoing IP traffic.6126worker1 # [ 170.299838] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.6127worker1 # [ 170.312457] systemd[1]: Starting Nix worker-protocol over gRPC...6128worker1 # [ 170.427061] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:16Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6129worker1 # [ 170.429469] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6130worker1 # [ 170.433209] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16131worker1 # [ 170.438459] nix-grpc-daemon[1881]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6132worker1 # [ 170.439940] nix-grpc-daemon[1881]: E0000 00:00:1790354056.031671 1881 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6133worker1 # [ 170.443983] nix-grpc-daemon[1881]: E0000 00:00:1790354056.037773 1881 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6134worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.54 seconds)6135lb: waiting until exactly ['worker1', 'worker2'] are healthy members of aarch64-linux6136lb: must succeed: curl -sf localhost:9901/clusters6137worker1 # [ 170.487996] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:16Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket6138worker1 # [ 170.490253] nix-grpc-daemon[1881]: E0000 00:00:1790354056.046365 1924 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6139worker1 # [ 170.495790] nix-grpc-daemon[1881]: E0000 00:00:1790354056.063837 1924 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6140worker1 # [ 170.500144] nix-grpc-daemon[1881]: E0000 00:00:1790354056.064031 1924 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6141worker2 # [ 170.517316] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:501366142worker1 # [ 170.503129] nix-grpc-daemon[1881]: E0000 00:00:1790354056.080608 1924 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6143worker2 # [ 170.517644] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=06144worker1 # [ 170.507918] systemd[1]: Started Nix worker-protocol over gRPC.6145worker1 # [ 170.510285] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:16Z level=info event=scheduler_connected addr=lb:500516146lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6147lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of aarch64-linux, in 0.05 seconds)6148lb: must succeed: curl -sf localhost:9901/clusters6149lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6150worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6151worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6152(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 12.40 seconds)6153subtest: queue gauges show a burst while every build blocks6154lb: must succeed: curl -sf localhost:9901/clusters6155lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6156lb: must succeed: curl -sf localhost:9901/clusters6157lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6158worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6159worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)6160client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]'6161client # [ 170.749590] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]".6162client # Running as unit: burst.service; invocation ID: 1e2db65774994e379c83cc57fe9eaa396163client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.05 seconds)6164lb: must succeed: curl -sf localhost:9901/clusters6165lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6166lb: must succeed: curl -sf localhost:9901/clusters6167lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6168worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6169worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)6170worker1 # [ 170.918956] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542246171worker1 # [ 170.927453] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6172client # [ 170.948483] nix[1509]: don't know how to build these paths:6173client # [ 170.949486] nix[1509]: /nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv6174client # [ 170.950574] nix[1509]: /nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv6175client # [ 170.952786] nix[1509]: /nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv6176client # [ 170.954047] nix[1509]: /nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv6177worker2 # [ 170.962399] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=debug event=want client=5 drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv cached=06178worker1 # [ 170.949189] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246179worker2 # [ 170.968220] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=debug event=assigned drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv worker=192.168.1.4:50051 clients=16180worker2 # [ 170.972978] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=debug event=want client=5 drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv cached=06181worker1 # [ 170.957726] nix-grpc-daemon[1881]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5)6182worker2 # [ 170.977143] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=debug event=assigned drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv worker=192.168.1.3:50051 clients=16183worker2 # [ 170.981378] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=debug event=want client=5 drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv cached=06184client # [ 170.978797] nix[1509]: copying 1 paths to 'lb:50051'...6185client # [ 170.980247] nix[1509]: copying path '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' to 'lb:50051'...6186worker2 # [ 170.989706] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=debug event=want client=5 drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv cached=06187worker2 # [ 170.996287] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266188worker2 # [ 170.999030] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454266189worker2 # [ 171.006108] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454266190worker2 # [ 171.021443] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6191worker1 # [ 171.038860] nix-grpc-daemon[1881]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 117 ms (attempt 2/5)6192worker2 # [ 171.119836] nix-daemon[840]: accepted connection from pid 1794, user nix-grpc-daemon (trusted)6193worker2 # [ 171.137872] nix-daemon[840]: reaped child process 1797, status = succeeded6194lb # [ 171.120488] niks3-server[1167]: 2026/09/25 16:34:16 INFO Received push request method=POST path=/api/pushes6195worker2 # [ 171.147206] nix-grpc-daemon[1615]: time=2026-09-25T16:34:16.744Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6196worker2 # [ 171.149004] nix-grpc-daemon[1615]: time=2026-09-25T16:34:16.744Z level=INFO msg="Uploading d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv (416B)"6197lb # [ 171.139154] niks3-server[1167]: 2026/09/25 16:34:16 INFO Registered completed upload object_key=nar/06ismykzsix0w29371dm1hbzzf3ljf9jn7dyh8skp5wqfkkw0vlk.nar.zst6198worker2 # [ 171.166079] nix-grpc-daemon[1615]: time=2026-09-25T16:34:16.763Z level=INFO msg="Uploading 1 narinfos"6199lb # [ 171.146750] niks3-server[1167]: 2026/09/25 16:34:16 INFO Received sign narinfos request method=POST path=/api/pushes/61/sign6200lb # [ 171.152394] niks3-server[1167]: 2026/09/25 16:34:16 INFO Signed narinfos id=61 count=16201worker1 # [ 171.156738] nix-grpc-daemon[1881]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 215 ms (attempt 3/5)6202lb # [ 171.157947] niks3-server[1167]: 2026/09/25 16:34:16 INFO Registered completed upload object_key=d4rrlfallgfbcpmjnsn604l2mgff4hgx.ls6203lb # [ 171.170405] niks3-server[1167]: 2026/09/25 16:34:16 INFO Received complete push request method=POST path=/api/pushes/61/complete6204worker2 # [ 171.194452] nix-grpc-daemon[1615]: time=2026-09-25T16:34:16.791Z level=INFO msg="Upload complete. (189ms)"6205lb # [ 171.178092] niks3-server[1167]: 2026/09/25 16:34:16 INFO Registered completed upload object_key=d4rrlfallgfbcpmjnsn604l2mgff4hgx.narinfo6206worker2 # [ 171.200197] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=0 paths=1 nar_bytes_in=4166207worker2 # [ 171.209957] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266208worker2 # [ 171.213129] nix-daemon[840]: reaped child process 1792, status = succeeded6209worker2 # [ 171.219008] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6210client # [ 171.222823] nix[1509]: building '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' on lb:50051...6211worker2 # [ 171.230598] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6212worker1 # [ 171.372795] nix-grpc-daemon[1881]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 446 ms (attempt 4/5)6213worker1 # [ 171.820808] nix-grpc-daemon[1881]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6214worker1 # [ 171.822817] nix-grpc-daemon[1881]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6215worker1 # [ 171.834243] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246216client # [ 171.852108] nix[1509]: copying 1 paths to 'lb:50051'...6217worker1 # [ 171.842033] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246218client # [ 171.853956] nix[1509]: copying path '/nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv' to 'lb:50051'...6219worker1 # [ 171.851863] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6220lb: must succeed: curl -sf localhost:9901/clusters6221worker1 # [ 171.868734] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:17Z level=info event=niks3_push_started pid=19416222lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6223lb: must succeed: curl -sf localhost:9901/clusters6224lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6225worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6226worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6227worker1 # [ 172.001581] nix-grpc-daemon[1941]: time=2026-09-25T16:34:17.592Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""6228worker1 # [ 172.122523] nix-daemon[855]: accepted connection from pid 1957, user nix-grpc-daemon (trusted)6229lb # [ 172.138639] niks3-server[1167]: 2026/09/25 16:34:17 INFO Received push request method=POST path=/api/pushes6230worker1 # [ 172.146251] nix-daemon[855]: reaped child process 1960, status = succeeded6231worker1 # [ 172.149737] nix-grpc-daemon[1941]: time=2026-09-25T16:34:17.742Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6232worker1 # [ 172.151268] nix-grpc-daemon[1941]: time=2026-09-25T16:34:17.742Z level=INFO msg="Uploading dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv (416B)"6233lb # [ 172.163242] niks3-server[1167]: 2026/09/25 16:34:17 INFO Received sign narinfos request method=POST path=/api/pushes/62/sign6234worker1 # [ 172.172938] nix-grpc-daemon[1941]: time=2026-09-25T16:34:17.766Z level=INFO msg="Uploading 1 narinfos"6235lb # [ 172.169673] niks3-server[1167]: 2026/09/25 16:34:17 INFO Signed narinfos id=62 count=16236lb # [ 172.174391] niks3-server[1167]: 2026/09/25 16:34:17 INFO Registered completed upload object_key=nar/06mdwsnf16qmfi86y8r33asi4vcrp5z7kdxqki87psgfpgvvpdki.nar.zst6237lb # [ 172.183852] niks3-server[1167]: 2026/09/25 16:34:17 INFO Registered completed upload object_key=dspy0axfmddglppg9zj9blmxlzhfs40x.ls6238worker1 # [ 172.192898] nix-grpc-daemon[1941]: time=2026-09-25T16:34:17.786Z level=INFO msg="Upload complete. (193ms)"6239lb # [ 172.188694] niks3-server[1167]: 2026/09/25 16:34:17 INFO Received complete push request method=POST path=/api/pushes/62/complete6240lb # [ 172.192794] niks3-server[1167]: 2026/09/25 16:34:17 INFO Registered completed upload object_key=dspy0axfmddglppg9zj9blmxlzhfs40x.narinfo6241worker1 # [ 172.197896] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=4166242worker1 # [ 172.206100] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246243worker1 # [ 172.212511] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6244worker1 # [ 172.214436] nix-daemon[855]: reaped child process 1939, status = succeeded6245client # [ 172.232704] nix[1509]: building '/nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv' on lb:50051...6246worker1 # [ 172.223504] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6247worker2 # [ 173.492435] nix-daemon[840]: reaped child process 1801, status = succeeded6248worker1 # [ 173.484246] nix-daemon[855]: reaped child process 1964, status = succeeded6249worker2 # [ 173.577782] nix-daemon[840]: accepted connection from pid 1829, user nix-grpc-daemon (trusted)6250worker1 # [ 173.564559] nix-daemon[855]: accepted connection from pid 1985, user nix-grpc-daemon (trusted)6251worker2 # [ 173.596902] nix-daemon[840]: reaped child process 1832, status = succeeded6252worker1 # [ 173.586276] nix-daemon[855]: reaped child process 1988, status = succeeded6253lb # [ 173.581328] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received push request method=POST path=/api/pushes6254lb # [ 173.585129] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received push request method=POST path=/api/pushes6255worker1 # [ 173.596368] nix-grpc-daemon[1941]: time=2026-09-25T16:34:19.189Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6256worker2 # [ 173.612364] nix-grpc-daemon[1615]: time=2026-09-25T16:34:19.207Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6257worker1 # [ 173.598056] nix-grpc-daemon[1941]: time=2026-09-25T16:34:19.189Z level=INFO msg="Uploading y3qkgrgq2zzpgvi2rf5chq94i627wkdb-slow-q3 (120B)"6258worker2 # [ 173.613983] nix-grpc-daemon[1615]: time=2026-09-25T16:34:19.207Z level=INFO msg="Uploading k6zivhvzgmlyxfmy64fzd759bxlhf9b5-slow-q0 (120B)"6259lb # [ 173.613445] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=log/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv6260lb # [ 173.620851] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=log/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv6261worker2 # [ 173.648124] nix-grpc-daemon[1615]: time=2026-09-25T16:34:19.245Z level=INFO msg="Uploading 1 narinfos"6262lb # [ 173.630550] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received sign narinfos request method=POST path=/api/pushes/63/sign6263lb # [ 173.635351] niks3-server[1167]: 2026/09/25 16:34:19 INFO Signed narinfos id=63 count=16264lb # [ 173.639470] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=k6zivhvzgmlyxfmy64fzd759bxlhf9b5.ls6265lb # [ 173.645834] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst6266worker1 # [ 173.657944] nix-grpc-daemon[1941]: time=2026-09-25T16:34:19.251Z level=INFO msg="Uploading 1 narinfos"6267lb # [ 173.653484] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received sign narinfos request method=POST path=/api/pushes/64/sign6268lb # [ 173.658902] niks3-server[1167]: 2026/09/25 16:34:19 INFO Signed narinfos id=64 count=16269lb # [ 173.662368] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst6270lb # [ 173.667246] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=y3qkgrgq2zzpgvi2rf5chq94i627wkdb.ls6271lb # [ 173.673882] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received complete push request method=POST path=/api/pushes/63/complete6272worker2 # [ 173.701843] nix-grpc-daemon[1615]: time=2026-09-25T16:34:19.299Z level=INFO msg="Upload complete. (259ms)"6273lb # [ 173.681981] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received complete push request method=POST path=/api/pushes/64/complete6274lb # [ 173.689765] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo6275lb # [ 173.691716] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo6276worker2 # [ 173.710094] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=2 drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv assign_id=7 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06277worker1 # [ 173.699887] nix-grpc-daemon[1941]: time=2026-09-25T16:34:19.293Z level=INFO msg="Upload complete. (268ms)"6278worker2 # [ 173.722444] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:19Z level=debug event=assigned drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv worker=192.168.1.4:50051 clients=16279worker1 # [ 173.708734] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=1 drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06280client # [ 173.727074] nix[1509]: copying 1 paths to 'lb:50051'...6281worker2 # [ 173.732215] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266282client # [ 173.727231] nix[1509]: copying path '/nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv' to 'lb:50051'...6283worker2 # [ 173.735052] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:19Z level=debug event=assigned drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv worker=192.168.1.3:50051 clients=16284worker1 # [ 173.723428] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246285worker1 # [ 173.726480] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246286worker2 # [ 173.744442] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454266287worker1 # [ 173.730591] nix-daemon[855]: reaped child process 1962, status = succeeded6288client # [ 173.744342] nix[1509]: copying 1 paths to 'lb:50051'...6289client # [ 173.746599] nix[1509]: copying path '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' to 'lb:50051'...6290worker2 # [ 173.750754] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454266291worker1 # [ 173.736466] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246292worker2 # [ 173.755676] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6293worker2 # [ 173.758292] nix-daemon[840]: reaped child process 1799, status = succeeded6294worker1 # [ 173.744398] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6295worker2 # [ 173.870162] nix-daemon[840]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6296worker1 # [ 173.863886] nix-daemon[855]: accepted connection from pid 1992, user nix-grpc-daemon (trusted)6297worker2 # [ 173.887866] nix-daemon[840]: reaped child process 1839, status = succeeded6298lb # [ 173.871558] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received push request method=POST path=/api/pushes6299worker1 # [ 173.880168] nix-daemon[855]: reaped child process 1995, status = succeeded6300worker2 # [ 173.896792] nix-grpc-daemon[1615]: time=2026-09-25T16:34:19.493Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6301worker2 # [ 173.898331] nix-grpc-daemon[1615]: time=2026-09-25T16:34:19.493Z level=INFO msg="Uploading jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv (416B)"6302lb # [ 173.881294] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received push request method=POST path=/api/pushes6303worker1 # [ 173.892758] nix-grpc-daemon[1941]: time=2026-09-25T16:34:19.486Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6304worker1 # [ 173.894428] nix-grpc-daemon[1941]: time=2026-09-25T16:34:19.486Z level=INFO msg="Uploading pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv (416B)"6305lb # [ 173.893130] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received sign narinfos request method=POST path=/api/pushes/65/sign6306worker2 # [ 173.917682] nix-grpc-daemon[1615]: time=2026-09-25T16:34:19.515Z level=INFO msg="Uploading 1 narinfos"6307lb # [ 173.899090] niks3-server[1167]: 2026/09/25 16:34:19 INFO Signed narinfos id=65 count=16308lb # [ 173.903194] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=nar/1fyfjzlx8vymsfmdv5cv8ymgjkr18fwm737qvys29plwwiwmyvwr.nar.zst6309lb # [ 173.914303] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.ls6310worker1 # [ 173.928147] nix-grpc-daemon[1941]: time=2026-09-25T16:34:19.521Z level=INFO msg="Uploading 1 narinfos"6311lb # [ 173.922999] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=nar/1k21jrz411xc9gkca2pnr9mrjq1s3bg3zhsam3nnv4j066dgzgm7.nar.zst6312lb # [ 173.932386] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received sign narinfos request method=POST path=/api/pushes/66/sign6313lb # [ 173.934730] niks3-server[1167]: 2026/09/25 16:34:19 INFO Signed narinfos id=66 count=16314worker2 # [ 173.958830] nix-grpc-daemon[1615]: time=2026-09-25T16:34:19.556Z level=INFO msg="Upload complete. (201ms)"6315lb # [ 173.943289] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received complete push request method=POST path=/api/pushes/65/complete6316worker2 # [ 173.964190] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=0 paths=1 nar_bytes_in=4166317lb # [ 173.949299] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.narinfo6318lb # [ 173.951681] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.ls6319worker2 # [ 173.975335] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266320worker2 # [ 173.980822] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6321lb # [ 173.961227] niks3-server[1167]: 2026/09/25 16:34:19 INFO Received complete push request method=POST path=/api/pushes/66/complete6322worker2 # [ 173.984821] nix-daemon[840]: reaped child process 1834, status = succeeded6323lb # [ 173.963504] niks3-server[1167]: 2026/09/25 16:34:19 INFO Registered completed upload object_key=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.narinfo6324worker1 # [ 173.971014] nix-grpc-daemon[1941]: time=2026-09-25T16:34:19.564Z level=INFO msg="Upload complete. (217ms)"6325client # [ 173.988282] nix[1509]: building '/nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv' on lb:50051...6326worker2 # [ 173.996322] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6327worker1 # [ 173.980368] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=4166328worker1 # [ 173.983706] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246329worker1 # [ 173.993651] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6330worker1 # [ 174.000386] nix-daemon[855]: reaped child process 1990, status = succeeded6331client # [ 174.016778] nix[1509]: building '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' on lb:50051...6332worker1 # [ 174.009437] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6333worker2 # [ 175.620613] nix-daemon[840]: reaped child process 1843, status = succeeded6334worker1 # [ 175.649599] nix-daemon[855]: reaped child process 1999, status = succeeded6335worker2 # [ 175.713157] nix-daemon[840]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)6336worker2 # [ 175.733027] nix-daemon[840]: reaped child process 1871, status = succeeded6337lb # [ 175.715663] niks3-server[1167]: 2026/09/25 16:34:21 INFO Received push request method=POST path=/api/pushes6338worker2 # [ 175.742862] nix-grpc-daemon[1615]: time=2026-09-25T16:34:21.338Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6339worker2 # [ 175.744541] nix-grpc-daemon[1615]: time=2026-09-25T16:34:21.338Z level=INFO msg="Uploading gjyi8j90pk5flrsqqdhj6h132pcb7n33-slow-q2 (120B)"6340lb # [ 175.738777] niks3-server[1167]: 2026/09/25 16:34:21 INFO Received sign narinfos request method=POST path=/api/pushes/67/sign6341worker2 # [ 175.763821] nix-grpc-daemon[1615]: time=2026-09-25T16:34:21.361Z level=INFO msg="Uploading 1 narinfos"6342worker1 # [ 175.751319] nix-daemon[855]: accepted connection from pid 2024, user nix-grpc-daemon (trusted)6343lb # [ 175.746906] niks3-server[1167]: 2026/09/25 16:34:21 INFO Signed narinfos id=67 count=16344lb # [ 175.751917] niks3-server[1167]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst6345lb # [ 175.762063] niks3-server[1167]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=gjyi8j90pk5flrsqqdhj6h132pcb7n33.ls6346worker2 # [ 175.787584] nix-grpc-daemon[1615]: time=2026-09-25T16:34:21.385Z level=INFO msg="Upload complete. (182ms)"6347worker1 # [ 175.773682] nix-daemon[855]: reaped child process 2027, status = succeeded6348worker1 # [ 175.777306] nix-grpc-daemon[1941]: time=2026-09-25T16:34:21.370Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6349lb # [ 175.771568] niks3-server[1167]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=log/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv6350worker1 # [ 175.778870] nix-grpc-daemon[1941]: time=2026-09-25T16:34:21.370Z level=INFO msg="Uploading l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx-slow-q1 (120B)"6351lb # [ 175.777608] niks3-server[1167]: 2026/09/25 16:34:21 INFO Received complete push request method=POST path=/api/pushes/67/complete6352worker2 # [ 175.796650] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=1 drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv assign_id=9 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06353lb # [ 175.779978] niks3-server[1167]: 2026/09/25 16:34:21 INFO Received push request method=POST path=/api/pushes6354worker2 # [ 175.804724] nix-daemon[840]: reaped child process 1841, status = succeeded6355lb # [ 175.787772] niks3-server[1167]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo6356lb # [ 175.797378] niks3-server[1167]: 2026/09/25 16:34:21 INFO Received sign narinfos request method=POST path=/api/pushes/68/sign6357worker1 # [ 175.802387] nix-grpc-daemon[1941]: time=2026-09-25T16:34:21.396Z level=INFO msg="Uploading 1 narinfos"6358lb # [ 175.803101] niks3-server[1167]: 2026/09/25 16:34:21 INFO Signed narinfos id=68 count=16359lb # [ 175.808718] niks3-server[1167]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=log/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv6360lb # [ 175.815538] niks3-server[1167]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst6361lb # [ 175.823551] niks3-server[1167]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.ls6362worker1 # [ 175.831877] nix-grpc-daemon[1941]: time=2026-09-25T16:34:21.425Z level=INFO msg="Upload complete. (213ms)"6363lb # [ 175.827723] niks3-server[1167]: 2026/09/25 16:34:21 INFO Received complete push request method=POST path=/api/pushes/68/complete6364lb # [ 175.830489] niks3-server[1167]: 2026/09/25 16:34:21 INFO Registered completed upload object_key=l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo6365worker1 # [ 175.840701] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=1 drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv assign_id=10 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06366worker1 # [ 175.850328] nix-daemon[855]: reaped child process 1997, status = succeeded6367client # [ 175.873610] systemd[1]: burst.service: Deactivated successfully.6368client # [ 175.876973] systemd[1]: burst.service: Consumed 184ms CPU time over 5.125s wall clock time, 53.6M memory peak, 13.6K incoming IP traffic, 18.3K outgoing IP traffic.6369client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }6370client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.04 seconds)6371lb: must succeed: curl -sf localhost:9901/clusters6372lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6373lb: must succeed: curl -sf localhost:9901/clusters6374lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6375worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6376worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)6377lb: must succeed: curl -sf localhost:9901/clusters6378lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6379lb: must succeed: curl -sf localhost:9901/clusters6380lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6381worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6382worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)6383(finished: subtest: queue gauges show a burst while every build blocks, in 6.35 seconds)6384subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6385client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16386worker1 # [ 177.131823] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542246387worker2 # [ 177.150681] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454266388worker2 # [ 177.175061] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:22Z level=debug event=want client=6 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=06389worker1 # [ 177.161698] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246390worker2 # [ 177.178402] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:22Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=16391worker2 # [ 177.181682] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:22Z level=debug event=want client=6 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=06392worker2 # [ 177.184493] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:22Z level=debug event=want client=6 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=06393worker1 # [ 177.170143] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246394worker1 # [ 177.179061] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246395worker1 # [ 177.187183] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6396worker1 # [ 177.312590] nix-daemon[855]: accepted connection from pid 2035, user nix-grpc-daemon (trusted)6397worker1 # [ 177.329522] nix-daemon[855]: reaped child process 2038, status = succeeded6398lb # [ 177.329934] niks3-server[1167]: 2026/09/25 16:34:22 INFO Received push request method=POST path=/api/pushes6399worker1 # [ 177.340876] nix-grpc-daemon[1941]: time=2026-09-25T16:34:22.934Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6400worker1 # [ 177.342446] nix-grpc-daemon[1941]: time=2026-09-25T16:34:22.934Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"6401lb # [ 177.347368] niks3-server[1167]: 2026/09/25 16:34:22 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst6402worker1 # [ 177.358444] nix-grpc-daemon[1941]: time=2026-09-25T16:34:22.952Z level=INFO msg="Uploading 1 narinfos"6403lb # [ 177.354751] niks3-server[1167]: 2026/09/25 16:34:22 INFO Received sign narinfos request method=POST path=/api/pushes/69/sign6404lb # [ 177.359404] niks3-server[1167]: 2026/09/25 16:34:22 INFO Signed narinfos id=69 count=16405lb # [ 177.362999] niks3-server[1167]: 2026/09/25 16:34:22 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls6406lb # [ 177.370950] niks3-server[1167]: 2026/09/25 16:34:22 INFO Received complete push request method=POST path=/api/pushes/69/complete6407worker1 # [ 177.379222] nix-grpc-daemon[1941]: time=2026-09-25T16:34:22.973Z level=INFO msg="Upload complete. (182ms)"6408lb # [ 177.375898] niks3-server[1167]: 2026/09/25 16:34:22 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo6409worker1 # [ 177.385994] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=5126410worker1 # [ 177.394925] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246411worker1 # [ 177.397875] nix-daemon[855]: reaped child process 2033, status = succeeded6412worker1 # [ 177.403096] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6413worker1 # [ 177.414310] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6414lb # [ 177.476511] envoy[894]: conn peer=[2001:db8:1::3]:56698 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1020 tx=459 ms=239856415lb # [ 177.479140] envoy[894]: conn peer=[2001:db8:1::1]:51734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9641 tx=5170 ms=49336416worker1 # [ 178.260571] nix-daemon[855]: reaped child process 2042, status = succeeded6417worker1 # [ 178.351882] nix-daemon[855]: accepted connection from pid 2058, user nix-grpc-daemon (trusted)6418lb # [ 178.364700] niks3-server[1167]: 2026/09/25 16:34:23 INFO Received push request method=POST path=/api/pushes6419worker1 # [ 178.371822] nix-daemon[855]: reaped child process 2061, status = succeeded6420worker1 # [ 178.376384] nix-grpc-daemon[1941]: time=2026-09-25T16:34:23.968Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6421worker1 # [ 178.377907] nix-grpc-daemon[1941]: time=2026-09-25T16:34:23.968Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"6422lb # [ 178.382188] niks3-server[1167]: 2026/09/25 16:34:23 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv6423lb # [ 178.393904] niks3-server[1167]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6424worker1 # [ 178.405754] nix-grpc-daemon[1941]: time=2026-09-25T16:34:23.999Z level=INFO msg="Uploading 1 narinfos"6425lb # [ 178.401019] niks3-server[1167]: 2026/09/25 16:34:24 INFO Received sign narinfos request method=POST path=/api/pushes/70/sign6426lb # [ 178.408840] niks3-server[1167]: 2026/09/25 16:34:24 INFO Signed narinfos id=70 count=16427lb # [ 178.410552] niks3-server[1167]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls6428lb # [ 178.419743] niks3-server[1167]: 2026/09/25 16:34:24 INFO Received complete push request method=POST path=/api/pushes/70/complete6429lb # [ 178.424194] niks3-server[1167]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo6430worker1 # [ 178.431853] nix-grpc-daemon[1941]: time=2026-09-25T16:34:24.025Z level=INFO msg="Upload complete. (210ms)"6431worker2 # [ 178.454628] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:24Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=16432worker1 # [ 178.439436] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=11 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06433worker2 # [ 178.458654] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:24Z level=debug event=want client=6 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=06434worker1 # [ 178.451481] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246435worker1 # [ 178.455934] nix-daemon[855]: reaped child process 2040, status = succeeded6436worker1 # [ 178.460817] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246437worker1 # [ 178.468749] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246438worker1 # [ 178.476173] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6439worker1 # [ 178.592212] nix-daemon[855]: accepted connection from pid 2065, user nix-grpc-daemon (trusted)6440worker1 # [ 178.607750] nix-daemon[855]: reaped child process 2068, status = succeeded6441lb # [ 178.608243] niks3-server[1167]: 2026/09/25 16:34:24 INFO Received push request method=POST path=/api/pushes6442worker1 # [ 178.617617] nix-grpc-daemon[1941]: time=2026-09-25T16:34:24.211Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6443worker1 # [ 178.619143] nix-grpc-daemon[1941]: time=2026-09-25T16:34:24.211Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"6444lb # [ 178.624150] niks3-server[1167]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst6445worker1 # [ 178.633441] nix-grpc-daemon[1941]: time=2026-09-25T16:34:24.227Z level=INFO msg="Uploading 1 narinfos"6446lb # [ 178.630238] niks3-server[1167]: 2026/09/25 16:34:24 INFO Received sign narinfos request method=POST path=/api/pushes/71/sign6447lb # [ 178.635259] niks3-server[1167]: 2026/09/25 16:34:24 INFO Signed narinfos id=71 count=16448lb # [ 178.641622] niks3-server[1167]: 2026/09/25 16:34:24 INFO Received complete push request method=POST path=/api/pushes/71/complete6449worker1 # [ 178.650902] nix-grpc-daemon[1941]: time=2026-09-25T16:34:24.244Z level=INFO msg="Upload complete. (166ms)"6450lb # [ 178.648140] niks3-server[1167]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo6451worker1 # [ 178.656193] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=5126452lb # [ 178.652590] niks3-server[1167]: 2026/09/25 16:34:24 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls6453worker1 # [ 178.664788] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246454worker1 # [ 178.671152] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6455worker1 # [ 178.673195] nix-daemon[855]: reaped child process 2063, status = succeeded6456worker1 # [ 178.682436] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6457worker1 # [ 179.915270] nix-daemon[855]: reaped child process 2072, status = succeeded6458worker1 # [ 180.017099] nix-daemon[855]: accepted connection from pid 2088, user nix-grpc-daemon (trusted)6459lb # [ 180.029837] niks3-server[1167]: 2026/09/25 16:34:25 INFO Received push request method=POST path=/api/pushes6460worker1 # [ 180.036801] nix-daemon[855]: reaped child process 2091, status = succeeded6461worker1 # [ 180.042784] nix-grpc-daemon[1941]: time=2026-09-25T16:34:25.634Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6462worker1 # [ 180.045205] nix-grpc-daemon[1941]: time=2026-09-25T16:34:25.634Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"6463lb # [ 180.057198] niks3-server[1167]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls6464worker1 # [ 180.066871] nix-grpc-daemon[1941]: time=2026-09-25T16:34:25.660Z level=INFO msg="Uploading 1 narinfos"6465lb # [ 180.064510] niks3-server[1167]: 2026/09/25 16:34:25 INFO Received sign narinfos request method=POST path=/api/pushes/72/sign6466lb # [ 180.067468] niks3-server[1167]: 2026/09/25 16:34:25 INFO Signed narinfos id=72 count=16467lb # [ 180.075164] niks3-server[1167]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6468worker1 # [ 180.088223] nix-grpc-daemon[1941]: time=2026-09-25T16:34:25.682Z level=INFO msg="Upload complete. (198ms)"6469lb # [ 180.083858] niks3-server[1167]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv6470worker2 # [ 180.109435] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:25Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=16471lb # [ 180.089747] niks3-server[1167]: 2026/09/25 16:34:25 INFO Received complete push request method=POST path=/api/pushes/72/complete6472worker1 # [ 180.095890] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06473lb # [ 180.094062] niks3-server[1167]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo6474worker2 # [ 180.118556] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:25Z level=debug event=want client=6 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=06475worker1 # [ 180.108688] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246476worker1 # [ 180.111921] nix-daemon[855]: reaped child process 2070, status = succeeded6477worker1 # [ 180.116709] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246478worker1 # [ 180.125128] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246479worker1 # [ 180.131561] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6480worker1 # [ 180.244173] nix-daemon[855]: accepted connection from pid 2095, user nix-grpc-daemon (trusted)6481worker1 # [ 180.260426] nix-daemon[855]: reaped child process 2098, status = succeeded6482lb # [ 180.259597] niks3-server[1167]: 2026/09/25 16:34:25 INFO Received push request method=POST path=/api/pushes6483worker1 # [ 180.269068] nix-grpc-daemon[1941]: time=2026-09-25T16:34:25.862Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6484worker1 # [ 180.270562] nix-grpc-daemon[1941]: time=2026-09-25T16:34:25.862Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"6485lb # [ 180.279614] niks3-server[1167]: 2026/09/25 16:34:25 INFO Received sign narinfos request method=POST path=/api/pushes/73/sign6486worker1 # [ 180.287187] nix-grpc-daemon[1941]: time=2026-09-25T16:34:25.881Z level=INFO msg="Uploading 1 narinfos"6487lb # [ 180.286794] niks3-server[1167]: 2026/09/25 16:34:25 INFO Signed narinfos id=73 count=16488lb # [ 180.291145] niks3-server[1167]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst6489lb # [ 180.300204] niks3-server[1167]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls6490lb # [ 180.302717] niks3-server[1167]: 2026/09/25 16:34:25 INFO Received complete push request method=POST path=/api/pushes/73/complete6491worker1 # [ 180.312090] nix-grpc-daemon[1941]: time=2026-09-25T16:34:25.906Z level=INFO msg="Upload complete. (171ms)"6492lb # [ 180.309091] niks3-server[1167]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo6493worker1 # [ 180.319609] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=5126494worker1 # [ 180.325790] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246495worker1 # [ 180.332122] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6496worker1 # [ 180.334169] nix-daemon[855]: reaped child process 2093, status = succeeded6497worker1 # [ 180.342229] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6498worker1 # [ 180.980191] nix-daemon[855]: reaped child process 2102, status = succeeded6499worker1 # [ 181.086140] nix-daemon[855]: accepted connection from pid 2118, user nix-grpc-daemon (trusted)6500lb # [ 181.098168] niks3-server[1167]: 2026/09/25 16:34:26 INFO Received push request method=POST path=/api/pushes6501worker1 # [ 181.105560] nix-daemon[855]: reaped child process 2121, status = succeeded6502worker1 # [ 181.108353] nix-grpc-daemon[1941]: time=2026-09-25T16:34:26.701Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6503worker1 # [ 181.112982] nix-grpc-daemon[1941]: time=2026-09-25T16:34:26.701Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"6504lb # [ 181.124731] niks3-server[1167]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv6505worker1 # [ 181.136276] nix-grpc-daemon[1941]: time=2026-09-25T16:34:26.730Z level=INFO msg="Uploading 1 narinfos"6506lb # [ 181.132391] niks3-server[1167]: 2026/09/25 16:34:26 INFO Received sign narinfos request method=POST path=/api/pushes/74/sign6507lb # [ 181.138476] niks3-server[1167]: 2026/09/25 16:34:26 INFO Signed narinfos id=74 count=16508lb # [ 181.142090] niks3-server[1167]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6509lb # [ 181.150503] niks3-server[1167]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls6510worker1 # [ 181.160065] nix-grpc-daemon[1941]: time=2026-09-25T16:34:26.754Z level=INFO msg="Upload complete. (208ms)"6511lb # [ 181.156265] niks3-server[1167]: 2026/09/25 16:34:26 INFO Received complete push request method=POST path=/api/pushes/74/complete6512lb # [ 181.161122] niks3-server[1167]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo6513worker2 # [ 181.182692] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:26Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=16514worker1 # [ 181.167400] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=13 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06515worker2 # [ 181.187385] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:26Z level=debug event=want client=6 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=06516worker1 # [ 181.179144] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246517worker1 # [ 181.183370] nix-daemon[855]: reaped child process 2100, status = succeeded6518worker1 # [ 181.188650] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246519worker1 # [ 181.196365] nix-grpc-daemon[1941]: time=2026-09-25T16:34:26.790Z level=INFO msg="All 1 paths already cached"6520worker1 # [ 181.201837] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246521worker1 # [ 181.209371] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6522worker1 # [ 181.321287] nix-daemon[855]: accepted connection from pid 2125, user nix-grpc-daemon (trusted)6523lb # [ 181.332143] niks3-server[1167]: 2026/09/25 16:34:26 INFO Received push request method=POST path=/api/pushes6524worker1 # [ 181.339001] nix-daemon[855]: reaped child process 2128, status = succeeded6525worker1 # [ 181.341535] nix-grpc-daemon[1941]: time=2026-09-25T16:34:26.935Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6526worker1 # [ 181.343034] nix-grpc-daemon[1941]: time=2026-09-25T16:34:26.935Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6527worker1 # [ 181.351151] nix-grpc-daemon[1941]: time=2026-09-25T16:34:26.945Z level=INFO msg="Uploading 1 narinfos"6528lb # [ 181.346491] niks3-server[1167]: 2026/09/25 16:34:26 INFO Received sign narinfos request method=POST path=/api/pushes/75/sign6529lb # [ 181.352664] niks3-server[1167]: 2026/09/25 16:34:26 INFO Signed narinfos id=75 count=16530lb # [ 181.357816] niks3-server[1167]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6531lb # [ 181.363375] niks3-server[1167]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6532worker1 # [ 181.378874] nix-grpc-daemon[1941]: time=2026-09-25T16:34:26.972Z level=INFO msg="Upload complete. (161ms)"6533lb # [ 181.371167] niks3-server[1167]: 2026/09/25 16:34:26 INFO Received complete push request method=POST path=/api/pushes/75/complete6534lb # [ 181.376718] niks3-server[1167]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6535worker1 # [ 181.384297] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=6246536worker1 # [ 181.393385] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246537worker1 # [ 181.399304] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6538worker1 # [ 181.401127] nix-daemon[855]: reaped child process 2123, status = succeeded6539worker1 # [ 181.409906] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6540worker1 # [ 182.641609] nix-daemon[855]: reaped child process 2132, status = succeeded6541worker1 # [ 182.740325] nix-daemon[855]: accepted connection from pid 2148, user nix-grpc-daemon (trusted)6542worker1 # [ 182.754853] nix-daemon[855]: reaped child process 2151, status = succeeded6543lb # [ 182.756508] niks3-server[1167]: 2026/09/25 16:34:28 INFO Received push request method=POST path=/api/pushes6544worker1 # [ 182.766242] nix-grpc-daemon[1941]: time=2026-09-25T16:34:28.359Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6545worker1 # [ 182.768901] nix-grpc-daemon[1941]: time=2026-09-25T16:34:28.361Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6546worker1 # [ 182.791781] nix-grpc-daemon[1941]: time=2026-09-25T16:34:28.385Z level=INFO msg="Uploading 1 narinfos"6547lb # [ 182.782330] niks3-server[1167]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6548lb # [ 182.790444] niks3-server[1167]: 2026/09/25 16:34:28 INFO Received sign narinfos request method=POST path=/api/pushes/76/sign6549lb # [ 182.796531] niks3-server[1167]: 2026/09/25 16:34:28 INFO Signed narinfos id=76 count=16550lb # [ 182.800516] niks3-server[1167]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6551worker1 # [ 182.813882] nix-grpc-daemon[1941]: time=2026-09-25T16:34:28.407Z level=INFO msg="Upload complete. (197ms)"6552lb # [ 182.810410] niks3-server[1167]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6553lb # [ 182.815069] niks3-server[1167]: 2026/09/25 16:34:28 INFO Received complete push request method=POST path=/api/pushes/76/complete6554worker2 # [ 182.835180] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:28Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16555worker1 # [ 182.820610] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=14 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=06556lb # [ 182.818732] niks3-server[1167]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6557worker2 # [ 182.844080] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:28Z level=debug event=want client=6 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06558worker1 # [ 182.833753] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246559worker1 # [ 182.837865] nix-daemon[855]: reaped child process 2130, status = succeeded6560worker1 # [ 182.842925] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246561worker1 # [ 182.850636] nix-grpc-daemon[1941]: time=2026-09-25T16:34:28.444Z level=INFO msg="All 1 paths already cached"6562worker1 # [ 182.855753] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246563worker1 # [ 182.863321] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6564worker1 # [ 182.976631] nix-daemon[855]: accepted connection from pid 2155, user nix-grpc-daemon (trusted)6565lb # [ 182.988034] niks3-server[1167]: 2026/09/25 16:34:28 INFO Received push request method=POST path=/api/pushes6566worker1 # [ 182.995689] nix-daemon[855]: reaped child process 2158, status = succeeded6567worker1 # [ 182.997697] nix-grpc-daemon[1941]: time=2026-09-25T16:34:28.591Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6568worker1 # [ 182.999166] nix-grpc-daemon[1941]: time=2026-09-25T16:34:28.591Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6569lb # [ 183.004724] niks3-server[1167]: 2026/09/25 16:34:28 INFO Received sign narinfos request method=POST path=/api/pushes/77/sign6570worker1 # [ 183.012329] nix-grpc-daemon[1941]: time=2026-09-25T16:34:28.606Z level=INFO msg="Uploading 1 narinfos"6571lb # [ 183.011480] niks3-server[1167]: 2026/09/25 16:34:28 INFO Signed narinfos id=77 count=16572lb # [ 183.016564] niks3-server[1167]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6573lb # [ 183.019609] niks3-server[1167]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6574lb # [ 183.029578] niks3-server[1167]: 2026/09/25 16:34:28 INFO Received complete push request method=POST path=/api/pushes/77/complete6575worker1 # [ 183.038031] nix-grpc-daemon[1941]: time=2026-09-25T16:34:28.632Z level=INFO msg="Upload complete. (166ms)"6576lb # [ 183.033794] niks3-server[1167]: 2026/09/25 16:34:28 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6577worker1 # [ 183.043679] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=6246578worker1 # [ 183.051892] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246579worker1 # [ 183.055812] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6580worker1 # [ 183.059025] nix-daemon[855]: reaped child process 2153, status = succeeded6581worker1 # [ 183.066298] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6582worker1 # [ 183.708710] nix-daemon[855]: reaped child process 2162, status = succeeded6583worker1 # [ 183.801540] nix-daemon[855]: accepted connection from pid 2178, user nix-grpc-daemon (trusted)6584worker1 # [ 183.821159] nix-daemon[855]: reaped child process 2181, status = succeeded6585lb # [ 183.815623] niks3-server[1167]: 2026/09/25 16:34:29 INFO Received push request method=POST path=/api/pushes6586worker1 # [ 183.828407] nix-grpc-daemon[1941]: time=2026-09-25T16:34:29.419Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6587worker1 # [ 183.829972] nix-grpc-daemon[1941]: time=2026-09-25T16:34:29.419Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6588lb # [ 183.838960] niks3-server[1167]: 2026/09/25 16:34:29 INFO Received sign narinfos request method=POST path=/api/pushes/78/sign6589worker1 # [ 183.848944] nix-grpc-daemon[1941]: time=2026-09-25T16:34:29.442Z level=INFO msg="Uploading 1 narinfos"6590lb # [ 183.846211] niks3-server[1167]: 2026/09/25 16:34:29 INFO Signed narinfos id=78 count=16591lb # [ 183.850852] niks3-server[1167]: 2026/09/25 16:34:29 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6592lb # [ 183.857288] niks3-server[1167]: 2026/09/25 16:34:29 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6593lb # [ 183.859940] niks3-server[1167]: 2026/09/25 16:34:29 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6594worker1 # [ 183.875472] nix-grpc-daemon[1941]: time=2026-09-25T16:34:29.469Z level=INFO msg="Upload complete. (201ms)"6595lb # [ 183.870911] niks3-server[1167]: 2026/09/25 16:34:29 INFO Received complete push request method=POST path=/api/pushes/78/complete6596lb # [ 183.875756] niks3-server[1167]: 2026/09/25 16:34:29 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6597worker2 # [ 183.896478] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:29Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16598worker1 # [ 183.884566] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=15 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=06599worker2 # [ 183.903836] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:29Z level=debug event=want client=6 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06600worker1 # [ 183.895216] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246601worker1 # [ 183.899305] nix-daemon[855]: reaped child process 2160, status = succeeded6602worker1 # [ 183.904363] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246603worker1 # [ 183.911812] nix-grpc-daemon[1941]: time=2026-09-25T16:34:29.505Z level=INFO msg="All 1 paths already cached"6604worker1 # [ 183.917094] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246605worker1 # [ 183.924560] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6606worker1 # [ 184.038923] nix-daemon[855]: accepted connection from pid 2185, user nix-grpc-daemon (trusted)6607lb # [ 184.049756] niks3-server[1167]: 2026/09/25 16:34:29 INFO Received push request method=POST path=/api/pushes6608worker1 # [ 184.056966] nix-daemon[855]: reaped child process 2188, status = succeeded6609worker1 # [ 184.059250] nix-grpc-daemon[1941]: time=2026-09-25T16:34:29.652Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6610worker1 # [ 184.060837] nix-grpc-daemon[1941]: time=2026-09-25T16:34:29.652Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6611lb # [ 184.066625] niks3-server[1167]: 2026/09/25 16:34:29 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6612worker1 # [ 184.078234] nix-grpc-daemon[1941]: time=2026-09-25T16:34:29.672Z level=INFO msg="Uploading 1 narinfos"6613lb # [ 184.075635] niks3-server[1167]: 2026/09/25 16:34:29 INFO Received sign narinfos request method=POST path=/api/pushes/79/sign6614lb # [ 184.081195] niks3-server[1167]: 2026/09/25 16:34:29 INFO Signed narinfos id=79 count=16615lb # [ 184.082919] niks3-server[1167]: 2026/09/25 16:34:29 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6616lb # [ 184.091212] niks3-server[1167]: 2026/09/25 16:34:29 INFO Received complete push request method=POST path=/api/pushes/79/complete6617worker1 # [ 184.099592] nix-grpc-daemon[1941]: time=2026-09-25T16:34:29.693Z level=INFO msg="Upload complete. (166ms)"6618lb # [ 184.095495] niks3-server[1167]: 2026/09/25 16:34:29 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6619worker1 # [ 184.105626] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=6246620worker1 # [ 184.112771] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246621worker1 # [ 184.118937] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6622worker1 # [ 184.120653] nix-daemon[855]: reaped child process 2183, status = succeeded6623worker1 # [ 184.130365] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6624worker1 # [ 185.382449] nix-daemon[855]: reaped child process 2192, status = succeeded6625worker1 # [ 185.476881] nix-daemon[855]: accepted connection from pid 2208, user nix-grpc-daemon (trusted)6626worker1 # [ 185.498176] nix-daemon[855]: reaped child process 2211, status = succeeded6627lb # [ 185.496726] niks3-server[1167]: 2026/09/25 16:34:31 INFO Received push request method=POST path=/api/pushes6628worker1 # [ 185.508391] nix-grpc-daemon[1941]: time=2026-09-25T16:34:31.101Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6629worker1 # [ 185.509983] nix-grpc-daemon[1941]: time=2026-09-25T16:34:31.101Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6630lb # [ 185.518779] niks3-server[1167]: 2026/09/25 16:34:31 INFO Received sign narinfos request method=POST path=/api/pushes/80/sign6631worker1 # [ 185.527726] nix-grpc-daemon[1941]: time=2026-09-25T16:34:31.121Z level=INFO msg="Uploading 1 narinfos"6632lb # [ 185.525921] niks3-server[1167]: 2026/09/25 16:34:31 INFO Signed narinfos id=80 count=16633lb # [ 185.530877] niks3-server[1167]: 2026/09/25 16:34:31 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6634lb # [ 185.540360] niks3-server[1167]: 2026/09/25 16:34:31 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6635lb # [ 185.543325] niks3-server[1167]: 2026/09/25 16:34:31 INFO Received complete push request method=POST path=/api/pushes/80/complete6636worker1 # [ 185.552396] nix-grpc-daemon[1941]: time=2026-09-25T16:34:31.146Z level=INFO msg="Upload complete. (215ms)"6637lb # [ 185.550030] niks3-server[1167]: 2026/09/25 16:34:31 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6638lb # [ 185.553762] niks3-server[1167]: 2026/09/25 16:34:31 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6639worker2 # [ 185.574882] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:31Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16640worker2 # [ 185.582341] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:31Z level=debug event=want client=6 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06641worker1 # [ 185.560682] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=16 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=06642worker1 # [ 185.573832] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246643worker1 # [ 185.577800] nix-daemon[855]: reaped child process 2190, status = succeeded6644worker1 # [ 185.583195] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246645worker1 # [ 185.591151] nix-grpc-daemon[1941]: time=2026-09-25T16:34:31.185Z level=INFO msg="All 2 paths already cached"6646worker1 # [ 185.596733] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246647worker1 # [ 185.604794] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6648worker1 # [ 185.722560] nix-daemon[855]: accepted connection from pid 2215, user nix-grpc-daemon (trusted)6649lb # [ 185.734834] niks3-server[1167]: 2026/09/25 16:34:31 INFO Received push request method=POST path=/api/pushes6650worker1 # [ 185.742999] nix-daemon[855]: reaped child process 2218, status = succeeded6651worker1 # [ 185.744990] nix-grpc-daemon[1941]: time=2026-09-25T16:34:31.338Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6652worker1 # [ 185.746504] nix-grpc-daemon[1941]: time=2026-09-25T16:34:31.338Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6653lb # [ 185.752682] niks3-server[1167]: 2026/09/25 16:34:31 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6654worker1 # [ 185.764481] nix-grpc-daemon[1941]: time=2026-09-25T16:34:31.358Z level=INFO msg="Uploading 1 narinfos"6655lb # [ 185.761182] niks3-server[1167]: 2026/09/25 16:34:31 INFO Received sign narinfos request method=POST path=/api/pushes/81/sign6656lb # [ 185.766874] niks3-server[1167]: 2026/09/25 16:34:31 INFO Signed narinfos id=81 count=16657lb # [ 185.772983] niks3-server[1167]: 2026/09/25 16:34:31 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6658worker1 # [ 185.784611] nix-grpc-daemon[1941]: time=2026-09-25T16:34:31.378Z level=INFO msg="Upload complete. (171ms)"6659lb # [ 185.780844] niks3-server[1167]: 2026/09/25 16:34:31 INFO Received complete push request method=POST path=/api/pushes/81/complete6660lb # [ 185.785046] niks3-server[1167]: 2026/09/25 16:34:31 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6661worker1 # [ 185.792177] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=7526662worker1 # [ 185.796735] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246663worker1 # [ 185.804991] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6664worker1 # [ 185.808707] nix-daemon[855]: reaped child process 2213, status = succeeded6665worker1 # [ 185.818187] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6666worker1 # [ 186.852858] nix-daemon[855]: reaped child process 2222, status = succeeded6667worker1 # [ 186.968063] nix-daemon[855]: accepted connection from pid 2238, user nix-grpc-daemon (trusted)6668worker1 # [ 186.984159] nix-daemon[855]: reaped child process 2241, status = succeeded6669lb # [ 186.986194] niks3-server[1167]: 2026/09/25 16:34:32 INFO Received push request method=POST path=/api/pushes6670worker1 # [ 186.998146] nix-grpc-daemon[1941]: time=2026-09-25T16:34:32.590Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6671worker1 # [ 186.999756] nix-grpc-daemon[1941]: time=2026-09-25T16:34:32.590Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6672lb # [ 187.012157] niks3-server[1167]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6673worker1 # [ 187.022643] nix-grpc-daemon[1941]: time=2026-09-25T16:34:32.616Z level=INFO msg="Uploading 1 narinfos"6674lb # [ 187.017730] niks3-server[1167]: 2026/09/25 16:34:32 INFO Received sign narinfos request method=POST path=/api/pushes/82/sign6675lb # [ 187.023949] niks3-server[1167]: 2026/09/25 16:34:32 INFO Signed narinfos id=82 count=16676lb # [ 187.028481] niks3-server[1167]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6677lb # [ 187.031425] niks3-server[1167]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6678worker1 # [ 187.046699] nix-grpc-daemon[1941]: time=2026-09-25T16:34:32.640Z level=INFO msg="Upload complete. (219ms)"6679lb # [ 187.041623] niks3-server[1167]: 2026/09/25 16:34:32 INFO Received complete push request method=POST path=/api/pushes/82/complete6680lb # [ 187.045150] niks3-server[1167]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6681worker2 # [ 187.070131] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:32Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16682worker1 # [ 187.055276] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=17 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=06683worker1 # [ 187.066933] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246684worker1 # [ 187.071058] nix-daemon[855]: reaped child process 2220, status = succeeded6685worker1 # [ 187.076407] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246686worker1 # [ 187.084490] nix-grpc-daemon[1941]: time=2026-09-25T16:34:32.678Z level=INFO msg="All 2 paths already cached"6687worker1 # [ 187.090121] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246688worker1 # [ 187.097849] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6689worker1 # [ 187.213403] nix-daemon[855]: accepted connection from pid 2245, user nix-grpc-daemon (trusted)6690worker1 # [ 187.230071] nix-daemon[855]: reaped child process 2248, status = succeeded6691lb # [ 187.230268] niks3-server[1167]: 2026/09/25 16:34:32 INFO Received push request method=POST path=/api/pushes6692worker1 # [ 187.239730] nix-grpc-daemon[1941]: time=2026-09-25T16:34:32.833Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6693worker1 # [ 187.241492] nix-grpc-daemon[1941]: time=2026-09-25T16:34:32.833Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6694worker1 # [ 187.257231] nix-grpc-daemon[1941]: time=2026-09-25T16:34:32.851Z level=INFO msg="Uploading 1 narinfos"6695lb # [ 187.247008] niks3-server[1167]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6696lb # [ 187.254342] niks3-server[1167]: 2026/09/25 16:34:32 INFO Received sign narinfos request method=POST path=/api/pushes/83/sign6697lb # [ 187.260365] niks3-server[1167]: 2026/09/25 16:34:32 INFO Signed narinfos id=83 count=16698lb # [ 187.267294] niks3-server[1167]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6699worker1 # [ 187.275931] nix-grpc-daemon[1941]: time=2026-09-25T16:34:32.869Z level=INFO msg="Upload complete. (169ms)"6700lb # [ 187.273580] niks3-server[1167]: 2026/09/25 16:34:32 INFO Received complete push request method=POST path=/api/pushes/83/complete6701lb # [ 187.277140] niks3-server[1167]: 2026/09/25 16:34:32 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6702worker1 # [ 187.286832] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=7526703worker1 # [ 187.290459] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246704worker1 # [ 187.293220] nix-daemon[855]: reaped child process 2243, status = succeeded6705worker1 # [ 187.298469] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6706worker1 # [ 187.306571] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6707worker1 # [ 188.552792] nix-daemon[855]: reaped child process 2252, status = succeeded6708worker1 # [ 188.655099] nix-daemon[855]: accepted connection from pid 2268, user nix-grpc-daemon (trusted)6709worker1 # [ 188.672942] nix-daemon[855]: reaped child process 2271, status = succeeded6710lb # [ 188.671640] niks3-server[1167]: 2026/09/25 16:34:34 INFO Received push request method=POST path=/api/pushes6711worker1 # [ 188.684415] nix-grpc-daemon[1941]: time=2026-09-25T16:34:34.277Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6712worker1 # [ 188.686068] nix-grpc-daemon[1941]: time=2026-09-25T16:34:34.277Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6713lb # [ 188.696761] niks3-server[1167]: 2026/09/25 16:34:34 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6714worker1 # [ 188.712922] nix-grpc-daemon[1941]: time=2026-09-25T16:34:34.306Z level=INFO msg="Uploading 1 narinfos"6715lb # [ 188.703314] niks3-server[1167]: 2026/09/25 16:34:34 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6716lb # [ 188.711241] niks3-server[1167]: 2026/09/25 16:34:34 INFO Received sign narinfos request method=POST path=/api/pushes/84/sign6717lb # [ 188.716255] niks3-server[1167]: 2026/09/25 16:34:34 INFO Signed narinfos id=84 count=16718lb # [ 188.717958] niks3-server[1167]: 2026/09/25 16:34:34 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6719worker1 # [ 188.733602] nix-grpc-daemon[1941]: time=2026-09-25T16:34:34.327Z level=INFO msg="Upload complete. (218ms)"6720lb # [ 188.729275] niks3-server[1167]: 2026/09/25 16:34:34 INFO Received complete push request method=POST path=/api/pushes/84/complete6721lb # [ 188.734247] niks3-server[1167]: 2026/09/25 16:34:34 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6722worker2 # [ 188.754695] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:34Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16723worker1 # [ 188.740522] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=18 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=06724worker1 # [ 188.753076] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246725worker1 # [ 188.757008] nix-daemon[855]: reaped child process 2250, status = succeeded6726worker1 # [ 188.761819] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542246727worker1 # [ 188.770158] nix-grpc-daemon[1941]: time=2026-09-25T16:34:34.364Z level=INFO msg="All 2 paths already cached"6728worker1 # [ 188.775773] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542246729worker1 # [ 188.785126] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6730worker1 # [ 188.901201] nix-daemon[855]: accepted connection from pid 2275, user nix-grpc-daemon (trusted)6731lb # [ 188.912729] niks3-server[1167]: 2026/09/25 16:34:34 INFO Received push request method=POST path=/api/pushes6732worker1 # [ 188.920741] nix-daemon[855]: reaped child process 2278, status = succeeded6733worker1 # [ 188.922697] nix-grpc-daemon[1941]: time=2026-09-25T16:34:34.516Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6734worker1 # [ 188.924238] nix-grpc-daemon[1941]: time=2026-09-25T16:34:34.516Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6735lb # [ 188.929412] niks3-server[1167]: 2026/09/25 16:34:34 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6736worker1 # [ 188.940075] nix-grpc-daemon[1941]: time=2026-09-25T16:34:34.533Z level=INFO msg="Uploading 1 narinfos"6737lb # [ 188.936564] niks3-server[1167]: 2026/09/25 16:34:34 INFO Received sign narinfos request method=POST path=/api/pushes/85/sign6738lb # [ 188.943148] niks3-server[1167]: 2026/09/25 16:34:34 INFO Signed narinfos id=85 count=16739lb # [ 188.946884] niks3-server[1167]: 2026/09/25 16:34:34 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6740lb # [ 188.956283] niks3-server[1167]: 2026/09/25 16:34:34 INFO Received complete push request method=POST path=/api/pushes/85/complete6741worker1 # [ 188.965421] nix-grpc-daemon[1941]: time=2026-09-25T16:34:34.559Z level=INFO msg="Upload complete. (173ms)"6742lb # [ 188.961518] niks3-server[1167]: 2026/09/25 16:34:34 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6743worker1 # [ 188.971682] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=0 paths=1 nar_bytes_in=7526744worker1 # [ 188.981334] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542246745worker1 # [ 188.985601] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6746worker1 # [ 188.989491] nix-daemon[855]: reaped child process 2273, status = succeeded6747worker1 # [ 188.998684] nix-daemon[855]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6748worker1 # [ 190.240729] nix-daemon[855]: reaped child process 2282, status = succeeded6749worker1 # [ 190.337788] nix-daemon[855]: accepted connection from pid 2298, user nix-grpc-daemon (trusted)6750worker1 # [ 190.355890] nix-daemon[855]: reaped child process 2301, status = succeeded6751lb # [ 190.349665] niks3-server[1167]: 2026/09/25 16:34:35 INFO Received push request method=POST path=/api/pushes6752worker1 # [ 190.360356] nix-grpc-daemon[1941]: time=2026-09-25T16:34:35.953Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6753worker1 # [ 190.361875] nix-grpc-daemon[1941]: time=2026-09-25T16:34:35.953Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6754lb # [ 190.380377] niks3-server[1167]: 2026/09/25 16:34:35 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6755worker1 # [ 190.390578] nix-grpc-daemon[1941]: time=2026-09-25T16:34:35.984Z level=INFO msg="Uploading 1 narinfos"6756lb # [ 190.388880] niks3-server[1167]: 2026/09/25 16:34:35 INFO Received sign narinfos request method=POST path=/api/pushes/86/sign6757lb # [ 190.391220] niks3-server[1167]: 2026/09/25 16:34:35 INFO Signed narinfos id=86 count=16758lb # [ 190.401795] niks3-server[1167]: 2026/09/25 16:34:36 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6759worker1 # [ 190.410991] nix-grpc-daemon[1941]: time=2026-09-25T16:34:36.005Z level=INFO msg="Upload complete. (205ms)"6760lb # [ 190.407842] niks3-server[1167]: 2026/09/25 16:34:36 INFO Received complete push request method=POST path=/api/pushes/86/complete6761lb # [ 190.413452] niks3-server[1167]: 2026/09/25 16:34:36 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6762lb # [ 190.417089] niks3-server[1167]: 2026/09/25 16:34:36 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6763worker1 # [ 190.420616] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54224 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=19 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=06764worker1 # [ 190.429309] nix-daemon[855]: reaped child process 2280, status = succeeded6765client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 13.50 seconds)6766worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6767worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6768client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]'6769client # [ 190.535924] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6770client # Running as unit: gpu.service; invocation ID: 081411399b4c449e9b003599485b38a66771client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.05 seconds)6772lb: must succeed: curl -sf localhost:9901/clusters6773lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6774lb: must succeed: curl -sf localhost:9901/clusters6775lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6776worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6777worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6778worker1 # [ 190.700197] nix-grpc-daemon[1881]: ts=2026-09-25T16:34:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542246779client # [ 190.715303] nix[1578]: don't know how to build these paths:6780client # [ 190.716376] nix[1578]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv6781worker2 # [ 190.724819] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454266782worker2 # [ 190.738917] nix-grpc-daemon[1535]: ts=2026-09-25T16:34:36Z level=debug event=want client=7 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06783client # [ 190.734664] nix[1578]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}, waiting up to 30s for a worker6784lb: must succeed: curl -sf localhost:9901/clusters6785lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6786lb: must succeed: curl -sf localhost:9901/clusters6787lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6788worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6789worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6790client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6791lb # [ 197.474778] envoy[894]: conn peer=[2001:db8:1::1]:51744 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27110 tx=12259 ms=133026792client # [ 220.739209] nix[1578]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}6793client # [ 220.748070] nix[1578]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed6794client # [ 220.772631] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6795client # [ 220.774681] systemd[1]: gpu.service: Failed with result 'exit-code'.6796client # [ 220.778433] systemd[1]: gpu.service: Consumed 166ms CPU time over 30.236s wall clock time, 35.4M memory peak, 5.6K incoming IP traffic, 5.2K outgoing IP traffic.6797client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.20 seconds)6798client: must succeed: journalctl -u gpu -o cat6799client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds)6800lb: must succeed: curl -sf localhost:9901/clusters6801lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6802lb: must succeed: curl -sf localhost:9901/clusters6803lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6804worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6805worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6806(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 44.13 seconds)6807subtest: low disk drains a worker and builds go to the other6808worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6809worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.17 seconds)6810worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6811worker1 # [ 222.469942] nix-grpc-daemon[1881]: ts=2026-09-25T16:35:08Z level=info event=unhealthy reason=min_free6812worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.07 seconds)6813client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&26814worker2 # [ 223.526357] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:454266815client # don't know how to build these paths:6816client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6817worker2 # [ 223.533936] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454266818worker2 # [ 223.549753] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:09Z level=debug event=want client=8 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06819worker2 # [ 223.555121] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:09Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16820worker2 # [ 223.560290] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266821worker2 # [ 223.564637] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454266822client # copying 1 paths to 'lb:50051'...6823client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6824worker2 # [ 223.571658] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454266825worker2 # [ 223.580908] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6826worker2 # [ 223.703379] nix-daemon[840]: accepted connection from pid 1912, user nix-grpc-daemon (trusted)6827worker2 # [ 223.722032] nix-daemon[840]: reaped child process 1915, status = succeeded6828lb # [ 223.706025] niks3-server[1167]: 2026/09/25 16:35:09 INFO Received push request method=POST path=/api/pushes6829worker2 # [ 223.733782] nix-grpc-daemon[1615]: time=2026-09-25T16:35:09.330Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6830worker2 # [ 223.735292] nix-grpc-daemon[1615]: time=2026-09-25T16:35:09.330Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6831lb # [ 223.732550] niks3-server[1167]: 2026/09/25 16:35:09 INFO Received sign narinfos request method=POST path=/api/pushes/87/sign6832worker2 # [ 223.758540] nix-grpc-daemon[1615]: time=2026-09-25T16:35:09.355Z level=INFO msg="Uploading 1 narinfos"6833lb # [ 223.740212] niks3-server[1167]: 2026/09/25 16:35:09 INFO Signed narinfos id=87 count=16834lb # [ 223.748391] niks3-server[1167]: 2026/09/25 16:35:09 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6835lb # [ 223.755366] niks3-server[1167]: 2026/09/25 16:35:09 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6836lb # [ 223.766355] niks3-server[1167]: 2026/09/25 16:35:09 INFO Received complete push request method=POST path=/api/pushes/87/complete6837worker2 # [ 223.789317] nix-grpc-daemon[1615]: time=2026-09-25T16:35:09.386Z level=INFO msg="Upload complete. (199ms)"6838lb # [ 223.774545] niks3-server[1167]: 2026/09/25 16:35:09 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6839worker2 # [ 223.796126] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=0 paths=1 nar_bytes_in=5126840worker2 # [ 223.799402] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266841worker2 # [ 223.812443] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6842worker2 # [ 223.814780] nix-daemon[840]: reaped child process 1910, status = succeeded6843client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6844client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6845worker2 # [ 223.823872] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6846client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6847client # farm-a> LOG-farm-a-drain6848worker2 # [ 224.860602] nix-daemon[840]: reaped child process 1919, status = succeeded6849worker2 # [ 224.963866] nix-daemon[840]: accepted connection from pid 1935, user nix-grpc-daemon (trusted)6850worker2 # [ 224.978250] nix-daemon[840]: reaped child process 1938, status = succeeded6851lb # [ 224.964749] niks3-server[1167]: 2026/09/25 16:35:10 INFO Received push request method=POST path=/api/pushes6852worker2 # [ 224.992298] nix-grpc-daemon[1615]: time=2026-09-25T16:35:10.588Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6853worker2 # [ 224.993801] nix-grpc-daemon[1615]: time=2026-09-25T16:35:10.588Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6854lb # [ 224.986349] niks3-server[1167]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6855lb # [ 224.995092] niks3-server[1167]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6856worker2 # [ 225.021880] nix-grpc-daemon[1615]: time=2026-09-25T16:35:10.619Z level=INFO msg="Uploading 1 narinfos"6857lb # [ 225.002200] niks3-server[1167]: 2026/09/25 16:35:10 INFO Received sign narinfos request method=POST path=/api/pushes/88/sign6858lb # [ 225.008805] niks3-server[1167]: 2026/09/25 16:35:10 INFO Signed narinfos id=88 count=16859lb # [ 225.010643] niks3-server[1167]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6860lb # [ 225.020302] niks3-server[1167]: 2026/09/25 16:35:10 INFO Received complete push request method=POST path=/api/pushes/88/complete6861worker2 # [ 225.047001] nix-grpc-daemon[1615]: time=2026-09-25T16:35:10.644Z level=INFO msg="Upload complete. (213ms)"6862lb # [ 225.027130] niks3-server[1167]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6863worker2 # [ 225.057585] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=20 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06864worker2 # [ 225.069290] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:10Z level=debug event=want client=8 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06865worker2 # [ 225.073876] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:10Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16866worker2 # [ 225.078748] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266867worker2 # [ 225.082902] nix-daemon[840]: reaped child process 1917, status = succeeded6868worker2 # [ 225.085595] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454266869client # copying 1 paths to 'lb:50051'...6870worker2 # [ 225.089383] nix-grpc-daemon[1615]: time=2026-09-25T16:35:10.686Z level=INFO msg="All 1 paths already cached"6871client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6872worker2 # [ 225.092305] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454266873worker2 # [ 225.104368] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6874worker2 # [ 225.209662] nix-daemon[840]: accepted connection from pid 1944, user nix-grpc-daemon (trusted)6875worker2 # [ 225.225392] nix-daemon[840]: reaped child process 1947, status = succeeded6876lb # [ 225.209454] niks3-server[1167]: 2026/09/25 16:35:10 INFO Received push request method=POST path=/api/pushes6877worker2 # [ 225.234936] nix-grpc-daemon[1615]: time=2026-09-25T16:35:10.832Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6878worker2 # [ 225.236643] nix-grpc-daemon[1615]: time=2026-09-25T16:35:10.832Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6879worker2 # [ 225.247166] nix-grpc-daemon[1615]: time=2026-09-25T16:35:10.844Z level=INFO msg="Uploading 1 narinfos"6880lb # [ 225.226081] niks3-server[1167]: 2026/09/25 16:35:10 INFO Received sign narinfos request method=POST path=/api/pushes/89/sign6881lb # [ 225.232239] niks3-server[1167]: 2026/09/25 16:35:10 INFO Signed narinfos id=89 count=16882lb # [ 225.238591] niks3-server[1167]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6883lb # [ 225.249314] niks3-server[1167]: 2026/09/25 16:35:10 INFO Received complete push request method=POST path=/api/pushes/89/complete6884lb # [ 225.251740] niks3-server[1167]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6885worker2 # [ 225.277278] nix-grpc-daemon[1615]: time=2026-09-25T16:35:10.874Z level=INFO msg="Upload complete. (169ms)"6886lb # [ 225.258291] niks3-server[1167]: 2026/09/25 16:35:10 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6887worker2 # [ 225.284905] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=0 paths=1 nar_bytes_in=6326888worker2 # [ 225.292184] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266889worker2 # [ 225.298523] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6890worker2 # [ 225.300968] nix-daemon[840]: reaped child process 1942, status = succeeded6891client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6892client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6893worker2 # [ 225.309742] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6894client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6895client # farm-b> LOG-farm-b-drain6896worker2 # [ 226.747193] nix-daemon[840]: reaped child process 1951, status = succeeded6897worker2 # [ 226.842648] nix-daemon[840]: accepted connection from pid 1967, user nix-grpc-daemon (trusted)6898worker2 # [ 226.859162] nix-daemon[840]: reaped child process 1970, status = succeeded6899lb # [ 226.843149] niks3-server[1167]: 2026/09/25 16:35:12 INFO Received push request method=POST path=/api/pushes6900worker2 # [ 226.872224] nix-grpc-daemon[1615]: time=2026-09-25T16:35:12.466Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6901worker2 # [ 226.873733] nix-grpc-daemon[1615]: time=2026-09-25T16:35:12.466Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6902lb # [ 226.868092] niks3-server[1167]: 2026/09/25 16:35:12 INFO Received sign narinfos request method=POST path=/api/pushes/90/sign6903worker2 # [ 226.893228] nix-grpc-daemon[1615]: time=2026-09-25T16:35:12.490Z level=INFO msg="Uploading 1 narinfos"6904lb # [ 226.876206] niks3-server[1167]: 2026/09/25 16:35:12 INFO Signed narinfos id=90 count=16905lb # [ 226.878004] niks3-server[1167]: 2026/09/25 16:35:12 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6906lb # [ 226.888290] niks3-server[1167]: 2026/09/25 16:35:12 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6907lb # [ 226.890917] niks3-server[1167]: 2026/09/25 16:35:12 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6908worker2 # [ 226.920497] nix-grpc-daemon[1615]: time=2026-09-25T16:35:12.517Z level=INFO msg="Upload complete. (203ms)"6909lb # [ 226.901567] niks3-server[1167]: 2026/09/25 16:35:12 INFO Received complete push request method=POST path=/api/pushes/90/complete6910lb # [ 226.905528] niks3-server[1167]: 2026/09/25 16:35:12 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6911worker2 # [ 226.928674] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=21 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=06912worker2 # [ 226.942314] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:12Z level=debug event=want client=8 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06913worker2 # [ 226.946273] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:12Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16914worker2 # [ 226.950248] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266915worker2 # [ 226.953584] nix-daemon[840]: reaped child process 1949, status = succeeded6916worker2 # [ 226.956305] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:454266917worker2 # [ 226.961769] nix-grpc-daemon[1615]: time=2026-09-25T16:35:12.559Z level=INFO msg="All 2 paths already cached"6918client # copying 1 paths to 'lb:50051'...6919client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6920worker2 # [ 226.967605] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:454266921worker2 # [ 226.975351] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6922worker2 # [ 227.085332] nix-daemon[840]: accepted connection from pid 1976, user nix-grpc-daemon (trusted)6923worker2 # [ 227.103941] nix-daemon[840]: reaped child process 1979, status = succeeded6924lb # [ 227.086978] niks3-server[1167]: 2026/09/25 16:35:12 INFO Received push request method=POST path=/api/pushes6925worker2 # [ 227.111850] nix-grpc-daemon[1615]: time=2026-09-25T16:35:12.709Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6926worker2 # [ 227.113625] nix-grpc-daemon[1615]: time=2026-09-25T16:35:12.709Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6927lb # [ 227.100847] niks3-server[1167]: 2026/09/25 16:35:12 INFO Received sign narinfos request method=POST path=/api/pushes/91/sign6928worker2 # [ 227.125383] nix-grpc-daemon[1615]: time=2026-09-25T16:35:12.722Z level=INFO msg="Uploading 1 narinfos"6929lb # [ 227.108753] niks3-server[1167]: 2026/09/25 16:35:12 INFO Signed narinfos id=91 count=16930lb # [ 227.113254] niks3-server[1167]: 2026/09/25 16:35:12 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6931lb # [ 227.115715] niks3-server[1167]: 2026/09/25 16:35:12 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6932lb # [ 227.126435] niks3-server[1167]: 2026/09/25 16:35:12 INFO Received complete push request method=POST path=/api/pushes/91/complete6933worker2 # [ 227.151468] nix-grpc-daemon[1615]: time=2026-09-25T16:35:12.748Z level=INFO msg="Upload complete. (168ms)"6934lb # [ 227.131564] niks3-server[1167]: 2026/09/25 16:35:12 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6935worker2 # [ 227.155774] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=0 paths=1 nar_bytes_in=7606936worker2 # [ 227.164452] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:454266937worker2 # [ 227.170128] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6938worker2 # [ 227.171644] nix-daemon[840]: reaped child process 1974, status = succeeded6939client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6940worker2 # [ 227.179892] nix-daemon[840]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)6941client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6942lb # [ 227.473553] envoy[894]: conn peer=[2001:db8:1::1]:42536 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=931 tx=613 ms=300466943client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6944client # farm-top> LOG-farm-top-drain6945worker2 # [ 228.018135] nix-daemon[840]: reaped child process 1983, status = succeeded6946worker2 # [ 228.118877] nix-daemon[840]: accepted connection from pid 1999, user nix-grpc-daemon (trusted)6947lb # [ 228.115411] niks3-server[1167]: 2026/09/25 16:35:13 INFO Received push request method=POST path=/api/pushes6948worker2 # [ 228.138458] nix-daemon[840]: reaped child process 2002, status = succeeded6949worker2 # [ 228.142640] nix-grpc-daemon[1615]: time=2026-09-25T16:35:13.738Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6950worker2 # [ 228.144284] nix-grpc-daemon[1615]: time=2026-09-25T16:35:13.738Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6951lb # [ 228.140206] niks3-server[1167]: 2026/09/25 16:35:13 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6952worker2 # [ 228.167329] nix-grpc-daemon[1615]: time=2026-09-25T16:35:13.764Z level=INFO msg="Uploading 1 narinfos"6953lb # [ 228.149346] niks3-server[1167]: 2026/09/25 16:35:13 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6954lb # [ 228.151799] niks3-server[1167]: 2026/09/25 16:35:13 INFO Received sign narinfos request method=POST path=/api/pushes/92/sign6955lb # [ 228.161662] niks3-server[1167]: 2026/09/25 16:35:13 INFO Signed narinfos id=92 count=16956lb # [ 228.163411] niks3-server[1167]: 2026/09/25 16:35:13 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6957worker2 # [ 228.188241] nix-grpc-daemon[1615]: time=2026-09-25T16:35:13.785Z level=INFO msg="Upload complete. (199ms)"6958lb # [ 228.169416] niks3-server[1167]: 2026/09/25 16:35:13 INFO Received complete push request method=POST path=/api/pushes/92/complete6959lb # [ 228.173182] niks3-server[1167]: 2026/09/25 16:35:13 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6960worker2 # [ 228.197225] nix-grpc-daemon[1535]: ts=2026-09-25T16:35:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45426 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=22 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=06961worker2 # [ 228.207108] nix-daemon[840]: reaped child process 1981, status = succeeded6962client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2, in 4.87 seconds)6963client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath6964client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath, in 0.14 seconds)6965worker1: must succeed: rm /nix/.rw-store/fill6966worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)6967worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6968worker1 # [ 229.473410] nix-grpc-daemon[1881]: ts=2026-09-25T16:35:15Z level=info event=healthy reason=min_free6969worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.07 seconds)6970(finished: subtest: low disk drains a worker and builds go to the other, in 8.48 seconds)6971(finished: run the VM test script, in 230.42 seconds)6972test script finished in 230.55s6973cleanup6974kill QemuMachine (pid 49)6975client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)6976client # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6977client # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6978client # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6979kill QemuMachine (pid 50)6980lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)6981lb # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6982lb # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6983lb # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6984kill QemuMachine (pid 52)6985worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)6986worker1 # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6987worker1 # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6988worker1 # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6989kill QemuMachine (pid 51)6990worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)6991worker2 # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6992worker2 # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6993worker2 # [2026-09-25T16:35:15Z INFO virtiofsd] Client disconnected, shutting down6994(finished: cleanup, in 1.05 seconds)6995additionally exposed symbols:6996 client, lb, worker1, worker2,6997 vlan1,6998 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh