vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #504
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2: QEMU running (pid 52)14client # Disk image does not exist, creating the virtualisation disk image...15client: QEMU running (pid 49)16worker1: QEMU running (pid 51)17lb: QEMU running (pid 50)18client # Formatting '/build/vm-state-client/tmp.7hLCZH9eft', fmt=raw size=107374182419worker2 # Formatting '/build/vm-state-worker2/tmp.Gh1pbaM3bE', fmt=raw size=107374182420worker1 # Disk image does not exist, creating the virtualisation disk image...21lb # Disk image does not exist, creating the virtualisation disk image...22(finished: start all VMs, in 0.48 seconds)23worker1 # Formatting '/build/vm-state-worker1/tmp.V8V2fcAO3E', fmt=raw size=107374182424lb # Formatting '/build/vm-state-lb/tmp.ywpVMv8GFf', fmt=raw size=107374182425client: waiting for unit network-addresses-eth1.service26worker1 # mke2fs 1.47.4 (6-Mar-2025)27lb # mke2fs 1.47.4 (6-Mar-2025)28client: waiting for the VM to finish booting29worker1 # Discarding device blocks: 0/262144 done30lb # Discarding device blocks: 0/262144 done31worker2 # mke2fs 1.47.4 (6-Mar-2025)32client # mke2fs 1.47.4 (6-Mar-2025)33worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes34lb # Creating filesystem with 262144 4k blocks and 65536 inodes35worker2 # Discarding device blocks: 0/262144 done36client # Discarding device blocks: 0/262144 done37client # Creating filesystem with 262144 4k blocks and 65536 inodes38worker1 # Filesystem UUID: 6a783ceb-600b-4b5c-ac6a-df45300af53839worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes40client # Filesystem UUID: 4a57d758-9f15-48b7-96ef-8ed31142ac7041lb # Filesystem UUID: 9575fba0-c2ef-42bd-b964-1967d78dca1c42client # Superblock backups stored on blocks:43lb # Superblock backups stored on blocks:44worker2 # Filesystem UUID: 3a36e322-9909-4099-a778-e879587c08cc45worker1 # Superblock backups stored on blocks:46client # 32768, 98304, 163840, 22937647lb # 32768, 98304, 163840, 22937648worker2 # Superblock backups stored on blocks:49worker1 # 32768, 98304, 163840, 22937650client # 51lb # 52worker2 # 32768, 98304, 163840, 22937653worker1 # 54client # Allocating group tables: 0/8 done55lb # Allocating group tables: 0/8 done56worker2 # 57worker1 # Allocating group tables: 0/8 done58client # Writing inode tables: 0/8 done59lb # Writing inode tables: 0/8 done60worker2 # Allocating group tables: 0/8 done61worker1 # Writing inode tables: 0/8 done62client # Creating journal (8192 blocks): done63lb # Creating journal (8192 blocks): done64worker2 # Writing inode tables: 0/8 done65worker1 # Creating journal (8192 blocks): done66client # Writing superblocks and filesystem accounting information: 0/8 done67lb # Writing superblocks and filesystem accounting information: 0/8 done68worker2 # Creating journal (8192 blocks): done69worker1 # Writing superblocks and filesystem accounting information: 0/8 done70client # 71lb # 72worker2 # Writing superblocks and filesystem accounting information: 0/8 done73worker1 # 74client # Virtualisation disk image created.75lb # Virtualisation disk image created.76worker2 # 77worker1 # Virtualisation disk image created.78client # Starting virtiofs daemons...79lb # Starting virtiofs daemons...80worker2 # Virtualisation disk image created.81worker1 # Starting virtiofs daemons...82client # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)83lb # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)84worker2 # Starting virtiofs daemons...85worker1 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)86client # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether87lb # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether88worker2 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)89worker1 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether90client # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)91lb # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...92worker2 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether93worker1 # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...94client # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether95lb # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)96worker2 # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...97worker1 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)98client # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...99lb # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether100worker2 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)101worker1 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether102client # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...103lb # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...104worker2 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether105worker1 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)106client # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)107lb # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)108worker2 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)109worker1 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether110client # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether111lb # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether112worker2 # [2026-09-22T16:04:07Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether113worker1 # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...114client # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...115lb # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...116worker2 # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...117worker1 # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...118client # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests119lb # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests120worker2 # [2026-09-22T16:04:07Z INFO virtiofsd] Waiting for vhost-user socket connection...121worker1 # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests122client # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests123lb # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests124worker2 # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests125worker1 # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests126client # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests127lb # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests128worker2 # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests129worker1 # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests130worker2 # [2026-09-22T16:04:07Z INFO virtiofsd] Client connected, servicing requests131worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]132worker2 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026133worker2 # [ 0.000000] KASLR enabled134worker2 # [ 0.000000] random: crng init done135worker2 # [ 0.000000] Machine model: linux,dummy-virt136worker2 # [ 0.000000] efi: UEFI not found.137worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT138worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]139worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]140worker2 # [ 0.000000] Zone ranges:141worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]142worker2 # [ 0.000000] DMA32 empty143worker2 # [ 0.000000] Normal empty144worker2 # [ 0.000000] Device empty145worker2 # [ 0.000000] Movable zone start for each node146worker2 # [ 0.000000] Early memory node ranges147worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]148worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]149worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]150worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000151worker1 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026152worker2 # [ 0.000000] psci: probing for conduit method from DT.153worker1 # [ 0.000000] KASLR enabled154worker1 # [ 0.000000] random: crng init done155worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.156worker1 # [ 0.000000] Machine model: linux,dummy-virt157worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs158worker1 # [ 0.000000] efi: UEFI not found.159worker2 # [ 0.000000] psci: Trusted OS migration not required160worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT161worker2 # [ 0.000000] psci: SMC Calling Convention v1.1162client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]163worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]164worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)165worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]166client # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026167worker1 # [ 0.000000] Zone ranges:168worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296169client # [ 0.000000] KASLR enabled170worker2 # [ 0.000000] Detected PIPT I-cache on CPU0171client # [ 0.000000] random: crng init done172worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]173worker1 # [ 0.000000] DMA32 empty174client # [ 0.000000] Machine model: linux,dummy-virt175worker1 # [ 0.000000] Normal empty176worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)177client # [ 0.000000] efi: UEFI not found.178worker1 # [ 0.000000] Device empty179worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface180worker1 # [ 0.000000] Movable zone start for each node181client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT182worker2 # [ 0.000000] CPU features: detected: Spectre-v4183worker1 # [ 0.000000] Early memory node ranges184worker2 # [ 0.000000] CPU features: detected: Spectre-BHB185client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]186worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]187worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38188client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]189client # [ 0.000000] Zone ranges:190worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]191worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23192worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000193client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]194worker2 # [ 0.000000] alternatives: applying boot alternatives195client # [ 0.000000] DMA32 empty196worker1 # [ 0.000000] psci: probing for conduit method from DT.197client # [ 0.000000] Normal empty198client # [ 0.000000] Device empty199worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.200client # [ 0.000000] Movable zone start for each node201worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs202client # [ 0.000000] Early memory node ranges203worker1 # [ 0.000000] psci: Trusted OS migration not required204client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]205worker1 # [ 0.000000] psci: SMC Calling Convention v1.1206client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]207worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)208worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/91x7j7xpp6q86mih2akg81hmd36hcvqs-nixos-system-worker2-test/init regInfo=/nix/store/i3k5wlp1fqfgi1004a4pn264iky91pbm-closure-info/registration console=ttyAMA0,115200n8 console=tty0209client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000210client # [ 0.000000] psci: probing for conduit method from DT.211worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296212client # [ 0.000000] psci: PSCIv1.3 detected in firmware.213worker1 # [ 0.000000] Detected PIPT I-cache on CPU0214client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs215worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)216worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i3k5wlp1fqfgi1004a4pn264iky91pbm-closure-info/registration", will be passed to user space.217client # [ 0.000000] psci: Trusted OS migration not required218worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface219client # [ 0.000000] psci: SMC Calling Convention v1.1220worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes221worker1 # [ 0.000000] CPU features: detected: Spectre-v4222worker1 # [ 0.000000] CPU features: detected: Spectre-BHB223client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)224worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)225worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38226client # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296227worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)228client # [ 0.000000] Detected PIPT I-cache on CPU0229worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23230worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB231worker1 # [ 0.000000] alternatives: applying boot alternatives232client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)233worker2 # [ 0.000000] software IO TLB: area num 1.234client # [ 0.000000] CPU features: detected: GICv3 CPU interface235worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB236client # [ 0.000000] CPU features: detected: Spectre-v4237client # [ 0.000000] CPU features: detected: Spectre-BHB238worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)239worker2 # [ 0.000000] Fallback order for Node 0: 0240client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38241client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23242worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216243worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nkxfr43rzbz80xc8q1a00w66rjj2an3s-nixos-system-worker1-test/init regInfo=/nix/store/s2vfldvxw21afqph8awka7bg9gka3b50-closure-info/registration console=ttyAMA0,115200n8 console=tty0244worker2 # [ 0.000000] Policy zone: DMA245client # [ 0.000000] alternatives: applying boot alternatives246worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off247worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1248worker2 # [ 0.000000] allocated 3145728 bytes of page_ext249worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/s2vfldvxw21afqph8awka7bg9gka3b50-closure-info/registration", will be passed to user space.250worker2 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages251lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]252worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes253worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups254client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c7dwh1z1cl7zl3zmm2gm23k4b20rxnfn-nixos-system-client-test/init regInfo=/nix/store/bvnhgdmv5qvfh2jgky9d95hczimkx039-closure-info/registration console=ttyAMA0,115200n8 console=tty0255worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.256worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)257worker2 # [ 0.000000] rcu: RCU event tracing is enabled.258lb # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026259lb # [ 0.000000] KASLR enabled260worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)261worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.262lb # [ 0.000000] random: crng init done263client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/bvnhgdmv5qvfh2jgky9d95hczimkx039-closure-info/registration", will be passed to user space.264worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB265lb # [ 0.000000] Machine model: linux,dummy-virt266worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.267lb # [ 0.000000] efi: UEFI not found.268worker1 # [ 0.000000] software IO TLB: area num 1.269worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.270client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes271worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.272worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB273lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT274client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)275worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.276lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]277worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)278client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)279worker1 # [ 0.000000] Fallback order for Node 0: 0280lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]281worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1282lb # [ 0.000000] Zone ranges:283client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB284worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216285client # [ 0.000000] software IO TLB: area num 1.286worker1 # [ 0.000000] Policy zone: DMA287worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.288lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]289lb # [ 0.000000] DMA32 empty290client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB291worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off292lb # [ 0.000000] Normal empty293worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.294lb # [ 0.000000] Device empty295worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1296client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)297lb # [ 0.000000] Movable zone start for each node298worker1 # [ 0.000000] allocated 3145728 bytes of page_ext299client # [ 0.000000] Fallback order for Node 0: 0300lb # [ 0.000000] Early memory node ranges301worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.302worker1 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages303client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216304lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]305worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0306client # [ 0.000000] Policy zone: DMA307worker2 # [ 0.000000] GICv3: 256 SPIs implemented308worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups309lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]310worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented311worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.312client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off313lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000314worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq315worker1 # [ 0.000000] rcu: RCU event tracing is enabled.316client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1317lb # [ 0.000000] psci: probing for conduit method from DT.318worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI319worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.320client # [ 0.000000] allocated 3145728 bytes of page_ext321lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.322worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0323worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.324client # [ 0.000000] ftrace: allocating 74950 entries in 294 pages325lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs326worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.327worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000328client # [ 0.000000] ftrace: allocated 294 pages with 4 groups329lb # [ 0.000000] psci: Trusted OS migration not required330worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]331worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.332client # [ 0.000000] rcu: Hierarchical RCU implementation.333lb # [ 0.000000] psci: SMC Calling Convention v1.1334client # [ 0.000000] rcu: RCU event tracing is enabled.335worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.336worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)337lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)338client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.339worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1340client # [ 0.000000] Trampoline variant of Tasks RCU enabled.341lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296342worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)343client # [ 0.000000] Rude variant of Tasks RCU enabled.344lb # [ 0.000000] Detected PIPT I-cache on CPU0345worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.346worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000347client # [ 0.000000] Tracing variant of Tasks RCU enabled.348lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)349worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000350worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.351client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.352lb # [ 0.000000] CPU features: detected: GICv3 CPU interface353worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.354lb # [ 0.000000] CPU features: detected: Spectre-v4355client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1356worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.357lb # [ 0.000000] CPU features: detected: Spectre-BHB358worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0359worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns360client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.361worker1 # [ 0.000000] GICv3: 256 SPIs implemented362lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38363worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented364worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).365lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23366worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq367client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.368lb # [ 0.000000] alternatives: applying boot alternatives369worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI370worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns371client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.372worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0373worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns374client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0375worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000376client # [ 0.000000] GICv3: 256 SPIs implemented377worker2 # [ 0.000033] arm-pv: using stolen time PV378worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]379client # [ 0.000000] GICv3: 0 Extended SPIs implemented380client # [ 0.000000] Root IRQ handler: gic_handle_irq381worker2 # [ 0.000635] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)382worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)383client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI384worker2 # [ 0.000799] Console: colour dummy device 80x25385lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/mn9m4a8i35iwjnz1zkvng0j27k4wmx18-nixos-system-lb-test/init regInfo=/nix/store/2ixac8xwwrdp73dwl37hz2588chd1m5k-closure-info/registration console=ttyAMA0,115200n8 console=tty0386client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0387worker2 # [ 0.000807] printk: legacy console [tty0] enabled388worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)389client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000390worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000391client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]392worker2 # [ 0.000996] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)393lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/2ixac8xwwrdp73dwl37hz2588chd1m5k-closure-info/registration", will be passed to user space.394worker2 # [ 0.001003] pid_max: default: 32768 minimum: 301395worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000396lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes397client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)398worker2 # [ 0.001073] LSM: initializing lsm=capability,landlock,yama,bpf,ima399worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.400worker2 # [ 0.001233] landlock: Up and running.401lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)402worker2 # [ 0.001236] Yama: becoming mindful.403client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)404worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns405worker2 # [ 0.001790] LSM support for eBPF active406lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)407client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000408worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).409worker2 # [ 0.001937] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)410lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB411client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000412lb # [ 0.000000] software IO TLB: area num 1.413worker2 # [ 0.001975] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)414worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns415client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.416lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB417worker2 # [ 0.003786] rcu: Hierarchical SRCU implementation.418worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns419worker2 # [ 0.003790] rcu: Max phase no-delay instances is 1000.420lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)421client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns422worker1 # [ 0.000030] arm-pv: using stolen time PV423worker2 # [ 0.005022] fsl-mc MSI: its@8080000 domain created424lb # [ 0.000000] Fallback order for Node 0: 0425client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).426worker2 # [ 0.005112] EFI services will not be available.427lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216428worker1 # [ 0.000440] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)429worker2 # [ 0.005185] smp: Bringing up secondary CPUs ...430lb # [ 0.000000] Policy zone: DMA431worker1 # [ 0.000609] Console: colour dummy device 80x25432worker2 # [ 0.005194] smp: Brought up 1 node, 1 CPU433client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns434lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off435worker1 # [ 0.000617] printk: legacy console [tty0] enabled436worker2 # [ 0.005197] SMP: Total of 1 processors activated.437client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns438worker2 # [ 0.005202] CPU: All CPU(s) started at EL1439lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1440client # [ 0.000028] arm-pv: using stolen time PV441lb # [ 0.000000] allocated 3145728 bytes of page_ext442worker1 # [ 0.000808] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)443worker2 # [ 0.005213] CPU features: detected: Branch Target Identification444worker1 # [ 0.000815] pid_max: default: 32768 minimum: 301445lb # [ 0.000000] ftrace: allocating 74950 entries in 294 pages446worker2 # [ 0.005217] CPU features: detected: ARMv8.4 Translation Table Level447client # [ 0.000425] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)448lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups449worker1 # [ 0.000887] LSM: initializing lsm=capability,landlock,yama,bpf,ima450client # [ 0.000595] Console: colour dummy device 80x25451worker1 # [ 0.001063] landlock: Up and running.452worker2 # [ 0.005220] CPU features: detected: Instruction cache invalidation not required for I/D coherence453lb # [ 0.000000] rcu: Hierarchical RCU implementation.454client # [ 0.000602] printk: legacy console [tty0] enabled455worker1 # [ 0.001066] Yama: becoming mindful.456lb # [ 0.000000] rcu: RCU event tracing is enabled.457worker1 # [ 0.001521] LSM support for eBPF active458worker2 # [ 0.005224] CPU features: detected: Data cache clean to the PoU not required for I/D coherence459lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.460client # [ 0.000818] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)461worker1 # [ 0.001664] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)462worker2 # [ 0.005228] CPU features: detected: Common not Private translations463client # [ 0.000825] pid_max: default: 32768 minimum: 301464lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.465worker2 # [ 0.005231] CPU features: detected: CRC32 instructions466lb # [ 0.000000] Rude variant of Tasks RCU enabled.467worker1 # [ 0.001697] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)468client # [ 0.000898] LSM: initializing lsm=capability,landlock,yama,bpf,ima469client # [ 0.001054] landlock: Up and running.470lb # [ 0.000000] Tracing variant of Tasks RCU enabled.471worker1 # [ 0.003547] rcu: Hierarchical SRCU implementation.472worker2 # [ 0.005234] CPU features: detected: Data cache clean to Point of Deep Persistence473client # [ 0.001057] Yama: becoming mindful.474worker1 # [ 0.003552] rcu: Max phase no-delay instances is 1000.475lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.476client # [ 0.001522] LSM support for eBPF active477worker2 # [ 0.005238] CPU features: detected: Data cache clean to Point of Persistence478worker1 # [ 0.004837] fsl-mc MSI: its@8080000 domain created479lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1480worker1 # [ 0.004928] EFI services will not be available.481worker2 # [ 0.005241] CPU features: detected: Data independent timing control (DIT)482client # [ 0.001689] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)483worker1 # [ 0.004996] smp: Bringing up secondary CPUs ...484worker2 # [ 0.005244] CPU features: detected: E0PD485client # [ 0.001723] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)486lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.487worker1 # [ 0.005004] smp: Brought up 1 node, 1 CPU488worker2 # [ 0.005246] CPU features: detected: Enhanced Counter Virtualization489client # [ 0.003576] rcu: Hierarchical SRCU implementation.490worker1 # [ 0.005007] SMP: Total of 1 processors activated.491lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.492worker1 # [ 0.005012] CPU: All CPU(s) started at EL1493worker2 # [ 0.005249] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)494client # [ 0.003581] rcu: Max phase no-delay instances is 1000.495client # [ 0.004849] fsl-mc MSI: its@8080000 domain created496worker1 # [ 0.005023] CPU features: detected: Branch Target Identification497worker2 # [ 0.005253] CPU features: detected: Enhanced Virtualization Traps498lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.499client # [ 0.004940] EFI services will not be available.500worker2 # [ 0.005256] CPU features: detected: Fine Grained Traps501worker1 # [ 0.005026] CPU features: detected: ARMv8.4 Translation Table Level502lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0503client # [ 0.005030] smp: Bringing up secondary CPUs ...504lb # [ 0.000000] GICv3: 256 SPIs implemented505client # [ 0.005039] smp: Brought up 1 node, 1 CPU506worker2 # [ 0.005259] CPU features: detected: Generic authentication (architected QARMA5 algorithm)507worker1 # [ 0.005030] CPU features: detected: Instruction cache invalidation not required for I/D coherence508lb # [ 0.000000] GICv3: 0 Extended SPIs implemented509client # [ 0.005042] SMP: Total of 1 processors activated.510worker2 # [ 0.005264] CPU features: detected: RCpc load-acquire (LDAPR)511client # [ 0.005047] CPU: All CPU(s) started at EL1512lb # [ 0.000000] Root IRQ handler: gic_handle_irq513worker1 # [ 0.005033] CPU features: detected: Data cache clean to the PoU not required for I/D coherence514worker2 # [ 0.005267] CPU features: detected: LSE atomic instructions515lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI516client # [ 0.005057] CPU features: detected: Branch Target Identification517worker1 # [ 0.005037] CPU features: detected: Common not Private translations518lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0519worker2 # [ 0.005270] CPU features: detected: Privileged Access Never520client # [ 0.005061] CPU features: detected: ARMv8.4 Translation Table Level521worker2 # [ 0.005272] CPU features: detected: PMUv3522worker1 # [ 0.005040] CPU features: detected: CRC32 instructions523lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000524worker2 # [ 0.005275] CPU features: detected: RAS Extension Support525lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]526client # [ 0.005064] CPU features: detected: Instruction cache invalidation not required for I/D coherence527worker1 # [ 0.005043] CPU features: detected: Data cache clean to Point of Deep Persistence528worker2 # [ 0.005278] CPU features: detected: RASv1p1 Extension Support529worker1 # [ 0.005046] CPU features: detected: Data cache clean to Point of Persistence530client # [ 0.005068] CPU features: detected: Data cache clean to the PoU not required for I/D coherence531lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)532worker2 # [ 0.005280] CPU features: detected: Random Number Generator533worker1 # [ 0.005049] CPU features: detected: Data independent timing control (DIT)534client # [ 0.005072] CPU features: detected: Common not Private translations535worker2 # [ 0.005283] CPU features: detected: Speculation barrier (SB)536lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)537client # [ 0.005075] CPU features: detected: CRC32 instructions538worker1 # [ 0.005053] CPU features: detected: E0PD539worker2 # [ 0.005286] CPU features: detected: Stage-2 Force Write-Back540lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000541worker1 # [ 0.005055] CPU features: detected: Enhanced Counter Virtualization542client # [ 0.005078] CPU features: detected: Data cache clean to Point of Deep Persistence543worker2 # [ 0.005289] CPU features: detected: TLB range maintenance instructions544worker1 # [ 0.005058] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)545lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000546client # [ 0.005081] CPU features: detected: Data cache clean to Point of Persistence547worker2 # [ 0.005294] CPU features: detected: Speculative Store Bypassing Safe (SSBS)548worker1 # [ 0.005062] CPU features: detected: Enhanced Virtualization Traps549lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.550worker2 # [ 0.005331] alternatives: applying system-wide alternatives551client # [ 0.005084] CPU features: detected: Data independent timing control (DIT)552worker1 # [ 0.005065] CPU features: detected: Fine Grained Traps553client # [ 0.005087] CPU features: detected: E0PD554worker2 # [ 0.008242] CPU features: detected: BBM Level 2 without TLB conflict abort555lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns556client # [ 0.005090] CPU features: detected: Enhanced Counter Virtualization557worker1 # [ 0.005069] CPU features: detected: Generic authentication (architected QARMA5 algorithm)558lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).559worker1 # [ 0.005074] CPU features: detected: RCpc load-acquire (LDAPR)560client # [ 0.005093] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)561worker2 # [ 0.008430] Memory: 1405696K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124632K reserved, 32768K cma-reserved)562worker1 # [ 0.005077] CPU features: detected: LSE atomic instructions563client # [ 0.005097] CPU features: detected: Enhanced Virtualization Traps564worker2 # [ 0.008807] devtmpfs: initialized565lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns566worker1 # [ 0.005080] CPU features: detected: Privileged Access Never567client # [ 0.005100] CPU features: detected: Fine Grained Traps568worker2 # [ 0.010645] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)569worker1 # [ 0.005083] CPU features: detected: PMUv3570lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns571client # [ 0.005104] CPU features: detected: Generic authentication (architected QARMA5 algorithm)572lb # [ 0.000029] arm-pv: using stolen time PV573worker1 # [ 0.005085] CPU features: detected: RAS Extension Support574worker2 # [ 0.010673] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).575worker1 # [ 0.005088] CPU features: detected: RASv1p1 Extension Support576client # [ 0.005108] CPU features: detected: RCpc load-acquire (LDAPR)577worker2 # [ 0.010834] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL578lb # [ 0.000399] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)579client # [ 0.005111] CPU features: detected: LSE atomic instructions580worker1 # [ 0.005091] CPU features: detected: Random Number Generator581lb # [ 0.000585] Console: colour dummy device 80x25582client # [ 0.005114] CPU features: detected: Privileged Access Never583worker1 # [ 0.005093] CPU features: detected: Speculation barrier (SB)584lb # [ 0.000593] printk: legacy console [tty0] enabled585client # [ 0.005117] CPU features: detected: PMUv3586worker1 # [ 0.005096] CPU features: detected: Stage-2 Force Write-Back587client # [ 0.005119] CPU features: detected: RAS Extension Support588lb # [ 0.000786] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)589worker1 # [ 0.005099] CPU features: detected: TLB range maintenance instructions590client # [ 0.005122] CPU features: detected: RASv1p1 Extension Support591lb # [ 0.000793] pid_max: default: 32768 minimum: 301592worker1 # [ 0.005104] CPU features: detected: Speculative Store Bypassing Safe (SSBS)593client # [ 0.005125] CPU features: detected: Random Number Generator594lb # [ 0.000881] LSM: initializing lsm=capability,landlock,yama,bpf,ima595worker1 # [ 0.005142] alternatives: applying system-wide alternatives596client # [ 0.005127] CPU features: detected: Speculation barrier (SB)597lb # [ 0.001045] landlock: Up and running.598lb # [ 0.001048] Yama: becoming mindful.599client # [ 0.005130] CPU features: detected: Stage-2 Force Write-Back600worker1 # [ 0.008058] CPU features: detected: BBM Level 2 without TLB conflict abort601lb # [ 0.001520] LSM support for eBPF active602client # [ 0.005133] CPU features: detected: TLB range maintenance instructions603lb # [ 0.001683] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)604client # [ 0.005138] CPU features: detected: Speculative Store Bypassing Safe (SSBS)605worker1 # [ 0.008258] Memory: 1405620K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124664K reserved, 32768K cma-reserved)606worker1 # [ 0.008632] devtmpfs: initialized607client # [ 0.005174] alternatives: applying system-wide alternatives608lb # [ 0.001718] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)609lb # [ 0.003553] rcu: Hierarchical SRCU implementation.610worker1 # [ 0.010459] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)611client # [ 0.008084] CPU features: detected: BBM Level 2 without TLB conflict abort612lb # [ 0.003558] rcu: Max phase no-delay instances is 1000.613lb # [ 0.004805] fsl-mc MSI: its@8080000 domain created614worker1 # [ 0.010481] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).615worker2 # [ 0.010838] 0 pages in range for non-PLT usage616lb # [ 0.004901] EFI services will not be available.617worker2 # [ 0.010839] 508272 pages in range for PLT usage618client # [ 0.008293] Memory: 1405656K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124660K reserved, 32768K cma-reserved)619worker1 # [ 0.010661] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL620client # [ 0.008668] devtmpfs: initialized621lb # [ 0.004966] smp: Bringing up secondary CPUs ...622worker2 # [ 0.010948] pinctrl core: initialized pinctrl subsystem623lb # [ 0.004974] smp: Brought up 1 node, 1 CPU624worker2 # [ 0.011713] DMI not present or invalid.625client # [ 0.010496] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)626lb # [ 0.004977] SMP: Total of 1 processors activated.627worker2 # [ 0.015039] NET: Registered PF_NETLINK/PF_ROUTE protocol family628lb # [ 0.004982] CPU: All CPU(s) started at EL1629client # [ 0.010519] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).630worker2 # [ 0.017281] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations631lb # [ 0.004993] CPU features: detected: Branch Target Identification632client # [ 0.010704] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL633lb # [ 0.004997] CPU features: detected: ARMv8.4 Translation Table Level634worker2 # [ 0.017472] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations635client # [ 0.010709] 0 pages in range for non-PLT usage636worker2 # [ 0.017667] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations637lb # [ 0.005000] CPU features: detected: Instruction cache invalidation not required for I/D coherence638client # [ 0.010710] 508272 pages in range for PLT usage639worker2 # [ 0.017689] audit: initializing netlink subsys (disabled)640client # [ 0.010808] pinctrl core: initialized pinctrl subsystem641lb # [ 0.005004] CPU features: detected: Data cache clean to the PoU not required for I/D coherence642worker2 # [ 0.018278] thermal_sys: Registered thermal governor 'fair_share'643client # [ 0.011537] DMI not present or invalid.644lb # [ 0.005008] CPU features: detected: Common not Private translations645client # [ 0.014896] NET: Registered PF_NETLINK/PF_ROUTE protocol family646worker2 # [ 0.018280] thermal_sys: Registered thermal governor 'bang_bang'647lb # [ 0.005011] CPU features: detected: CRC32 instructions648worker2 # [ 0.018284] thermal_sys: Registered thermal governor 'step_wise'649client # [ 0.017084] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations650lb # [ 0.005014] CPU features: detected: Data cache clean to Point of Deep Persistence651worker2 # [ 0.018286] thermal_sys: Registered thermal governor 'user_space'652client # [ 0.017272] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations653lb # [ 0.005017] CPU features: detected: Data cache clean to Point of Persistence654worker2 # [ 0.018292] thermal_sys: Registered thermal governor 'power_allocator'655worker1 # [ 0.010665] 0 pages in range for non-PLT usage656client # [ 0.017465] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations657worker1 # [ 0.010666] 508272 pages in range for PLT usage658lb # [ 0.005021] CPU features: detected: Data independent timing control (DIT)659worker2 # [ 0.018317] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1660client # [ 0.017486] audit: initializing netlink subsys (disabled)661lb # [ 0.005024] CPU features: detected: E0PD662worker1 # [ 0.010779] pinctrl core: initialized pinctrl subsystem663worker2 # [ 0.018325] cpuidle: using governor ladder664worker1 # [ 0.011530] DMI not present or invalid.665client # [ 0.018420] thermal_sys: Registered thermal governor 'fair_share'666worker2 # [ 0.018331] cpuidle: using governor menu667lb # [ 0.005026] CPU features: detected: Enhanced Counter Virtualization668worker1 # [ 0.014935] NET: Registered PF_NETLINK/PF_ROUTE protocol family669client # [ 0.018422] thermal_sys: Registered thermal governor 'bang_bang'670worker2 # [ 0.018524] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.671lb # [ 0.005029] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)672client # [ 0.018426] thermal_sys: Registered thermal governor 'step_wise'673worker2 # [ 0.018539] ASID allocator initialised with 65536 entries674worker1 # [ 0.017147] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations675lb # [ 0.005033] CPU features: detected: Enhanced Virtualization Traps676worker2 # [ 0.019732] Serial: AMBA PL011 UART driver677client # [ 0.018428] thermal_sys: Registered thermal governor 'user_space'678lb # [ 0.005036] CPU features: detected: Fine Grained Traps679worker1 # [ 0.017318] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations680client # [ 0.018434] thermal_sys: Registered thermal governor 'power_allocator'681worker2 # [ 0.025105] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1682lb # [ 0.005040] CPU features: detected: Generic authentication (architected QARMA5 algorithm)683worker1 # [ 0.017522] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations684worker2 # [ 0.025256] printk: console [ttyAMA0] enabled685client # [ 0.018459] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1686lb # [ 0.005045] CPU features: detected: RCpc load-acquire (LDAPR)687worker1 # [ 0.017543] audit: initializing netlink subsys (disabled)688client # [ 0.018468] cpuidle: using governor ladder689lb # [ 0.005047] CPU features: detected: LSE atomic instructions690worker1 # [ 0.018081] thermal_sys: Registered thermal governor 'fair_share'691client # [ 0.018474] cpuidle: using governor menu692worker2 # [ 0.144069] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages693lb # [ 0.005050] CPU features: detected: Privileged Access Never694worker1 # [ 0.018084] thermal_sys: Registered thermal governor 'bang_bang'695client # [ 0.018650] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.696worker2 # [ 0.144089] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page697lb # [ 0.005053] CPU features: detected: PMUv3698worker1 # [ 0.018087] thermal_sys: Registered thermal governor 'step_wise'699client # [ 0.018666] ASID allocator initialised with 65536 entries700lb # [ 0.005056] CPU features: detected: RAS Extension Support701worker2 # [ 0.144095] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages702client # [ 0.019897] Serial: AMBA PL011 UART driver703worker1 # [ 0.018090] thermal_sys: Registered thermal governor 'user_space'704lb # [ 0.005059] CPU features: detected: RASv1p1 Extension Support705worker2 # [ 0.144099] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page706worker1 # [ 0.018096] thermal_sys: Registered thermal governor 'power_allocator'707client # [ 0.025100] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1708lb # [ 0.005061] CPU features: detected: Random Number Generator709worker2 # [ 0.144103] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages710client # [ 0.025237] printk: console [ttyAMA0] enabled711lb # [ 0.005064] CPU features: detected: Speculation barrier (SB)712worker1 # [ 0.018128] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1713worker2 # [ 0.144107] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page714worker1 # [ 0.018136] cpuidle: using governor ladder715lb # [ 0.005067] CPU features: detected: Stage-2 Force Write-Back716worker1 # [ 0.018142] cpuidle: using governor menu717worker2 # [ 0.144111] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages718lb # [ 0.005070] CPU features: detected: TLB range maintenance instructions719worker1 # [ 0.018324] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.720worker2 # [ 0.144115] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page721lb # [ 0.005074] CPU features: detected: Speculative Store Bypassing Safe (SSBS)722worker1 # [ 0.018339] ASID allocator initialised with 65536 entries723lb # [ 0.005110] alternatives: applying system-wide alternatives724worker1 # [ 0.019574] Serial: AMBA PL011 UART driver725lb # [ 0.008032] CPU features: detected: BBM Level 2 without TLB conflict abort726worker1 # [ 0.024800] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1727worker2 # [ 0.151283] fbcon: Taking over console728worker1 # [ 0.024950] printk: console [ttyAMA0] enabled729worker2 # [ 0.151297] ACPI: Interpreter disabled.730worker2 # [ 0.153148] iommu: Default domain type: Translated731lb # [ 0.008234] Memory: 1405908K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124636K reserved, 32768K cma-reserved)732worker1 # [ 0.143394] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages733lb # [ 0.008605] devtmpfs: initialized734worker2 # [ 0.153158] iommu: DMA domain TLB invalidation policy: strict mode735worker1 # [ 0.143413] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page736lb # [ 0.010407] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)737worker2 # [ 0.154848] SCSI subsystem initialized738client # [ 0.140847] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages739worker1 # [ 0.143418] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages740lb # [ 0.010431] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).741client # [ 0.140863] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page742worker1 # [ 0.143422] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page743lb # [ 0.010615] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL744client # [ 0.140869] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages745worker1 # [ 0.143426] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages746lb # [ 0.010619] 0 pages in range for non-PLT usage747client # [ 0.140873] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page748lb # [ 0.010620] 508272 pages in range for PLT usage749worker1 # [ 0.143430] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page750lb # [ 0.010736] pinctrl core: initialized pinctrl subsystem751client # [ 0.140877] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages752worker1 # [ 0.143434] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages753lb # [ 0.011747] DMI not present or invalid.754client # [ 0.140882] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page755worker1 # [ 0.143439] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page756lb # [ 0.014991] NET: Registered PF_NETLINK/PF_ROUTE protocol family757client # [ 0.140886] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages758lb # [ 0.017371] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations759client # [ 0.140890] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page760lb # [ 0.017545] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations761worker1 # [ 0.150666] fbcon: Taking over console762worker1 # [ 0.150680] ACPI: Interpreter disabled.763lb # [ 0.017740] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations764worker1 # [ 0.152548] iommu: Default domain type: Translated765lb # [ 0.017761] audit: initializing netlink subsys (disabled)766client # [ 0.148089] fbcon: Taking over console767worker2 # [ 0.162405] usbcore: registered new interface driver usbfs768client # [ 0.148103] ACPI: Interpreter disabled.769worker1 # [ 0.152558] iommu: DMA domain TLB invalidation policy: strict mode770lb # [ 0.018306] thermal_sys: Registered thermal governor 'fair_share'771worker2 # [ 0.162439] usbcore: registered new interface driver hub772worker1 # [ 0.154182] SCSI subsystem initialized773lb # [ 0.018308] thermal_sys: Registered thermal governor 'bang_bang'774worker2 # [ 0.162456] usbcore: registered new device driver usb775lb # [ 0.018312] thermal_sys: Registered thermal governor 'step_wise'776worker2 # [ 0.162732] pps_core: LinuxPPS API ver. 1 registered777lb # [ 0.018314] thermal_sys: Registered thermal governor 'user_space'778worker2 # [ 0.162739] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>779worker2 # [ 0.162749] PTP clock support registered780worker2 # [ 0.162808] EDAC MC: Ver: 3.0.0781lb # [ 0.018319] thermal_sys: Registered thermal governor 'power_allocator'782worker2 # [ 0.167369] scmi_core: SCMI protocol bus registered783lb # [ 0.018343] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1784lb # [ 0.018351] cpuidle: using governor ladder785worker2 # [ 0.168350] FPGA manager framework786lb # [ 0.018357] cpuidle: using governor menu787worker2 # [ 0.169267] vgaarb: loaded788lb # [ 0.018539] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.789lb # [ 0.018555] ASID allocator initialised with 65536 entries790worker2 # [ 0.169892] clocksource: Switched to clocksource arch_sys_counter791lb # [ 0.019771] Serial: AMBA PL011 UART driver792worker2 # [ 0.170496] VFS: Disk quotas dquot_6.6.0793client # [ 0.157092] iommu: Default domain type: Translated794lb # [ 0.025003] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1795client # [ 0.157103] iommu: DMA domain TLB invalidation policy: strict mode796worker2 # [ 0.170521] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)797worker1 # [ 0.161674] usbcore: registered new interface driver usbfs798lb # [ 0.025125] printk: console [ttyAMA0] enabled799client # [ 0.157424] SCSI subsystem initialized800worker1 # [ 0.161706] usbcore: registered new interface driver hub801worker2 # [ 0.172802] netfs: FS-Cache loaded802worker2 # [ 0.172919] pnp: PnP ACPI: disabled803worker1 # [ 0.161734] usbcore: registered new device driver usb804client # [ 0.159356] usbcore: registered new interface driver usbfs805worker1 # [ 0.161995] pps_core: LinuxPPS API ver. 1 registered806client # [ 0.159387] usbcore: registered new interface driver hub807worker1 # [ 0.162001] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>808client # [ 0.159402] usbcore: registered new device driver usb809worker1 # [ 0.162012] PTP clock support registered810client # [ 0.159695] pps_core: LinuxPPS API ver. 1 registered811worker1 # [ 0.162059] EDAC MC: Ver: 3.0.0812client # [ 0.159702] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>813worker1 # [ 0.166628] scmi_core: SCMI protocol bus registered814client # [ 0.159712] PTP clock support registered815client # [ 0.159761] EDAC MC: Ver: 3.0.0816worker1 # [ 0.167588] FPGA manager framework817worker1 # [ 0.168490] vgaarb: loaded818client # [ 0.164333] scmi_core: SCMI protocol bus registered819lb # [ 0.141998] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages820client # [ 0.165273] FPGA manager framework821lb # [ 0.142015] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page822client # [ 0.166177] vgaarb: loaded823worker1 # [ 0.169112] clocksource: Switched to clocksource arch_sys_counter824worker1 # [ 0.169714] VFS: Disk quotas dquot_6.6.0825lb # [ 0.142021] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages826client # [ 0.166782] clocksource: Switched to clocksource arch_sys_counter827worker1 # [ 0.169740] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)828lb # [ 0.142026] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page829worker1 # [ 0.172026] netfs: FS-Cache loaded830worker2 # [ 0.178846] NET: Registered PF_INET protocol family831lb # [ 0.142030] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages832worker1 # [ 0.172120] pnp: PnP ACPI: disabled833worker2 # [ 0.179114] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)834lb # [ 0.142034] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page835lb # [ 0.142039] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages836client # [ 0.170101] VFS: Disk quotas dquot_6.6.0837lb # [ 0.142043] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page838client # [ 0.170135] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)839lb # [ 0.149401] fbcon: Taking over console840lb # [ 0.149415] ACPI: Interpreter disabled.841client # [ 0.173808] netfs: FS-Cache loaded842client # [ 0.173926] pnp: PnP ACPI: disabled843worker1 # [ 0.178084] NET: Registered PF_INET protocol family844worker1 # [ 0.178357] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)845client # [ 0.177804] NET: Registered PF_INET protocol family846client # [ 0.178061] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)847lb # [ 0.158400] iommu: Default domain type: Translated848lb # [ 0.158410] iommu: DMA domain TLB invalidation policy: strict mode849lb # [ 0.158751] SCSI subsystem initialized850lb # [ 0.160774] usbcore: registered new interface driver usbfs851lb # [ 0.160807] usbcore: registered new interface driver hub852lb # [ 0.160823] usbcore: registered new device driver usb853lb # [ 0.161109] pps_core: LinuxPPS API ver. 1 registered854lb # [ 0.161115] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>855lb # [ 0.161125] PTP clock support registered856lb # [ 0.161189] EDAC MC: Ver: 3.0.0857lb # [ 0.165885] scmi_core: SCMI protocol bus registered858lb # [ 0.166867] FPGA manager framework859lb # [ 0.167879] vgaarb: loaded860lb # [ 0.168494] clocksource: Switched to clocksource arch_sys_counter861lb # [ 0.174809] VFS: Disk quotas dquot_6.6.0862lb # [ 0.174854] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)863lb # [ 0.176517] netfs: FS-Cache loaded864lb # [ 0.176639] pnp: PnP ACPI: disabled865worker2 # [ 0.207306] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)866worker2 # [ 0.207344] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)867worker2 # [ 0.207370] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)868worker2 # [ 0.207438] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)869worker2 # [ 0.207580] TCP: Hash tables configured (established 16384 bind 16384)870worker2 # [ 0.207654] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)871worker2 # [ 0.207689] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)872worker2 # [ 0.207724] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)873client # [ 0.206417] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)874worker2 # [ 0.207822] NET: Registered PF_UNIX/PF_LOCAL protocol family875lb # [ 0.180513] NET: Registered PF_INET protocol family876worker2 # [ 0.207862] NET: Registered PF_XDP protocol family877client # [ 0.206457] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)878lb # [ 0.180779] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)879worker2 # [ 0.207877] PCI: CLS 0 bytes, default 64880worker2 # [ 0.208093] Trying to unpack rootfs image as initramfs...881client # [ 0.206485] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)882worker1 # [ 0.207119] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)883client # [ 0.206551] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)884worker1 # [ 0.207159] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)885client # [ 0.206694] TCP: Hash tables configured (established 16384 bind 16384)886worker1 # [ 0.207183] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)887client # [ 0.206768] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)888worker1 # [ 0.207257] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)889worker1 # [ 0.207400] TCP: Hash tables configured (established 16384 bind 16384)890worker1 # [ 0.207476] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)891worker1 # [ 0.207509] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)892worker1 # [ 0.207544] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)893worker2 # [ 0.223568] kvm [1]: HYP mode not available894worker1 # [ 0.207642] NET: Registered PF_UNIX/PF_LOCAL protocol family895worker1 # [ 0.207661] NET: Registered PF_XDP protocol family896worker1 # [ 0.207678] PCI: CLS 0 bytes, default 64897worker1 # [ 0.207999] Trying to unpack rootfs image as initramfs...898client # [ 0.212285] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)899client # [ 0.212324] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)900client # [ 0.212417] NET: Registered PF_UNIX/PF_LOCAL protocol family901client # [ 0.212450] NET: Registered PF_XDP protocol family902client # [ 0.212469] PCI: CLS 0 bytes, default 64903client # [ 0.212703] Trying to unpack rootfs image as initramfs...904client # [ 0.222735] kvm [1]: HYP mode not available905worker1 # [ 0.222811] kvm [1]: HYP mode not available906lb # [ 0.210647] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)907lb # [ 0.210689] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)908lb # [ 0.210718] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)909lb # [ 0.210797] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)910lb # [ 0.210940] TCP: Hash tables configured (established 16384 bind 16384)911lb # [ 0.211023] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)912lb # [ 0.211058] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)913lb # [ 0.211094] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)914lb # [ 0.211214] NET: Registered PF_UNIX/PF_LOCAL protocol family915lb # [ 0.211287] NET: Registered PF_XDP protocol family916lb # [ 0.211304] PCI: CLS 0 bytes, default 64917lb # [ 0.211542] Trying to unpack rootfs image as initramfs...918lb # [ 0.232513] kvm [1]: HYP mode not available919worker2 # [ 0.314429] Initialise system trusted keyrings920worker2 # [ 0.315174] workingset: timestamp_bits=42 max_order=19 bucket_order=0921worker2 # [ 0.316475] squashfs: version 4.0 (2009/01/31) Phillip Lougher922worker2 # [ 0.317235] 9p: Installing v9fs 9p2000 file system support923worker1 # [ 0.313620] Initialise system trusted keyrings924worker1 # [ 0.314358] workingset: timestamp_bits=42 max_order=19 bucket_order=0925worker1 # [ 0.315587] squashfs: version 4.0 (2009/01/31) Phillip Lougher926worker1 # [ 0.316367] 9p: Installing v9fs 9p2000 file system support927client # [ 0.315323] Initialise system trusted keyrings928client # [ 0.316054] workingset: timestamp_bits=42 max_order=19 bucket_order=0929client # [ 0.317332] squashfs: version 4.0 (2009/01/31) Phillip Lougher930client # [ 0.318082] 9p: Installing v9fs 9p2000 file system support931worker2 # [ 0.345999] Key type asymmetric registered932worker2 # [ 0.346023] Asymmetric key parser 'x509' registered933worker1 # [ 0.337050] Key type asymmetric registered934worker1 # [ 0.337073] Asymmetric key parser 'x509' registered935worker2 # [ 0.346088] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)936worker2 # [ 0.348229] io scheduler mq-deadline registered937worker2 # [ 0.348239] io scheduler kyber registered938client # [ 0.338763] Key type asymmetric registered939client # [ 0.338786] Asymmetric key parser 'x509' registered940lb # [ 0.317357] Initialise system trusted keyrings941lb # [ 0.318111] workingset: timestamp_bits=42 max_order=19 bucket_order=0942worker1 # [ 0.345169] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)943worker1 # [ 0.346202] io scheduler mq-deadline registered944worker1 # [ 0.346213] io scheduler kyber registered945worker2 # [ 0.358042] pl061_gpio 9030000.pl061: PL061 GPIO chip registered946client # [ 0.346905] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)947lb # [ 0.324893] squashfs: version 4.0 (2009/01/31) Phillip Lougher948client # [ 0.347938] io scheduler mq-deadline registered949worker2 # [ 0.359412] ledtrig-cpu: registered to indicate activity on CPUs950client # [ 0.347949] io scheduler kyber registered951worker2 # [ 0.359823] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:952worker2 # [ 0.359840] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000953worker2 # [ 0.359852] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000954worker2 # [ 0.359861] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000955worker2 # [ 0.359881] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits956worker1 # [ 0.357420] pl061_gpio 9030000.pl061: PL061 GPIO chip registered957worker2 # [ 0.359904] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]958worker2 # [ 0.359994] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00959lb # [ 0.325681] 9p: Installing v9fs 9p2000 file system support960worker2 # [ 0.360019] pci_bus 0000:00: root bus resource [bus 00-ff]961worker2 # [ 0.360025] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]962worker1 # [ 0.358771] ledtrig-cpu: registered to indicate activity on CPUs963worker2 # [ 0.360031] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]964worker1 # [ 0.359180] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:965worker2 # [ 0.360036] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]966worker1 # [ 0.359198] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000967worker2 # [ 0.360089] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint968client # [ 0.358917] pl061_gpio 9030000.pl061: PL061 GPIO chip registered969worker1 # [ 0.359210] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000970worker2 # [ 0.360515] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint971worker2 # [ 0.360695] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]972worker1 # [ 0.359218] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000973worker2 # [ 0.360711] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]974worker1 # [ 0.359237] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits975worker2 # [ 0.360740] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]976client # [ 0.360236] ledtrig-cpu: registered to indicate activity on CPUs977worker2 # [ 0.360755] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]978worker1 # [ 0.359260] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]979client # [ 0.360627] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:980worker2 # [ 0.361203] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint981worker1 # [ 0.359341] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00982worker2 # [ 0.361383] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]983client # [ 0.360644] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000984worker1 # [ 0.359350] pci_bus 0000:00: root bus resource [bus 00-ff]985worker2 # [ 0.361399] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]986worker1 # [ 0.359356] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]987client # [ 0.360664] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000988worker2 # [ 0.361428] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]989worker1 # [ 0.359362] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]990client # [ 0.360673] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000991worker1 # [ 0.359367] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]992client # [ 0.360693] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits993worker1 # [ 0.359433] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint994worker2 # [ 0.380701] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint995lb # [ 0.345669] Key type asymmetric registered996client # [ 0.360723] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]997worker2 # [ 0.380887] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]998lb # [ 0.345685] Asymmetric key parser 'x509' registered999worker1 # [ 0.359869] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1000client # [ 0.360839] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001001worker2 # [ 0.380903] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1002worker1 # [ 0.360078] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1003lb # [ 0.345740] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1004client # [ 0.360848] pci_bus 0000:00: root bus resource [bus 00-ff]1005worker2 # [ 0.380932] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1006worker1 # [ 0.360096] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1007lb # [ 0.347781] io scheduler mq-deadline registered1008client # [ 0.360854] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1009lb # [ 0.347792] io scheduler kyber registered1010worker1 # [ 0.360125] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1011worker2 # [ 0.381385] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1012client # [ 0.360859] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1013worker1 # [ 0.360141] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1014worker2 # [ 0.381566] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1015client # [ 0.360864] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1016worker2 # [ 0.381582] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1017worker1 # [ 0.360593] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1018worker1 # [ 0.360774] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1019worker2 # [ 0.381611] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1020client # [ 0.360958] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1021worker1 # [ 0.360789] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1022worker2 # [ 0.381629] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1023client # [ 0.361389] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1024worker1 # [ 0.360818] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1025client # [ 0.361574] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1026client # [ 0.361591] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1027worker2 # [ 0.388861] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1028client # [ 0.361620] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1029worker2 # [ 0.389050] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1030client # [ 0.361636] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1031worker1 # [ 0.379791] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1032worker2 # [ 0.389079] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1033worker1 # [ 0.379978] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1034client # [ 0.362084] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1035worker1 # [ 0.379994] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1036client # [ 0.362266] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1037worker2 # [ 0.389562] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1038worker1 # [ 0.380023] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1039worker2 # [ 0.389749] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1040client # [ 0.362281] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1041worker2 # [ 0.389778] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1042client # [ 0.362310] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1043worker1 # [ 0.380476] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1044worker1 # [ 0.380658] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1045client # [ 0.362754] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1046worker1 # [ 0.380673] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1047worker1 # [ 0.380703] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1048client # [ 0.382085] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1049worker1 # [ 0.380721] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1050client # [ 0.382105] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1051client # [ 0.382134] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1052lb # [ 0.360848] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1053client # [ 0.382595] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1054worker1 # [ 0.388098] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1055client # [ 0.382775] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1056worker1 # [ 0.388284] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1057client # [ 0.386512] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1058worker1 # [ 0.388315] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1059lb # [ 0.362287] ledtrig-cpu: registered to indicate activity on CPUs1060client # [ 0.386544] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1061worker1 # [ 0.388762] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1062lb # [ 0.362691] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1063client # [ 0.386562] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1064worker1 # [ 0.388946] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1065lb # [ 0.362709] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001066worker1 # [ 0.388975] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1067lb # [ 0.362721] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001068lb # [ 0.362730] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001069lb # [ 0.362750] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1070lb # [ 0.362773] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1071lb # [ 0.362845] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001072lb # [ 0.362854] pci_bus 0000:00: root bus resource [bus 00-ff]1073lb # [ 0.362860] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1074worker2 # [ 0.402267] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1075lb # [ 0.362865] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1076worker2 # [ 0.402465] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1077lb # [ 0.362870] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1078worker2 # [ 0.402729] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1079lb # [ 0.362954] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1080worker2 # [ 0.402916] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1081lb # [ 0.363398] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1082worker2 # [ 0.402945] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1083lb # [ 0.363586] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1084worker2 # [ 0.403390] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1085lb # [ 0.363603] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1086worker2 # [ 0.403575] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1087lb # [ 0.363632] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1088worker2 # [ 0.403604] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1089lb # [ 0.363649] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1090client # [ 0.395108] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1091worker2 # [ 0.404054] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1092lb # [ 0.364113] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1093client # [ 0.395309] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1094worker2 # [ 0.404238] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1095lb # [ 0.364297] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1096client # [ 0.395340] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1097worker2 # [ 0.404267] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1098lb # [ 0.364313] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1099worker1 # [ 0.401451] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1100client # [ 0.395800] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1101lb # [ 0.364342] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1102worker2 # [ 0.404722] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1103worker1 # [ 0.401644] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1104client # [ 0.395992] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1105worker2 # [ 0.404993] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1106client # [ 0.396022] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1107worker1 # [ 0.401911] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1108worker2 # [ 0.405010] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1109worker1 # [ 0.402097] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1110worker2 # [ 0.405039] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1111client # [ 0.396406] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1112worker1 # [ 0.402126] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1113client # [ 0.396586] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1114worker2 # [ 0.405491] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1115worker2 # [ 0.405670] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1116worker1 # [ 0.402570] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1117client # [ 0.396861] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1118worker2 # [ 0.405686] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1119worker1 # [ 0.402753] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1120client # [ 0.397046] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1121worker2 # [ 0.405715] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1122worker1 # [ 0.402782] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1123client # [ 0.397075] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1124worker2 # [ 0.406299] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1125worker1 # [ 0.403227] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1126client # [ 0.397521] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1127worker2 # [ 0.406311] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1128worker1 # [ 0.403410] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1129client # [ 0.397705] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1130worker1 # [ 0.403440] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131worker2 # [ 0.406316] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1132client # [ 0.397735] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1133worker1 # [ 0.403889] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1134client # [ 0.398179] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1135worker2 # [ 0.406360] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1136worker1 # [ 0.404175] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1137client # [ 0.398363] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1138worker2 # [ 0.406406] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1139worker1 # [ 0.404192] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1140client # [ 0.398393] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1141worker2 # [ 0.406452] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1142worker1 # [ 0.404221] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1143client # [ 0.398865] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1144worker2 # [ 0.406500] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1145worker1 # [ 0.404670] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1146client # [ 0.399113] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1147worker1 # [ 0.404850] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1148client # [ 0.399130] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1149worker2 # [ 0.406547] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1150worker1 # [ 0.404866] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1151client # [ 0.399159] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1152worker2 # [ 0.406594] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1153worker1 # [ 0.404895] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1154lb # [ 0.388883] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1155client # [ 0.399610] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1156lb # [ 0.389084] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1157worker2 # [ 0.406640] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1158worker1 # [ 0.405493] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1159client # [ 0.399790] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1160lb # [ 0.389102] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1161worker2 # [ 0.406685] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1162client # [ 0.399806] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1163worker1 # [ 0.405505] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1164lb # [ 0.389132] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1165client # [ 0.399843] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1166worker2 # [ 0.406731] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1167worker1 # [ 0.405510] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1168lb # [ 0.389630] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1169client # [ 0.400406] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1170worker2 # [ 0.406806] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1171worker1 # [ 0.405553] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1172lb # [ 0.389817] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1173client # [ 0.400417] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1174worker2 # [ 0.406857] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1175lb # [ 0.389833] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1176worker1 # [ 0.405599] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1177worker2 # [ 0.406879] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1178client # [ 0.400423] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1179lb # [ 0.389863] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1180worker1 # [ 0.405645] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1181worker2 # [ 0.406900] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1182client # [ 0.400467] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1183lb # [ 0.389881] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1184worker1 # [ 0.405692] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1185worker2 # [ 0.406921] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1186lb # [ 0.390341] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1187client # [ 0.400514] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1188worker1 # [ 0.405739] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1189worker2 # [ 0.406950] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1190lb # [ 0.390532] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1191client # [ 0.400560] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1192worker2 # [ 0.406969] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1193worker1 # [ 0.405785] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1194lb # [ 0.390562] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1195client # [ 0.400607] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1196worker2 # [ 0.406991] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1197worker1 # [ 0.405831] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1198lb # [ 0.391018] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1199client # [ 0.400653] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1200worker2 # [ 0.407015] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1201lb # [ 0.391209] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1202worker1 # [ 0.405876] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1203worker2 # [ 0.407036] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1204client # [ 0.400698] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1205lb # [ 0.391238] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1206worker1 # [ 0.405921] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1207worker2 # [ 0.407058] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1208client # [ 0.400744] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1209lb # [ 0.391631] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1210worker1 # [ 0.405988] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1211worker2 # [ 0.407080] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1212lb # [ 0.391816] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1213client # [ 0.400789] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1214worker1 # [ 0.406033] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1215worker2 # [ 0.407102] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1216worker1 # [ 0.406054] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1217worker2 # [ 0.407122] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1218lb # [ 0.392101] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1219client # [ 0.400835] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1220lb # [ 0.392291] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1221worker1 # [ 0.406075] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1222worker2 # [ 0.407143] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1223client # [ 0.400901] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1224worker2 # [ 0.407164] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1225lb # [ 0.392321] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1226worker1 # [ 0.406096] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1227client # [ 0.400947] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1228worker2 # [ 0.407185] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1229worker1 # [ 0.406117] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1230lb # [ 0.392795] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1231client # [ 0.400968] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1232worker2 # [ 0.407205] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1233worker1 # [ 0.406138] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1234lb # [ 0.392985] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1235client # [ 0.400990] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1236worker2 # [ 0.407227] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1237worker1 # [ 0.406167] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1238client # [ 0.401011] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1239lb # [ 0.393015] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1240worker2 # [ 0.407253] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1241worker1 # [ 0.406189] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1242client # [ 0.401032] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1243worker2 # [ 0.407262] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1244lb # [ 0.393481] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1245worker1 # [ 0.406211] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1246lb # [ 0.393673] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1247client # [ 0.401053] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1248worker2 # [ 0.407267] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1249worker1 # [ 0.406233] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1250worker2 # [ 0.408064] pci 0000:00:07.0: enabling device (0000 -> 0002)1251client # [ 0.401074] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1252lb # [ 0.393703] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1253worker1 # [ 0.406254] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1254client # [ 0.401098] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1255lb # [ 0.394168] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1256worker1 # [ 0.406276] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1257client # [ 0.401120] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1258lb # [ 0.394417] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1259worker1 # [ 0.406297] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1260client # [ 0.401142] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1261lb # [ 0.394434] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1262worker1 # [ 0.406318] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1263client # [ 0.401164] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1264lb # [ 0.394464] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1265worker1 # [ 0.406338] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1266client # [ 0.401186] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1267lb # [ 0.394923] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1268worker1 # [ 0.406359] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1269client # [ 0.401207] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1270lb # [ 0.395106] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1271worker1 # [ 0.406380] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1272client # [ 0.401228] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1273lb # [ 0.395122] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1274worker1 # [ 0.406401] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1275client # [ 0.401249] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1276lb # [ 0.395151] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1277worker1 # [ 0.406427] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1278client # [ 0.401270] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1279worker1 # [ 0.406436] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1280lb # [ 0.395713] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1281client # [ 0.401291] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1282worker1 # [ 0.406440] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1283lb # [ 0.395724] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1284client # [ 0.401312] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1285worker1 # [ 0.407245] pci 0000:00:07.0: enabling device (0000 -> 0002)1286client # [ 0.401337] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1287lb # [ 0.395729] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1288client # [ 0.401346] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1289lb # [ 0.395773] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1290client # [ 0.401351] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1291client # [ 0.402147] pci 0000:00:07.0: enabling device (0000 -> 0002)1292lb # [ 0.395819] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1293lb # [ 0.395864] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1294lb # [ 0.395910] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1295lb # [ 0.395955] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1296lb # [ 0.396001] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1297lb # [ 0.396047] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1298lb # [ 0.396092] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1299lb # [ 0.396138] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1300lb # [ 0.396203] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1301lb # [ 0.396248] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1302lb # [ 0.396269] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1303lb # [ 0.396290] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1304lb # [ 0.396311] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1305lb # [ 0.396332] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1306lb # [ 0.396353] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1307lb # [ 0.396374] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1308worker2 # [ 0.476151] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1309lb # [ 0.396397] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1310lb # [ 0.396419] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1311lb # [ 0.396441] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1312lb # [ 0.396463] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1313lb # [ 0.396485] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1314worker2 # [ 0.482557] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1315worker1 # [ 0.475194] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1316worker2 # [ 0.484602] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1317lb # [ 0.452583] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1318lb # [ 0.452614] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1319client # [ 0.478423] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1320lb # [ 0.452637] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1321lb # [ 0.452663] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1322lb # [ 0.452686] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1323lb # [ 0.452710] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1324worker1 # [ 0.481317] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1325lb # [ 0.452743] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1326worker1 # [ 0.483534] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1327lb # [ 0.452753] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1328lb # [ 0.452758] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1329worker2 # [ 0.494421] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1330lb # [ 0.453609] pci 0000:00:07.0: enabling device (0000 -> 0002)1331worker2 # [ 0.496355] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1332client # [ 0.488151] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1333worker1 # [ 0.493274] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1334worker1 # [ 0.495221] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1335client # [ 0.492533] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1336client # [ 0.494403] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1337worker2 # [ 0.506048] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1338client # [ 0.496336] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1339worker2 # [ 0.508113] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1340client # [ 0.498377] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1341worker2 # [ 0.509851] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1342worker2 # [ 0.511583] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1343worker2 # [ 0.513356] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1344lb # [ 0.481459] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1345lb # [ 0.483874] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1346worker1 # [ 0.505290] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1347worker1 # [ 0.507711] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1348worker1 # [ 0.509443] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1349worker1 # [ 0.511191] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1350worker1 # [ 0.512971] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1351worker2 # [ 0.527332] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1352client # [ 0.516163] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1353lb # [ 0.494731] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1354client # [ 0.518159] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1355client # [ 0.521450] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1356worker1 # [ 0.526541] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1357worker2 # [ 0.543152] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1358client # [ 0.528300] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1359worker2 # [ 0.545647] msm_serial: driver initialized1360worker2 # [ 0.545810] SuperH (H)SCI(F) driver initialized1361worker2 # [ 0.545863] STM32 USART driver initialized1362worker1 # [ 0.541711] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1363client # [ 0.535821] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1364lb # [ 0.508686] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1365lb # [ 0.510909] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1366lb # [ 0.512918] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1367worker1 # [ 0.544150] msm_serial: driver initialized1368worker1 # [ 0.544298] SuperH (H)SCI(F) driver initialized1369worker1 # [ 0.544351] STM32 USART driver initialized1370lb # [ 0.514744] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1371client # [ 0.551460] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1372lb # [ 0.524665] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1373lb # [ 0.526571] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1374lb # [ 0.528377] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1375client # [ 0.553985] msm_serial: driver initialized1376client # [ 0.554142] SuperH (H)SCI(F) driver initialized1377client # [ 0.554196] STM32 USART driver initialized1378lb # [ 0.538973] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1379worker2 # [ 0.576415] loop: module loaded1380worker2 # [ 0.576595] virtio_blk virtio2: 1/0/0 default/read/poll queues1381worker2 # [ 0.577370] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1382worker2 # [ 0.582479] megasas: 07.734.00.00-rc11383worker1 # [ 0.575263] loop: module loaded1384worker1 # [ 0.575452] virtio_blk virtio2: 1/0/0 default/read/poll queues1385worker2 # [ 0.583142] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1386worker1 # [ 0.576239] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1387lb # [ 0.551792] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1388lb # [ 0.554358] msm_serial: driver initialized1389lb # [ 0.554513] SuperH (H)SCI(F) driver initialized1390lb # [ 0.554568] STM32 USART driver initialized1391worker1 # [ 0.581670] megasas: 07.734.00.00-rc11392worker1 # [ 0.582343] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1393worker2 # [ 0.594966] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001394client # [ 0.584630] loop: module loaded1395worker2 # [ 0.594996] Intel/Sharp Extended Query Table at 0x00311396client # [ 0.584795] virtio_blk virtio2: 1/0/0 default/read/poll queues1397worker2 # [ 0.596575] Using buffer write method1398client # [ 0.585553] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1399worker2 # [ 0.596641] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1400client # [ 0.591352] megasas: 07.734.00.00-rc11401client # [ 0.592135] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1402worker1 # [ 0.593710] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001403worker1 # [ 0.593739] Intel/Sharp Extended Query Table at 0x00311404client # [ 0.594439] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001405worker1 # [ 0.595472] Using buffer write method1406client # [ 0.594508] Intel/Sharp Extended Query Table at 0x00311407worker1 # [ 0.595542] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1408worker1 # [ 0.598410] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001409worker1 # [ 0.598427] Intel/Sharp Extended Query Table at 0x00311410worker2 # [ 0.612336] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001411worker1 # [ 0.599804] Using buffer write method1412worker2 # [ 0.612366] Intel/Sharp Extended Query Table at 0x00311413worker1 # [ 0.599829] Concatenating MTD devices:1414worker1 # [ 0.599833] (0): "0.flash"1415worker2 # [ 0.615767] Using buffer write method1416worker1 # [ 0.599836] (1): "0.flash"1417worker1 # [ 0.599849] into device "0.flash"1418worker2 # [ 0.615791] Concatenating MTD devices:1419worker2 # [ 0.615795] (0): "0.flash"1420worker2 # [ 0.615798] (1): "0.flash"1421worker2 # [ 0.615810] into device "0.flash"1422client # [ 0.603766] Using buffer write method1423client # [ 0.603840] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1424lb # [ 0.587311] loop: module loaded1425lb # [ 0.587519] virtio_blk virtio2: 1/0/0 default/read/poll queues1426lb # [ 0.588258] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1427client # [ 0.614843] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001428client # [ 0.614867] Intel/Sharp Extended Query Table at 0x00311429client # [ 0.616404] Using buffer write method1430client # [ 0.616432] Concatenating MTD devices:1431client # [ 0.616436] (0): "0.flash"1432lb # [ 0.593064] megasas: 07.734.00.00-rc11433client # [ 0.616439] (1): "0.flash"1434client # [ 0.616450] into device "0.flash"1435lb # [ 0.593761] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1436lb # [ 0.596074] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001437lb # [ 0.596128] Intel/Sharp Extended Query Table at 0x00311438lb # [ 0.605625] Using buffer write method1439lb # [ 0.605699] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1440lb # [ 0.616529] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001441lb # [ 0.616551] Intel/Sharp Extended Query Table at 0x00311442lb # [ 0.618006] Using buffer write method1443lb # [ 0.618035] Concatenating MTD devices:1444lb # [ 0.618039] (0): "0.flash"1445lb # [ 0.618042] (1): "0.flash"1446lb # [ 0.618054] into device "0.flash"1447worker2 # [ 0.854267] Freeing initrd memory: 26944K1448worker2 # [ 0.860329] tun: Universal TUN/TAP device driver, 1.61449client # [ 0.846987] Freeing initrd memory: 26972K1450worker1 # [ 0.852705] Freeing initrd memory: 26976K1451worker2 # [ 0.864085] thunder_xcv, ver 1.01452worker2 # [ 0.864123] thunder_bgx, ver 1.01453worker2 # [ 0.864146] nicpf, ver 1.01454client # [ 0.852999] tun: Universal TUN/TAP device driver, 1.61455worker2 # [ 0.864714] e1000: Intel(R) PRO/1000 Network Driver1456worker2 # [ 0.864721] e1000: Copyright (c) 1999-2006 Intel Corporation.1457worker2 # [ 0.864746] e1000e: Intel(R) PRO/1000 Network Driver1458worker1 # [ 0.858732] tun: Universal TUN/TAP device driver, 1.61459worker2 # [ 0.864753] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1460worker2 # [ 0.864781] igb: Intel(R) Gigabit Ethernet Network Driver1461worker2 # [ 0.864787] igb: Copyright (c) 2007-2014 Intel Corporation.1462worker2 # [ 0.864822] igbvf: Intel(R) Gigabit Virtual Function Network Driver1463worker2 # [ 0.864828] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1464worker2 # [ 0.864963] sky2: driver version 1.301465client # [ 0.856689] thunder_xcv, ver 1.01466client # [ 0.856733] thunder_bgx, ver 1.01467client # [ 0.856756] nicpf, ver 1.01468client # [ 0.857304] e1000: Intel(R) PRO/1000 Network Driver1469worker2 # [ 0.873657] usbcore: registered new interface driver usb-storage1470client # [ 0.857311] e1000: Copyright (c) 1999-2006 Intel Corporation.1471worker2 # [ 0.873817] usbcore: registered new interface driver usbserial_generic1472client # [ 0.857336] e1000e: Intel(R) PRO/1000 Network Driver1473worker2 # [ 0.873831] usbserial: USB Serial support registered for generic1474worker1 # [ 0.862496] thunder_xcv, ver 1.01475client # [ 0.857343] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1476worker1 # [ 0.862539] thunder_bgx, ver 1.01477client # [ 0.857372] igb: Intel(R) Gigabit Ethernet Network Driver1478worker1 # [ 0.862561] nicpf, ver 1.01479worker1 # [ 0.863121] e1000: Intel(R) PRO/1000 Network Driver1480client # [ 0.857378] igb: Copyright (c) 2007-2014 Intel Corporation.1481worker2 # [ 0.876888] ehci-pci 0000:00:07.0: EHCI Host Controller1482worker1 # [ 0.863129] e1000: Copyright (c) 1999-2006 Intel Corporation.1483client # [ 0.857402] igbvf: Intel(R) Gigabit Virtual Function Network Driver1484worker2 # [ 0.876916] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11485worker1 # [ 0.863153] e1000e: Intel(R) PRO/1000 Network Driver1486client # [ 0.857408] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1487worker2 # [ 0.877168] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001488client # [ 0.857541] sky2: driver version 1.301489worker1 # [ 0.863160] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1490worker1 # [ 0.863189] igb: Intel(R) Gigabit Ethernet Network Driver1491worker1 # [ 0.863195] igb: Copyright (c) 2007-2014 Intel Corporation.1492worker2 # [ 0.880010] hv_vmbus: registering driver hyperv_keyboard1493client # [ 0.866421] ehci-pci 0000:00:07.0: EHCI Host Controller1494worker1 # [ 0.863217] igbvf: Intel(R) Gigabit Virtual Function Network Driver1495client # [ 0.866448] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11496worker1 # [ 0.863222] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1497worker2 # [ 0.881478] rtc-pl031 9010000.pl031: registered as rtc01498worker1 # [ 0.863355] sky2: driver version 1.301499client # [ 0.866862] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001500worker2 # [ 0.881509] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T16:04:09 UTC (1790093049)1501worker1 # [ 0.864931] usbcore: registered new interface driver usb-storage1502worker2 # [ 0.881817] i2c_dev: i2c /dev entries driver1503worker1 # [ 0.864981] usbcore: registered new interface driver usbserial_generic1504worker1 # [ 0.864994] usbserial: USB Serial support registered for generic1505client # [ 0.869503] usbcore: registered new interface driver usb-storage1506worker1 # [ 0.865913] ehci-pci 0000:00:07.0: EHCI Host Controller1507client # [ 0.869593] usbcore: registered new interface driver usbserial_generic1508worker1 # [ 0.865937] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11509client # [ 0.869606] usbserial: USB Serial support registered for generic1510client # [ 0.870195] hv_vmbus: registering driver hyperv_keyboard1511worker1 # [ 0.866103] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001512worker1 # [ 0.877839] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001513client # [ 0.873922] rtc-pl031 9010000.pl031: registered as rtc01514worker1 # [ 0.878144] hub 1-0:1.0: USB hub found1515worker1 # [ 0.878159] hub 1-0:1.0: 6 ports detected1516client # [ 0.873950] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T16:04:09 UTC (1790093049)1517worker2 # [ 0.887046] sdhci: Secure Digital Host Controller Interface driver1518client # [ 0.874244] i2c_dev: i2c /dev entries driver1519worker2 # [ 0.887057] sdhci: Copyright(c) Pierre Ossman1520worker1 # [ 0.880733] hv_vmbus: registering driver hyperv_keyboard1521worker2 # [ 0.887318] Synopsys Designware Multimedia Card Interface Driver1522worker2 # [ 0.887687] sdhci-pltfm: SDHCI platform and OF driver helper1523worker2 # [ 0.889169] hid: raw HID events driver (C) Jiri Kosina1524worker1 # [ 0.882272] rtc-pl031 9010000.pl031: registered as rtc01525worker2 # [ 0.889415] usbcore: registered new interface driver usbhid1526worker2 # [ 0.889421] usbhid: USB HID core driver1527worker1 # [ 0.882299] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T16:04:09 UTC (1790093049)1528worker2 # [ 0.894434] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001529worker1 # [ 0.882601] i2c_dev: i2c /dev entries driver1530worker2 # [ 0.895490] hub 1-0:1.0: USB hub found1531lb # [ 0.858922] Freeing initrd memory: 26948K1532worker2 # [ 0.895985] hub 1-0:1.0: 6 ports detected1533client # [ 0.879703] sdhci: Secure Digital Host Controller Interface driver1534client # [ 0.879715] sdhci: Copyright(c) Pierre Ossman1535client # [ 0.879994] Synopsys Designware Multimedia Card Interface Driver1536worker2 # [ 0.897580] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1537client # [ 0.880355] sdhci-pltfm: SDHCI platform and OF driver helper1538worker1 # [ 0.887906] sdhci: Secure Digital Host Controller Interface driver1539client # [ 0.881849] hid: raw HID events driver (C) Jiri Kosina1540worker1 # [ 0.887923] sdhci: Copyright(c) Pierre Ossman1541client # [ 0.882079] usbcore: registered new interface driver usbhid1542worker1 # [ 0.888184] Synopsys Designware Multimedia Card Interface Driver1543client # [ 0.882085] usbhid: USB HID core driver1544worker2 # [ 0.900241] drop_monitor: Initializing network drop monitor service1545worker1 # [ 0.888547] sdhci-pltfm: SDHCI platform and OF driver helper1546worker2 # [ 0.900384] NET: Registered PF_INET6 protocol family1547lb # [ 0.864922] tun: Universal TUN/TAP device driver, 1.61548client # [ 0.887266] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001549worker2 # [ 0.902330] Segment Routing with IPv61550client # [ 0.887583] hub 1-0:1.0: USB hub found1551worker2 # [ 0.902347] In-situ OAM (IOAM) with IPv61552client # [ 0.887602] hub 1-0:1.0: 6 ports detected1553worker1 # [ 0.892739] hid: raw HID events driver (C) Jiri Kosina1554worker2 # [ 0.902375] NET: Registered PF_PACKET protocol family1555worker1 # [ 0.892979] usbcore: registered new interface driver usbhid1556worker1 # [ 0.892985] usbhid: USB HID core driver1557client # [ 0.889938] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1558worker2 # [ 0.903986] 9pnet: Installing 9P2000 support1559worker2 # [ 0.904036] Key type dns_resolver registered1560client # [ 0.892532] drop_monitor: Initializing network drop monitor service1561client # [ 0.892678] NET: Registered PF_INET6 protocol family1562worker1 # [ 0.895802] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1563client # [ 0.894548] Segment Routing with IPv61564worker1 # [ 0.898446] drop_monitor: Initializing network drop monitor service1565client # [ 0.894568] In-situ OAM (IOAM) with IPv61566worker1 # [ 0.898587] NET: Registered PF_INET6 protocol family1567client # [ 0.894596] NET: Registered PF_PACKET protocol family1568lb # [ 0.868565] thunder_xcv, ver 1.01569lb # [ 0.868603] thunder_bgx, ver 1.01570worker1 # [ 0.900560] Segment Routing with IPv61571lb # [ 0.868625] nicpf, ver 1.01572worker1 # [ 0.900579] In-situ OAM (IOAM) with IPv61573lb # [ 0.869211] e1000: Intel(R) PRO/1000 Network Driver1574worker1 # [ 0.900605] NET: Registered PF_PACKET protocol family1575lb # [ 0.869219] e1000: Copyright (c) 1999-2006 Intel Corporation.1576lb # [ 0.869243] e1000e: Intel(R) PRO/1000 Network Driver1577client # [ 0.896272] 9pnet: Installing 9P2000 support1578client # [ 0.896326] Key type dns_resolver registered1579lb # [ 0.869250] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1580lb # [ 0.869280] igb: Intel(R) Gigabit Ethernet Network Driver1581worker2 # [ 0.910598] registered taskstats version 11582lb # [ 0.869286] igb: Copyright (c) 2007-2014 Intel Corporation.1583worker2 # [ 0.910744] Loading compiled-in X.509 certificates1584worker1 # [ 0.902456] 9pnet: Installing 9P2000 support1585lb # [ 0.869308] igbvf: Intel(R) Gigabit Virtual Function Network Driver1586worker1 # [ 0.902502] Key type dns_resolver registered1587lb # [ 0.869314] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1588lb # [ 0.869451] sky2: driver version 1.301589lb # [ 0.871003] usbcore: registered new interface driver usb-storage1590lb # [ 0.871090] usbcore: registered new interface driver usbserial_generic1591lb # [ 0.871103] usbserial: USB Serial support registered for generic1592lb # [ 0.871691] hv_vmbus: registering driver hyperv_keyboard1593worker2 # [ 0.919546] Demotion targets for Node 0: null1594lb # [ 0.872990] ehci-pci 0000:00:07.0: EHCI Host Controller1595worker2 # [ 0.919645] Key type .fscrypt registered1596client # [ 0.903062] registered taskstats version 11597lb # [ 0.873013] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11598worker2 # [ 0.919651] Key type fscrypt-provisioning registered1599client # [ 0.903222] Loading compiled-in X.509 certificates1600worker2 # [ 0.919741] ima: No TPM chip found, activating TPM-bypass!1601lb # [ 0.873267] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001602worker2 # [ 0.919760] ima: Allocated hash algorithm: sha11603worker2 # [ 0.919779] ima: No architecture policies found1604worker1 # [ 0.909189] registered taskstats version 11605lb # [ 0.885699] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001606worker1 # [ 0.909343] Loading compiled-in X.509 certificates1607lb # [ 0.886029] hub 1-0:1.0: USB hub found1608worker2 # [ 0.923659] input: gpio-keys as /devices/platform/gpio-keys/input/input01609lb # [ 0.886050] hub 1-0:1.0: 6 ports detected1610lb # [ 0.888230] rtc-pl031 9010000.pl031: registered as rtc01611client # [ 0.911909] Demotion targets for Node 0: null1612lb # [ 0.888258] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T16:04:09 UTC (1790093049)1613client # [ 0.912013] Key type .fscrypt registered1614client # [ 0.912019] Key type fscrypt-provisioning registered1615lb # [ 0.890333] i2c_dev: i2c /dev entries driver1616client # [ 0.912112] ima: No TPM chip found, activating TPM-bypass!1617worker1 # [ 0.917798] Demotion targets for Node 0: null1618client # [ 0.912131] ima: Allocated hash algorithm: sha11619worker1 # [ 0.917900] Key type .fscrypt registered1620client # [ 0.912152] ima: No architecture policies found1621worker1 # [ 0.917906] Key type fscrypt-provisioning registered1622worker1 # [ 0.917998] ima: No TPM chip found, activating TPM-bypass!1623client # [ 0.916083] input: gpio-keys as /devices/platform/gpio-keys/input/input01624worker1 # [ 0.918017] ima: Allocated hash algorithm: sha11625worker1 # [ 0.918038] ima: No architecture policies found1626worker1 # [ 0.922142] input: gpio-keys as /devices/platform/gpio-keys/input/input01627lb # [ 0.893985] sdhci: Secure Digital Host Controller Interface driver1628lb # [ 0.893997] sdhci: Copyright(c) Pierre Ossman1629lb # [ 0.894260] Synopsys Designware Multimedia Card Interface Driver1630lb # [ 0.894630] sdhci-pltfm: SDHCI platform and OF driver helper1631lb # [ 0.896134] hid: raw HID events driver (C) Jiri Kosina1632lb # [ 0.896381] usbcore: registered new interface driver usbhid1633lb # [ 0.896388] usbhid: USB HID core driver1634lb # [ 0.902047] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1635lb # [ 0.903555] drop_monitor: Initializing network drop monitor service1636worker2 # [ 0.941063] clk: Disabling unused clocks1637lb # [ 0.903716] NET: Registered PF_INET6 protocol family1638worker2 # [ 0.941090] PM: genpd: Disabling unused power domains1639lb # [ 0.906807] Segment Routing with IPv61640lb # [ 0.906827] In-situ OAM (IOAM) with IPv61641lb # [ 0.906855] NET: Registered PF_PACKET protocol family1642lb # [ 0.908483] 9pnet: Installing 9P2000 support1643worker2 # [ 0.945191] Freeing unused kernel memory: 4736K1644worker2 # [ 0.945376] Run /init as init process1645client # [ 0.933352] clk: Disabling unused clocks1646lb # [ 0.909246] Key type dns_resolver registered1647client # [ 0.933377] PM: genpd: Disabling unused power domains1648worker1 # [ 0.939772] clk: Disabling unused clocks1649worker1 # [ 0.939798] PM: genpd: Disabling unused power domains1650client # [ 0.937465] Freeing unused kernel memory: 4736K1651client # [ 0.937643] Run /init as init process1652lb # [ 0.915413] registered taskstats version 11653lb # [ 0.915553] Loading compiled-in X.509 certificates1654worker1 # [ 0.943895] Freeing unused kernel memory: 4736K1655worker1 # [ 0.944106] Run /init as init process1656worker2 # [ 0.960074] systemd[1]: Successfully made /usr/ read-only.1657lb # [ 0.924213] Demotion targets for Node 0: null1658lb # [ 0.924314] Key type .fscrypt registered1659lb # [ 0.924321] Key type fscrypt-provisioning registered1660lb # [ 0.924417] ima: No TPM chip found, activating TPM-bypass!1661lb # [ 0.924436] ima: Allocated hash algorithm: sha11662lb # [ 0.924457] ima: No architecture policies found1663lb # [ 0.928653] input: gpio-keys as /devices/platform/gpio-keys/input/input01664client # [ 0.952962] systemd[1]: Successfully made /usr/ read-only.1665worker1 # [ 0.959325] systemd[1]: Successfully made /usr/ read-only.1666lb # [ 0.946515] clk: Disabling unused clocks1667lb # [ 0.946542] PM: genpd: Disabling unused power domains1668lb # [ 0.950684] Freeing unused kernel memory: 4736K1669lb # [ 0.950883] Run /init as init process1670lb # [ 0.966637] systemd[1]: Successfully made /usr/ read-only.1671worker1 # [ 1.125190] usb 1-1: new high-speed USB device number 2 using ehci-pci1672worker2 # [ 1.141971] usb 1-1: new high-speed USB device number 2 using ehci-pci1673client # [ 1.134858] usb 1-1: new high-speed USB device number 2 using ehci-pci1674lb # [ 1.132564] usb 1-1: new high-speed USB device number 2 using ehci-pci1675worker1 # [ 1.277649] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11676worker2 # [ 1.294497] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11677client # [ 1.287224] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11678worker2 # [ 1.300396] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1679worker1 # [ 1.293919] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1680worker2 # [ 1.312852] systemd[1]: Detected virtualization qemu.1681worker2 # [ 1.312930] systemd[1]: Detected architecture arm64.1682client # [ 1.293462] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1683worker2 # [ 1.312945] systemd[1]: Running in initrd.1684worker1 # [ 1.306118] systemd[1]: Detected virtualization qemu.1685worker1 # [ 1.306209] systemd[1]: Detected architecture arm64.1686client # [ 1.305871] systemd[1]: Detected virtualization qemu.1687worker2 # [ 1.313874] systemd[1]: Initializing machine ID from random generator.1688worker1 # [ 1.306232] systemd[1]: Running in initrd.1689client # [ 1.308021] systemd[1]: Detected architecture arm64.1690worker2 # [ 1.322332] systemd[1]: Hostname set to <worker2>.1691worker1 # [ 1.307154] systemd[1]: Initializing machine ID from random generator.1692client # [ 1.309969] systemd[1]: Running in initrd.1693lb # [ 1.285087] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11694worker1 # [ 1.307584] systemd[1]: Hostname set to <worker1>.1695client # [ 1.312601] systemd[1]: Initializing machine ID from random generator.1696client # [ 1.315478] systemd[1]: Hostname set to <client>.1697lb # [ 1.301419] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1698lb # [ 1.313646] systemd[1]: Detected virtualization qemu.1699lb # [ 1.315635] systemd[1]: Detected architecture arm64.1700lb # [ 1.317621] systemd[1]: Running in initrd.1701lb # [ 1.320193] systemd[1]: Initializing machine ID from random generator.1702lb # [ 1.323217] systemd[1]: Hostname set to <lb>.1703worker1 # [ 1.361424] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01704worker2 # [ 1.378185] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01705client # [ 1.371051] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01706lb # [ 1.372782] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01707worker1 # [ 1.481166] usb 1-2: new high-speed USB device number 3 using ehci-pci1708worker2 # [ 1.497998] usb 1-2: new high-speed USB device number 3 using ehci-pci1709client # [ 1.494867] usb 1-2: new high-speed USB device number 3 using ehci-pci1710lb # [ 1.496578] usb 1-2: new high-speed USB device number 3 using ehci-pci1711worker2 # [ 1.619026] systemd[1]: bpf-restrict-fs: LSM BPF program attached1712worker1 # [ 1.619755] systemd[1]: bpf-restrict-fs: LSM BPF program attached1713client # [ 1.625838] systemd[1]: bpf-restrict-fs: LSM BPF program attached1714worker2 # [ 1.648379] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21715worker1 # [ 1.641869] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21716worker2 # [ 1.653542] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01717worker1 # [ 1.647054] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01718lb # [ 1.626939] systemd[1]: bpf-restrict-fs: LSM BPF program attached1719client # [ 1.653548] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21720client # [ 1.663208] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01721lb # [ 1.657315] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21722lb # [ 1.664670] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01723worker2 # [ 1.734103] systemd[1]: Queued start job for default target Initrd Default Target.1724worker1 # [ 1.731589] systemd[1]: Queued start job for default target Initrd Default Target.1725worker2 # [ 1.745717] systemd[1]: Created slice Slice /system/modprobe.1726worker2 # [ 1.747143] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1727worker2 # [ 1.748499] systemd[1]: Expecting device /dev/disk/by-label/nixos...1728worker2 # [ 1.749599] systemd[1]: Reached target Path Units.1729worker2 # [ 1.750516] systemd[1]: Reached target Slice Units.1730worker2 # [ 1.751379] systemd[1]: Reached target Swaps.1731worker2 # [ 1.752164] systemd[1]: Reached target Timer Units.1732worker2 # [ 1.753219] systemd[1]: Listening on D-Bus System Message Bus Socket.1733worker1 # [ 1.744684] systemd[1]: Created slice Slice /system/modprobe.1734worker2 # [ 1.754573] systemd[1]: Listening on Journal Socket (/dev/log).1735worker2 # [ 1.755767] systemd[1]: Listening on Journal Sockets.1736worker1 # [ 1.746011] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1737worker2 # [ 1.756804] systemd[1]: Listening on udev Control Socket.1738worker1 # [ 1.747478] systemd[1]: Expecting device /dev/disk/by-label/nixos...1739worker2 # [ 1.757887] systemd[1]: Listening on udev Kernel Socket.1740worker1 # [ 1.748600] systemd[1]: Reached target Path Units.1741worker2 # [ 1.758861] systemd[1]: Reached target Socket Units.1742worker1 # [ 1.749498] systemd[1]: Reached target Slice Units.1743client # [ 1.745698] systemd[1]: Queued start job for default target Initrd Default Target.1744worker1 # [ 1.750356] systemd[1]: Reached target Swaps.1745worker1 # [ 1.751135] systemd[1]: Reached target Timer Units.1746worker2 # [ 1.761362] systemd[1]: Starting Create List of Static Device Nodes...1747worker1 # [ 1.752188] systemd[1]: Listening on D-Bus System Message Bus Socket.1748worker1 # [ 1.753506] systemd[1]: Listening on Journal Socket (/dev/log).1749worker1 # [ 1.754677] systemd[1]: Listening on Journal Sockets.1750worker2 # [ 1.762678] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1751worker1 # [ 1.755725] systemd[1]: Listening on udev Control Socket.1752worker1 # [ 1.756808] systemd[1]: Listening on udev Kernel Socket.1753client # [ 1.753164] systemd[1]: Created slice Slice /system/modprobe.1754client # [ 1.754302] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1755worker1 # [ 1.757822] systemd[1]: Reached target Socket Units.1756worker1 # [ 1.760329] systemd[1]: Starting Create List of Static Device Nodes...1757client # [ 1.755598] systemd[1]: Expecting device /dev/disk/by-label/nixos...1758client # [ 1.755632] systemd[1]: Reached target Path Units.1759client # [ 1.755652] systemd[1]: Reached target Slice Units.1760worker1 # [ 1.761568] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1761client # [ 1.755672] systemd[1]: Reached target Swaps.1762worker2 # [ 1.774062] systemd[1]: Mounting Kernel Configuration File System...1763client # [ 1.755693] systemd[1]: Reached target Timer Units.1764client # [ 1.755880] systemd[1]: Listening on D-Bus System Message Bus Socket.1765client # [ 1.756058] systemd[1]: Listening on Journal Socket (/dev/log).1766client # [ 1.756192] systemd[1]: Listening on Journal Sockets.1767client # [ 1.756320] systemd[1]: Listening on udev Control Socket.1768client # [ 1.756424] systemd[1]: Listening on udev Kernel Socket.1769client # [ 1.756445] systemd[1]: Reached target Socket Units.1770client # [ 1.766748] systemd[1]: Starting Create List of Static Device Nodes...1771client # [ 1.767918] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1772worker2 # [ 1.782557] systemd[1]: Starting Journal Service...1773worker1 # [ 1.772784] systemd[1]: Mounting Kernel Configuration File System...1774lb # [ 1.745968] systemd[1]: Queued start job for default target Initrd Default Target.1775lb # [ 1.750701] systemd[1]: Created slice Slice /system/modprobe.1776lb # [ 1.751913] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1777lb # [ 1.753247] systemd[1]: Expecting device /dev/disk/by-label/nixos...1778lb # [ 1.754254] systemd[1]: Reached target Path Units.1779worker2 # [ 1.791273] systemd[1]: Starting Load Kernel Modules...1780lb # [ 1.755032] systemd[1]: Reached target Slice Units.1781lb # [ 1.755828] systemd[1]: Reached target Swaps.1782worker2 # [ 1.792236] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1783client # [ 1.778978] systemd[1]: Mounting Kernel Configuration File System...1784lb # [ 1.756587] systemd[1]: Reached target Timer Units.1785lb # [ 1.757551] systemd[1]: Listening on D-Bus System Message Bus Socket.1786lb # [ 1.758701] systemd[1]: Listening on Journal Socket (/dev/log).1787lb # [ 1.759764] systemd[1]: Listening on Journal Sockets.1788lb # [ 1.760737] systemd[1]: Listening on udev Control Socket.1789lb # [ 1.760847] systemd[1]: Listening on udev Kernel Socket.1790lb # [ 1.760870] systemd[1]: Reached target Socket Units.1791lb # [ 1.768690] systemd[1]: Starting Create List of Static Device Nodes...1792lb # [ 1.769819] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1793lb # [ 1.773058] systemd[1]: Mounting Kernel Configuration File System...1794client # [ 1.799100] systemd[1]: Starting Journal Service...1795worker1 # [ 1.801834] systemd[1]: Starting Journal Service...1796worker1 # [ 1.804511] systemd[1]: Starting Load Kernel Modules...1797worker1 # [ 1.805701] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1798lb # [ 1.784134] systemd[1]: Starting Journal Service...1799client # [ 1.807055] systemd[1]: Starting Load Kernel Modules...1800client # [ 1.808060] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1801worker1 # [ 1.815327] systemd[1]: Starting Coldplug All udev Devices...1802worker2 # [ 1.830211] systemd[1]: Starting Coldplug All udev Devices...1803client # [ 1.820119] systemd[1]: Starting Coldplug All udev Devices...1804lb # [ 1.797781] systemd[1]: Starting Load Kernel Modules...1805lb # [ 1.797900] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1806worker1 # [ 1.829287] systemd[1]: Finished Create List of Static Device Nodes.1807worker1 # [ 1.830079] systemd[1]: Mounted Kernel Configuration File System.1808worker2 # [ 1.842020] systemd[1]: Finished Create List of Static Device Nodes.1809worker2 # [ 1.854817] systemd-journald[72]: Collecting audit messages is disabled.1810worker1 # [ 1.849836] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1811client # [ 1.846900] systemd[1]: Finished Create List of Static Device Nodes.1812lb # [ 1.826457] systemd-journald[72]: Collecting audit messages is disabled.1813client # [ 1.847713] systemd[1]: Mounted Kernel Configuration File System.1814lb # [ 1.827482] systemd[1]: Starting Coldplug All udev Devices...1815client # [ 1.855194] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1816worker2 # [ 1.872667] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1817worker1 # [ 1.867972] systemd-journald[72]: Collecting audit messages is disabled.1818client # [ 1.864718] systemd-journald[72]: Collecting audit messages is disabled.1819lb # [ 1.840710] systemd[1]: Finished Create List of Static Device Nodes.1820worker2 # [ 1.882632] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1821worker2 # [ 1.883224] systemd[1]: Mounted Kernel Configuration File System.1822worker2 # [ 1.885039] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1823worker1 # [ 1.879439] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1824worker2 # [ 1.898999] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01825lb # [ 1.864687] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1826worker2 # [ 1.899227] [drm] features: -virgl +edid -resource_blob -host_visible1827worker2 # [ 1.899237] [drm] features: -context_init1828worker2 # [ 1.899907] [drm] number of scanouts: 11829worker2 # [ 1.899924] [drm] number of cap sets: 01830lb # [ 1.868837] systemd[1]: Mounted Kernel Configuration File System.1831client # [ 1.892137] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1832worker1 # [ 1.897759] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1833client # [ 1.894974] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1834worker1 # [ 1.900158] systemd[1]: Starting Create Static Device Nodes in /dev...1835worker1 # [ 1.901998] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1836worker2 # [ 1.914553] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1837worker2 # [ 1.917016] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1838worker2 # [ 1.917033] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01839client # [ 1.904094] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01840client # [ 1.904324] [drm] features: -virgl +edid -resource_blob -host_visible1841worker2 # [ 1.920032] systemd[1]: Starting Create Static Device Nodes in /dev...1842client # [ 1.904333] [drm] features: -context_init1843client # [ 1.905033] [drm] number of scanouts: 11844worker1 # [ 1.910308] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01845client # [ 1.905050] [drm] number of cap sets: 01846worker1 # [ 1.910536] [drm] features: -virgl +edid -resource_blob -host_visible1847worker1 # [ 1.910546] [drm] features: -context_init1848worker1 # [ 1.911252] [drm] number of scanouts: 11849worker1 # [ 1.911271] [drm] number of cap sets: 01850lb # [ 1.893120] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1851client # [ 1.915418] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1852client # [ 1.923122] systemd[1]: Starting Create Static Device Nodes in /dev...1853lb # [ 1.900823] systemd[1]: Starting Create Static Device Nodes in /dev...1854client # [ 1.931195] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1855client # [ 1.931209] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01856worker1 # [ 1.937756] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1857lb # [ 1.914400] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1858worker1 # [ 1.937774] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01859worker2 # [ 1.950180] Console: switching to colour frame buffer device 160x501860worker2 # [ 1.956785] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1861lb # [ 1.931710] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1862worker1 # [ 1.957731] systemd[1]: Finished Create Static Device Nodes in /dev.1863worker1 # [ 1.958069] systemd[1]: Reached target Preparation for Local File Systems.1864worker1 # [ 1.958097] systemd[1]: Reached target Local File Systems.1865worker2 # [ 1.970559] systemd[1]: Finished Create Static Device Nodes in /dev.1866worker2 # [ 1.972646] systemd[1]: Reached target Preparation for Local File Systems.1867worker1 # [ 1.962039] systemd[1]: Starting Rule-based Manager for Device Events and Files...1868lb # [ 1.937208] systemd[1]: Finished Create Static Device Nodes in /dev.1869worker2 # [ 1.974474] systemd[1]: Reached target Local File Systems.1870lb # [ 1.937371] systemd[1]: Reached target Preparation for Local File Systems.1871lb # [ 1.937399] systemd[1]: Reached target Local File Systems.1872client # [ 1.958348] Console: switching to colour frame buffer device 160x501873client # [ 1.966725] systemd[1]: Finished Create Static Device Nodes in /dev.1874client # [ 1.967958] systemd[1]: Reached target Preparation for Local File Systems.1875worker1 # [ 1.966314] Console: switching to colour frame buffer device 160x501876client # [ 1.967988] systemd[1]: Reached target Local File Systems.1877worker1 # [ 1.972925] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1878lb # [ 1.949689] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01879lb # [ 1.949924] [drm] features: -virgl +edid -resource_blob -host_visible1880lb # [ 1.949934] [drm] features: -context_init1881lb # [ 1.950638] [drm] number of scanouts: 11882lb # [ 1.950655] [drm] number of cap sets: 01883worker2 # [ 1.986880] systemd[1]: Starting Rule-based Manager for Device Events and Files...1884lb # [ 1.954293] systemd[1]: Starting Rule-based Manager for Device Events and Files...1885client # [ 1.979142] systemd[1]: Starting Rule-based Manager for Device Events and Files...1886worker2 # [ 2.006054] systemd[1]: Finished Load Kernel Modules.1887client # [ 1.992454] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1888worker2 # [ 2.011089] systemd[1]: Starting Apply Kernel Variables...1889lb # [ 1.972835] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1890lb # [ 1.972853] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01891worker1 # [ 2.005379] systemd[1]: Finished Load Kernel Modules.1892worker1 # [ 2.007050] systemd[1]: Starting Apply Kernel Variables...1893worker2 # [ 2.022074] systemd[1]: Started Journal Service.1894client # [ 2.011069] systemd[1]: Finished Load Kernel Modules.1895client # [ 2.014205] systemd[1]: Starting Apply Kernel Variables...1896worker2 # [ 2.024378] systemd-modules-load[73]: Inserted module 'dm_mod'1897worker2 # [ 2.025607] systemd-modules-load[73]: Module 'virtio_balloon' is built in1898lb # [ 1.996759] Console: switching to colour frame buffer device 160x501899worker2 # [ 2.026677] systemd-modules-load[73]: Module 'virtio_console' is built in1900worker2 # [ 2.027720] systemd-modules-load[73]: Inserted module 'virtio_gpu'1901worker2 # [ 2.040370] systemd-modules-load[73]: Module 'virtio_rng' is built in1902lb # [ 2.016771] systemd[1]: Started Journal Service.1903worker2 # [ 2.041428] systemd[1]: Starting Create System Files and Directories...1904worker1 # [ 2.032309] systemd-modules-load[73]: Inserted module 'dm_mod'1905lb # [ 2.006449] systemd-modules-load[74]: Inserted module 'dm_mod'1906lb # [ 2.007533] systemd-modules-load[74]: Module 'virtio_balloon' is built in1907worker1 # [ 2.046480] systemd[1]: Started Journal Service.1908worker1 # [ 2.040243] systemd-modules-load[73]: Module 'virtio_balloon' is built in1909client # [ 2.045216] systemd[1]: Started Journal Service.1910lb # [ 2.016451] systemd-modules-load[74]: Module 'virtio_console' is built in1911lb # [ 2.017605] systemd[1]: Starting Create System Files and Directories...1912worker1 # [ 2.048133] systemd-modules-load[73]: Module 'virtio_console' is built in1913worker1 # [ 2.049320] systemd-modules-load[73]: Inserted module 'virtio_gpu'1914client # [ 2.047476] systemd-modules-load[73]: Inserted module 'dm_mod'1915client # [ 2.048808] systemd-modules-load[73]: Module 'virtio_balloon' is built in1916client # [ 2.049887] systemd-modules-load[73]: Module 'virtio_console' is built in1917lb # [ 2.037108] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1918client # [ 2.050939] systemd-modules-load[73]: Inserted module 'virtio_gpu'1919worker2 # [ 2.062227] systemd[1]: Finished Apply Kernel Variables.1920client # [ 2.051930] systemd-modules-load[73]: Module 'virtio_rng' is built in1921worker1 # [ 2.056319] systemd-modules-load[73]: Module 'virtio_rng' is built in1922lb # [ 2.032542] systemd-modules-load[74]: Inserted module 'virtio_gpu'1923lb # [ 2.036109] systemd-modules-load[74]: Module 'virtio_rng' is built in1924worker1 # [ 2.064374] systemd[1]: Starting Create System Files and Directories...1925client # [ 2.064318] systemd[1]: Starting Create System Files and Directories...1926worker2 # [ 2.075492] systemd[1]: Finished Create System Files and Directories.1927worker1 # [ 2.066789] systemd[1]: Finished Apply Kernel Variables.1928client # [ 2.065422] systemd[1]: Finished Apply Kernel Variables.1929lb # [ 2.045520] systemd[1]: Finished Load Kernel Modules.1930worker2 # [ 2.081597] systemd-udevd[79]: Using default interface naming scheme 'v261'.1931worker1 # [ 2.072659] systemd-udevd[78]: Using default interface naming scheme 'v261'.1932lb # [ 2.048438] systemd-udevd[79]: Using default interface naming scheme 'v261'.1933client # [ 2.076530] systemd-udevd[79]: Using default interface naming scheme 'v261'.1934worker1 # [ 2.086156] systemd[1]: Finished Create System Files and Directories.1935lb # [ 2.063614] systemd[1]: Starting Apply Kernel Variables...1936lb # [ 2.068895] systemd[1]: Finished Create System Files and Directories.1937client # [ 2.093480] systemd[1]: Finished Create System Files and Directories.1938worker2 # [ 2.107877] systemd[1]: Started Rule-based Manager for Device Events and Files.1939worker1 # [ 2.103862] systemd[1]: Started Rule-based Manager for Device Events and Files.1940client # [ 2.113953] systemd[1]: Started Rule-based Manager for Device Events and Files.1941lb # [ 2.093193] systemd[1]: Finished Apply Kernel Variables.1942lb # [ 2.102542] systemd[1]: Started Rule-based Manager for Device Events and Files.1943worker2 # [ 2.164091] systemd[1]: Starting Virtual Console Setup...1944worker1 # [ 2.160128] systemd[1]: Starting Virtual Console Setup...1945client # [ 2.172234] systemd[1]: Starting Virtual Console Setup...1946lb # [ 2.163609] systemd[1]: Starting Virtual Console Setup...1947worker2 # [ 2.216476] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1948worker1 # [ 2.208501] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones.1949worker2 # [ 2.219706] systemd[1]: Finished Virtual Console Setup.1950worker1 # [ 2.211946] systemd[1]: Finished Virtual Console Setup.1951client # [ 2.220488] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1952client # [ 2.223834] systemd[1]: Finished Virtual Console Setup.1953lb # [ 2.204460] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1954lb # [ 2.207803] systemd[1]: Finished Virtual Console Setup.1955worker2 # [ 2.801948] systemd[1]: Finished Coldplug All udev Devices.1956worker2 # [ 2.802885] systemd[1]: Reached target System Initialization.1957worker2 # [ 2.808285] systemd[1]: Reached target Basic System.1958worker1 # [ 2.813030] systemd[1]: Finished Coldplug All udev Devices.1959worker1 # [ 2.813961] systemd[1]: Reached target System Initialization.1960worker1 # [ 2.814768] systemd[1]: Reached target Basic System.1961lb # [ 2.805976] systemd[1]: Finished Coldplug All udev Devices.1962lb # [ 2.806902] systemd[1]: Reached target System Initialization.1963lb # [ 2.812099] systemd[1]: Reached target Basic System.1964client # [ 2.868962] systemd[1]: Finished Coldplug All udev Devices.1965client # [ 2.869897] systemd[1]: Reached target System Initialization.1966client # [ 2.870698] systemd[1]: Reached target Basic System.1967worker2 # [ 2.969303] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1968worker1 # [ 2.964380] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1969worker2 # [ 2.973955] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1970lb # [ 2.951884] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1971worker2 # [ 2.988691] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1972worker1 # [ 3.003050] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1973worker1 # [ 3.008233] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1974lb # [ 2.986634] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1975lb # [ 2.991253] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1976client # [ 3.023496] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1977client # [ 3.038567] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1978client # [ 3.044288] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1979worker2 # [ 3.056918] systemd[1]: Found device /dev/disk/by-label/nixos.1980worker2 # [ 3.067387] systemd[1]: Reached target Initrd Root Device.1981worker2 # [ 3.071461] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1982worker1 # [ 3.086121] systemd[1]: Found device /dev/disk/by-label/nixos.1983lb # [ 3.060088] systemd[1]: Found device /dev/disk/by-label/nixos.1984worker1 # [ 3.088636] systemd[1]: Reached target Initrd Root Device.1985worker1 # [ 3.092171] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1986lb # [ 3.067862] systemd[1]: Reached target Initrd Root Device.1987lb # [ 3.073277] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1988worker2 # [ 3.116308] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks1989worker2 # [ 3.124156] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1990worker2 # [ 3.127160] systemd[1]: Mounting /sysroot...1991client # [ 3.120472] systemd[1]: Found device /dev/disk/by-label/nixos.1992client # [ 3.126585] systemd[1]: Reached target Initrd Root Device.1993client # [ 3.131173] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1994worker1 # [ 3.136338] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks1995worker1 # [ 3.143431] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1996worker1 # [ 3.148147] systemd[1]: Mounting /sysroot...1997lb # [ 3.124393] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks1998worker2 # [ 3.172156] EXT4-fs (vda): mounted filesystem 3a36e322-9909-4099-a778-e879587c08cc r/w with ordered data mode. Quota mode: none.1999worker2 # [ 3.166763] systemd[1]: Mounted /sysroot.2000lb # [ 3.132167] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.
loading 2,204 hidden lines…
4205lb # [ 45.089520] niks3-server[970]: 2026/09/22 16:04:53 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4206lb # [ 45.107293] niks3-server[970]: 2026/09/22 16:04:53 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4207worker1 # [ 45.144681] nix-grpc-daemon[863]: time=2026-09-22T16:04:53.775Z level=INFO msg="Uploading 1 narinfos"4208lb # [ 45.119874] niks3-server[970]: 2026/09/22 16:04:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4209lb # [ 45.129917] niks3-server[970]: 2026/09/22 16:04:53 INFO Signed narinfos id=6 count=14210lb # [ 45.136469] niks3-server[970]: 2026/09/22 16:04:53 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4211lb # [ 45.146480] niks3-server[970]: 2026/09/22 16:04:53 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4212lb # [ 45.154883] niks3-server[970]: 2026/09/22 16:04:53 INFO Completed upload id=64213lb # [ 45.157503] niks3-server[970]: 2026/09/22 16:04:53 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4214worker1 # [ 45.178721] nix-grpc-daemon[863]: time=2026-09-22T16:04:53.809Z level=INFO msg="Upload complete. (280ms)"4215worker1 # [ 45.191458] nix-grpc-daemon[765]: ts=2026-09-22T16:04:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14216worker1 # [ 45.213310] nix-daemon[848]: reaped child process 960, status = succeeded4217client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2, in 5.90 seconds)4218client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath4219client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.19 seconds)4220client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4221client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4222client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4223client # copying 3 paths...4224client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4225client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4226client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4227client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.24 seconds)4228(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.45 seconds)4229subtest: repeat is answered Cached by the scheduler without building4230worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4231worker1 # finding garbage collector roots...4232worker1 # deleting specified paths...4233worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4234worker1 # deleting unused links...4235worker1 # note: hard linking is currently saving 0.0 KiB4236worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.22 seconds)4237worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4238worker2 # finding garbage collector roots...4239worker2 # deleting specified paths...4240worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4241worker2 # deleting unused links...4242worker2 # note: hard linking is currently saving 0.0 KiB4243worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.24 seconds)4244client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&24245client # don't know how to build these paths:4246client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4247worker2 # [ 46.479778] nix-grpc-daemon[773]: ts=2026-09-22T16:04:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:517044248worker1 # [ 46.474323] nix-grpc-daemon[765]: ts=2026-09-22T16:04:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184249worker1 # [ 46.486101] nix-grpc-daemon[863]: time=2026-09-22T16:04:55.116Z level=INFO msg="All 2 paths already cached"4250worker1 # [ 46.503785] nix-grpc-daemon[765]: ts=2026-09-22T16:04:55Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14251client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2, in 0.28 seconds)4252client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath4253client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.13 seconds)4254lb: must succeed: curl -sf localhost:9901/clusters4255lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4256lb: must succeed: curl -sf localhost:9901/clusters4257lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4258worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4259worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4260(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.14 seconds)4261subtest: inputs already in the cache are not sent to the scheduler4262lb: must succeed: curl -sf localhost:9901/clusters4263lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4264lb: must succeed: curl -sf localhost:9901/clusters4265lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4266worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4267worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4268client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&24269lb # [ 47.088928] envoy[896]: conn peer=[2001:db8:1::1]:50508 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=14674270lb # [ 47.093808] envoy[896]: conn peer=[2001:db8:1::1]:50514 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=365 ms=14264271lb # [ 47.098386] envoy[896]: conn peer=[2001:db8:1::1]:50528 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=154272lb # [ 47.103436] envoy[896]: conn peer=[2001:db8:1::1]:50538 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=194273lb # [ 47.109236] envoy[896]: conn peer=[2001:db8:1::1]:50542 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9532 tx=4416 ms=57184274lb # [ 47.114050] envoy[896]: conn peer=[2001:db8:1::1]:56552 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=554275worker2 # [ 47.326013] nix-grpc-daemon[773]: ts=2026-09-22T16:04:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:517044276client # don't know how to build these paths:4277client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4278worker2 # [ 47.335594] nix-grpc-daemon[773]: ts=2026-09-22T16:04:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:517044279worker1 # [ 47.352963] nix-grpc-daemon[765]: ts=2026-09-22T16:04:55Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04280worker1 # [ 47.360394] nix-grpc-daemon[765]: ts=2026-09-22T16:04:55Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14281worker1 # [ 47.399098] nix-grpc-daemon[765]: ts=2026-09-22T16:04:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184282worker1 # [ 47.420727] nix-grpc-daemon[765]: ts=2026-09-22T16:04:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184283worker1 # [ 47.438842] nix-grpc-daemon[863]: time=2026-09-22T16:04:56.069Z level=INFO msg="All 2 paths already cached"4284client # copying 1 paths to 'lb:50051'...4285client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4286worker1 # [ 47.450088] nix-grpc-daemon[765]: ts=2026-09-22T16:04:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582184287worker1 # [ 47.465440] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4288worker1 # [ 47.617084] nix-daemon[848]: accepted connection from pid 1011, user nix-grpc-daemon (trusted)4289worker1 # [ 47.638813] nix-daemon[848]: reaped child process 1014, status = succeeded4290worker1 # [ 47.741607] nix-daemon[848]: accepted connection from pid 1016, user nix-grpc-daemon (trusted)4291worker1 # [ 47.758264] nix-daemon[848]: reaped child process 1019, status = succeeded4292lb # [ 47.739288] niks3-server[970]: 2026/09/22 16:04:56 INFO Received uploads request method=POST path=/api/pending_closures4293worker1 # [ 47.775876] nix-grpc-daemon[863]: time=2026-09-22T16:04:56.406Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4294worker1 # [ 47.777594] nix-grpc-daemon[863]: time=2026-09-22T16:04:56.406Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4295worker1 # [ 47.809934] nix-grpc-daemon[863]: time=2026-09-22T16:04:56.440Z level=INFO msg="Uploading 1 narinfos"4296lb # [ 47.773101] niks3-server[970]: 2026/09/22 16:04:56 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4297lb # [ 47.786605] niks3-server[970]: 2026/09/22 16:04:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4298lb # [ 47.798739] niks3-server[970]: 2026/09/22 16:04:56 INFO Signed narinfos id=7 count=14299lb # [ 47.805462] niks3-server[970]: 2026/09/22 16:04:56 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4300lb # [ 47.815159] niks3-server[970]: 2026/09/22 16:04:56 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4301lb # [ 47.822617] niks3-server[970]: 2026/09/22 16:04:56 INFO Completed upload id=74302worker1 # [ 47.848506] nix-grpc-daemon[863]: time=2026-09-22T16:04:56.479Z level=INFO msg="Upload complete. (365ms)"4303lb # [ 47.826361] niks3-server[970]: 2026/09/22 16:04:56 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4304worker1 # [ 47.861229] nix-grpc-daemon[765]: ts=2026-09-22T16:04:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=0 paths=1 nar_bytes_in=7524305worker1 # [ 47.873708] nix-grpc-daemon[765]: ts=2026-09-22T16:04:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184306worker1 # [ 47.879568] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4307worker1 # [ 47.885088] nix-daemon[848]: reaped child process 1009, status = succeeded4308client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4309client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4310worker1 # [ 47.898410] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4311client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4312client # farm-top> LOG-farm-top-t1b4313worker1 # [ 48.947976] nix-daemon[848]: reaped child process 1023, status = succeeded4314worker1 # [ 49.058332] nix-daemon[848]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)4315worker1 # [ 49.076767] nix-daemon[848]: reaped child process 1042, status = succeeded4316lb # [ 49.057403] niks3-server[970]: 2026/09/22 16:04:57 INFO Received uploads request method=POST path=/api/pending_closures4317worker1 # [ 49.095763] nix-grpc-daemon[863]: time=2026-09-22T16:04:57.723Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4318worker1 # [ 49.097557] nix-grpc-daemon[863]: time=2026-09-22T16:04:57.723Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4319lb # [ 49.097805] niks3-server[970]: 2026/09/22 16:04:57 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4320lb # [ 49.110115] niks3-server[970]: 2026/09/22 16:04:57 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4321worker1 # [ 49.144476] nix-grpc-daemon[863]: time=2026-09-22T16:04:57.774Z level=INFO msg="Uploading 1 narinfos"4322lb # [ 49.119519] niks3-server[970]: 2026/09/22 16:04:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4323lb # [ 49.128687] niks3-server[970]: 2026/09/22 16:04:57 INFO Signed narinfos id=8 count=14324lb # [ 49.134794] niks3-server[970]: 2026/09/22 16:04:57 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4325lb # [ 49.145661] niks3-server[970]: 2026/09/22 16:04:57 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4326worker1 # [ 49.177130] nix-grpc-daemon[863]: time=2026-09-22T16:04:57.807Z level=INFO msg="Upload complete. (268ms)"4327lb # [ 49.152414] niks3-server[970]: 2026/09/22 16:04:57 INFO Completed upload id=84328lb # [ 49.156375] niks3-server[970]: 2026/09/22 16:04:57 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4329worker1 # [ 49.192869] nix-grpc-daemon[765]: ts=2026-09-22T16:04:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14330worker1 # [ 49.210141] nix-daemon[848]: reaped child process 1021, status = succeeded4331client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.13 seconds)4332client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath4333client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.18 seconds)4334lb: must succeed: curl -sf localhost:9901/clusters4335lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4336lb: must succeed: curl -sf localhost:9901/clusters4337lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4338worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4339worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4340(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.65 seconds)4341subtest: outputs read back through any worker carry the cache signature4342client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&24343worker1 # [ 49.804977] nix-grpc-daemon[765]: ts=2026-09-22T16:04:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582184344client # don't know how to build these paths:4345client # /nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4346worker1 # [ 49.814920] nix-grpc-daemon[765]: ts=2026-09-22T16:04:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184347worker1 # [ 49.838772] nix-grpc-daemon[765]: ts=2026-09-22T16:04:58Z level=debug event=want client=4 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv cached=04348worker1 # [ 49.844711] nix-grpc-daemon[765]: ts=2026-09-22T16:04:58Z level=debug event=assigned drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker=192.168.1.4:50051 clients=14349worker2 # [ 49.859652] nix-grpc-daemon[773]: ts=2026-09-22T16:04:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044350worker2 # [ 49.875457] nix-grpc-daemon[773]: ts=2026-09-22T16:04:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:517044351client # copying 1 paths to 'lb:50051'...4352client # copying path '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' to 'lb:50051'...4353worker2 # [ 49.891411] nix-grpc-daemon[773]: ts=2026-09-22T16:04:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:517044354worker2 # [ 49.907735] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4355worker2 # [ 49.937100] nix-grpc-daemon[773]: ts=2026-09-22T16:04:58Z level=info event=niks3_push_started pid=8694356worker2 # [ 50.105335] nix-grpc-daemon[869]: time=2026-09-22T16:04:58.737Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""4357worker2 # [ 50.217910] nix-daemon[842]: accepted connection from pid 882, user nix-grpc-daemon (trusted)4358worker2 # [ 50.239259] nix-daemon[842]: reaped child process 885, status = succeeded4359worker2 # [ 50.342360] nix-daemon[842]: accepted connection from pid 887, user nix-grpc-daemon (trusted)4360worker2 # [ 50.357542] nix-daemon[842]: reaped child process 890, status = succeeded4361lb # [ 50.330283] niks3-server[970]: 2026/09/22 16:04:58 INFO Received uploads request method=POST path=/api/pending_closures4362worker2 # [ 50.376065] nix-grpc-daemon[869]: time=2026-09-22T16:04:59.007Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4363worker2 # [ 50.377548] nix-grpc-daemon[869]: time=2026-09-22T16:04:59.007Z level=INFO msg="Uploading 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv (512B)"4364lb # [ 50.363113] niks3-server[970]: 2026/09/22 16:04:58 INFO Registered completed upload object_key=nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst4365worker2 # [ 50.415192] nix-grpc-daemon[869]: time=2026-09-22T16:04:59.046Z level=INFO msg="Uploading 1 narinfos"4366lb # [ 50.379077] niks3-server[970]: 2026/09/22 16:04:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4367lb # [ 50.393684] niks3-server[970]: 2026/09/22 16:04:59 INFO Signed narinfos id=9 count=14368lb # [ 50.400326] niks3-server[970]: 2026/09/22 16:04:59 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls4369worker2 # [ 50.450176] nix-grpc-daemon[869]: time=2026-09-22T16:04:59.082Z level=INFO msg="Upload complete. (340ms)"4370lb # [ 50.415165] niks3-server[970]: 2026/09/22 16:04:59 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4371worker2 # [ 50.460408] nix-grpc-daemon[773]: ts=2026-09-22T16:04:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_in=5124372lb # [ 50.428833] niks3-server[970]: 2026/09/22 16:04:59 INFO Completed upload id=94373lb # [ 50.431689] niks3-server[970]: 2026/09/22 16:04:59 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo4374worker2 # [ 50.470159] nix-grpc-daemon[773]: ts=2026-09-22T16:04:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044375worker2 # [ 50.476721] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4376worker2 # [ 50.481600] nix-daemon[842]: reaped child process 867, status = succeeded4377client # building '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' on lb:50051...4378worker2 # [ 50.494284] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4379client # farm-a> worker2: building 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4380client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4381client # farm-a> LOG-farm-a-sig4382worker2 # [ 51.569187] nix-daemon[842]: reaped child process 894, status = succeeded4383worker2 # [ 51.673865] nix-daemon[842]: accepted connection from pid 910, user nix-grpc-daemon (trusted)4384worker2 # [ 51.694523] nix-daemon[842]: reaped child process 913, status = succeeded4385lb # [ 51.664767] niks3-server[970]: 2026/09/22 16:05:00 INFO Received uploads request method=POST path=/api/pending_closures4386worker2 # [ 51.712419] nix-grpc-daemon[869]: time=2026-09-22T16:05:00.341Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4387worker2 # [ 51.714101] nix-grpc-daemon[869]: time=2026-09-22T16:05:00.341Z level=INFO msg="Uploading 2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a (128B)"4388lb # [ 51.707215] niks3-server[970]: 2026/09/22 16:05:00 INFO Registered completed upload object_key=log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4389lb # [ 51.720966] niks3-server[970]: 2026/09/22 16:05:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4390worker2 # [ 51.765193] nix-grpc-daemon[869]: time=2026-09-22T16:05:00.396Z level=INFO msg="Uploading 1 narinfos"4391lb # [ 51.735789] niks3-server[970]: 2026/09/22 16:05:00 INFO Signed narinfos id=10 count=14392lb # [ 51.742300] niks3-server[970]: 2026/09/22 16:05:00 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.ls4393worker2 # [ 51.791367] nix-grpc-daemon[869]: time=2026-09-22T16:05:00.423Z level=INFO msg="Upload complete. (287ms)"4394lb # [ 51.755956] niks3-server[970]: 2026/09/22 16:05:00 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4395lb # [ 51.766220] niks3-server[970]: 2026/09/22 16:05:00 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4396lb # [ 51.773884] niks3-server[970]: 2026/09/22 16:05:00 INFO Completed upload id=104397worker2 # [ 51.804640] nix-grpc-daemon[773]: ts=2026-09-22T16:05:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=1 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv assign_id=5 outputs=14398worker1 # [ 51.802498] nix-grpc-daemon[765]: ts=2026-09-22T16:05:00Z level=debug event=want client=4 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv cached=04399lb # [ 51.779637] niks3-server[970]: 2026/09/22 16:05:00 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo4400worker2 # [ 51.823804] nix-daemon[842]: reaped child process 892, status = succeeded4401worker2 # [ 51.860178] nix-grpc-daemon[773]: ts=2026-09-22T16:05:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044402worker2 # [ 51.875203] nix-grpc-daemon[773]: ts=2026-09-22T16:05:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:517044403worker2 # [ 51.889495] nix-grpc-daemon[869]: time=2026-09-22T16:05:00.521Z level=INFO msg="All 1 paths already cached"4404client # copying 1 paths to 'lb:50051'...4405client # copying path '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' to 'lb:50051'...4406worker2 # [ 51.900425] nix-grpc-daemon[773]: ts=2026-09-22T16:05:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:517044407worker2 # [ 51.914153] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4408worker2 # [ 52.069495] nix-daemon[842]: accepted connection from pid 917, user nix-grpc-daemon (trusted)4409worker2 # [ 52.086525] nix-daemon[842]: reaped child process 920, status = succeeded4410worker2 # [ 52.189483] nix-daemon[842]: accepted connection from pid 922, user nix-grpc-daemon (trusted)4411worker2 # [ 52.207145] nix-daemon[842]: reaped child process 925, status = succeeded4412lb # [ 52.175654] niks3-server[970]: 2026/09/22 16:05:00 INFO Received uploads request method=POST path=/api/pending_closures4413worker2 # [ 52.219865] nix-grpc-daemon[869]: time=2026-09-22T16:05:00.851Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4414worker2 # [ 52.221569] nix-grpc-daemon[869]: time=2026-09-22T16:05:00.851Z level=INFO msg="Uploading z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv (624B)"4415lb # [ 52.204057] niks3-server[970]: 2026/09/22 16:05:00 INFO Registered completed upload object_key=nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst4416worker2 # [ 52.262046] nix-grpc-daemon[869]: time=2026-09-22T16:05:00.894Z level=INFO msg="Uploading 1 narinfos"4417lb # [ 52.219946] niks3-server[970]: 2026/09/22 16:05:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4418lb # [ 52.233022] niks3-server[970]: 2026/09/22 16:05:00 INFO Signed narinfos id=11 count=14419lb # [ 52.239629] niks3-server[970]: 2026/09/22 16:05:00 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.ls4420worker2 # [ 52.287268] nix-grpc-daemon[869]: time=2026-09-22T16:05:00.919Z level=INFO msg="Upload complete. (356ms)"4421lb # [ 52.252477] niks3-server[970]: 2026/09/22 16:05:00 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4422lb # [ 52.261159] niks3-server[970]: 2026/09/22 16:05:00 INFO Completed upload id=114423worker2 # [ 52.294351] nix-grpc-daemon[773]: ts=2026-09-22T16:05:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_in=6244424lb # [ 52.263715] niks3-server[970]: 2026/09/22 16:05:00 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo4425worker2 # [ 52.304303] nix-grpc-daemon[773]: ts=2026-09-22T16:05:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044426worker2 # [ 52.315844] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4427worker2 # [ 52.321141] nix-daemon[842]: reaped child process 915, status = succeeded4428client # building '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' on lb:50051...4429client # farm-b> worker2: building z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4430worker2 # [ 52.335202] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4431worker1 # [ 51.808838] nix-grpc-daemon[765]: ts=2026-09-22T16:05:00Z level=debug event=assigned drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker=192.168.1.4:50051 clients=14432client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4433client # farm-b> LOG-farm-b-sig4434worker2 # [ 53.613109] nix-daemon[842]: reaped child process 929, status = succeeded4435worker2 # [ 53.727471] nix-daemon[842]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4436worker2 # [ 53.744693] nix-daemon[842]: reaped child process 948, status = succeeded4437lb # [ 53.717119] niks3-server[970]: 2026/09/22 16:05:02 INFO Received uploads request method=POST path=/api/pending_closures4438worker2 # [ 53.762066] nix-grpc-daemon[869]: time=2026-09-22T16:05:02.393Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4439worker2 # [ 53.763717] nix-grpc-daemon[869]: time=2026-09-22T16:05:02.393Z level=INFO msg="Uploading h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b (176B)"4440lb # [ 53.750098] niks3-server[970]: 2026/09/22 16:05:02 INFO Registered completed upload object_key=log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4441lb # [ 53.766744] niks3-server[970]: 2026/09/22 16:05:02 INFO Registered completed upload object_key=nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst4442worker2 # [ 53.812353] nix-grpc-daemon[869]: time=2026-09-22T16:05:02.444Z level=INFO msg="Uploading 1 narinfos"4443lb # [ 53.780821] niks3-server[970]: 2026/09/22 16:05:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4444lb # [ 53.790386] niks3-server[970]: 2026/09/22 16:05:02 INFO Signed narinfos id=12 count=14445lb # [ 53.799330] niks3-server[970]: 2026/09/22 16:05:02 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls4446lb # [ 53.807132] niks3-server[970]: 2026/09/22 16:05:02 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4447lb # [ 53.812205] niks3-server[970]: 2026/09/22 16:05:02 INFO Completed upload id=124448worker2 # [ 53.838844] nix-grpc-daemon[869]: time=2026-09-22T16:05:02.471Z level=INFO msg="Upload complete. (290ms)"4449lb # [ 53.815081] niks3-server[970]: 2026/09/22 16:05:02 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo4450worker2 # [ 53.853334] nix-grpc-daemon[773]: ts=2026-09-22T16:05:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=1 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv assign_id=6 outputs=14451worker1 # [ 53.850433] nix-grpc-daemon[765]: ts=2026-09-22T16:05:02Z level=debug event=want client=4 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv cached=04452worker1 # [ 53.856287] nix-grpc-daemon[765]: ts=2026-09-22T16:05:02Z level=debug event=assigned drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker=192.168.1.4:50051 clients=14453worker2 # [ 53.871720] nix-daemon[842]: reaped child process 927, status = succeeded4454worker2 # [ 53.904441] nix-grpc-daemon[773]: ts=2026-09-22T16:05:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044455worker2 # [ 53.919662] nix-grpc-daemon[773]: ts=2026-09-22T16:05:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:517044456worker2 # [ 53.933701] nix-grpc-daemon[869]: time=2026-09-22T16:05:02.565Z level=INFO msg="All 2 paths already cached"4457client # copying 1 paths to 'lb:50051'...4458worker2 # [ 53.944832] nix-grpc-daemon[773]: ts=2026-09-22T16:05:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:517044459client # copying path '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' to 'lb:50051'...4460worker2 # [ 53.962121] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4461worker2 # [ 54.120605] nix-daemon[842]: accepted connection from pid 952, user nix-grpc-daemon (trusted)4462worker2 # [ 54.141348] nix-daemon[842]: reaped child process 955, status = succeeded4463worker2 # [ 54.238041] nix-daemon[842]: accepted connection from pid 957, user nix-grpc-daemon (trusted)4464worker2 # [ 54.255767] nix-daemon[842]: reaped child process 960, status = succeeded4465lb # [ 54.223793] niks3-server[970]: 2026/09/22 16:05:02 INFO Received uploads request method=POST path=/api/pending_closures4466worker2 # [ 54.268242] nix-grpc-daemon[869]: time=2026-09-22T16:05:02.900Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4467worker2 # [ 54.270105] nix-grpc-daemon[869]: time=2026-09-22T16:05:02.902Z level=INFO msg="Uploading knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv (752B)"4468lb # [ 54.252735] niks3-server[970]: 2026/09/22 16:05:02 INFO Registered completed upload object_key=nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst4469lb # [ 54.268572] niks3-server[970]: 2026/09/22 16:05:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4470worker2 # [ 54.310667] nix-grpc-daemon[869]: time=2026-09-22T16:05:02.942Z level=INFO msg="Uploading 1 narinfos"4471lb # [ 54.281078] niks3-server[970]: 2026/09/22 16:05:02 INFO Signed narinfos id=13 count=14472lb # [ 54.287589] niks3-server[970]: 2026/09/22 16:05:02 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls4473lb # [ 54.301416] niks3-server[970]: 2026/09/22 16:05:02 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4474worker2 # [ 54.343083] nix-grpc-daemon[869]: time=2026-09-22T16:05:02.975Z level=INFO msg="Upload complete. (363ms)"4475lb # [ 54.309513] niks3-server[970]: 2026/09/22 16:05:02 INFO Completed upload id=134476lb # [ 54.312196] niks3-server[970]: 2026/09/22 16:05:02 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo4477worker2 # [ 54.352345] nix-grpc-daemon[773]: ts=2026-09-22T16:05:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_in=7524478worker2 # [ 54.367182] nix-grpc-daemon[773]: ts=2026-09-22T16:05:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044479worker2 # [ 54.376244] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4480worker2 # [ 54.379164] nix-daemon[842]: reaped child process 950, status = succeeded4481client # building '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' on lb:50051...4482worker2 # [ 54.392864] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4483client # farm-top> worker2: building knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4484client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4485client # farm-top> LOG-farm-top-sig4486worker2 # [ 55.272152] nix-daemon[842]: reaped child process 964, status = succeeded4487worker2 # [ 55.370247] nix-daemon[842]: accepted connection from pid 980, user nix-grpc-daemon (trusted)4488worker2 # [ 55.388880] nix-daemon[842]: reaped child process 983, status = succeeded4489lb # [ 55.361290] niks3-server[970]: 2026/09/22 16:05:03 INFO Received uploads request method=POST path=/api/pending_closures4490worker2 # [ 55.408447] nix-grpc-daemon[869]: time=2026-09-22T16:05:04.039Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4491worker2 # [ 55.410212] nix-grpc-daemon[869]: time=2026-09-22T16:05:04.039Z level=INFO msg="Uploading 4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top (232B)"4492lb # [ 55.406941] niks3-server[970]: 2026/09/22 16:05:04 INFO Registered completed upload object_key=nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst4493lb # [ 55.420646] niks3-server[970]: 2026/09/22 16:05:04 INFO Registered completed upload object_key=log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4494worker2 # [ 55.468345] nix-grpc-daemon[869]: time=2026-09-22T16:05:04.100Z level=INFO msg="Uploading 1 narinfos"4495lb # [ 55.436477] niks3-server[970]: 2026/09/22 16:05:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4496lb # [ 55.446794] niks3-server[970]: 2026/09/22 16:05:04 INFO Signed narinfos id=14 count=14497lb # [ 55.452634] niks3-server[970]: 2026/09/22 16:05:04 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls4498worker2 # [ 55.498659] nix-grpc-daemon[869]: time=2026-09-22T16:05:04.130Z level=INFO msg="Upload complete. (295ms)"4499lb # [ 55.463857] niks3-server[970]: 2026/09/22 16:05:04 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4500lb # [ 55.469062] niks3-server[970]: 2026/09/22 16:05:04 INFO Completed upload id=144501lb # [ 55.472677] niks3-server[970]: 2026/09/22 16:05:04 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo4502worker2 # [ 55.513153] nix-grpc-daemon[773]: ts=2026-09-22T16:05:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=1 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv assign_id=7 outputs=14503worker2 # [ 55.531425] nix-daemon[842]: reaped child process 962, status = succeeded4504client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&2, in 5.98 seconds)4505client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath4506client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath, in 0.18 seconds)4507client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4508worker1 # [ 55.873903] nix-grpc-daemon[765]: ts=2026-09-22T16:05:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:513004509client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):4510client # /nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a4511client # /nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b4512client # /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4513worker1 # [ 55.915270] nix-grpc-daemon[765]: ts=2026-09-22T16:05:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:513004514worker1 # [ 55.924455] nix-grpc-daemon[765]: copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'http://lb:5751'...4515worker1 # [ 55.941655] nix-grpc-daemon[765]: copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'http://lb:5751'...4516worker1 # [ 55.956486] nix-grpc-daemon[765]: copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'http://lb:5751'...4517client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.26 seconds)4518client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4519worker2 # [ 56.186479] nix-grpc-daemon[773]: ts=2026-09-22T16:05:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:582064520worker2 # [ 56.193579] nix-grpc-daemon[773]: ts=2026-09-22T16:05:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:582064521client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.25 seconds)4522client: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4523client # finding garbage collector roots...4524client # removing stale temporary roots file "/nix/var/nix/temproots/808"4525client # removing stale temporary roots file "/nix/var/nix/temproots/862"4526client # removing stale temporary roots file "/nix/var/nix/temproots/829"4527client # removing stale temporary roots file "/nix/var/nix/temproots/849"4528client # removing stale temporary roots file "/nix/var/nix/temproots/841"4529client # removing stale temporary roots file "/nix/var/nix/temproots/792"4530client # removing stale temporary roots file "/nix/var/nix/temproots/870"4531client # removing stale temporary roots file "/nix/var/nix/temproots/885"4532client # deleting specified paths...4533client # deleting '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top'4534client # deleting unused links...4535client # note: hard linking is currently saving 0.0 KiB4536worker1 # [ 56.572242] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582184537worker1 # [ 56.580121] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184538worker1 # [ 56.590718] nix-grpc-daemon[863]: time=2026-09-22T16:05:05.220Z level=INFO msg="All 1 paths already cached"4539worker2 # [ 56.610521] nix-grpc-daemon[773]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:517044540client # copying 3 paths...4541worker2 # [ 56.618306] nix-grpc-daemon[773]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:517044542worker1 # [ 56.616650] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582184543client # copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'grpc://lb:50051'...4544worker1 # [ 56.643279] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582184545worker1 # [ 56.650839] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=0 paths=1 nar_bytes_out=2324546worker2 # [ 56.669209] nix-grpc-daemon[773]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:517044547worker2 # [ 56.677034] nix-grpc-daemon[773]: ts=2026-09-22T16:05:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_out=1764548worker2 # [ 56.685769] nix-grpc-daemon[773]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:517044549worker2 # [ 56.690934] nix-grpc-daemon[773]: ts=2026-09-22T16:05:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_out=1284550client # copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'grpc://lb:50051'...4551client # copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'grpc://lb:50051'...4552client: (finished: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.53 seconds)4553(finished: subtest: outputs read back through any worker carry the cache signature, in 7.20 seconds)4554subtest: two clients wanting the same drv build it once4555client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4556client # [ 56.834701] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4557client # Running as unit: dedup1.service; invocation ID: c97c7934dd4e4f94bd333dc0d1d39c064558client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 0.07 seconds)4559client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4560worker1 # [ 57.026958] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582184561client # [ 57.032767] nix[938]: don't know how to build these paths:4562client # [ 57.035095] nix[938]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4563worker1 # [ 57.045517] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04564worker1 # [ 57.052479] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14565worker1 # [ 57.090691] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184566worker1 # [ 57.105623] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184567lb # [ 57.089085] envoy[896]: conn peer=[2001:db8:1::1]:56566 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4198 tx=1918 ms=18864568client # [ 57.124233] nix[938]: copying 1 paths to 'lb:50051'...4569worker1 # [ 57.126517] nix-grpc-daemon[765]: ts=2026-09-22T16:05:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582184570client # [ 57.126520] nix[938]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4571worker1 # [ 57.143594] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4572worker1 # [ 57.310435] nix-daemon[848]: accepted connection from pid 1062, user nix-grpc-daemon (trusted)4573worker1 # [ 57.334000] nix-daemon[848]: reaped child process 1065, status = succeeded4574worker1 # [ 57.428967] nix-daemon[848]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)4575worker1 # [ 57.447462] nix-daemon[848]: reaped child process 1070, status = succeeded4576lb # [ 57.095575] envoy[896]: conn peer=[2001:db8:1::1]:56578 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9528 tx=4358 ms=57154577lb # [ 57.095727] envoy[896]: conn peer=[2001:db8:1::1]:60344 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2891 ms=1824578lb # [ 57.095828] envoy[896]: conn peer=[2001:db8:1::1]:60358 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=1134579lb # [ 57.095926] envoy[896]: conn peer=[2001:db8:1::1]:60382 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=329 ms=824580lb # [ 57.096055] envoy[896]: conn peer=[2001:db8:1::1]:60366 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=375 ms=964581lb # [ 57.423085] niks3-server[970]: 2026/09/22 16:05:06 INFO Received uploads request method=POST path=/api/pending_closures4582worker1 # [ 57.483095] nix-grpc-daemon[863]: time=2026-09-22T16:05:06.113Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4583worker1 # [ 57.485042] nix-grpc-daemon[863]: time=2026-09-22T16:05:06.113Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4584lb # [ 57.475969] niks3-server[970]: 2026/09/22 16:05:06 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4585lb # [ 57.490713] niks3-server[970]: 2026/09/22 16:05:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4586worker1 # [ 57.522269] nix-grpc-daemon[863]: time=2026-09-22T16:05:06.152Z level=INFO msg="Uploading 1 narinfos"4587lb # [ 57.500655] niks3-server[970]: 2026/09/22 16:05:06 INFO Signed narinfos id=15 count=14588lb # [ 57.506984] niks3-server[970]: 2026/09/22 16:05:06 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4589lb # [ 57.518798] niks3-server[970]: 2026/09/22 16:05:06 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4590worker1 # [ 57.550557] nix-grpc-daemon[863]: time=2026-09-22T16:05:06.181Z level=INFO msg="Upload complete. (389ms)"4591lb # [ 57.526512] niks3-server[970]: 2026/09/22 16:05:06 INFO Completed upload id=154592lb # [ 57.529531] niks3-server[970]: 2026/09/22 16:05:06 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4593worker1 # [ 57.560416] nix-grpc-daemon[765]: ts=2026-09-22T16:05:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=0 paths=1 nar_bytes_in=4324594worker1 # [ 57.580856] nix-grpc-daemon[765]: ts=2026-09-22T16:05:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184595worker1 # [ 57.588636] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4596worker1 # [ 57.595657] nix-daemon[848]: reaped child process 1060, status = succeeded4597client # [ 57.605626] nix[938]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4598worker1 # [ 57.609111] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4599client # [ 57.930159] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4600client # Running as unit: dedup2.service; invocation ID: 6f2e5cf7ae784bf5aa86658edec45cf64601client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 1.11 seconds)4602worker1 # [ 58.140284] nix-grpc-daemon[765]: ts=2026-09-22T16:05:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582184603client # [ 58.151093] nix[954]: this derivation will be built:4604worker2 # [ 58.166423] nix-grpc-daemon[773]: ts=2026-09-22T16:05:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:517044605worker2 # [ 58.179240] nix-grpc-daemon[773]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'...4606client # [ 58.187131] nix[954]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4607worker1 # [ 58.200125] nix-grpc-daemon[765]: ts=2026-09-22T16:05:06Z level=debug event=want client=6 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04608worker1 # [ 58.215270] nix-grpc-daemon[765]: ts=2026-09-22T16:05:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184609client # [ 58.221391] nix[954]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4610client: must succeed: sleep 24611client: (finished: must succeed: sleep 2, in 2.05 seconds)4612client: waiting for success: ! systemctl is-active dedup1 dedup24613worker1 # [ 61.454576] nix-daemon[848]: reaped child process 1074, status = succeeded4614worker1 # [ 61.556221] nix-daemon[848]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)4615worker1 # [ 61.574563] nix-daemon[848]: reaped child process 1109, status = succeeded4616lb # [ 61.558031] niks3-server[970]: 2026/09/22 16:05:10 INFO Received uploads request method=POST path=/api/pending_closures4617worker1 # [ 61.594977] nix-grpc-daemon[863]: time=2026-09-22T16:05:10.222Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4618worker1 # [ 61.596554] nix-grpc-daemon[863]: time=2026-09-22T16:05:10.222Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4619lb # [ 61.595038] niks3-server[970]: 2026/09/22 16:05:10 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4620lb # [ 61.607952] niks3-server[970]: 2026/09/22 16:05:10 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4621worker1 # [ 61.644658] nix-grpc-daemon[863]: time=2026-09-22T16:05:10.275Z level=INFO msg="Uploading 1 narinfos"4622lb # [ 61.620490] niks3-server[970]: 2026/09/22 16:05:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4623lb # [ 61.630759] niks3-server[970]: 2026/09/22 16:05:10 INFO Signed narinfos id=16 count=14624lb # [ 61.637922] niks3-server[970]: 2026/09/22 16:05:10 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4625lb # [ 61.650004] niks3-server[970]: 2026/09/22 16:05:10 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4626worker1 # [ 61.684189] nix-grpc-daemon[863]: time=2026-09-22T16:05:10.314Z level=INFO msg="Upload complete. (258ms)"4627lb # [ 61.659051] niks3-server[970]: 2026/09/22 16:05:10 INFO Completed upload id=164628lb # [ 61.663692] niks3-server[970]: 2026/09/22 16:05:10 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4629worker1 # [ 61.698230] nix-grpc-daemon[765]: ts=2026-09-22T16:05:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14630worker1 # [ 61.717766] nix-grpc-daemon[765]: ts=2026-09-22T16:05:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14631worker1 # [ 61.724874] nix-daemon[848]: reaped child process 1072, status = succeeded4632client # [ 61.743391] systemd[1]: dedup2.service: Deactivated successfully.4633client # [ 61.747938] systemd[1]: dedup2.service: Consumed 193ms CPU time over 3.817s wall clock time, 35.2M memory peak, 6.4K incoming IP traffic, 5.8K outgoing IP traffic.4634client # [ 61.797164] systemd[1]: dedup1.service: Deactivated successfully.4635client # [ 61.801766] systemd[1]: dedup1.service: Consumed 173ms CPU time over 4.966s wall clock time, 41.4M memory peak, 7.4K incoming IP traffic, 8.4K outgoing IP traffic.4636client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.13 seconds)4637client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4638client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.06 seconds)4639worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4640worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4641worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4642worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4643worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4644worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4645worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4646worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4647(finished: subtest: two clients wanting the same drv build it once, in 6.12 seconds)4648subtest: --timeout and --max-silent-time reach the builder4649worker2 # [ 63.126233] nix-grpc-daemon[773]: ts=2026-09-22T16:05:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:517044650worker1 # [ 63.127902] nix-grpc-daemon[765]: ts=2026-09-22T16:05:11Z level=debug event=want client=7 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=04651worker1 # [ 63.133216] nix-grpc-daemon[765]: ts=2026-09-22T16:05:11Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.4:50051 clients=14652worker2 # [ 63.189015] nix-grpc-daemon[773]: ts=2026-09-22T16:05:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044653worker2 # [ 63.204984] nix-grpc-daemon[773]: ts=2026-09-22T16:05:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:517044654worker2 # [ 63.218965] nix-grpc-daemon[773]: ts=2026-09-22T16:05:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:517044655worker2 # [ 63.233554] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4656worker2 # [ 63.397416] nix-daemon[842]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)4657worker2 # [ 63.416834] nix-daemon[842]: reaped child process 1012, status = succeeded4658worker2 # [ 63.517951] nix-daemon[842]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)4659worker2 # [ 63.537206] nix-daemon[842]: reaped child process 1017, status = succeeded4660lb # [ 63.501684] niks3-server[970]: 2026/09/22 16:05:12 INFO Received uploads request method=POST path=/api/pending_closures4661worker2 # [ 63.546804] nix-grpc-daemon[869]: time=2026-09-22T16:05:12.178Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4662worker2 # [ 63.548382] nix-grpc-daemon[869]: time=2026-09-22T16:05:12.178Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)"4663lb # [ 63.535140] niks3-server[970]: 2026/09/22 16:05:12 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst4664worker2 # [ 63.580025] nix-grpc-daemon[869]: time=2026-09-22T16:05:12.212Z level=INFO msg="Uploading 1 narinfos"4665lb # [ 63.548426] niks3-server[970]: 2026/09/22 16:05:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4666lb # [ 63.559834] niks3-server[970]: 2026/09/22 16:05:12 INFO Signed narinfos id=17 count=14667lb # [ 63.566457] niks3-server[970]: 2026/09/22 16:05:12 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls4668worker2 # [ 63.612156] nix-grpc-daemon[869]: time=2026-09-22T16:05:12.244Z level=INFO msg="Upload complete. (362ms)"4669lb # [ 63.578569] niks3-server[970]: 2026/09/22 16:05:12 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4670worker2 # [ 63.620161] nix-grpc-daemon[773]: ts=2026-09-22T16:05:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_in=4244671lb # [ 63.588938] niks3-server[970]: 2026/09/22 16:05:12 INFO Completed upload id=174672lb # [ 63.592377] niks3-server[970]: 2026/09/22 16:05:12 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo4673worker2 # [ 63.635918] nix-grpc-daemon[773]: ts=2026-09-22T16:05:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044674worker2 # [ 63.642304] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4675worker2 # [ 63.646954] nix-daemon[842]: reaped child process 1007, status = succeeded4676worker2 # [ 63.660317] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4677lb # [ 67.087120] envoy[896]: conn peer=[2001:db8:1::1]:60396 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1599 ms=35934678lb # [ 67.092163] envoy[896]: conn peer=[2001:db8:1::1]:60388 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3005 tx=1539 ms=47464679worker2 # [ 69.678049] nix-grpc-daemon[773]: ts=2026-09-22T16:05:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=9 outputs=04680worker2 # [ 69.701060] nix-daemon[842]: reaped child process 1019, status = succeeded4681worker2 # [ 69.702660] nix-daemon[842]: reaped child process 1021, status = succeeded4682worker2 # [ 69.912437] nix-grpc-daemon[773]: ts=2026-09-22T16:05:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:517044683worker1 # [ 69.921015] nix-grpc-daemon[765]: ts=2026-09-22T16:05:18Z level=debug event=want client=8 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=04684worker1 # [ 69.931399] nix-grpc-daemon[765]: ts=2026-09-22T16:05:18Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.3:50051 clients=14685worker1 # [ 69.939982] nix-grpc-daemon[765]: ts=2026-09-22T16:05:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184686worker1 # [ 69.946760] nix-grpc-daemon[765]: ts=2026-09-22T16:05:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184687worker1 # [ 69.954556] nix-grpc-daemon[765]: ts=2026-09-22T16:05:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582184688worker1 # [ 69.968345] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4689worker1 # [ 70.124448] nix-daemon[848]: accepted connection from pid 1126, user nix-grpc-daemon (trusted)4690worker1 # [ 70.148534] nix-daemon[848]: reaped child process 1129, status = succeeded4691worker1 # [ 70.259695] nix-daemon[848]: accepted connection from pid 1131, user nix-grpc-daemon (trusted)4692worker1 # [ 70.280795] nix-daemon[848]: reaped child process 1134, status = succeeded4693lb # [ 70.259574] niks3-server[970]: 2026/09/22 16:05:18 INFO Received uploads request method=POST path=/api/pending_closures4694worker1 # [ 70.297635] nix-grpc-daemon[863]: time=2026-09-22T16:05:18.927Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4695worker1 # [ 70.299148] nix-grpc-daemon[863]: time=2026-09-22T16:05:18.927Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)"4696lb # [ 70.296840] niks3-server[970]: 2026/09/22 16:05:18 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst4697worker1 # [ 70.336829] nix-grpc-daemon[863]: time=2026-09-22T16:05:18.967Z level=INFO msg="Uploading 1 narinfos"4698lb # [ 70.313797] niks3-server[970]: 2026/09/22 16:05:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4699lb # [ 70.322369] niks3-server[970]: 2026/09/22 16:05:18 INFO Signed narinfos id=18 count=14700lb # [ 70.329681] niks3-server[970]: 2026/09/22 16:05:18 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls4701worker1 # [ 70.359522] nix-grpc-daemon[863]: time=2026-09-22T16:05:18.990Z level=INFO msg="Upload complete. (376ms)"4702lb # [ 70.337163] niks3-server[970]: 2026/09/22 16:05:18 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4703lb # [ 70.341462] niks3-server[970]: 2026/09/22 16:05:18 INFO Completed upload id=184704worker1 # [ 70.367211] nix-grpc-daemon[765]: ts=2026-09-22T16:05:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=0 paths=1 nar_bytes_in=4244705lb # [ 70.344788] niks3-server[970]: 2026/09/22 16:05:18 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo4706worker1 # [ 70.387477] nix-grpc-daemon[765]: ts=2026-09-22T16:05:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184707worker1 # [ 70.393069] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4708worker1 # [ 70.398166] nix-daemon[848]: reaped child process 1124, status = succeeded4709worker1 # [ 70.411427] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4710worker1 # [ 76.828936] nix-grpc-daemon[765]: ts=2026-09-22T16:05:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=6 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=10 outputs=04711worker1 # [ 76.874515] nix-daemon[848]: reaped child process 1136, status = succeeded4712worker1 # [ 76.877792] nix-daemon[848]: reaped child process 1138, status = succeeded4713(finished: subtest: --timeout and --max-silent-time reach the builder, in 14.16 seconds)4714subtest: the first client leaving does not fail the second4715client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4716lb # [ 77.086385] envoy[896]: conn peer=[2001:db8:1::1]:40870 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2975 tx=953 ms=65714717lb # [ 77.091718] envoy[896]: conn peer=[2001:db8:1::1]:40886 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2989 tx=952 ms=69884718client # [ 77.124928] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4719client # Running as unit: share1.service; invocation ID: 42659cec2f0e46cabef75a791b0932e14720client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 0.09 seconds)4721client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4722worker1 # [ 77.343406] nix-grpc-daemon[765]: ts=2026-09-22T16:05:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582184723client # [ 77.348743] nix[1027]: don't know how to build these paths:4724client # [ 77.349784] nix[1027]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4725worker1 # [ 77.361536] nix-grpc-daemon[765]: ts=2026-09-22T16:05:25Z level=debug event=want client=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04726worker2 # [ 77.377247] nix-grpc-daemon[773]: ts=2026-09-22T16:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044727worker1 # [ 77.368618] nix-grpc-daemon[765]: ts=2026-09-22T16:05:25Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.4:50051 clients=14728worker2 # [ 77.392354] nix-grpc-daemon[773]: ts=2026-09-22T16:05:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:517044729client # [ 77.393432] nix[1027]: copying 1 paths to 'lb:50051'...4730client # [ 77.398078] nix[1027]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'...4731worker2 # [ 77.408884] nix-grpc-daemon[773]: ts=2026-09-22T16:05:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:517044732worker2 # [ 77.424270] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4733worker2 # [ 77.596555] nix-daemon[842]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4734worker2 # [ 77.617236] nix-daemon[842]: reaped child process 1047, status = succeeded4735worker2 # [ 77.718602] nix-daemon[842]: accepted connection from pid 1049, user nix-grpc-daemon (trusted)4736worker2 # [ 77.734986] nix-daemon[842]: reaped child process 1052, status = succeeded4737lb # [ 77.706771] niks3-server[970]: 2026/09/22 16:05:26 INFO Received uploads request method=POST path=/api/pending_closures4738worker2 # [ 77.752378] nix-grpc-daemon[869]: time=2026-09-22T16:05:26.383Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4739worker2 # [ 77.753828] nix-grpc-daemon[869]: time=2026-09-22T16:05:26.384Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)"4740lb # [ 77.749538] niks3-server[970]: 2026/09/22 16:05:26 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst4741worker2 # [ 77.807270] nix-grpc-daemon[869]: time=2026-09-22T16:05:26.439Z level=INFO msg="Uploading 1 narinfos"4742lb # [ 77.765533] niks3-server[970]: 2026/09/22 16:05:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4743lb # [ 77.778722] niks3-server[970]: 2026/09/22 16:05:26 INFO Signed narinfos id=19 count=14744lb # [ 77.785116] niks3-server[970]: 2026/09/22 16:05:26 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls4745lb # [ 77.796620] niks3-server[970]: 2026/09/22 16:05:26 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4746lb # [ 77.804949] niks3-server[970]: 2026/09/22 16:05:26 INFO Completed upload id=194747worker2 # [ 77.837955] nix-grpc-daemon[869]: time=2026-09-22T16:05:26.470Z level=INFO msg="Upload complete. (392ms)"4748lb # [ 77.808514] niks3-server[970]: 2026/09/22 16:05:26 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo4749worker2 # [ 77.852417] nix-grpc-daemon[773]: ts=2026-09-22T16:05:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_in=4324750worker2 # [ 77.864380] nix-grpc-daemon[773]: ts=2026-09-22T16:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044751worker2 # [ 77.877946] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4752worker2 # [ 77.883229] nix-daemon[842]: reaped child process 1042, status = succeeded4753client # [ 77.884727] nix[1027]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4754worker2 # [ 77.899557] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4755client # [ 78.231534] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4756client # Running as unit: share2.service; invocation ID: 02b2af367ee1497c984bca4287ad035d4757client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 1.12 seconds)4758worker1 # [ 78.463041] nix-grpc-daemon[765]: ts=2026-09-22T16:05:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582184759client # [ 78.469145] nix[1043]: don't know how to build these paths:4760client # [ 78.470152] nix[1043]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4761worker1 # [ 78.478725] nix-grpc-daemon[765]: ts=2026-09-22T16:05:27Z level=debug event=want client=10 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04762worker2 # [ 78.492864] nix-grpc-daemon[773]: ts=2026-09-22T16:05:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517044763client # [ 78.488988] nix[1043]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4764client: must succeed: sleep 2; systemctl kill -s INT share14765client # [ 81.604781] systemd[1]: share1.service: Sent signal SIGINT to main process 1027 (nix) on client request.4766client # [ 81.614578] nix[1027]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)4767client # [ 81.615727] nix[1027]: error: interrupted by the user4768client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.09 seconds)4769client: waiting for success: ! systemctl is-active share14770client # [ 81.680662] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE4771client # [ 81.683949] systemd[1]: share1.service: Failed with result 'exit-code'.4772client # [ 81.687108] systemd[1]: share1.service: Consumed 186ms CPU time over 4.559s wall clock time, 41.4M memory peak, 6.3K incoming IP traffic, 8.2K outgoing IP traffic.4773client: (finished: waiting for success: ! systemctl is-active share1, in 1.12 seconds)4774client: waiting for success: ! systemctl is-active share24775worker2 # [ 83.161493] nix-daemon[842]: reaped child process 1056, status = succeeded4776worker2 # [ 83.285887] nix-daemon[842]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4777worker2 # [ 83.303736] nix-daemon[842]: reaped child process 1093, status = succeeded4778lb # [ 83.273885] niks3-server[970]: 2026/09/22 16:05:31 INFO Received uploads request method=POST path=/api/pending_closures4779worker2 # [ 83.323911] nix-grpc-daemon[869]: time=2026-09-22T16:05:31.953Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4780worker2 # [ 83.325895] nix-grpc-daemon[869]: time=2026-09-22T16:05:31.953Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)"4781lb # [ 83.319043] niks3-server[970]: 2026/09/22 16:05:31 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst4782worker2 # [ 83.365592] nix-grpc-daemon[869]: time=2026-09-22T16:05:31.996Z level=INFO msg="Uploading 1 narinfos"4783lb # [ 83.335914] niks3-server[970]: 2026/09/22 16:05:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4784lb # [ 83.346048] niks3-server[970]: 2026/09/22 16:05:31 INFO Signed narinfos id=20 count=14785lb # [ 83.351279] niks3-server[970]: 2026/09/22 16:05:31 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls4786lb # [ 83.359018] niks3-server[970]: 2026/09/22 16:05:31 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4787worker2 # [ 83.400791] nix-grpc-daemon[869]: time=2026-09-22T16:05:32.033Z level=INFO msg="Upload complete. (285ms)"4788lb # [ 83.366033] niks3-server[970]: 2026/09/22 16:05:31 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4789lb # [ 83.370116] niks3-server[970]: 2026/09/22 16:05:31 INFO Completed upload id=204790lb # [ 83.373800] niks3-server[970]: 2026/09/22 16:05:31 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo4791worker2 # [ 83.413279] nix-grpc-daemon[773]: ts=2026-09-22T16:05:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=5 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14792worker2 # [ 83.431878] nix-grpc-daemon[773]: ts=2026-09-22T16:05:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=4 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14793worker2 # [ 83.438485] nix-daemon[842]: reaped child process 1054, status = succeeded4794client # [ 83.480721] systemd[1]: share2.service: Deactivated successfully.4795client # [ 83.485030] systemd[1]: share2.service: Consumed 204ms CPU time over 5.253s wall clock time, 35.3M memory peak, 6.1K incoming IP traffic, 5.8K outgoing IP traffic.4796client: (finished: waiting for success: ! systemctl is-active share2, in 1.12 seconds)4797client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }4798client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.06 seconds)4799(finished: subtest: the first client leaving does not fail the second, in 7.12 seconds)4800subtest: build hook: nix-daemon with builders = grpc://lb4801client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log4802client # [ 84.310383] systemd[1]: Started Nix Daemon.4803client # [ 84.427255] nix-daemon[1095]: accepted connection from pid 1092, user root (trusted)4804worker1 # [ 84.574318] nix-grpc-daemon[765]: ts=2026-09-22T16:05:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582184805worker1 # [ 84.580853] nix-grpc-daemon[765]: ts=2026-09-22T16:05:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184806worker1 # [ 84.598906] nix-grpc-daemon[765]: ts=2026-09-22T16:05:33Z level=debug event=want client=11 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04807worker1 # [ 84.606121] nix-grpc-daemon[765]: ts=2026-09-22T16:05:33Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14808worker1 # [ 84.614710] nix-grpc-daemon[765]: ts=2026-09-22T16:05:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184809worker1 # [ 84.625724] nix-grpc-daemon[765]: ts=2026-09-22T16:05:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184810worker1 # [ 84.640506] nix-grpc-daemon[765]: ts=2026-09-22T16:05:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582184811worker1 # [ 84.655396] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4812worker1 # [ 84.819786] nix-daemon[848]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)4813worker1 # [ 84.839135] nix-daemon[848]: reaped child process 1186, status = succeeded4814worker1 # [ 84.940831] nix-daemon[848]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)4815worker1 # [ 84.961671] nix-daemon[848]: reaped child process 1191, status = succeeded4816lb # [ 84.933536] niks3-server[970]: 2026/09/22 16:05:33 INFO Received uploads request method=POST path=/api/pending_closures4817worker1 # [ 84.969735] nix-grpc-daemon[863]: time=2026-09-22T16:05:33.599Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4818worker1 # [ 84.971229] nix-grpc-daemon[863]: time=2026-09-22T16:05:33.599Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4819lb # [ 84.964127] niks3-server[970]: 2026/09/22 16:05:33 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4820worker1 # [ 85.003910] nix-grpc-daemon[863]: time=2026-09-22T16:05:33.634Z level=INFO msg="Uploading 1 narinfos"4821lb # [ 84.979217] niks3-server[970]: 2026/09/22 16:05:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4822lb # [ 84.990388] niks3-server[970]: 2026/09/22 16:05:33 INFO Signed narinfos id=21 count=14823lb # [ 84.995269] niks3-server[970]: 2026/09/22 16:05:33 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4824lb # [ 85.006019] niks3-server[970]: 2026/09/22 16:05:33 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4825worker1 # [ 85.037097] nix-grpc-daemon[863]: time=2026-09-22T16:05:33.667Z level=INFO msg="Upload complete. (365ms)"4826lb # [ 85.012390] niks3-server[970]: 2026/09/22 16:05:33 INFO Completed upload id=214827worker1 # [ 85.044254] nix-grpc-daemon[765]: ts=2026-09-22T16:05:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=0 paths=1 nar_bytes_in=5124828lb # [ 85.014614] niks3-server[970]: 2026/09/22 16:05:33 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4829worker1 # [ 85.056246] nix-grpc-daemon[765]: ts=2026-09-22T16:05:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184830worker1 # [ 85.061713] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4831worker1 # [ 85.066587] nix-daemon[848]: reaped child process 1181, status = succeeded4832worker1 # [ 85.079377] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4833worker1 # [ 85.940577] nix-daemon[848]: reaped child process 1195, status = succeeded4834worker1 # [ 86.075230] nix-daemon[848]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)4835worker1 # [ 86.093263] nix-daemon[848]: reaped child process 1214, status = succeeded4836lb # [ 86.075554] niks3-server[970]: 2026/09/22 16:05:34 INFO Received uploads request method=POST path=/api/pending_closures4837worker1 # [ 86.112627] nix-grpc-daemon[863]: time=2026-09-22T16:05:34.742Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4838worker1 # [ 86.115072] nix-grpc-daemon[863]: time=2026-09-22T16:05:34.742Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4839lb # [ 86.120483] niks3-server[970]: 2026/09/22 16:05:34 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4840lb # [ 86.133512] niks3-server[970]: 2026/09/22 16:05:34 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4841lb # [ 86.144068] niks3-server[970]: 2026/09/22 16:05:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4842worker1 # [ 86.176654] nix-grpc-daemon[863]: time=2026-09-22T16:05:34.806Z level=INFO msg="Uploading 1 narinfos"4843lb # [ 86.154628] niks3-server[970]: 2026/09/22 16:05:34 INFO Signed narinfos id=22 count=14844lb # [ 86.162654] niks3-server[970]: 2026/09/22 16:05:34 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4845lb # [ 86.175334] niks3-server[970]: 2026/09/22 16:05:34 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4846worker1 # [ 86.208707] nix-grpc-daemon[863]: time=2026-09-22T16:05:34.839Z level=INFO msg="Upload complete. (319ms)"4847lb # [ 86.183795] niks3-server[970]: 2026/09/22 16:05:34 INFO Completed upload id=224848lb # [ 86.187291] niks3-server[970]: 2026/09/22 16:05:34 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4849worker1 # [ 86.224495] nix-grpc-daemon[765]: ts=2026-09-22T16:05:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=12 outputs=14850worker1 # [ 86.244597] nix-grpc-daemon[765]: ts=2026-09-22T16:05:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582184851worker1 # [ 86.251821] nix-daemon[848]: reaped child process 1193, status = succeeded4852worker1 # [ 86.276827] nix-grpc-daemon[765]: ts=2026-09-22T16:05:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582184853worker1 # [ 86.283667] nix-grpc-daemon[765]: ts=2026-09-22T16:05:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=0 paths=1 nar_bytes_out=1284854worker2 # [ 86.581222] nix-grpc-daemon[773]: ts=2026-09-22T16:05:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:517044855worker1 # [ 86.574960] nix-grpc-daemon[765]: ts=2026-09-22T16:05:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184856worker1 # [ 86.584956] nix-grpc-daemon[863]: time=2026-09-22T16:05:35.215Z level=INFO msg="All 1 paths already cached"4857worker1 # [ 86.603775] nix-grpc-daemon[765]: ts=2026-09-22T16:05:35Z level=debug event=want client=12 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04858worker1 # [ 86.611181] nix-grpc-daemon[765]: ts=2026-09-22T16:05:35Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14859worker1 # [ 86.619894] nix-grpc-daemon[765]: ts=2026-09-22T16:05:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184860worker1 # [ 86.631722] nix-grpc-daemon[765]: ts=2026-09-22T16:05:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184861worker1 # [ 86.645284] nix-grpc-daemon[863]: time=2026-09-22T16:05:35.275Z level=INFO msg="All 1 paths already cached"4862worker1 # [ 86.654610] nix-grpc-daemon[765]: ts=2026-09-22T16:05:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582184863worker1 # [ 86.667906] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4864worker1 # [ 86.824096] nix-daemon[848]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)4865worker1 # [ 86.843115] nix-daemon[848]: reaped child process 1223, status = succeeded4866worker1 # [ 86.946996] nix-daemon[848]: accepted connection from pid 1225, user nix-grpc-daemon (trusted)4867worker1 # [ 86.964599] nix-daemon[848]: reaped child process 1228, status = succeeded4868lb # [ 86.943000] niks3-server[970]: 2026/09/22 16:05:35 INFO Received uploads request method=POST path=/api/pending_closures4869worker1 # [ 86.978815] nix-grpc-daemon[863]: time=2026-09-22T16:05:35.609Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4870worker1 # [ 86.980405] nix-grpc-daemon[863]: time=2026-09-22T16:05:35.609Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4871lb # [ 86.971314] niks3-server[970]: 2026/09/22 16:05:35 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4872lb # [ 86.988591] niks3-server[970]: 2026/09/22 16:05:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4873worker1 # [ 87.020618] nix-grpc-daemon[863]: time=2026-09-22T16:05:35.651Z level=INFO msg="Uploading 1 narinfos"4874lb # [ 87.000674] niks3-server[970]: 2026/09/22 16:05:35 INFO Signed narinfos id=23 count=14875lb # [ 87.008226] niks3-server[970]: 2026/09/22 16:05:35 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4876lb # [ 87.020370] niks3-server[970]: 2026/09/22 16:05:35 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4877worker1 # [ 87.052357] nix-grpc-daemon[863]: time=2026-09-22T16:05:35.683Z level=INFO msg="Upload complete. (368ms)"4878lb # [ 87.028289] niks3-server[970]: 2026/09/22 16:05:35 INFO Completed upload id=234879worker1 # [ 87.060136] nix-grpc-daemon[765]: ts=2026-09-22T16:05:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=0 paths=1 nar_bytes_in=6244880lb # [ 87.032747] niks3-server[970]: 2026/09/22 16:05:35 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4881worker1 # [ 87.076440] nix-grpc-daemon[765]: ts=2026-09-22T16:05:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184882worker1 # [ 87.084385] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4883worker1 # [ 87.089636] nix-daemon[848]: reaped child process 1218, status = succeeded4884worker1 # [ 87.103230] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4885lb # [ 87.085952] envoy[896]: conn peer=[2001:db8:1::1]:47714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3003 tx=814 ms=42944886lb # [ 87.090918] envoy[896]: conn peer=[2001:db8:1::1]:47722 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1456 tx=1194 ms=49984887lb # [ 87.095826] envoy[896]: conn peer=[2001:db8:1::1]:52762 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3388 tx=1963 ms=17694888lb # [ 87.100991] envoy[896]: conn peer=[2001:db8:1::1]:52772 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=734889worker1 # [ 88.406537] nix-daemon[848]: reaped child process 1232, status = succeeded4890worker1 # [ 88.479388] nix-daemon[848]: accepted connection from pid 1248, user nix-grpc-daemon (trusted)4891worker1 # [ 88.501031] nix-daemon[848]: reaped child process 1251, status = succeeded4892lb # [ 88.482121] niks3-server[970]: 2026/09/22 16:05:37 INFO Received uploads request method=POST path=/api/pending_closures4893worker1 # [ 88.516414] nix-grpc-daemon[863]: time=2026-09-22T16:05:37.146Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4894worker1 # [ 88.518022] nix-grpc-daemon[863]: time=2026-09-22T16:05:37.146Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4895lb # [ 88.524606] niks3-server[970]: 2026/09/22 16:05:37 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4896worker1 # [ 88.566351] nix-grpc-daemon[863]: time=2026-09-22T16:05:37.196Z level=INFO msg="Uploading 1 narinfos"4897lb # [ 88.539498] niks3-server[970]: 2026/09/22 16:05:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4898lb # [ 88.549178] niks3-server[970]: 2026/09/22 16:05:37 INFO Signed narinfos id=24 count=14899lb # [ 88.557760] niks3-server[970]: 2026/09/22 16:05:37 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4900lb # [ 88.571323] niks3-server[970]: 2026/09/22 16:05:37 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4901worker1 # [ 88.598463] nix-grpc-daemon[863]: time=2026-09-22T16:05:37.229Z level=INFO msg="Upload complete. (284ms)"4902lb # [ 88.581813] niks3-server[970]: 2026/09/22 16:05:37 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4903lb # [ 88.587216] niks3-server[970]: 2026/09/22 16:05:37 INFO Completed upload id=244904lb # [ 88.589941] niks3-server[970]: 2026/09/22 16:05:37 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4905worker1 # [ 88.613762] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=13 outputs=14906worker1 # [ 88.630527] nix-daemon[848]: reaped child process 1230, status = succeeded4907worker1 # [ 88.654893] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582184908worker1 # [ 88.684328] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582184909worker1 # [ 88.691175] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=0 paths=1 nar_bytes_out=1764910worker1 # [ 88.980567] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582184911worker1 # [ 88.988149] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184912worker1 # [ 88.996227] nix-grpc-daemon[863]: time=2026-09-22T16:05:37.624Z level=INFO msg="All 2 paths already cached"4913worker1 # [ 89.009050] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=debug event=want client=13 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04914worker1 # [ 89.016469] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14915worker1 # [ 89.025220] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184916worker1 # [ 89.036779] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184917worker1 # [ 89.050610] nix-grpc-daemon[863]: time=2026-09-22T16:05:37.681Z level=INFO msg="All 2 paths already cached"4918worker1 # [ 89.060749] nix-grpc-daemon[765]: ts=2026-09-22T16:05:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582184919worker1 # [ 89.076237] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4920worker1 # [ 89.228820] nix-daemon[848]: accepted connection from pid 1257, user nix-grpc-daemon (trusted)4921worker1 # [ 89.245176] nix-daemon[848]: reaped child process 1260, status = succeeded4922worker1 # [ 89.350577] nix-daemon[848]: accepted connection from pid 1262, user nix-grpc-daemon (trusted)4923worker1 # [ 89.369880] nix-daemon[848]: reaped child process 1265, status = succeeded4924lb # [ 89.341543] niks3-server[970]: 2026/09/22 16:05:37 INFO Received uploads request method=POST path=/api/pending_closures4925worker1 # [ 89.377026] nix-grpc-daemon[863]: time=2026-09-22T16:05:38.007Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4926worker1 # [ 89.378474] nix-grpc-daemon[863]: time=2026-09-22T16:05:38.007Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4927lb # [ 89.371737] niks3-server[970]: 2026/09/22 16:05:37 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4928worker1 # [ 89.411072] nix-grpc-daemon[863]: time=2026-09-22T16:05:38.041Z level=INFO msg="Uploading 1 narinfos"4929lb # [ 89.386982] niks3-server[970]: 2026/09/22 16:05:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4930lb # [ 89.396791] niks3-server[970]: 2026/09/22 16:05:38 INFO Signed narinfos id=25 count=14931worker1 # [ 89.433010] nix-grpc-daemon[863]: time=2026-09-22T16:05:38.063Z level=INFO msg="Upload complete. (341ms)"4932lb # [ 89.407341] niks3-server[970]: 2026/09/22 16:05:38 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4933worker1 # [ 89.440121] nix-grpc-daemon[765]: ts=2026-09-22T16:05:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=0 paths=1 nar_bytes_in=7524934lb # [ 89.415280] niks3-server[970]: 2026/09/22 16:05:38 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4935lb # [ 89.419027] niks3-server[970]: 2026/09/22 16:05:38 INFO Completed upload id=254936worker1 # [ 89.450282] nix-grpc-daemon[765]: ts=2026-09-22T16:05:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582184937lb # [ 89.422672] niks3-server[970]: 2026/09/22 16:05:38 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4938worker1 # [ 89.456724] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4939worker1 # [ 89.460949] nix-daemon[848]: reaped child process 1255, status = succeeded4940worker1 # [ 89.473052] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)4941worker1 # [ 90.978821] nix-daemon[848]: reaped child process 1269, status = succeeded4942worker1 # [ 91.048483] nix-daemon[848]: accepted connection from pid 1286, user nix-grpc-daemon (trusted)4943worker1 # [ 91.068699] nix-daemon[848]: reaped child process 1289, status = succeeded4944lb # [ 91.047985] niks3-server[970]: 2026/09/22 16:05:39 INFO Received uploads request method=POST path=/api/pending_closures4945worker1 # [ 91.084416] nix-grpc-daemon[863]: time=2026-09-22T16:05:39.713Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4946worker1 # [ 91.086138] nix-grpc-daemon[863]: time=2026-09-22T16:05:39.713Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4947lb # [ 91.091494] niks3-server[970]: 2026/09/22 16:05:39 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4948lb # [ 91.106772] niks3-server[970]: 2026/09/22 16:05:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4949lb # [ 91.121519] niks3-server[970]: 2026/09/22 16:05:39 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4950lb # [ 91.133084] niks3-server[970]: 2026/09/22 16:05:39 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4951lb # [ 91.148187] niks3-server[970]: 2026/09/22 16:05:39 INFO Signed narinfos id=26 count=14952worker1 # [ 91.175087] nix-grpc-daemon[863]: time=2026-09-22T16:05:39.805Z level=INFO msg="Uploading 1 narinfos"4953lb # [ 91.160743] niks3-server[970]: 2026/09/22 16:05:39 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4954lb # [ 91.174104] niks3-server[970]: 2026/09/22 16:05:39 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4955lb # [ 91.183447] niks3-server[970]: 2026/09/22 16:05:39 INFO Completed upload id=264956worker1 # [ 91.210080] nix-grpc-daemon[863]: time=2026-09-22T16:05:39.840Z level=INFO msg="Upload complete. (327ms)"4957worker2 # [ 91.235902] nix-grpc-daemon[773]: ts=2026-09-22T16:05:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:517044958worker1 # [ 91.225235] nix-grpc-daemon[765]: ts=2026-09-22T16:05:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=14 outputs=14959worker1 # [ 91.244114] nix-daemon[848]: reaped child process 1267, status = succeeded4960worker2 # [ 91.255673] nix-grpc-daemon[773]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4961worker2 # [ 91.277400] nix-grpc-daemon[773]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4962worker2 # [ 91.291757] nix-grpc-daemon[773]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4963worker1 # [ 91.319490] nix-grpc-daemon[765]: ts=2026-09-22T16:05:39Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582184964worker1 # [ 91.326557] nix-grpc-daemon[765]: ts=2026-09-22T16:05:39Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=0 paths=1 nar_bytes_out=2324965client # [ 91.409767] nix-daemon[1095]: reaped child process 1097, status = succeeded4966client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.26 seconds)4967client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4968client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4969client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4970client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4971client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4972client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4973(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.37 seconds)4974subtest: an input only one worker has still reaches the builder4975client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only4976client # this derivation will be built:4977client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4978client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4979client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only, in 0.30 seconds)4980client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4981client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.12 seconds)4982worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4983worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.19 seconds)4984worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4985worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds)4986client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&24987client # [ 92.375594] nix-daemon[1095]: accepted connection from pid 1177, user root (trusted)4988client # this derivation will be built:4989client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4990client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...4991worker1 # [ 92.524077] nix-grpc-daemon[765]: ts=2026-09-22T16:05:41Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582184992worker1 # [ 92.531573] nix-grpc-daemon[765]: ts=2026-09-22T16:05:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582184993worker1 # [ 92.694159] nix-daemon[848]: accepted connection from pid 1296, user nix-grpc-daemon (trusted)4994worker1 # [ 92.710353] nix-daemon[848]: reaped child process 1299, status = succeeded4995lb # [ 92.692672] niks3-server[970]: 2026/09/22 16:05:41 INFO Received uploads request method=POST path=/api/pending_closures4996worker1 # [ 92.731382] nix-grpc-daemon[863]: time=2026-09-22T16:05:41.361Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4997worker1 # [ 92.734191] nix-grpc-daemon[863]: time=2026-09-22T16:05:41.361Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4998lb # [ 92.724886] niks3-server[970]: 2026/09/22 16:05:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4999worker1 # [ 92.759955] nix-grpc-daemon[863]: time=2026-09-22T16:05:41.390Z level=INFO msg="Uploading 1 narinfos"5000lb # [ 92.738110] niks3-server[970]: 2026/09/22 16:05:41 INFO Signed narinfos id=27 count=15001lb # [ 92.746896] niks3-server[970]: 2026/09/22 16:05:41 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5002lb # [ 92.764324] niks3-server[970]: 2026/09/22 16:05:41 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls5003worker1 # [ 92.798633] nix-grpc-daemon[863]: time=2026-09-22T16:05:41.429Z level=INFO msg="Upload complete. (268ms)"5004lb # [ 92.772672] niks3-server[970]: 2026/09/22 16:05:41 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5005lb # [ 92.780514] niks3-server[970]: 2026/09/22 16:05:41 INFO Completed upload id=275006lb # [ 92.783112] niks3-server[970]: 2026/09/22 16:05:41 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo5007worker1 # [ 92.824185] nix-grpc-daemon[765]: ts=2026-09-22T16:05:41Z level=debug event=want client=14 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=05008worker1 # [ 92.830787] nix-grpc-daemon[765]: ts=2026-09-22T16:05:41Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=15009worker2 # [ 92.844767] nix-grpc-daemon[773]: ts=2026-09-22T16:05:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517045010worker2 # [ 92.860710] nix-grpc-daemon[773]: ts=2026-09-22T16:05:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:517045011client # copying 2 paths to 'lb:50051'...5012client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...5013worker2 # [ 92.881116] nix-grpc-daemon[773]: ts=2026-09-22T16:05:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:517045014client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...5015worker2 # [ 92.897367] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5016worker2 # [ 93.056447] nix-daemon[842]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)5017worker2 # [ 93.082678] nix-daemon[842]: reaped child process 1106, status = succeeded5018worker2 # [ 93.177527] nix-daemon[842]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)5019worker2 # [ 93.193793] nix-daemon[842]: reaped child process 1111, status = succeeded5020lb # [ 93.164391] niks3-server[970]: 2026/09/22 16:05:41 INFO Received uploads request method=POST path=/api/pending_closures5021lb # [ 93.174940] niks3-server[970]: 2026/09/22 16:05:41 INFO Received uploads request method=POST path=/api/pending_closures5022worker2 # [ 93.222674] nix-grpc-daemon[869]: time=2026-09-22T16:05:41.854Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5023worker2 # [ 93.224240] nix-grpc-daemon[869]: time=2026-09-22T16:05:41.854Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"5024worker2 # [ 93.225961] nix-grpc-daemon[869]: time=2026-09-22T16:05:41.854Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"5025lb # [ 93.215040] niks3-server[970]: 2026/09/22 16:05:41 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst5026lb # [ 93.229322] niks3-server[970]: 2026/09/22 16:05:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5027worker2 # [ 93.274555] nix-grpc-daemon[869]: time=2026-09-22T16:05:41.906Z level=INFO msg="Uploading 3 narinfos"5028lb # [ 93.240720] niks3-server[970]: 2026/09/22 16:05:41 INFO Signed narinfos id=28 count=15029lb # [ 93.242919] niks3-server[970]: 2026/09/22 16:05:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5030lb # [ 93.255237] niks3-server[970]: 2026/09/22 16:05:41 INFO Signed narinfos id=29 count=25031lb # [ 93.260545] niks3-server[970]: 2026/09/22 16:05:41 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst5032lb # [ 93.268180] niks3-server[970]: 2026/09/22 16:05:41 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls5033lb # [ 93.274167] niks3-server[970]: 2026/09/22 16:05:41 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls5034lb # [ 93.289020] niks3-server[970]: 2026/09/22 16:05:41 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5035lb # [ 93.299044] niks3-server[970]: 2026/09/22 16:05:41 INFO Completed upload id=295036lb # [ 93.303180] niks3-server[970]: 2026/09/22 16:05:41 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5037lb # [ 93.306258] niks3-server[970]: 2026/09/22 16:05:41 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo5038lb # [ 93.309478] niks3-server[970]: 2026/09/22 16:05:41 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo5039worker2 # [ 93.344891] nix-grpc-daemon[869]: time=2026-09-22T16:05:41.977Z level=INFO msg="Upload complete. (428ms)"5040lb # [ 93.311919] niks3-server[970]: 2026/09/22 16:05:41 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo5041lb # [ 93.315105] niks3-server[970]: 2026/09/22 16:05:41 INFO Completed upload id=285042worker2 # [ 93.357798] nix-grpc-daemon[773]: ts=2026-09-22T16:05:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=2 nar_bytes_in=9845043worker2 # [ 93.375810] nix-grpc-daemon[773]: ts=2026-09-22T16:05:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517045044worker2 # [ 93.385108] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5045worker2 # [ 93.393159] nix-daemon[842]: reaped child process 1101, status = succeeded5046worker2 # [ 93.412461] nix-grpc-daemon[773]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...5047client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...5048worker2 # [ 93.431264] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5049client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5050client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds5051worker2 # [ 94.272859] nix-daemon[842]: reaped child process 1116, status = succeeded5052worker2 # [ 94.397182] nix-daemon[842]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)5053worker2 # [ 94.415335] nix-daemon[842]: reaped child process 1135, status = succeeded5054lb # [ 94.387237] niks3-server[970]: 2026/09/22 16:05:43 INFO Received uploads request method=POST path=/api/pending_closures5055worker2 # [ 94.432384] nix-grpc-daemon[869]: time=2026-09-22T16:05:43.063Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5056lb # [ 94.417937] niks3-server[970]: 2026/09/22 16:05:43 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls5057worker2 # [ 94.464223] nix-grpc-daemon[869]: time=2026-09-22T16:05:43.096Z level=INFO msg="Uploading 1 narinfos"5058lb # [ 94.432428] niks3-server[970]: 2026/09/22 16:05:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5059lb # [ 94.442221] niks3-server[970]: 2026/09/22 16:05:43 INFO Signed narinfos id=30 count=15060lb # [ 94.448214] niks3-server[970]: 2026/09/22 16:05:43 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5061lb # [ 94.457678] niks3-server[970]: 2026/09/22 16:05:43 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5062worker2 # [ 94.498333] nix-grpc-daemon[869]: time=2026-09-22T16:05:43.130Z level=INFO msg="Upload complete. (249ms)"5063lb # [ 94.465000] niks3-server[970]: 2026/09/22 16:05:43 INFO Completed upload id=305064lb # [ 94.469592] niks3-server[970]: 2026/09/22 16:05:43 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo5065client # copying 1 paths...5066worker2 # [ 94.509007] nix-grpc-daemon[773]: ts=2026-09-22T16:05:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=15 outputs=15067client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...5068worker2 # [ 94.526777] nix-grpc-daemon[773]: ts=2026-09-22T16:05:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:517045069worker2 # [ 94.531064] nix-daemon[842]: reaped child process 1113, status = succeeded5070worker2 # [ 94.549762] nix-grpc-daemon[773]: ts=2026-09-22T16:05:43Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:517045071worker2 # [ 94.555789] nix-grpc-daemon[773]: ts=2026-09-22T16:05:43Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_out=1205072client # [ 94.678411] nix-daemon[1095]: reaped child process 1180, status = succeeded5073client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.50 seconds)5074client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&25075client # [ 94.852516] nix-daemon[1095]: accepted connection from pid 1199, user root (trusted)5076client # this derivation will be built:5077client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5078client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5079worker1 # [ 95.003966] nix-grpc-daemon[765]: ts=2026-09-22T16:05:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582185080worker1 # [ 95.012320] nix-grpc-daemon[765]: ts=2026-09-22T16:05:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582185081worker1 # [ 95.024841] nix-grpc-daemon[863]: time=2026-09-22T16:05:43.654Z level=INFO msg="All 1 paths already cached"5082worker1 # [ 95.042601] nix-grpc-daemon[765]: ts=2026-09-22T16:05:43Z level=debug event=want client=15 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=05083worker1 # [ 95.050015] nix-grpc-daemon[765]: ts=2026-09-22T16:05:43Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15084worker1 # [ 95.058849] nix-grpc-daemon[765]: ts=2026-09-22T16:05:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582185085worker1 # [ 95.070126] nix-grpc-daemon[765]: ts=2026-09-22T16:05:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582185086client # copying 1 paths to 'lb:50051'...5087client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...5088worker1 # [ 95.089518] nix-grpc-daemon[765]: ts=2026-09-22T16:05:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582185089worker1 # [ 95.104428] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)5090worker1 # [ 95.126143] nix-grpc-daemon[765]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5)5091worker1 # [ 95.145376] nix-grpc-daemon[765]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 109 ms (attempt 2/5)5092worker1 # [ 95.256450] nix-grpc-daemon[765]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 3/5)5093worker1 # [ 95.329371] nix-grpc-daemon[765]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 397 ms (attempt 4/5)5094worker1 # [ 95.728875] nix-grpc-daemon[765]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5095worker1 # [ 95.737703] nix-grpc-daemon[765]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5096worker1 # [ 95.744903] nix-grpc-daemon[765]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...5097worker1 # [ 95.918056] nix-daemon[848]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5098worker1 # [ 95.935996] nix-daemon[848]: reaped child process 1315, status = succeeded5099worker1 # [ 96.038068] nix-daemon[848]: accepted connection from pid 1317, user nix-grpc-daemon (trusted)5100worker1 # [ 96.054044] nix-daemon[848]: reaped child process 1320, status = succeeded5101lb # [ 96.035416] niks3-server[970]: 2026/09/22 16:05:44 INFO Received uploads request method=POST path=/api/pending_closures5102worker1 # [ 96.073422] nix-grpc-daemon[863]: time=2026-09-22T16:05:44.703Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5103worker1 # [ 96.074869] nix-grpc-daemon[863]: time=2026-09-22T16:05:44.703Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"5104lb # [ 96.066952] niks3-server[970]: 2026/09/22 16:05:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5105worker1 # [ 96.102343] nix-grpc-daemon[863]: time=2026-09-22T16:05:44.732Z level=INFO msg="Uploading 1 narinfos"5106lb # [ 96.081056] niks3-server[970]: 2026/09/22 16:05:44 INFO Signed narinfos id=31 count=15107lb # [ 96.091469] niks3-server[970]: 2026/09/22 16:05:44 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst5108lb # [ 96.101574] niks3-server[970]: 2026/09/22 16:05:44 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls5109lb # [ 96.117033] niks3-server[970]: 2026/09/22 16:05:44 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5110worker1 # [ 96.143559] nix-grpc-daemon[863]: time=2026-09-22T16:05:44.774Z level=INFO msg="Upload complete. (386ms)"5111lb # [ 96.126321] niks3-server[970]: 2026/09/22 16:05:44 INFO Completed upload id=315112lb # [ 96.129326] niks3-server[970]: 2026/09/22 16:05:44 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo5113worker1 # [ 96.156647] nix-grpc-daemon[765]: ts=2026-09-22T16:05:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=1 paths=1 nar_bytes_in=5685114worker1 # [ 96.168386] nix-grpc-daemon[765]: ts=2026-09-22T16:05:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582185115worker1 # [ 96.179687] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)5116worker1 # [ 96.188206] nix-daemon[848]: reaped child process 1305, status = succeeded5117client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...5118worker1 # [ 96.195455] nix-daemon[848]: accepted connection from pid 765, user nix-grpc-daemon (trusted)5119client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5120lb # [ 97.084735] envoy[896]: conn peer=[2001:db8:1::1]:52782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3888 tx=2178 ms=21805121lb # [ 97.087279] envoy[896]: conn peer=[2001:db8:1::1]:52796 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=715122lb # [ 97.089722] envoy[896]: conn peer=[2001:db8:1::1]:43292 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=255123lb # [ 97.091907] envoy[896]: conn peer=[2001:db8:1::1]:52806 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2390 ms=23645124lb # [ 97.094333] envoy[896]: conn peer=[2001:db8:1::1]:43298 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=2069 ms=20845125lb # [ 97.096614] envoy[896]: conn peer=[2001:db8:1::1]:43312 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=725126client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds5127worker1 # [ 97.873086] nix-daemon[848]: reaped child process 1324, status = succeeded5128worker1 # [ 97.975081] nix-daemon[848]: accepted connection from pid 1340, user nix-grpc-daemon (trusted)5129worker1 # [ 97.993069] nix-daemon[848]: reaped child process 1343, status = succeeded5130lb # [ 97.974737] niks3-server[970]: 2026/09/22 16:05:46 INFO Received uploads request method=POST path=/api/pending_closures5131worker1 # [ 98.012546] nix-grpc-daemon[863]: time=2026-09-22T16:05:46.642Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5132lb # [ 98.004951] niks3-server[970]: 2026/09/22 16:05:46 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls5133lb # [ 98.017551] niks3-server[970]: 2026/09/22 16:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5134worker1 # [ 98.051140] nix-grpc-daemon[863]: time=2026-09-22T16:05:46.681Z level=INFO msg="Uploading 1 narinfos"5135lb # [ 98.031318] niks3-server[970]: 2026/09/22 16:05:46 INFO Signed narinfos id=32 count=15136lb # [ 98.039061] niks3-server[970]: 2026/09/22 16:05:46 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5137lb # [ 98.051848] niks3-server[970]: 2026/09/22 16:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5138lb # [ 98.058751] niks3-server[970]: 2026/09/22 16:05:46 INFO Completed upload id=325139worker1 # [ 98.084551] nix-grpc-daemon[863]: time=2026-09-22T16:05:46.715Z level=INFO msg="Upload complete. (278ms)"5140lb # [ 98.061056] niks3-server[970]: 2026/09/22 16:05:46 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo5141client # copying 1 paths...5142worker2 # [ 98.111680] nix-grpc-daemon[773]: ts=2026-09-22T16:05:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:517045143worker1 # [ 98.101084] nix-grpc-daemon[765]: ts=2026-09-22T16:05:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58218 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=16 outputs=15144worker1 # [ 98.116598] nix-daemon[848]: reaped child process 1322, status = succeeded5145worker2 # [ 98.124733] nix-grpc-daemon[773]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...5146client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...5147worker2 # [ 98.167233] nix-grpc-daemon[773]: ts=2026-09-22T16:05:46Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:517045148worker2 # [ 98.174208] nix-grpc-daemon[773]: ts=2026-09-22T16:05:46Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_out=1205149client # [ 98.287078] nix-daemon[1095]: reaped child process 1202, status = succeeded5150client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.61 seconds)5151client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&25152client # [ 98.451809] nix-daemon[1095]: accepted connection from pid 1221, user root (trusted)5153client # this derivation will be built:5154client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5155worker1 # [ 98.597212] nix-grpc-daemon[765]: ts=2026-09-22T16:05:47Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582185156client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5157worker1 # [ 98.605045] nix-grpc-daemon[765]: ts=2026-09-22T16:05:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582185158worker1 # [ 98.612538] nix-grpc-daemon[863]: time=2026-09-22T16:05:47.241Z level=INFO msg="All 1 paths already cached"5159worker1 # [ 98.623632] nix-grpc-daemon[765]: ts=2026-09-22T16:05:47Z level=debug event=want client=16 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=05160worker2 # [ 98.636219] nix-grpc-daemon[773]: ts=2026-09-22T16:05:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517045161worker1 # [ 98.630178] nix-grpc-daemon[765]: ts=2026-09-22T16:05:47Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15162worker2 # [ 98.650589] nix-grpc-daemon[773]: ts=2026-09-22T16:05:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:517045163client # copying 1 paths to 'lb:50051'...5164worker2 # [ 98.667232] nix-grpc-daemon[869]: time=2026-09-22T16:05:47.297Z level=INFO msg="All 1 paths already cached"5165client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...5166worker2 # [ 98.672813] nix-grpc-daemon[773]: ts=2026-09-22T16:05:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:517045167worker2 # [ 98.687936] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5168worker2 # [ 98.848988] nix-daemon[842]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)5169worker2 # [ 98.870042] nix-daemon[842]: reaped child process 1143, status = succeeded5170worker2 # [ 98.975191] nix-daemon[842]: accepted connection from pid 1145, user nix-grpc-daemon (trusted)5171worker2 # [ 98.991243] nix-daemon[842]: reaped child process 1148, status = succeeded5172lb # [ 98.962900] niks3-server[970]: 2026/09/22 16:05:47 INFO Received uploads request method=POST path=/api/pending_closures5173worker2 # [ 99.007859] nix-grpc-daemon[869]: time=2026-09-22T16:05:47.639Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5174worker2 # [ 99.009523] nix-grpc-daemon[869]: time=2026-09-22T16:05:47.639Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"5175lb # [ 98.991380] niks3-server[970]: 2026/09/22 16:05:47 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst5176worker2 # [ 99.039824] nix-grpc-daemon[869]: time=2026-09-22T16:05:47.671Z level=INFO msg="Uploading 1 narinfos"5177lb # [ 99.006005] niks3-server[970]: 2026/09/22 16:05:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5178lb # [ 99.020267] niks3-server[970]: 2026/09/22 16:05:47 INFO Signed narinfos id=33 count=15179lb # [ 99.023358] niks3-server[970]: 2026/09/22 16:05:47 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls5180lb # [ 99.037935] niks3-server[970]: 2026/09/22 16:05:47 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5181lb # [ 99.045941] niks3-server[970]: 2026/09/22 16:05:47 INFO Completed upload id=335182worker2 # [ 99.079863] nix-grpc-daemon[869]: time=2026-09-22T16:05:47.712Z level=INFO msg="Upload complete. (374ms)"5183lb # [ 99.048232] niks3-server[970]: 2026/09/22 16:05:47 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo5184worker2 # [ 99.091618] nix-grpc-daemon[773]: ts=2026-09-22T16:05:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_in=5685185worker2 # [ 99.103377] nix-grpc-daemon[773]: ts=2026-09-22T16:05:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:517045186worker2 # [ 99.110220] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5187worker2 # [ 99.114789] nix-daemon[842]: reaped child process 1138, status = succeeded5188client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...5189worker2 # [ 99.128396] nix-daemon[842]: accepted connection from pid 773, user nix-grpc-daemon (trusted)5190client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5191client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds5192worker2 # [ 100.168416] nix-daemon[842]: reaped child process 1152, status = succeeded5193worker2 # [ 100.249458] nix-daemon[842]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5194worker2 # [ 100.269297] nix-daemon[842]: reaped child process 1171, status = succeeded5195lb # [ 100.237855] niks3-server[970]: 2026/09/22 16:05:48 INFO Received uploads request method=POST path=/api/pending_closures5196worker2 # [ 100.283080] nix-grpc-daemon[869]: time=2026-09-22T16:05:48.914Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5197lb # [ 100.265836] niks3-server[970]: 2026/09/22 16:05:48 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls5198worker2 # [ 100.313853] nix-grpc-daemon[869]: time=2026-09-22T16:05:48.945Z level=INFO msg="Uploading 1 narinfos"5199lb # [ 100.279175] niks3-server[970]: 2026/09/22 16:05:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5200lb # [ 100.291331] niks3-server[970]: 2026/09/22 16:05:48 INFO Signed narinfos id=34 count=15201lb # [ 100.297682] niks3-server[970]: 2026/09/22 16:05:48 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5202lb # [ 100.310443] niks3-server[970]: 2026/09/22 16:05:48 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5203worker2 # [ 100.352639] nix-grpc-daemon[869]: time=2026-09-22T16:05:48.984Z level=INFO msg="Upload complete. (214ms)"5204lb # [ 100.318575] niks3-server[970]: 2026/09/22 16:05:48 INFO Completed upload id=345205lb # [ 100.322628] niks3-server[970]: 2026/09/22 16:05:48 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo5206worker2 # [ 100.364969] nix-grpc-daemon[773]: ts=2026-09-22T16:05:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=17 outputs=15207worker2 # [ 100.377860] nix-daemon[842]: reaped child process 1150, status = succeeded5208client # copying 1 paths...5209worker2 # [ 100.408991] nix-grpc-daemon[773]: ts=2026-09-22T16:05:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:517045210client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...5211worker2 # [ 100.441923] nix-grpc-daemon[773]: ts=2026-09-22T16:05:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:517045212worker2 # [ 100.448782] nix-grpc-daemon[773]: ts=2026-09-22T16:05:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51704 duration_s=0 paths=1 nar_bytes_out=1205213client # [ 100.565195] nix-daemon[1095]: reaped child process 1224, status = succeeded5214client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.28 seconds)5215(finished: subtest: an input only one worker has still reaches the builder, in 9.03 seconds)5216subtest: upload whose reference the worker lacks is completed from the cache5217client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache5218client # this derivation will be built:5219client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv5220client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...5221client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache, in 0.32 seconds)5222client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache5223client # this derivation will be built:5224client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv5225client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...5226client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache, in 0.28 seconds)5227client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure5228client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.12 seconds)5229worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5230worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.19 seconds)5231worker2 # [ 101.569666] systemd[1]: Stopping Nix worker-protocol over gRPC...5232worker2 # [ 101.725063] nix-grpc-daemon[773]: ts=2026-09-22T16:05:50Z level=info event=signal_exit5233worker1 # [ 102.898748] nix-grpc-daemon[765]: ts=2026-09-22T16:05:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:582025234worker2 # [ 102.909030] nix-grpc-daemon[773]: ts=2026-09-22T16:05:51Z level=info event=scheduler_restarting5235worker2 # [ 102.924846] nix-grpc-daemon[773]: E0000 00:00:1790093151.533019 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true5236worker2 # [ 102.952688] nix-grpc-daemon[773]: ts=2026-09-22T16:05:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5237worker2 # [ 102.967192] nix-daemon[842]: reaped child process 844, status = succeeded5238worker1 # [ 102.904144] nix-grpc-daemon[765]: ts=2026-09-22T16:05:51Z level=info event=worker_gone addr=192.168.1.4:500515239worker2 # [ 103.884120] nix-grpc-daemon[773]: E0000 00:00:1790093152.516101 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5240worker2 # [ 104.990061] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5241worker2 # [ 104.996397] systemd[1]: Stopped Nix worker-protocol over gRPC.5242worker2 # [ 104.999105] systemd[1]: nix-grpc-daemon.service: Consumed 3.273s CPU time over 1min 27.454s wall clock time, 62.3M memory peak, 80.5K incoming IP traffic, 193K outgoing IP traffic.5243worker2 # [ 105.016797] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5244worker2 # [ 105.019085] systemd[1]: Closed Nix worker-protocol over gRPC.5245worker2 # [ 105.025670] systemd[1]: nix-grpc-daemon.socket: Consumed 538us CPU time over 1min 35.688s wall clock time, 256K memory peak, 92.9K incoming IP traffic, 81.9K outgoing IP traffic.5246lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy5247lb: must succeed: curl -sf localhost:9901/clusters5248lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5249lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)5250client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&25251worker1 # [ 105.321924] nix-grpc-daemon[765]: ts=2026-09-22T16:05:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582185252client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5253worker1 # [ 105.329304] nix-grpc-daemon[765]: ts=2026-09-22T16:05:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582185254client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.24 seconds)5255worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5256worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)5257worker2 # [ 105.458125] systemd[1]: Listening on Nix worker-protocol over gRPC.5258worker1 # [ 105.522135] systemd[1]: Stopping Nix worker-protocol over gRPC...5259worker2 # [ 105.908007] systemd[1]: Starting scheduler-token.service...5260worker2 # [ 105.996141] systemd[1]: scheduler-token.service: Deactivated successfully.5261worker2 # [ 106.005238] systemd[1]: Finished scheduler-token.service.5262worker2 # [ 106.007440] systemd[1]: scheduler-token.service: Consumed 59ms CPU time over 92ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5263worker2 # [ 106.016855] systemd[1]: Starting Nix worker-protocol over gRPC...5264worker2 # [ 106.155830] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5265worker2 # [ 106.158367] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5266worker2 # [ 106.162249] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15267worker2 # [ 106.167757] nix-grpc-daemon[1195]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5268worker2 # [ 106.187237] nix-grpc-daemon[1195]: E0000 00:00:1790093154.799458 1195 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5269worker2 # [ 106.216199] nix-grpc-daemon[1195]: E0000 00:00:1790093154.803175 1195 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5270worker2 # [ 106.218451] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5271worker2 # [ 106.223599] nix-grpc-daemon[1195]: E0000 00:00:1790093154.815230 1236 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5272worker2 # [ 106.226541] nix-grpc-daemon[1195]: E0000 00:00:1790093154.835706 1236 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5273worker2 # [ 106.229157] nix-grpc-daemon[1195]: E0000 00:00:1790093154.835868 1236 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5274worker2 # [ 106.234390] systemd[1]: Started Nix worker-protocol over gRPC.5275worker2 # [ 106.237358] nix-grpc-daemon[1195]: E0000 00:00:1790093154.854825 1236 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5276worker2 # [ 106.239676] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:54Z level=info event=scheduler_connected addr=lb:500515277worker1 # [ 106.230217] nix-grpc-daemon[765]: ts=2026-09-22T16:05:54Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:582025278worker1 # [ 106.236291] nix-grpc-daemon[765]: ts=2026-09-22T16:05:54Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05279worker1 # [ 106.396474] nix-grpc-daemon[765]: ts=2026-09-22T16:05:55Z level=info event=signal_exit5280lb # [ 106.865348] niks3-server[970]: 2026/09/22 16:05:55 INFO lead: released remote=192.168.1.3:457365281lb # [ 107.089084] envoy[896]: conn peer=[2001:db8:1::1]:43328 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3766 tx=2122 ms=32205282lb # [ 107.094054] envoy[896]: conn peer=[2001:db8:1::1]:43334 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=695283lb # [ 107.098666] envoy[896]: conn peer=[2001:db8:1::1]:43346 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=705284lb # [ 107.103513] envoy[896]: conn peer=[2001:db8:1::1]:43340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3753 tx=2124 ms=19025285lb # [ 107.108953] envoy[896]: conn peer=[2001:db8:1::4]:37120 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=61072 tx=3344 ms=851635286lb # [ 107.113764] envoy[896]: conn peer=[2001:db8:1::1]:49482 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=245287worker1 # [ 107.889728] nix-grpc-daemon[765]: ts=2026-09-22T16:05:56Z level=info event=scheduler_restarting5288worker2 # [ 107.901091] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:56Z level=info event=scheduler_restarting addr=lb:500515289worker1 # [ 107.902770] nix-grpc-daemon[765]: ts=2026-09-22T16:05:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:582025290worker1 # [ 107.907728] nix-grpc-daemon[765]: ts=2026-09-22T16:05:56Z level=info event=worker_gone addr=192.168.1.4:500515291worker1 # [ 107.912356] nix-grpc-daemon[765]: ts=2026-09-22T16:05:56Z level=info event=scheduler_restarting addr=lb:500515292worker1 # [ 107.917059] nix-grpc-daemon[765]: ts=2026-09-22T16:05:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:582025293worker1 # [ 107.921756] nix-grpc-daemon[765]: ts=2026-09-22T16:05:56Z level=info event=worker_gone addr=192.168.1.3:500515294worker1 # [ 107.949301] nix-daemon[848]: reaped child process 850, status = succeeded5295worker2 # [ 108.101656] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:56Z level=info event=scheduler_connected addr=lb:500515296worker2 # [ 108.106760] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5297worker1 # [ 108.125074] nix-grpc-daemon[765]: ts=2026-09-22T16:05:56Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5298worker2 # [ 108.307916] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:56Z level=info event=scheduler_connected addr=lb:500515299worker2 # [ 108.313365] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5300worker2 # [ 108.514822] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=info event=scheduler_connected addr=lb:500515301worker2 # [ 108.520460] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5302worker1 # [ 108.574415] nix-grpc-daemon[765]: E0000 00:00:1790093157.204832 810 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true5303worker1 # [ 108.583039] nix-grpc-daemon[765]: E0000 00:00:1790093157.213657 810 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5304worker2 # [ 108.721518] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=info event=scheduler_connected addr=lb:500515305worker2 # [ 108.727056] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5306worker1 # [ 108.907002] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5307worker1 # [ 108.914670] systemd[1]: Stopped Nix worker-protocol over gRPC.5308worker2 # [ 108.929798] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=info event=scheduler_connected addr=lb:500515309worker1 # [ 108.920832] systemd[1]: nix-grpc-daemon.service: Consumed 4.816s CPU time over 1min 31.790s wall clock time, 69.7M memory peak, 115.6K incoming IP traffic, 234.6K outgoing IP traffic.5310worker2 # [ 108.933894] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5311worker1 # [ 108.936655] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5312worker1 # [ 108.938666] systemd[1]: Closed Nix worker-protocol over gRPC.5313worker1 # [ 108.942467] systemd[1]: nix-grpc-daemon.socket: Consumed 532us CPU time over 1min 38.947s wall clock time, 256K memory peak, 129.8K incoming IP traffic, 111.3K outgoing IP traffic.5314lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy5315lb: must succeed: curl -sf localhost:9901/clusters5316lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5317lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.04 seconds)5318client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&25319worker2 # [ 109.130960] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=info event=scheduler_connected addr=lb:500515320worker2 # [ 109.136306] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5321worker2 # [ 109.229103] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355825322worker2 # [ 109.244404] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5323worker2 # [ 109.270894] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)5324worker2 # [ 109.308819] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 2/5)5325worker2 # [ 109.335390] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 160 ms (attempt 3/5)5326worker2 # [ 109.344074] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=info event=scheduler_connected addr=lb:500515327worker2 # [ 109.348986] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5328worker2 # [ 109.497420] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 4/5)5329worker2 # [ 109.550014] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=info event=scheduler_connected addr=lb:500515330worker2 # [ 109.555129] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5331worker2 # [ 109.596747] nix-grpc-daemon[1195]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5332worker2 # [ 109.600282] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5333client # copying 2 paths...5334client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...5335worker2 # [ 109.618621] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355825336client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...5337worker2 # [ 109.638597] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5338worker2 # [ 109.667102] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=info event=niks3_push_started pid=12555339worker2 # [ 109.756351] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=info event=scheduler_connected addr=lb:500515340worker2 # [ 109.760091] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5341worker2 # [ 109.827676] nix-grpc-daemon[1255]: time=2026-09-22T16:05:58.459Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""5342worker2 # [ 109.934993] nix-daemon[842]: accepted connection from pid 1268, user nix-grpc-daemon (trusted)5343worker2 # [ 109.952210] nix-daemon[842]: reaped child process 1271, status = succeeded5344worker2 # [ 109.959783] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=info event=scheduler_connected addr=lb:500515345worker2 # [ 109.961833] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5346lb # [ 109.923965] niks3-server[970]: 2026/09/22 16:05:58 INFO Received uploads request method=POST path=/api/pending_closures5347lb # [ 109.938731] niks3-server[970]: 2026/09/22 16:05:58 INFO Received uploads request method=POST path=/api/pending_closures5348worker2 # [ 109.984065] nix-grpc-daemon[1255]: time=2026-09-22T16:05:58.615Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5349worker2 # [ 109.985504] nix-grpc-daemon[1255]: time=2026-09-22T16:05:58.615Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"5350worker2 # [ 109.987192] nix-grpc-daemon[1255]: time=2026-09-22T16:05:58.615Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"5351lb # [ 109.980640] niks3-server[970]: 2026/09/22 16:05:58 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5352lb # [ 110.006355] niks3-server[970]: 2026/09/22 16:05:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5353lb # [ 110.020821] niks3-server[970]: 2026/09/22 16:05:58 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst5354lb # [ 110.031575] niks3-server[970]: 2026/09/22 16:05:58 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls5355lb # [ 110.037486] niks3-server[970]: 2026/09/22 16:05:58 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls5356worker2 # [ 110.075259] nix-grpc-daemon[1255]: time=2026-09-22T16:05:58.705Z level=INFO msg="Uploading 3 narinfos"5357lb # [ 110.043419] niks3-server[970]: 2026/09/22 16:05:58 INFO Signed narinfos id=35 count=15358lb # [ 110.048263] niks3-server[970]: 2026/09/22 16:05:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5359lb # [ 110.050851] niks3-server[970]: 2026/09/22 16:05:58 INFO Signed narinfos id=36 count=25360lb # [ 110.075645] niks3-server[970]: 2026/09/22 16:05:58 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5361lb # [ 110.083189] niks3-server[970]: 2026/09/22 16:05:58 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo5362lb # [ 110.087773] niks3-server[970]: 2026/09/22 16:05:58 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5363lb # [ 110.090874] niks3-server[970]: 2026/09/22 16:05:58 INFO Completed upload id=355364lb # [ 110.093601] niks3-server[970]: 2026/09/22 16:05:58 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5365lb # [ 110.095636] niks3-server[970]: 2026/09/22 16:05:58 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5366lb # [ 110.098608] niks3-server[970]: 2026/09/22 16:05:58 INFO Completed upload id=365367worker2 # [ 110.134193] nix-grpc-daemon[1255]: time=2026-09-22T16:05:58.766Z level=INFO msg="Upload complete. (302ms)"5368worker2 # [ 110.144347] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=2 nar_bytes_in=3125369worker2 # [ 110.163368] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=info event=scheduler_connected addr=lb:500515370worker2 # [ 110.168359] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5371client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.18 seconds)5372worker2 # [ 110.174678] nix-daemon[842]: reaped child process 1253, status = succeeded5373worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache5374worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)5375worker1 # [ 110.277182] systemd[1]: Listening on Nix worker-protocol over gRPC.5376worker1 # [ 110.287960] systemd[1]: Starting Nix worker-protocol over gRPC...5377worker2 # [ 110.369691] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:59Z level=info event=scheduler_connected addr=lb:500515378worker2 # [ 110.374677] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5379worker1 # [ 110.432430] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5380worker1 # [ 110.435307] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5381worker1 # [ 110.439372] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15382worker1 # [ 110.444965] nix-grpc-daemon[1368]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5383worker1 # [ 110.446412] nix-grpc-daemon[1368]: E0000 00:00:1790093159.075217 1368 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5384lb # [ 110.430322] niks3-server[970]: 2026/09/22 16:05:59 INFO lead: acquired remote=192.168.1.3:412145385lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5386lb: must succeed: curl -sf localhost:9901/clusters5387worker1 # [ 110.468242] nix-grpc-daemon[1368]: E0000 00:00:1790093159.081152 1368 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5388worker1 # [ 110.470564] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5389worker1 # [ 110.495827] nix-grpc-daemon[1368]: E0000 00:00:1790093159.091182 1409 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5390worker1 # [ 110.498939] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=scheduler_take_over5391worker1 # [ 110.500315] systemd[1]: Started Nix worker-protocol over gRPC.5392worker1 # [ 110.501136] nix-grpc-daemon[1368]: E0000 00:00:1790093159.111190 1409 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5393worker1 # [ 110.503473] nix-grpc-daemon[1368]: E0000 00:00:1790093159.111360 1409 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5394worker1 # [ 110.509332] nix-grpc-daemon[1368]: E0000 00:00:1790093159.125693 1409 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5395worker1 # [ 110.513871] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=scheduler_connected addr=lb:500515396worker1 # [ 110.515184] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5397lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5398worker2 # [ 110.575963] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:59Z level=info event=scheduler_connected addr=lb:500515399worker2 # [ 110.581246] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5400worker1 # [ 110.714855] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=scheduler_connected addr=lb:500515401worker1 # [ 110.719854] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5402worker2 # [ 110.782334] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:59Z level=info event=scheduler_connected addr=lb:500515403worker2 # [ 110.787911] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5404worker1 # [ 110.920519] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=scheduler_connected addr=lb:500515405worker1 # [ 110.929078] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:489825406worker1 # [ 110.934382] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05407worker2 # [ 110.990422] nix-grpc-daemon[1195]: ts=2026-09-22T16:05:59Z level=info event=scheduler_connected addr=lb:500515408worker1 # [ 110.989301] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=oidc_jwks provider=mock keys=15409worker1 # [ 110.994262] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:489825410worker1 # [ 110.999531] nix-grpc-daemon[1368]: ts=2026-09-22T16:05:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05411lb: must succeed: curl -sf localhost:9901/clusters5412lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5413lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.14 seconds)5414(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.02 seconds)5415subtest: a niks3 restart does not cost the leader its role5416lb: must succeed: curl -sf localhost:9901/clusters5417lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5418lb: must succeed: curl -sf localhost:9901/clusters5419lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5420lb # [ 111.697309] systemd[1]: Stopping niks3 server...5421lb # [ 111.698219] niks3-server[970]: 2026/09/22 16:06:00 INFO Shutdown signal received, draining in-flight requests timeout=10s5422lb # [ 111.706823] niks3-server[970]: 2026/09/22 16:06:00 INFO lead: released remote=192.168.1.3:412145423worker2 # [ 111.742133] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:00Z level=info event=scheduler_lock_lost status=2005424worker1 # [ 111.735483] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:00Z level=info event=scheduler_lock_lost status=2005425lb # [ 111.727660] systemd[1]: niks3.service: Deactivated successfully.5426lb # [ 111.729878] systemd[1]: Stopped niks3 server.5427lb # [ 111.731590] systemd[1]: niks3.service: Consumed 657ms CPU time over 1min 29.103s wall clock time, 27.7M memory peak, 97K incoming IP traffic, 139.3K outgoing IP traffic.5428lb # [ 111.742448] systemd[1]: Starting niks3 server...5429lb # [ 111.807986] niks3-server[1110]: 2026/09/22 16:06:00 goose: no migrations to run. current version: 202609200000005430lb # [ 111.814703] niks3-server[1110]: 2026/09/22 16:06:00 OK 1_commit_pending_closure.sql (4.96ms)5431lb # [ 111.818890] niks3-server[1110]: 2026/09/22 16:06:00 OK 2_object_stats_trigger.sql (3.84ms)5432lb # [ 111.821316] niks3-server[1110]: 2026/09/22 16:06:00 goose: up to current file version: 25433lb # [ 111.822618] niks3-server[1110]: 2026/09/22 16:06:00 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key5434lb # [ 111.833185] niks3-server[1110]: 2026/09/22 16:06:00 INFO Read proxy enabled — serving cache objects from S35435lb # [ 111.834514] niks3-server[1110]: 2026/09/22 16:06:00 INFO Using socket-activated listener address=0.0.0.0:57515436lb # [ 111.839188] niks3-server[1110]: 2026/09/22 16:06:00 INFO systemd watchdog enabled interval=15s5437lb # [ 111.841345] niks3-server[1110]: 2026/09/22 16:06:00 INFO Starting HTTP server address=0.0.0.0:57515438lb # [ 111.842538] systemd[1]: Started niks3 server.5439lb: waiting for unit niks3.service5440lb: (finished: waiting for unit niks3.service, in 0.03 seconds)5441lb: must succeed: curl -sf localhost:9901/clusters5442lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5443worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5444worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5445lb: must succeed: curl -sf localhost:9901/clusters5446lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5447lb: must succeed: curl -sf localhost:9901/clusters5448lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5449worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5450worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.07 seconds)5451client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&25452worker2 # [ 112.371108] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:355825453client # don't know how to build these paths:5454client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5455worker2 # [ 112.382929] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355825456worker1 # [ 112.405245] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:01Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=05457worker1 # [ 112.412413] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:01Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.3:50051 clients=15458worker1 # [ 112.455421] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489905459worker1 # [ 112.470456] nix-daemon[848]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5460worker1 # [ 112.496286] nix-grpc-daemon[1368]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5)5461worker1 # [ 112.507769] nix-grpc-daemon[1368]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 2/5)5462worker1 # [ 112.519139] nix-grpc-daemon[1368]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 180 ms (attempt 3/5)5463worker1 # [ 112.707555] nix-grpc-daemon[1368]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 414 ms (attempt 4/5)5464lb # [ 112.714865] niks3-server[1110]: 2026/09/22 16:06:01 INFO lead: acquired remote=192.168.1.3:594745465worker1 # [ 113.126716] nix-grpc-daemon[1368]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5466worker1 # [ 113.133592] nix-grpc-daemon[1368]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5467worker1 # [ 113.148882] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:489905468client # copying 1 paths to 'lb:50051'...5469worker1 # [ 113.166687] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:489905470client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'...5471worker1 # [ 113.183768] nix-daemon[848]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5472worker1 # [ 113.212165] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:01Z level=info event=niks3_push_started pid=14405473worker1 # [ 113.365357] nix-grpc-daemon[1440]: time=2026-09-22T16:06:01.995Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""5474worker1 # [ 113.496587] nix-daemon[848]: accepted connection from pid 1453, user nix-grpc-daemon (trusted)5475worker1 # [ 113.514898] nix-daemon[848]: reaped child process 1456, status = succeeded5476worker1 # [ 113.616113] nix-daemon[848]: accepted connection from pid 1458, user nix-grpc-daemon (trusted)5477worker1 # [ 113.631636] nix-daemon[848]: reaped child process 1461, status = succeeded5478lb # [ 113.613572] niks3-server[1110]: 2026/09/22 16:06:02 INFO Received uploads request method=POST path=/api/pending_closures5479worker1 # [ 113.655822] nix-grpc-daemon[1440]: time=2026-09-22T16:06:02.285Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5480worker1 # [ 113.657881] nix-grpc-daemon[1440]: time=2026-09-22T16:06:02.285Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)"5481lb # [ 113.674562] niks3-server[1110]: 2026/09/22 16:06:02 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst5482lb # [ 113.688307] niks3-server[1110]: 2026/09/22 16:06:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5483lb # [ 113.693469] niks3-server[1110]: 2026/09/22 16:06:02 INFO Signed narinfos id=37 count=15484worker1 # [ 113.720663] nix-grpc-daemon[1440]: time=2026-09-22T16:06:02.350Z level=INFO msg="Uploading 1 narinfos"5485lb # [ 113.708719] niks3-server[1110]: 2026/09/22 16:06:02 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5486lb # [ 113.721409] niks3-server[1110]: 2026/09/22 16:06:02 INFO Completed upload id=375487worker1 # [ 113.748196] nix-grpc-daemon[1440]: time=2026-09-22T16:06:02.378Z level=INFO msg="Upload complete. (379ms)"5488worker1 # [ 113.760158] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48990 duration_s=0 paths=1 nar_bytes_in=5445489worker1 # [ 113.776649] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489905490lb # [ 113.754416] niks3-server[1110]: 2026/09/22 16:06:02 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls5491worker1 # [ 113.785249] nix-daemon[848]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5492worker1 # [ 113.795870] nix-daemon[848]: reaped child process 1438, status = succeeded5493client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051...5494worker1 # [ 113.801369] nix-daemon[848]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5495client # farm-a> node-a: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5496client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5497client # farm-a> LOG-farm-a-after-niks3-restart5498worker1 # [ 114.867236] nix-daemon[848]: reaped child process 1465, status = succeeded5499worker1 # [ 114.990079] nix-daemon[848]: accepted connection from pid 1481, user nix-grpc-daemon (trusted)5500worker1 # [ 115.010110] nix-daemon[848]: reaped child process 1484, status = succeeded5501lb # [ 114.989485] niks3-server[1110]: 2026/09/22 16:06:03 INFO Received uploads request method=POST path=/api/pending_closures5502worker1 # [ 115.032462] nix-grpc-daemon[1440]: time=2026-09-22T16:06:03.659Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5503worker1 # [ 115.034237] nix-grpc-daemon[1440]: time=2026-09-22T16:06:03.659Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)"5504lb # [ 115.041003] niks3-server[1110]: 2026/09/22 16:06:03 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5505lb # [ 115.055127] niks3-server[1110]: 2026/09/22 16:06:03 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5506lb # [ 115.070202] niks3-server[1110]: 2026/09/22 16:06:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5507worker1 # [ 115.097369] nix-grpc-daemon[1440]: time=2026-09-22T16:06:03.726Z level=INFO msg="Uploading 1 narinfos"5508lb # [ 115.087101] niks3-server[1110]: 2026/09/22 16:06:03 INFO Signed narinfos id=38 count=15509lb # [ 115.094158] niks3-server[1110]: 2026/09/22 16:06:03 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls5510lb # [ 115.106445] niks3-server[1110]: 2026/09/22 16:06:03 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5511lb # [ 115.110844] niks3-server[1110]: 2026/09/22 16:06:03 INFO Completed upload id=385512worker1 # [ 115.137543] nix-grpc-daemon[1440]: time=2026-09-22T16:06:03.768Z level=INFO msg="Upload complete. (323ms)"5513lb # [ 115.113104] niks3-server[1110]: 2026/09/22 16:06:03 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo5514worker1 # [ 115.161504] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48990 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=15515worker1 # [ 115.178797] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:03Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=05516worker1 # [ 115.183212] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:03Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.3:50051 clients=15517worker1 # [ 115.187571] nix-daemon[848]: reaped child process 1463, status = succeeded5518worker1 # [ 115.202954] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489905519worker1 # [ 115.218196] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:489905520worker1 # [ 115.233623] nix-grpc-daemon[1440]: time=2026-09-22T16:06:03.864Z level=INFO msg="All 1 paths already cached"5521client # copying 1 paths to 'lb:50051'...5522client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'...5523worker1 # [ 115.244806] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:489905524worker1 # [ 115.258423] nix-daemon[848]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5525worker1 # [ 115.412229] nix-daemon[848]: accepted connection from pid 1490, user nix-grpc-daemon (trusted)5526worker1 # [ 115.434343] nix-daemon[848]: reaped child process 1493, status = succeeded5527worker1 # [ 115.533442] nix-daemon[848]: accepted connection from pid 1495, user nix-grpc-daemon (trusted)5528worker1 # [ 115.552104] nix-daemon[848]: reaped child process 1498, status = succeeded5529lb # [ 115.529088] niks3-server[1110]: 2026/09/22 16:06:04 INFO Received uploads request method=POST path=/api/pending_closures5530worker1 # [ 115.565206] nix-grpc-daemon[1440]: time=2026-09-22T16:06:04.195Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5531worker1 # [ 115.566823] nix-grpc-daemon[1440]: time=2026-09-22T16:06:04.195Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)"5532lb # [ 115.560950] niks3-server[1110]: 2026/09/22 16:06:04 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst5533worker1 # [ 115.601493] nix-grpc-daemon[1440]: time=2026-09-22T16:06:04.232Z level=INFO msg="Uploading 1 narinfos"5534lb # [ 115.575280] niks3-server[1110]: 2026/09/22 16:06:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5535lb # [ 115.586617] niks3-server[1110]: 2026/09/22 16:06:04 INFO Signed narinfos id=39 count=15536lb # [ 115.594386] niks3-server[1110]: 2026/09/22 16:06:04 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls5537lb # [ 115.608913] niks3-server[1110]: 2026/09/22 16:06:04 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5538lb # [ 115.616730] niks3-server[1110]: 2026/09/22 16:06:04 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo5539worker1 # [ 115.643366] nix-grpc-daemon[1440]: time=2026-09-22T16:06:04.273Z level=INFO msg="Upload complete. (369ms)"5540lb # [ 115.620068] niks3-server[1110]: 2026/09/22 16:06:04 INFO Completed upload id=395541worker1 # [ 115.653322] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48990 duration_s=0 paths=1 nar_bytes_in=6565542worker1 # [ 115.672243] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489905543worker1 # [ 115.677015] nix-daemon[848]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5544worker1 # [ 115.687377] nix-daemon[848]: reaped child process 1488, status = succeeded5545client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051...5546worker1 # [ 115.694884] nix-daemon[848]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5547client # farm-b> node-a: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5548client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5549client # farm-b> LOG-farm-b-after-niks3-restart5550worker1 # [ 116.917916] nix-daemon[848]: reaped child process 1502, status = succeeded5551worker1 # [ 117.014161] nix-daemon[848]: accepted connection from pid 1518, user nix-grpc-daemon (trusted)5552worker1 # [ 117.033877] nix-daemon[848]: reaped child process 1521, status = succeeded5553lb # [ 117.013737] niks3-server[1110]: 2026/09/22 16:06:05 INFO Received uploads request method=POST path=/api/pending_closures5554worker1 # [ 117.051549] nix-grpc-daemon[1440]: time=2026-09-22T16:06:05.681Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5555worker1 # [ 117.053209] nix-grpc-daemon[1440]: time=2026-09-22T16:06:05.681Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)"5556lb # [ 117.048936] niks3-server[1110]: 2026/09/22 16:06:05 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5557lb # [ 117.064208] niks3-server[1110]: 2026/09/22 16:06:05 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst5558worker1 # [ 117.104267] nix-grpc-daemon[1440]: time=2026-09-22T16:06:05.734Z level=INFO msg="Uploading 1 narinfos"5559lb # [ 117.077481] niks3-server[1110]: 2026/09/22 16:06:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5560lb # [ 117.087407] niks3-server[1110]: 2026/09/22 16:06:05 INFO Signed narinfos id=40 count=15561lb # [ 117.097105] niks3-server[1110]: 2026/09/22 16:06:05 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls5562lb # [ 117.106378] envoy[896]: conn peer=[2001:db8:1::3]:54348 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=12953 tx=3668 ms=907005563lb # [ 117.119843] envoy[896]: conn peer=[2001:db8:1::1]:49498 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=304 ms=9305564worker1 # [ 117.146076] nix-grpc-daemon[1440]: time=2026-09-22T16:06:05.776Z level=INFO msg="Upload complete. (241ms)"5565lb # [ 117.125378] niks3-server[1110]: 2026/09/22 16:06:05 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5566lb # [ 117.131873] niks3-server[1110]: 2026/09/22 16:06:05 INFO Completed upload id=405567lb # [ 117.134484] niks3-server[1110]: 2026/09/22 16:06:05 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo5568worker1 # [ 117.161545] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48990 duration_s=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=15569worker1 # [ 117.184416] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:05Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=05570worker1 # [ 117.190400] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:05Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.3:50051 clients=15571worker1 # [ 117.195762] nix-daemon[848]: reaped child process 1500, status = succeeded5572worker1 # [ 117.223101] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489905573worker1 # [ 117.238265] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:489905574worker1 # [ 117.253730] nix-grpc-daemon[1440]: time=2026-09-22T16:06:05.884Z level=INFO msg="All 2 paths already cached"5575client # copying 1 paths to 'lb:50051'...5576client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'...5577worker1 # [ 117.265154] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:489905578worker1 # [ 117.278985] nix-daemon[848]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5579worker1 # [ 117.438741] nix-daemon[848]: accepted connection from pid 1527, user nix-grpc-daemon (trusted)5580worker1 # [ 117.467840] nix-daemon[848]: reaped child process 1530, status = succeeded5581worker1 # [ 117.557597] nix-daemon[848]: accepted connection from pid 1532, user nix-grpc-daemon (trusted)5582worker1 # [ 117.576550] nix-daemon[848]: reaped child process 1535, status = succeeded5583lb # [ 117.548799] niks3-server[1110]: 2026/09/22 16:06:06 INFO Received uploads request method=POST path=/api/pending_closures5584worker1 # [ 117.586139] nix-grpc-daemon[1440]: time=2026-09-22T16:06:06.216Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5585worker1 # [ 117.587586] nix-grpc-daemon[1440]: time=2026-09-22T16:06:06.216Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)"5586lb # [ 117.578959] niks3-server[1110]: 2026/09/22 16:06:06 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst5587worker1 # [ 117.625805] nix-grpc-daemon[1440]: time=2026-09-22T16:06:06.256Z level=INFO msg="Uploading 1 narinfos"5588lb # [ 117.592618] niks3-server[1110]: 2026/09/22 16:06:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5589lb # [ 117.605962] niks3-server[1110]: 2026/09/22 16:06:06 INFO Signed narinfos id=41 count=15590lb # [ 117.614985] niks3-server[1110]: 2026/09/22 16:06:06 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls5591lb # [ 117.624866] niks3-server[1110]: 2026/09/22 16:06:06 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5592lb # [ 117.630290] niks3-server[1110]: 2026/09/22 16:06:06 INFO Completed upload id=415593worker1 # [ 117.648526] nix-grpc-daemon[1440]: time=2026-09-22T16:06:06.279Z level=INFO msg="Upload complete. (353ms)"5594lb # [ 117.634208] niks3-server[1110]: 2026/09/22 16:06:06 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo5595worker1 # [ 117.661264] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48990 duration_s=0 paths=1 nar_bytes_in=7845596worker1 # [ 117.672120] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489905597worker1 # [ 117.681217] nix-daemon[848]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5598worker1 # [ 117.684158] nix-daemon[848]: reaped child process 1525, status = succeeded5599client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051...5600client # farm-top> node-a: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5601worker1 # [ 117.697914] nix-daemon[848]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5602client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5603client # farm-top> LOG-farm-top-after-niks3-restart5604worker1 # [ 118.759995] nix-daemon[848]: reaped child process 1539, status = succeeded5605worker1 # [ 118.869533] nix-daemon[848]: accepted connection from pid 1555, user nix-grpc-daemon (trusted)5606worker1 # [ 118.890103] nix-daemon[848]: reaped child process 1558, status = succeeded5607lb # [ 118.869715] niks3-server[1110]: 2026/09/22 16:06:07 INFO Received uploads request method=POST path=/api/pending_closures5608worker1 # [ 118.905639] nix-grpc-daemon[1440]: time=2026-09-22T16:06:07.536Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5609worker1 # [ 118.909105] nix-grpc-daemon[1440]: time=2026-09-22T16:06:07.538Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)"5610lb # [ 118.904135] niks3-server[1110]: 2026/09/22 16:06:07 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5611lb # [ 118.921345] niks3-server[1110]: 2026/09/22 16:06:07 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst5612worker1 # [ 118.963712] nix-grpc-daemon[1440]: time=2026-09-22T16:06:07.594Z level=INFO msg="Uploading 1 narinfos"5613lb # [ 118.937528] niks3-server[1110]: 2026/09/22 16:06:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5614lb # [ 118.944895] niks3-server[1110]: 2026/09/22 16:06:07 INFO Signed narinfos id=42 count=15615lb # [ 118.952444] niks3-server[1110]: 2026/09/22 16:06:07 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls5616lb # [ 118.963988] niks3-server[1110]: 2026/09/22 16:06:07 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5617lb # [ 118.972171] niks3-server[1110]: 2026/09/22 16:06:07 INFO Completed upload id=425618worker1 # [ 118.996633] nix-grpc-daemon[1440]: time=2026-09-22T16:06:07.627Z level=INFO msg="Upload complete. (288ms)"5619lb # [ 118.975204] niks3-server[1110]: 2026/09/22 16:06:07 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo5620worker1 # [ 119.009635] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48990 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=15621worker1 # [ 119.030433] nix-daemon[848]: reaped child process 1537, status = succeeded5622client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2, in 6.91 seconds)5623client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath5624client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath, in 0.19 seconds)5625(finished: subtest: a niks3 restart does not cost the leader its role, in 7.65 seconds)5626subtest: scheduler down: the other node takes the lock and keeps it5627lb: must succeed: curl -sf localhost:9901/clusters5628lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5629lb: must succeed: curl -sf localhost:9901/clusters5630lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5631lb: must succeed: curl -sf localhost:9901/clusters5632lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5633lb: must succeed: curl -sf localhost:9901/clusters5634lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5635worker1 # [ 119.490303] systemd[1]: Stopping Nix worker-protocol over gRPC...5636worker1 # [ 120.459075] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:09Z level=info event=signal_exit5637lb # [ 120.722013] niks3-server[1110]: 2026/09/22 16:06:09 INFO lead: released remote=192.168.1.3:594745638worker2 # [ 121.759981] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:10Z level=info event=scheduler_restarting addr=lb:500515639worker1 # [ 121.754844] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:10Z level=info event=scheduler_restarting5640worker1 # [ 121.755289] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:489825641worker1 # [ 121.755418] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:10Z level=info event=worker_gone addr=192.168.1.4:500515642worker1 # [ 121.755549] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:10Z level=info event=scheduler_restarting addr=lb:500515643worker1 # [ 121.755661] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:489825644worker1 # [ 121.755766] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:10Z level=info event=worker_gone addr=192.168.1.3:500515645worker1 # [ 121.805970] nix-daemon[848]: reaped child process 1430, status = succeeded5646worker2 # [ 121.960345] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:10Z level=info event=scheduler_connected addr=lb:500515647worker2 # [ 121.966033] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5648worker1 # [ 121.950758] nix-grpc-daemon[1368]: E0000 00:00:1790093170.581319 1413 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5649worker1 # [ 121.966667] nix-grpc-daemon[1368]: E0000 00:00:1790093170.581462 1413 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5650worker1 # [ 121.970322] nix-grpc-daemon[1368]: ts=2026-09-22T16:06:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5651worker1 # [ 122.026861] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5652worker1 # [ 122.035735] systemd[1]: Stopped Nix worker-protocol over gRPC.5653worker1 # [ 122.039036] systemd[1]: nix-grpc-daemon.service: Consumed 1.487s CPU time over 11.746s wall clock time, 37.8M memory peak, 35.8K incoming IP traffic, 57.1K outgoing IP traffic.5654worker1 # [ 122.055547] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5655worker1 # [ 122.059942] systemd[1]: Closed Nix worker-protocol over gRPC.5656worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5657worker1 # [ 122.062466] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 11.790s wall clock time, 256K memory peak, 33.8K incoming IP traffic, 24.8K outgoing IP traffic.5658worker2 # [ 122.167321] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:10Z level=info event=scheduler_connected addr=lb:500515659worker2 # [ 122.172792] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5660worker2 # [ 122.374142] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_connected addr=lb:500515661worker2 # [ 122.379887] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5662worker2 # [ 122.581152] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_connected addr=lb:500515663worker2 # [ 122.586598] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5664worker2 # [ 122.753870] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_take_over5665lb # [ 122.719283] niks3-server[1110]: 2026/09/22 16:06:11 INFO lead: acquired remote=192.168.1.4:387465666worker2 # [ 122.789148] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_connected addr=lb:500515667worker2 # [ 122.793839] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5668worker2 # [ 122.995042] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_connected addr=lb:500515669worker2 # [ 123.000374] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5670worker2 # [ 123.202561] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_connected addr=lb:500515671worker2 # [ 123.211454] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5672worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.17 seconds)5673worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5674worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5675worker2 # [ 123.409326] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:12Z level=info event=scheduler_connected addr=lb:500515676worker2 # [ 123.438129] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:12Z level=info event=oidc_jwks provider=mock keys=15677worker2 # [ 123.442817] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:12Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:352225678worker2 # [ 123.448257] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:12Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05679worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5680worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5681client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&25682client # don't know how to build these paths:5683client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5684worker2 # [ 124.560774] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:355825685worker2 # [ 124.568736] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355825686worker2 # [ 124.593164] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:13Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05687worker2 # [ 124.600389] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:13Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=15688worker2 # [ 124.639416] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355825689worker2 # [ 124.655172] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355825690client # copying 1 paths to 'lb:50051'...5691client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5692worker2 # [ 124.670714] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355825693worker2 # [ 124.685713] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5694worker2 # [ 124.848075] nix-daemon[842]: accepted connection from pid 1300, user nix-grpc-daemon (trusted)5695worker2 # [ 124.868754] nix-daemon[842]: reaped child process 1303, status = succeeded5696worker2 # [ 124.969953] nix-daemon[842]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5697worker2 # [ 124.987468] nix-daemon[842]: reaped child process 1308, status = succeeded5698lb # [ 124.957907] niks3-server[1110]: 2026/09/22 16:06:13 INFO Received uploads request method=POST path=/api/pending_closures5699worker2 # [ 125.004149] nix-grpc-daemon[1255]: time=2026-09-22T16:06:13.635Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5700worker2 # [ 125.005749] nix-grpc-daemon[1255]: time=2026-09-22T16:06:13.635Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5701lb # [ 124.988728] niks3-server[1110]: 2026/09/22 16:06:13 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5702worker2 # [ 125.044884] nix-grpc-daemon[1255]: time=2026-09-22T16:06:13.677Z level=INFO msg="Uploading 1 narinfos"5703lb # [ 125.003402] niks3-server[1110]: 2026/09/22 16:06:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5704lb # [ 125.015834] niks3-server[1110]: 2026/09/22 16:06:13 INFO Signed narinfos id=43 count=15705lb # [ 125.022621] niks3-server[1110]: 2026/09/22 16:06:13 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5706lb # [ 125.035115] niks3-server[1110]: 2026/09/22 16:06:13 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5707worker2 # [ 125.080193] nix-grpc-daemon[1255]: time=2026-09-22T16:06:13.712Z level=INFO msg="Upload complete. (378ms)"5708lb # [ 125.046345] niks3-server[1110]: 2026/09/22 16:06:13 INFO Completed upload id=435709lb # [ 125.049234] niks3-server[1110]: 2026/09/22 16:06:13 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5710worker2 # [ 125.092304] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=1 nar_bytes_in=5205711worker2 # [ 125.106280] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355825712worker2 # [ 125.113029] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5713worker2 # [ 125.118449] nix-daemon[842]: reaped child process 1298, status = succeeded5714client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5715worker2 # [ 125.129566] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5716client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5717client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5718client # farm-a> LOG-farm-a-on-standby5719worker2 # [ 125.768435] nix-daemon[842]: reaped child process 1312, status = succeeded5720worker2 # [ 125.878644] nix-daemon[842]: accepted connection from pid 1328, user nix-grpc-daemon (trusted)5721worker2 # [ 125.897716] nix-daemon[842]: reaped child process 1331, status = succeeded5722lb # [ 125.867233] niks3-server[1110]: 2026/09/22 16:06:14 INFO Received uploads request method=POST path=/api/pending_closures5723worker2 # [ 125.913868] nix-grpc-daemon[1255]: time=2026-09-22T16:06:14.544Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5724worker2 # [ 125.915701] nix-grpc-daemon[1255]: time=2026-09-22T16:06:14.544Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5725lb # [ 125.899617] niks3-server[1110]: 2026/09/22 16:06:14 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5726lb # [ 125.913169] niks3-server[1110]: 2026/09/22 16:06:14 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5727lb # [ 125.925934] niks3-server[1110]: 2026/09/22 16:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5728worker2 # [ 125.967474] nix-grpc-daemon[1255]: time=2026-09-22T16:06:14.598Z level=INFO msg="Uploading 1 narinfos"5729lb # [ 125.935982] niks3-server[1110]: 2026/09/22 16:06:14 INFO Signed narinfos id=44 count=15730lb # [ 125.940663] niks3-server[1110]: 2026/09/22 16:06:14 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5731lb # [ 125.948132] niks3-server[1110]: 2026/09/22 16:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5732lb # [ 125.957973] niks3-server[1110]: 2026/09/22 16:06:14 INFO Completed upload id=445733worker2 # [ 125.992823] nix-grpc-daemon[1255]: time=2026-09-22T16:06:14.625Z level=INFO msg="Upload complete. (251ms)"5734lb # [ 125.962574] niks3-server[1110]: 2026/09/22 16:06:14 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5735worker2 # [ 126.016250] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15736worker2 # [ 126.030588] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:14Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05737worker2 # [ 126.034061] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:14Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=15738worker2 # [ 126.038225] nix-daemon[842]: reaped child process 1310, status = succeeded5739worker2 # [ 126.060160] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355825740worker2 # [ 126.075434] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355825741worker2 # [ 126.091612] nix-grpc-daemon[1255]: time=2026-09-22T16:06:14.723Z level=INFO msg="All 1 paths already cached"5742client # copying 1 paths to 'lb:50051'...5743client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5744worker2 # [ 126.102796] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355825745worker2 # [ 126.116676] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5746worker2 # [ 126.274460] nix-daemon[842]: accepted connection from pid 1337, user nix-grpc-daemon (trusted)5747worker2 # [ 126.293174] nix-daemon[842]: reaped child process 1340, status = succeeded5748worker2 # [ 126.393367] nix-daemon[842]: accepted connection from pid 1342, user nix-grpc-daemon (trusted)5749worker2 # [ 126.412158] nix-daemon[842]: reaped child process 1345, status = succeeded5750lb # [ 126.375236] niks3-server[1110]: 2026/09/22 16:06:14 INFO Received uploads request method=POST path=/api/pending_closures5751worker2 # [ 126.419991] nix-grpc-daemon[1255]: time=2026-09-22T16:06:15.051Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5752worker2 # [ 126.421758] nix-grpc-daemon[1255]: time=2026-09-22T16:06:15.052Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5753lb # [ 126.402898] niks3-server[1110]: 2026/09/22 16:06:15 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5754lb # [ 126.418227] niks3-server[1110]: 2026/09/22 16:06:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5755worker2 # [ 126.460229] nix-grpc-daemon[1255]: time=2026-09-22T16:06:15.092Z level=INFO msg="Uploading 1 narinfos"5756lb # [ 126.430215] niks3-server[1110]: 2026/09/22 16:06:15 INFO Signed narinfos id=45 count=15757lb # [ 126.436556] niks3-server[1110]: 2026/09/22 16:06:15 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5758worker2 # [ 126.482269] nix-grpc-daemon[1255]: time=2026-09-22T16:06:15.114Z level=INFO msg="Upload complete. (349ms)"5759lb # [ 126.446926] niks3-server[1110]: 2026/09/22 16:06:15 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5760lb # [ 126.455045] niks3-server[1110]: 2026/09/22 16:06:15 INFO Completed upload id=455761worker2 # [ 126.491040] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=1 nar_bytes_in=6405762lb # [ 126.458716] niks3-server[1110]: 2026/09/22 16:06:15 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5763worker2 # [ 126.503757] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355825764worker2 # [ 126.509061] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5765worker2 # [ 126.513503] nix-daemon[842]: reaped child process 1335, status = succeeded5766client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5767worker2 # [ 126.525081] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5768client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5769lb # [ 127.096858] envoy[896]: conn peer=[2001:db8:1::1]:55572 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9753 tx=4508 ms=66645770lb # [ 127.101866] envoy[896]: conn peer=[2001:db8:1::3]:43792 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1335 tx=564 ms=114575771client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5772client # farm-b> LOG-farm-b-on-standby5773worker2 # [ 127.586308] nix-daemon[842]: reaped child process 1349, status = succeeded5774worker2 # [ 127.706218] nix-daemon[842]: accepted connection from pid 1365, user nix-grpc-daemon (trusted)5775worker2 # [ 127.722695] nix-daemon[842]: reaped child process 1368, status = succeeded5776lb # [ 127.695057] niks3-server[1110]: 2026/09/22 16:06:16 INFO Received uploads request method=POST path=/api/pending_closures5777worker2 # [ 127.741315] nix-grpc-daemon[1255]: time=2026-09-22T16:06:16.372Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5778worker2 # [ 127.742953] nix-grpc-daemon[1255]: time=2026-09-22T16:06:16.372Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5779lb # [ 127.731089] niks3-server[1110]: 2026/09/22 16:06:16 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5780worker2 # [ 127.790657] nix-grpc-daemon[1255]: time=2026-09-22T16:06:16.422Z level=INFO msg="Uploading 1 narinfos"5781lb # [ 127.749851] niks3-server[1110]: 2026/09/22 16:06:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5782lb # [ 127.761035] niks3-server[1110]: 2026/09/22 16:06:16 INFO Signed narinfos id=46 count=15783lb # [ 127.763664] niks3-server[1110]: 2026/09/22 16:06:16 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5784lb # [ 127.776304] niks3-server[1110]: 2026/09/22 16:06:16 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5785worker2 # [ 127.821576] nix-grpc-daemon[1255]: time=2026-09-22T16:06:16.453Z level=INFO msg="Upload complete. (287ms)"5786lb # [ 127.787427] niks3-server[1110]: 2026/09/22 16:06:16 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5787lb # [ 127.791778] niks3-server[1110]: 2026/09/22 16:06:16 INFO Completed upload id=465788lb # [ 127.796538] niks3-server[1110]: 2026/09/22 16:06:16 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5789worker2 # [ 127.841101] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15790worker2 # [ 127.860568] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:16Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05791worker2 # [ 127.865401] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:16Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=15792worker2 # [ 127.870353] nix-daemon[842]: reaped child process 1347, status = succeeded5793worker2 # [ 127.900086] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355825794worker2 # [ 127.914914] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355825795worker2 # [ 127.928996] nix-grpc-daemon[1255]: time=2026-09-22T16:06:16.561Z level=INFO msg="All 2 paths already cached"5796client # copying 1 paths to 'lb:50051'...5797client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5798worker2 # [ 127.940427] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355825799worker2 # [ 127.954008] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5800worker2 # [ 128.098894] nix-daemon[842]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5801worker2 # [ 128.119190] nix-daemon[842]: reaped child process 1377, status = succeeded5802worker2 # [ 128.219162] nix-daemon[842]: accepted connection from pid 1379, user nix-grpc-daemon (trusted)5803worker2 # [ 128.237345] nix-daemon[842]: reaped child process 1382, status = succeeded5804lb # [ 128.207581] niks3-server[1110]: 2026/09/22 16:06:16 INFO Received uploads request method=POST path=/api/pending_closures5805worker2 # [ 128.251757] nix-grpc-daemon[1255]: time=2026-09-22T16:06:16.884Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5806worker2 # [ 128.253731] nix-grpc-daemon[1255]: time=2026-09-22T16:06:16.884Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5807lb # [ 128.228918] niks3-server[1110]: 2026/09/22 16:06:16 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5808lb # [ 128.236875] niks3-server[1110]: 2026/09/22 16:06:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5809worker2 # [ 128.276540] nix-grpc-daemon[1255]: time=2026-09-22T16:06:16.908Z level=INFO msg="Uploading 1 narinfos"5810lb # [ 128.243970] niks3-server[1110]: 2026/09/22 16:06:16 INFO Signed narinfos id=47 count=15811lb # [ 128.245606] niks3-server[1110]: 2026/09/22 16:06:16 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5812lb # [ 128.253326] niks3-server[1110]: 2026/09/22 16:06:16 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5813worker2 # [ 128.292130] nix-grpc-daemon[1255]: time=2026-09-22T16:06:16.924Z level=INFO msg="Upload complete. (323ms)"5814lb # [ 128.259269] niks3-server[1110]: 2026/09/22 16:06:16 INFO Completed upload id=475815lb # [ 128.261659] niks3-server[1110]: 2026/09/22 16:06:16 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5816worker2 # [ 128.300098] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=1 nar_bytes_in=7685817worker2 # [ 128.303677] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355825818worker2 # [ 128.311883] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5819worker2 # [ 128.315532] nix-daemon[842]: reaped child process 1372, status = succeeded5820client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5821worker2 # [ 128.325870] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5822client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5823client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5824client # farm-top> LOG-farm-top-on-standby5825worker2 # [ 129.231080] nix-daemon[842]: reaped child process 1386, status = succeeded5826worker2 # [ 129.301416] nix-daemon[842]: accepted connection from pid 1402, user nix-grpc-daemon (trusted)5827worker2 # [ 129.319667] nix-daemon[842]: reaped child process 1405, status = succeeded5828lb # [ 129.289978] niks3-server[1110]: 2026/09/22 16:06:17 INFO Received uploads request method=POST path=/api/pending_closures5829worker2 # [ 129.336396] nix-grpc-daemon[1255]: time=2026-09-22T16:06:17.967Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5830worker2 # [ 129.337956] nix-grpc-daemon[1255]: time=2026-09-22T16:06:17.967Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5831lb # [ 129.325033] niks3-server[1110]: 2026/09/22 16:06:17 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5832lb # [ 129.340437] niks3-server[1110]: 2026/09/22 16:06:17 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5833lb # [ 129.351408] niks3-server[1110]: 2026/09/22 16:06:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5834worker2 # [ 129.391811] nix-grpc-daemon[1255]: time=2026-09-22T16:06:18.023Z level=INFO msg="Uploading 1 narinfos"5835lb # [ 129.358508] niks3-server[1110]: 2026/09/22 16:06:17 INFO Signed narinfos id=48 count=15836lb # [ 129.366905] niks3-server[1110]: 2026/09/22 16:06:17 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5837lb # [ 129.374323] niks3-server[1110]: 2026/09/22 16:06:17 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5838lb # [ 129.380511] niks3-server[1110]: 2026/09/22 16:06:18 INFO Completed upload id=485839worker2 # [ 129.415699] nix-grpc-daemon[1255]: time=2026-09-22T16:06:18.047Z level=INFO msg="Upload complete. (278ms)"5840lb # [ 129.383151] niks3-server[1110]: 2026/09/22 16:06:18 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5841worker2 # [ 129.429130] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15842worker2 # [ 129.448425] nix-daemon[842]: reaped child process 1384, status = succeeded5843client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2, in 5.13 seconds)5844client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath5845client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath, in 0.18 seconds)5846worker1 # [ 129.722973] systemd[1]: Listening on Nix worker-protocol over gRPC.5847worker1 # [ 129.734951] systemd[1]: Starting Nix worker-protocol over gRPC...5848worker1 # [ 129.872434] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:18Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5849worker1 # [ 129.874758] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5850worker1 # [ 129.878642] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15851worker1 # [ 129.884058] nix-grpc-daemon[1576]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5852worker1 # [ 129.885510] nix-grpc-daemon[1576]: E0000 00:00:1790093178.513785 1576 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5853lb: must succeed: curl -sf localhost:9901/clusters5854worker1 # [ 129.928063] nix-grpc-daemon[1576]: E0000 00:00:1790093178.520197 1576 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5855worker1 # [ 129.930378] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5856worker1 # [ 129.935258] nix-grpc-daemon[1576]: E0000 00:00:1790093178.528641 1615 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5857worker1 # [ 129.938264] nix-grpc-daemon[1576]: E0000 00:00:1790093178.546293 1615 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5858worker1 # [ 129.940755] nix-grpc-daemon[1576]: E0000 00:00:1790093178.546446 1615 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5859worker1 # [ 129.943083] systemd[1]: Started Nix worker-protocol over gRPC.5860worker1 # [ 129.946821] nix-grpc-daemon[1576]: E0000 00:00:1790093178.565071 1615 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5861worker1 # [ 129.951226] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:18Z level=info event=scheduler_connected addr=lb:500515862worker2 # [ 129.960987] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:18Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:352225863worker2 # [ 129.967536] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05864lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5865worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5866worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5867lb: must succeed: curl -sf localhost:9901/clusters5868lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5869lb: must succeed: curl -sf localhost:9901/clusters5870lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5871worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5872worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5873(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 10.96 seconds)5874subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5875client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs5876client # [ 130.269697] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs.5877client # Running as unit: rs.service; invocation ID: 70adb37a1ac746deb9ef1c3cc268af465878client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs, in 0.09 seconds)5879client # [ 130.474951] nix[1347]: don't know how to build these paths:5880client # [ 130.475985] nix[1347]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5881worker2 # [ 130.484152] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:355825882worker2 # [ 130.497122] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:19Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05883worker2 # [ 130.504127] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:19Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=15884worker2 # [ 130.543567] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355825885worker2 # [ 130.559472] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355825886client # [ 130.561804] nix[1347]: copying 1 paths to 'lb:50051'...5887worker2 # [ 130.574625] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355825888client # [ 130.566734] nix[1347]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5889worker2 # [ 130.589667] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5890worker2 # [ 130.754011] nix-daemon[842]: accepted connection from pid 1418, user nix-grpc-daemon (trusted)5891worker2 # [ 130.772121] nix-daemon[842]: reaped child process 1421, status = succeeded5892worker2 # [ 130.875197] nix-daemon[842]: accepted connection from pid 1423, user nix-grpc-daemon (trusted)5893worker2 # [ 130.890639] nix-daemon[842]: reaped child process 1426, status = succeeded5894lb # [ 130.863822] niks3-server[1110]: 2026/09/22 16:06:19 INFO Received uploads request method=POST path=/api/pending_closures5895worker2 # [ 130.909082] nix-grpc-daemon[1255]: time=2026-09-22T16:06:19.540Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5896worker2 # [ 130.910611] nix-grpc-daemon[1255]: time=2026-09-22T16:06:19.540Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5897lb # [ 130.894914] niks3-server[1110]: 2026/09/22 16:06:19 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5898worker2 # [ 130.942352] nix-grpc-daemon[1255]: time=2026-09-22T16:06:19.574Z level=INFO msg="Uploading 1 narinfos"5899lb # [ 130.910332] niks3-server[1110]: 2026/09/22 16:06:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5900lb # [ 130.920600] niks3-server[1110]: 2026/09/22 16:06:19 INFO Signed narinfos id=49 count=15901worker2 # [ 130.965905] nix-grpc-daemon[1255]: time=2026-09-22T16:06:19.598Z level=INFO msg="Upload complete. (360ms)"5902lb # [ 130.933289] niks3-server[1110]: 2026/09/22 16:06:19 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5903lb # [ 130.938225] niks3-server[1110]: 2026/09/22 16:06:19 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5904worker2 # [ 130.976309] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=1 nar_bytes_in=4165905lb # [ 130.942904] niks3-server[1110]: 2026/09/22 16:06:19 INFO Completed upload id=495906lb # [ 130.946879] niks3-server[1110]: 2026/09/22 16:06:19 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5907worker2 # [ 130.990827] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355825908worker2 # [ 130.997575] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5909worker2 # [ 131.002827] nix-daemon[842]: reaped child process 1416, status = succeeded5910client # [ 131.003482] nix[1347]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5911worker2 # [ 131.017596] nix-daemon[842]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5912lb: must succeed: curl -sf localhost:9901/clusters5913lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5914lb: must succeed: curl -sf localhost:9901/clusters5915lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5916lb: must succeed: curl -sf localhost:9901/clusters5917lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5918lb: must succeed: curl -sf localhost:9901/clusters5919lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5920worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5921worker1 # [ 133.080525] systemd-journald[269]: Received client request to rotate journal, rotating.5922worker1 # [ 133.100189] systemd-journald[269]: Vacuuming done, freed 0B of archived journals from /var/log/journal/884de07dae3740f98c64a432e7033015.5923worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5924worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5925worker2 # [ 133.163465] systemd[1]: Stopping Nix worker-protocol over gRPC...5926worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5927client: must succeed: sleep 5.05928worker2 # [ 133.187311] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:21Z level=info event=draining5929lb # [ 137.094201] envoy[896]: conn peer=[2001:db8:1::1]:42164 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9576 tx=4374 ms=48835930client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5931worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5932worker2 # [ 138.726104] nix-daemon[842]: reaped child process 1430, status = succeeded5933worker2 # [ 138.804947] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5934worker2 # [ 138.823502] nix-daemon[842]: reaped child process 1474, status = succeeded5935lb # [ 138.794979] niks3-server[1110]: 2026/09/22 16:06:27 INFO Received uploads request method=POST path=/api/pending_closures5936worker2 # [ 138.843604] nix-grpc-daemon[1255]: time=2026-09-22T16:06:27.473Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5937worker2 # [ 138.845444] nix-grpc-daemon[1255]: time=2026-09-22T16:06:27.473Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5938lb # [ 138.832736] niks3-server[1110]: 2026/09/22 16:06:27 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5939lb # [ 138.847726] niks3-server[1110]: 2026/09/22 16:06:27 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5940lb # [ 138.859836] niks3-server[1110]: 2026/09/22 16:06:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5941worker2 # [ 138.900551] nix-grpc-daemon[1255]: time=2026-09-22T16:06:27.532Z level=INFO msg="Uploading 1 narinfos"5942lb # [ 138.868702] niks3-server[1110]: 2026/09/22 16:06:27 INFO Signed narinfos id=50 count=15943lb # [ 138.874663] niks3-server[1110]: 2026/09/22 16:06:27 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5944lb # [ 138.885356] niks3-server[1110]: 2026/09/22 16:06:27 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5945worker2 # [ 138.927690] nix-grpc-daemon[1255]: time=2026-09-22T16:06:27.559Z level=INFO msg="Upload complete. (293ms)"5946lb # [ 138.894476] niks3-server[1110]: 2026/09/22 16:06:27 INFO Completed upload id=505947lb # [ 138.896909] niks3-server[1110]: 2026/09/22 16:06:27 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5948worker2 # [ 138.941481] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15949worker2 # [ 138.962079] nix-daemon[842]: reaped child process 1428, status = succeeded5950client # [ 138.966523] systemd[1]: rs.service: Deactivated successfully.5951client # [ 138.971753] systemd[1]: rs.service: Consumed 200ms CPU time over 8.698s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.5952worker2 # [ 139.188538] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:27Z level=info event=signal_exit5953lb # [ 139.728105] niks3-server[1110]: 2026/09/22 16:06:28 INFO lead: released remote=192.168.1.4:387465954lb # [ 139.871681] niks3-server[1110]: 2026/09/22 16:06:28 INFO lead: acquired remote=192.168.1.3:404385955worker1 # [ 139.903532] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:28Z level=info event=scheduler_take_over5956worker1 # [ 140.750671] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:29Z level=info event=scheduler_restarting addr=lb:500515957worker2 # [ 140.765853] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:29Z level=info event=scheduler_restarting5958worker2 # [ 140.766521] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:29Z level=info event=scheduler_restarting addr=lb:500515959worker2 # [ 140.766699] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:352225960worker2 # [ 140.766831] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:29Z level=info event=worker_gone addr=192.168.1.3:500515961worker2 # [ 140.767020] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:352225962worker2 # [ 140.767134] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:29Z level=info event=worker_gone addr=192.168.1.4:500515963worker2 # [ 140.817942] nix-daemon[842]: reaped child process 1247, status = succeeded5964worker1 # [ 140.953231] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:29Z level=info event=scheduler_connected addr=lb:500515965worker1 # [ 140.958482] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5966worker2 # [ 140.986002] nix-grpc-daemon[1195]: ts=2026-09-22T16:06:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5967worker1 # [ 141.155029] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:29Z level=info event=scheduler_connected addr=lb:500515968worker1 # [ 141.164625] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:397565969worker1 # [ 141.170681] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05970worker2 # [ 141.244871] nix-grpc-daemon[1195]: E0000 00:00:1790093189.876784 1240 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true5971worker2 # [ 141.251583] nix-grpc-daemon[1195]: E0000 00:00:1790093189.877117 1240 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5972worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.26 seconds)5973client: waiting for success: ! systemctl is-active rs5974client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5975client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5976client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5977client: must fail: journalctl -u rs | grep -q 'reconnecting'5978client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5979lb: must succeed: curl -sf localhost:9901/clusters5980lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5981worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5982worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5983worker2 # [ 142.098990] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5984worker2 # [ 142.103727] systemd[1]: Stopped Nix worker-protocol over gRPC.5985worker2 # [ 142.111333] systemd[1]: nix-grpc-daemon.service: Consumed 2.142s CPU time over 36.086s wall clock time, 39.2M memory peak, 59.3K incoming IP traffic, 133.5K outgoing IP traffic.5986worker2 # [ 142.129133] systemd[1]: Starting scheduler-token.service...5987worker2 # [ 142.206758] systemd[1]: scheduler-token.service: Deactivated successfully.5988worker2 # [ 142.212764] systemd[1]: Finished scheduler-token.service.5989worker2 # [ 142.214493] systemd[1]: scheduler-token.service: Consumed 46ms CPU time over 80ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5990worker2 # [ 142.223197] systemd[1]: Starting Nix worker-protocol over gRPC...5991worker2 # [ 142.342678] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5992worker2 # [ 142.345041] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5993worker2 # [ 142.349060] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15994worker2 # [ 142.355677] nix-grpc-daemon[1484]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5995worker2 # [ 142.372166] nix-grpc-daemon[1484]: E0000 00:00:1790093190.985727 1484 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5996worker2 # [ 142.397232] nix-grpc-daemon[1484]: E0000 00:00:1790093190.987846 1484 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5997worker2 # [ 142.400048] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5998worker2 # [ 142.401859] nix-grpc-daemon[1484]: E0000 00:00:1790093190.995774 1524 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5999worker2 # [ 142.404220] nix-grpc-daemon[1484]: E0000 00:00:1790093191.013873 1524 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6000worker2 # [ 142.409523] nix-grpc-daemon[1484]: E0000 00:00:1790093191.014021 1524 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6001worker2 # [ 142.414005] nix-grpc-daemon[1484]: E0000 00:00:1790093191.028525 1524 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6002worker2 # [ 142.416607] systemd[1]: Started Nix worker-protocol over gRPC.6003worker2 # [ 142.417465] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:31Z level=info event=scheduler_connected addr=lb:500516004worker1 # [ 142.415435] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:31Z level=info event=oidc_jwks provider=mock keys=16005worker1 # [ 142.420063] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:31Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:397566006worker1 # [ 142.425137] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06007lb: must succeed: curl -sf localhost:9901/clusters6008lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6009worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6010worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6011(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.93 seconds)6012subtest: scheduler restart mid-build: build finishes, no double build6013client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid6014client # [ 143.198850] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid.6015client # Running as unit: mid.service; invocation ID: ddd6aed4b88e48afa3f71d3df6227a7d6016client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid, in 0.09 seconds)6017worker2 # [ 143.416517] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:507166018worker2 # [ 143.430755] nix-daemon[842]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)6019client # [ 143.437769] nix[1383]: don't know how to build these paths:6020client # [ 143.439197] nix[1383]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv6021worker1 # [ 143.456757] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:32Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=06022worker1 # [ 143.462531] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:32Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=16023worker1 # [ 143.509922] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:397626024worker1 # [ 143.517347] nix-daemon[848]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)6025worker1 # [ 143.530910] nix-grpc-daemon[1576]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 38 ms (attempt 1/5)6026worker1 # [ 143.574429] nix-grpc-daemon[1576]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 2/5)6027worker1 # [ 143.719473] nix-grpc-daemon[1576]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 353 ms (attempt 3/5)6028worker1 # [ 144.074728] nix-grpc-daemon[1576]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 799 ms (attempt 4/5)6029worker1 # [ 144.877308] nix-grpc-daemon[1576]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6030worker1 # [ 144.882076] nix-grpc-daemon[1576]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6031worker1 # [ 144.906832] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:397626032client # [ 144.921204] nix[1383]: copying 1 paths to 'lb:50051'...6033worker1 # [ 144.923232] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:397626034client # [ 144.925923] nix[1383]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...6035worker1 # [ 144.938746] nix-daemon[848]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)6036worker1 # [ 144.967411] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:33Z level=info event=niks3_push_started pid=17086037worker1 # [ 145.122613] nix-grpc-daemon[1708]: time=2026-09-22T16:06:33.752Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""6038worker1 # [ 145.231085] nix-daemon[848]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6039worker1 # [ 145.251689] nix-daemon[848]: reaped child process 1724, status = succeeded6040worker1 # [ 145.348669] nix-daemon[848]: accepted connection from pid 1726, user nix-grpc-daemon (trusted)6041worker1 # [ 145.364367] nix-daemon[848]: reaped child process 1729, status = succeeded6042lb # [ 145.345025] niks3-server[1110]: 2026/09/22 16:06:33 INFO Received uploads request method=POST path=/api/pending_closures6043worker1 # [ 145.382624] nix-grpc-daemon[1708]: time=2026-09-22T16:06:34.012Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6044worker1 # [ 145.384351] nix-grpc-daemon[1708]: time=2026-09-22T16:06:34.012Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"6045lb # [ 145.378990] niks3-server[1110]: 2026/09/22 16:06:34 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst6046worker1 # [ 145.420071] nix-grpc-daemon[1708]: time=2026-09-22T16:06:34.050Z level=INFO msg="Uploading 1 narinfos"6047lb # [ 145.393482] niks3-server[1110]: 2026/09/22 16:06:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6048lb # [ 145.405214] niks3-server[1110]: 2026/09/22 16:06:34 INFO Signed narinfos id=51 count=16049lb # [ 145.412146] niks3-server[1110]: 2026/09/22 16:06:34 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls6050lb # [ 145.427100] niks3-server[1110]: 2026/09/22 16:06:34 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6051lb # [ 145.437971] niks3-server[1110]: 2026/09/22 16:06:34 INFO Completed upload id=516052worker1 # [ 145.464213] nix-grpc-daemon[1708]: time=2026-09-22T16:06:34.094Z level=INFO msg="Upload complete. (338ms)"6053worker1 # [ 145.472147] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39762 duration_s=0 paths=1 nar_bytes_in=4246054lb # [ 145.456428] niks3-server[1110]: 2026/09/22 16:06:34 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo6055worker1 # [ 145.484516] nix-grpc-daemon[1576]: ts=2026-09-22T16:06:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:397626056worker1 # [ 145.492965] nix-daemon[848]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)6057worker1 # [ 145.498047] nix-daemon[848]: reaped child process 1706, status = succeeded6058worker1 # [ 145.508891] nix-daemon[848]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)6059client # [ 145.506465] nix[1383]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...6060lb: must succeed: curl -sf localhost:9901/clusters6061lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6062lb: must succeed: curl -sf localhost:9901/clusters6063lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6064worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service6065worker1 # [ 147.037381] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1576 (nix-grpc-daemon) on client request.6066worker1 # [ 147.038991] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.6067lb # [ 147.025454] niks3-server[1110]: 2026/09/22 16:06:35 INFO lead: released remote=192.168.1.3:404386068worker1 # [ 147.056982] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL6069worker1 # [ 147.058571] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.6070worker1 # [ 147.059808] systemd[1]: nix-grpc-daemon.service: Consumed 597ms CPU time over 17.320s wall clock time, 34.9M memory peak, 14.5K incoming IP traffic, 23K outgoing IP traffic.6071client # [ 147.057559] nix[1383]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting6072worker2 # [ 147.068495] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:35Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"6073client # [ 147.062619] nix[1383]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again6074worker1 # [ 147.085877] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.6075worker1 # [ 147.087380] systemd[1]: Starting Nix worker-protocol over gRPC...6076lb # [ 147.094420] envoy[896]: conn peer=[2001:db8:1::1]:42168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1542 ms=84736077lb # [ 147.099593] envoy[896]: conn peer=[2001:db8:1::4]:45900 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=19535 tx=1386 ms=347376078lb # [ 147.104745] envoy[896]: conn peer=[2001:db8:1::3]:56072 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=801 tx=376 ms=171186079worker1 # [ 147.180145] nix-daemon[848]: reaped child process 1731, status = succeeded6080worker1 # [ 147.181128] nix-daemon[848]: reaped child process 1696, status = succeeded6081worker1 # [ 147.182280] nix-daemon[1733]: unexpected Nix daemon error: error: interrupted by the user6082worker1 # [ 147.201099] nix-daemon[848]: reaped child process 1733, status = failed with exit code 16083worker1 # [ 147.224612] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6084worker1 # [ 147.226272] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6085worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.23 seconds)6086lb # [ 147.200607] niks3-server[1110]: 2026/09/22 16:06:35 INFO lead: acquired remote=192.168.1.3:521366087client: must succeed: sleep 5.06088worker2 # [ 147.268859] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:35Z level=info event=scheduler_connected addr=lb:500516089worker1 # [ 147.263490] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16090worker1 # [ 147.266843] nix-grpc-daemon[1769]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6091worker1 # [ 147.268677] nix-grpc-daemon[1769]: E0000 00:00:1790093195.840495 1769 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6092worker1 # [ 147.276105] nix-grpc-daemon[1769]: E0000 00:00:1790093195.842369 1769 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6093worker1 # [ 147.280456] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6094worker1 # [ 147.282465] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=scheduler_take_over6095worker1 # [ 147.283581] nix-grpc-daemon[1769]: E0000 00:00:1790093195.861583 1811 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6096worker1 # [ 147.286032] nix-grpc-daemon[1769]: E0000 00:00:1790093195.878233 1811 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6097worker1 # [ 147.288252] nix-grpc-daemon[1769]: E0000 00:00:1790093195.878364 1811 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6098worker1 # [ 147.290563] nix-grpc-daemon[1769]: E0000 00:00:1790093195.893190 1811 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6099worker1 # [ 147.292877] systemd[1]: Started Nix worker-protocol over gRPC.6100worker1 # [ 147.293678] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=oidc_jwks provider=mock keys=16101worker1 # [ 147.294880] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:397906102worker1 # [ 147.296540] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06103worker1 # [ 147.298319] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=scheduler_connected addr=lb:500516104worker1 # [ 147.299535] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:397906105worker1 # [ 147.301069] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=06106worker1 # [ 147.567785] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:36Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=06107worker1 # [ 147.573720] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:36Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=16108worker2 # [ 147.624125] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507166109worker2 # [ 147.640089] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 1/5)6110worker2 # [ 147.670016] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 117 ms (attempt 2/5)6111worker2 # [ 147.788881] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 382 ms (attempt 3/5)6112worker2 # [ 148.174023] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 598 ms (attempt 4/5)6113worker2 # [ 148.773519] nix-grpc-daemon[1484]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6114worker2 # [ 148.780306] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6115worker2 # [ 148.796147] nix-grpc-daemon[1484]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...6116worker2 # [ 148.824541] nix-daemon[842]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)6117client # [ 148.832829] nix[1383]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...6118worker2 # [ 148.846669] nix-daemon[842]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)6119client: (finished: must succeed: sleep 5.0, in 5.05 seconds)6120client: waiting for success: ! systemctl is-active mid6121worker2 # [ 152.669229] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:41Z level=info event=niks3_push_started pid=15906122worker2 # [ 152.745842] nix-daemon[842]: reaped child process 1565, status = succeeded6123worker2 # [ 152.831417] nix-grpc-daemon[1590]: time=2026-09-22T16:06:41.463Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""6124worker2 # [ 152.943986] nix-daemon[842]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)6125worker2 # [ 152.964286] nix-daemon[842]: reaped child process 1606, status = succeeded6126lb # [ 152.937078] niks3-server[1110]: 2026/09/22 16:06:41 INFO Received uploads request method=POST path=/api/pending_closures6127worker2 # [ 152.983604] nix-grpc-daemon[1590]: time=2026-09-22T16:06:41.614Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6128worker2 # [ 152.987078] nix-grpc-daemon[1590]: time=2026-09-22T16:06:41.614Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"6129lb # [ 152.986295] niks3-server[1110]: 2026/09/22 16:06:41 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv6130lb # [ 152.999206] niks3-server[1110]: 2026/09/22 16:06:41 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6131lb # [ 153.014239] niks3-server[1110]: 2026/09/22 16:06:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6132lb # [ 153.028341] niks3-server[1110]: 2026/09/22 16:06:41 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls6133lb # [ 153.040979] niks3-server[1110]: 2026/09/22 16:06:41 INFO Signed narinfos id=52 count=16134worker2 # [ 153.078353] nix-grpc-daemon[1590]: time=2026-09-22T16:06:41.708Z level=INFO msg="Uploading 1 narinfos"6135lb # [ 153.049966] niks3-server[1110]: 2026/09/22 16:06:41 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6136lb # [ 153.058018] niks3-server[1110]: 2026/09/22 16:06:41 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo6137lb # [ 153.066245] niks3-server[1110]: 2026/09/22 16:06:41 INFO Completed upload id=526138worker2 # [ 153.102018] nix-grpc-daemon[1590]: time=2026-09-22T16:06:41.734Z level=INFO msg="Upload complete. (266ms)"6139worker2 # [ 153.115090] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50716 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=16140worker2 # [ 153.133788] nix-daemon[842]: reaped child process 1563, status = succeeded6141client # [ 153.139949] systemd[1]: mid.service: Deactivated successfully.6142client # [ 153.144268] systemd[1]: mid.service: Consumed 203ms CPU time over 9.944s wall clock time, 41.4M memory peak, 8.9K incoming IP traffic, 10.3K outgoing IP traffic.6143client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds)6144client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6145client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)6146(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.58 seconds)6147subtest: interrupting the client stops the build on the worker6148client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr6149client # [ 153.748624] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr.6150client # Running as unit: intr.service; invocation ID: ed8334122e8a4f6cb36e0c025b3f40096151client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr, in 0.05 seconds)6152worker1 # [ 153.927553] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346686153worker1 # [ 153.942247] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6154client # [ 153.958115] nix[1419]: don't know how to build these paths:6155client # [ 153.960072] nix[1419]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6156worker1 # [ 153.974761] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:42Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=06157worker1 # [ 153.981599] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:42Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=16158worker1 # [ 154.022651] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686159worker1 # [ 154.038231] nix-grpc-daemon[1769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 1/5)6160worker1 # [ 154.143258] nix-grpc-daemon[1769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 152 ms (attempt 2/5)6161worker1 # [ 154.305013] nix-grpc-daemon[1769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 216 ms (attempt 3/5)6162worker1 # [ 154.522790] nix-grpc-daemon[1769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 4/5)6163worker1 # [ 154.639058] nix-grpc-daemon[1769]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6164worker1 # [ 154.645244] nix-grpc-daemon[1769]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6165worker1 # [ 154.664045] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686166client # [ 154.676400] nix[1419]: copying 1 paths to 'lb:50051'...6167worker1 # [ 154.679707] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686168client # [ 154.679449] nix[1419]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...6169worker1 # [ 154.696773] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6170worker1 # [ 154.724629] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:43Z level=info event=niks3_push_started pid=18466171worker1 # [ 154.877254] nix-grpc-daemon[1846]: time=2026-09-22T16:06:43.507Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""6172worker1 # [ 155.007779] nix-daemon[848]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)6173worker1 # [ 155.037055] nix-daemon[848]: reaped child process 1866, status = succeeded6174worker1 # [ 155.134091] nix-daemon[848]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)6175worker1 # [ 155.155150] nix-daemon[848]: reaped child process 1871, status = succeeded6176lb # [ 155.129537] niks3-server[1110]: 2026/09/22 16:06:43 INFO Received uploads request method=POST path=/api/pending_closures6177worker1 # [ 155.168081] nix-grpc-daemon[1846]: time=2026-09-22T16:06:43.797Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6178worker1 # [ 155.169856] nix-grpc-daemon[1846]: time=2026-09-22T16:06:43.797Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"6179lb # [ 155.170843] niks3-server[1110]: 2026/09/22 16:06:43 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst6180worker1 # [ 155.209672] nix-grpc-daemon[1846]: time=2026-09-22T16:06:43.839Z level=INFO msg="Uploading 1 narinfos"6181lb # [ 155.183031] niks3-server[1110]: 2026/09/22 16:06:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6182lb # [ 155.198027] niks3-server[1110]: 2026/09/22 16:06:43 INFO Signed narinfos id=53 count=16183lb # [ 155.206100] niks3-server[1110]: 2026/09/22 16:06:43 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls6184worker1 # [ 155.240460] nix-grpc-daemon[1846]: time=2026-09-22T16:06:43.871Z level=INFO msg="Upload complete. (359ms)"6185lb # [ 155.214510] niks3-server[1110]: 2026/09/22 16:06:43 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6186lb # [ 155.218743] niks3-server[1110]: 2026/09/22 16:06:43 INFO Completed upload id=536187lb # [ 155.222023] niks3-server[1110]: 2026/09/22 16:06:43 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo6188worker1 # [ 155.252929] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=4246189worker1 # [ 155.266768] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686190worker1 # [ 155.272842] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6191worker1 # [ 155.277926] nix-daemon[848]: reaped child process 1844, status = succeeded6192worker1 # [ 155.289225] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6193client # [ 155.287591] nix[1419]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...6194client: must succeed: systemctl kill -s INT intr6195worker1 # [ 156.284296] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:44Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6196client # [ 156.281296] systemd[1]: intr.service: Sent signal SIGINT to main process 1419 (nix) on client request.6197client # [ 156.291505] nix[1419]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6198client # [ 156.305389] nix[1419]: error: interrupted by the user6199client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)6200worker1 # [ 156.318233] nix-daemon[1875]: unexpected Nix daemon error: error: interrupted by the user6201worker1 # [ 156.328390] nix-daemon[848]: reaped child process 1873, status = succeeded6202client # [ 156.329804] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6203worker1 # [ 156.334515] nix-daemon[848]: reaped child process 1875, status = failed with exit code 16204client # [ 156.334961] systemd[1]: intr.service: Failed with result 'exit-code'.6205client # [ 156.337402] systemd[1]: intr.service: Consumed 168ms CPU time over 2.584s wall clock time, 41.5M memory peak, 6.5K incoming IP traffic, 8.2K outgoing IP traffic.6206(finished: subtest: interrupting the client stops the build on the worker, in 2.71 seconds)6207subtest: a deploy mid-build drains: the build finishes, the new generation takes over6208client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw6209client # [ 156.485039] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw.6210client # Running as unit: sw.service; invocation ID: 6cb4753db95640f7825f323db17013fa6211client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw, in 0.08 seconds)6212client # [ 156.698873] nix[1440]: don't know how to build these paths:6213client # [ 156.699847] nix[1440]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6214worker1 # [ 156.697321] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346686215worker1 # [ 156.712169] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:45Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=06216worker1 # [ 156.718030] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:45Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=16217worker2 # [ 156.769318] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507166218worker2 # [ 156.785619] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507166219client # [ 156.788141] nix[1440]: copying 1 paths to 'lb:50051'...6220worker2 # [ 156.800129] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:507166221client # [ 156.792213] nix[1440]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...6222worker2 # [ 156.815923] nix-daemon[842]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)6223worker2 # [ 156.978066] nix-daemon[842]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)6224worker2 # [ 156.996954] nix-daemon[842]: reaped child process 1633, status = succeeded6225worker2 # [ 157.098167] nix-daemon[842]: accepted connection from pid 1635, user nix-grpc-daemon (trusted)6226worker2 # [ 157.113614] nix-daemon[842]: reaped child process 1638, status = succeeded6227lb # [ 157.086266] niks3-server[1110]: 2026/09/22 16:06:45 INFO Received uploads request method=POST path=/api/pending_closures6228lb # [ 157.095990] envoy[896]: conn peer=[2001:db8:1::1]:44702 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3914 tx=1964 ms=97166229worker2 # [ 157.138231] nix-grpc-daemon[1590]: time=2026-09-22T16:06:45.769Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6230worker2 # [ 157.139696] nix-grpc-daemon[1590]: time=2026-09-22T16:06:45.769Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"6231lb # [ 157.102082] envoy[896]: conn peer=[2001:db8:1::1]:60796 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2987 tx=827 ms=23916232lb # [ 157.127020] niks3-server[1110]: 2026/09/22 16:06:45 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst6233lb # [ 157.141863] niks3-server[1110]: 2026/09/22 16:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6234worker2 # [ 157.182434] nix-grpc-daemon[1590]: time=2026-09-22T16:06:45.814Z level=INFO msg="Uploading 1 narinfos"6235lb # [ 157.149088] niks3-server[1110]: 2026/09/22 16:06:45 INFO Signed narinfos id=54 count=16236lb # [ 157.156632] niks3-server[1110]: 2026/09/22 16:06:45 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls6237lb # [ 157.166528] niks3-server[1110]: 2026/09/22 16:06:45 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6238lb # [ 157.172412] niks3-server[1110]: 2026/09/22 16:06:45 INFO Completed upload id=546239worker2 # [ 157.206745] nix-grpc-daemon[1590]: time=2026-09-22T16:06:45.839Z level=INFO msg="Upload complete. (373ms)"6240lb # [ 157.179945] niks3-server[1110]: 2026/09/22 16:06:45 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo6241worker2 # [ 157.215777] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50716 duration_s=0 paths=1 nar_bytes_in=4166242worker2 # [ 157.231747] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507166243worker2 # [ 157.237943] nix-daemon[842]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)6244worker2 # [ 157.243103] nix-daemon[842]: reaped child process 1628, status = succeeded6245worker2 # [ 157.255308] nix-daemon[842]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)6246client # [ 157.243491] nix[1440]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...6247worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26248worker2 # Checking switch inhibitors... done6249worker2 # activating the configuration...6250worker2 # [ 159.519831] nixos[1675]: switching to system configuration /nix/store/5z1z28f0c1svdppr8nf8pgwmgxnlj7by-nixos-system-worker2-test6251worker2 # [ 159.525770] systemd[1]: Stopped target Local File Systems.6252worker2 # [ 159.526597] systemd[1]: Stopped target Remote File Systems.6253worker2 # setting up /etc...6254worker2 # [ 160.077368] systemd[1]: Reload requested from client PID 1675 ('.switch-to-conf') (unit backdoor.service)...6255worker2 # [ 160.079238] systemd[1]: Reloading...6256worker2 # [ 164.984388] systemd[1]: Reloading finished in 4902 ms.6257worker2 # restarting sysinit-reactivation.target6258worker2 # [ 165.118826] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6259worker2 # [ 165.245540] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6260worker2 # [ 165.246743] systemd[1]: Reached target Reactivate sysinit units.6261worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6262worker2 # [ 165.251242] systemd[1]: Reloading D-Bus System Message Bus...6263worker2 # [ 165.261138] dbus-broker-launch[488]: Caught SIGHUP, trigger reload.6264worker2 # [ 165.262055] systemd[1]: Reloading Nix worker-protocol over gRPC...6265worker2 # [ 165.274109] dbus-broker-launch[488]: Looking up NSS user entry for 'systemd-timesync'...6266worker2 # [ 165.285494] dbus-broker-launch[488]: NSS returned no entry for 'systemd-timesync'6267worker2 # [ 165.286544] dbus-broker-launch[488]: Invalid user-name in /nix/store/ng2ydfkv03gvmdws4f4mjf9wj6qj3kq6-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6268worker2 # [ 165.300556] systemd[1]: Reloaded Nix worker-protocol over gRPC.6269worker2 # [ 165.319308] systemd[1]: Reloaded D-Bus System Message Bus.6270worker2 # [ 165.323416] systemd[1]: Reached target Remote File Systems.6271worker2 # [ 165.329789] systemd[1]: Starting linger-users.service...6272worker2 # [ 165.339245] systemd[1]: Reached target Local File Systems.6273worker2 # [ 165.345152] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6274worker2 # [ 165.346629] systemd[1]: Starting Create SUID/SGID Wrappers...6275worker2 # [ 165.347426] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6276worker2 # [ 165.364179] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676277worker2 # [ 165.366288] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6278worker2 # [ 165.381005] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6279worker2 # [ 165.382680] nix-grpc-daemon[1484]: ts=2026-09-22T16:06:54Z level=info event=draining6280worker2 # [ 165.392636] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6281worker2 # [ 165.397774] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6282worker2 # [ 165.399068] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6283worker2 # [ 165.407471] systemd[1]: linger-users.service: Deactivated successfully.6284worker2 # [ 165.410328] systemd[1]: Finished linger-users.service.6285worker2 # [ 165.696971] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6286worker2 # [ 165.698018] systemd[1]: Finished Create SUID/SGID Wrappers.6287worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6288worker2 # [ 165.950613] nixos[1675]: finished switching to system configuration /nix/store/5z1z28f0c1svdppr8nf8pgwmgxnlj7by-nixos-system-worker2-test6289worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 6.87 seconds)6290worker2: must succeed: pgrep -f 'read -t [9]0 x'6291worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6292client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&26293client # don't know how to build these paths:6294client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6295worker1 # [ 166.223959] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346686296worker1 # [ 166.231172] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686297worker1 # [ 166.253397] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:54Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=06298worker1 # [ 166.265702] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:54Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=16299worker1 # [ 166.298504] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686300worker1 # [ 166.319928] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686301client # copying 1 paths to 'lb:50051'...6302worker1 # [ 166.336527] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686303client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...6304worker1 # [ 166.359745] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6305worker1 # [ 166.521404] nix-daemon[848]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6306worker1 # [ 166.543260] nix-daemon[848]: reaped child process 1925, status = succeeded6307worker1 # [ 166.642592] nix-daemon[848]: accepted connection from pid 1927, user nix-grpc-daemon (trusted)6308worker1 # [ 166.660776] nix-daemon[848]: reaped child process 1930, status = succeeded6309lb # [ 166.642002] niks3-server[1110]: 2026/09/22 16:06:55 INFO Received uploads request method=POST path=/api/pending_closures6310worker1 # [ 166.678685] nix-grpc-daemon[1846]: time=2026-09-22T16:06:55.308Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6311worker1 # [ 166.680368] nix-grpc-daemon[1846]: time=2026-09-22T16:06:55.308Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"6312lb # [ 166.671656] niks3-server[1110]: 2026/09/22 16:06:55 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst6313worker1 # [ 166.720297] nix-grpc-daemon[1846]: time=2026-09-22T16:06:55.350Z level=INFO msg="Uploading 1 narinfos"6314lb # [ 166.688200] niks3-server[1110]: 2026/09/22 16:06:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6315lb # [ 166.701669] niks3-server[1110]: 2026/09/22 16:06:55 INFO Signed narinfos id=55 count=16316lb # [ 166.712101] niks3-server[1110]: 2026/09/22 16:06:55 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls6317worker1 # [ 166.747136] nix-grpc-daemon[1846]: time=2026-09-22T16:06:55.377Z level=INFO msg="Upload complete. (370ms)"6318lb # [ 166.722835] niks3-server[1110]: 2026/09/22 16:06:55 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6319lb # [ 166.729606] niks3-server[1110]: 2026/09/22 16:06:55 INFO Completed upload id=556320worker1 # [ 166.756315] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=5286321lb # [ 166.732854] niks3-server[1110]: 2026/09/22 16:06:55 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo6322worker1 # [ 166.771487] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686323worker1 # [ 166.777977] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6324worker1 # [ 166.782592] nix-daemon[848]: reaped child process 1920, status = succeeded6325worker1 # [ 166.793138] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6326client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...6327client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6328client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6329client # farm-a> LOG-farm-a-during-drain6330worker1 # [ 167.672202] nix-daemon[848]: reaped child process 1934, status = succeeded6331worker1 # [ 167.777022] nix-daemon[848]: accepted connection from pid 1950, user nix-grpc-daemon (trusted)6332worker1 # [ 167.795426] nix-daemon[848]: reaped child process 1953, status = succeeded6333lb # [ 167.773665] niks3-server[1110]: 2026/09/22 16:06:56 INFO Received uploads request method=POST path=/api/pending_closures6334worker1 # [ 167.812458] nix-grpc-daemon[1846]: time=2026-09-22T16:06:56.441Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6335worker1 # [ 167.814309] nix-grpc-daemon[1846]: time=2026-09-22T16:06:56.441Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"6336lb # [ 167.817559] niks3-server[1110]: 2026/09/22 16:06:56 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6337worker1 # [ 167.859433] nix-grpc-daemon[1846]: time=2026-09-22T16:06:56.489Z level=INFO msg="Uploading 1 narinfos"6338lb # [ 167.832625] niks3-server[1110]: 2026/09/22 16:06:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6339lb # [ 167.846291] niks3-server[1110]: 2026/09/22 16:06:56 INFO Signed narinfos id=56 count=16340lb # [ 167.853045] niks3-server[1110]: 2026/09/22 16:06:56 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls6341lb # [ 167.865745] niks3-server[1110]: 2026/09/22 16:06:56 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6342worker1 # [ 167.901207] nix-grpc-daemon[1846]: time=2026-09-22T16:06:56.531Z level=INFO msg="Upload complete. (296ms)"6343lb # [ 167.877339] niks3-server[1110]: 2026/09/22 16:06:56 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6344lb # [ 167.883678] niks3-server[1110]: 2026/09/22 16:06:56 INFO Completed upload id=566345lb # [ 167.887084] niks3-server[1110]: 2026/09/22 16:06:56 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo6346worker1 # [ 167.916940] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=16347worker1 # [ 167.939688] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:56Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=06348worker1 # [ 167.944550] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:56Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=16349worker1 # [ 167.949002] nix-daemon[848]: reaped child process 1932, status = succeeded6350worker1 # [ 167.979200] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686351worker1 # [ 167.994639] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686352worker1 # [ 168.009123] nix-grpc-daemon[1846]: time=2026-09-22T16:06:56.639Z level=INFO msg="All 1 paths already cached"6353client # copying 1 paths to 'lb:50051'...6354worker1 # [ 168.021381] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686355client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...6356worker1 # [ 168.043947] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6357worker1 # [ 168.205330] nix-daemon[848]: accepted connection from pid 1959, user nix-grpc-daemon (trusted)6358worker1 # [ 168.222066] nix-daemon[848]: reaped child process 1962, status = succeeded6359worker1 # [ 168.325870] nix-daemon[848]: accepted connection from pid 1964, user nix-grpc-daemon (trusted)6360worker1 # [ 168.342103] nix-daemon[848]: reaped child process 1967, status = succeeded6361lb # [ 168.320960] niks3-server[1110]: 2026/09/22 16:06:56 INFO Received uploads request method=POST path=/api/pending_closures6362worker1 # [ 168.356094] nix-grpc-daemon[1846]: time=2026-09-22T16:06:56.986Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6363worker1 # [ 168.357582] nix-grpc-daemon[1846]: time=2026-09-22T16:06:56.986Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"6364lb # [ 168.347011] niks3-server[1110]: 2026/09/22 16:06:56 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst6365worker1 # [ 168.387976] nix-grpc-daemon[1846]: time=2026-09-22T16:06:57.018Z level=INFO msg="Uploading 1 narinfos"6366lb # [ 168.361794] niks3-server[1110]: 2026/09/22 16:06:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6367lb # [ 168.371636] niks3-server[1110]: 2026/09/22 16:06:56 INFO Signed narinfos id=57 count=16368lb # [ 168.379127] niks3-server[1110]: 2026/09/22 16:06:57 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls6369lb # [ 168.391260] niks3-server[1110]: 2026/09/22 16:06:57 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6370worker1 # [ 168.424347] nix-grpc-daemon[1846]: time=2026-09-22T16:06:57.055Z level=INFO msg="Upload complete. (363ms)"6371lb # [ 168.401530] niks3-server[1110]: 2026/09/22 16:06:57 INFO Completed upload id=576372worker1 # [ 168.432141] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=6406373lb # [ 168.405993] niks3-server[1110]: 2026/09/22 16:06:57 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo6374worker1 # [ 168.444092] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686375worker1 # [ 168.453484] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6376worker1 # [ 168.456424] nix-daemon[848]: reaped child process 1957, status = succeeded6377client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...6378worker1 # [ 168.469600] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6379client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6380client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6381client # farm-b> LOG-farm-b-during-drain6382worker1 # [ 169.693672] nix-daemon[848]: reaped child process 1971, status = succeeded6383worker1 # [ 169.801765] nix-daemon[848]: accepted connection from pid 1987, user nix-grpc-daemon (trusted)6384worker1 # [ 169.819641] nix-daemon[848]: reaped child process 1990, status = succeeded6385lb # [ 169.801404] niks3-server[1110]: 2026/09/22 16:06:58 INFO Received uploads request method=POST path=/api/pending_closures6386worker1 # [ 169.839300] nix-grpc-daemon[1846]: time=2026-09-22T16:06:58.469Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6387worker1 # [ 169.840902] nix-grpc-daemon[1846]: time=2026-09-22T16:06:58.469Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"6388lb # [ 169.839249] niks3-server[1110]: 2026/09/22 16:06:58 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6389lb # [ 169.850314] niks3-server[1110]: 2026/09/22 16:06:58 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst6390worker1 # [ 169.890349] nix-grpc-daemon[1846]: time=2026-09-22T16:06:58.520Z level=INFO msg="Uploading 1 narinfos"6391lb # [ 169.866639] niks3-server[1110]: 2026/09/22 16:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6392lb # [ 169.876823] niks3-server[1110]: 2026/09/22 16:06:58 INFO Signed narinfos id=58 count=16393lb # [ 169.887086] niks3-server[1110]: 2026/09/22 16:06:58 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls6394worker1 # [ 169.920330] nix-grpc-daemon[1846]: time=2026-09-22T16:06:58.551Z level=INFO msg="Upload complete. (241ms)"6395lb # [ 169.895737] niks3-server[1110]: 2026/09/22 16:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6396lb # [ 169.900992] niks3-server[1110]: 2026/09/22 16:06:58 INFO Completed upload id=586397worker1 # [ 169.927883] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=16398lb # [ 169.904781] niks3-server[1110]: 2026/09/22 16:06:58 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo6399worker1 # [ 169.936967] nix-daemon[848]: reaped child process 1969, status = succeeded6400worker1 # [ 169.939955] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:58Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=06401worker1 # [ 169.942621] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:58Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=16402worker1 # [ 169.991312] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686403worker1 # [ 170.006131] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686404worker1 # [ 170.020579] nix-grpc-daemon[1846]: time=2026-09-22T16:06:58.651Z level=INFO msg="All 2 paths already cached"6405client # copying 1 paths to 'lb:50051'...6406worker1 # [ 170.032123] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686407client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...6408worker1 # [ 170.054572] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6409worker1 # [ 170.219150] nix-daemon[848]: accepted connection from pid 1996, user nix-grpc-daemon (trusted)6410worker1 # [ 170.246126] nix-daemon[848]: reaped child process 1999, status = succeeded6411worker1 # [ 170.340397] nix-daemon[848]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)6412worker1 # [ 170.359773] nix-daemon[848]: reaped child process 2004, status = succeeded6413lb # [ 170.334848] niks3-server[1110]: 2026/09/22 16:06:58 INFO Received uploads request method=POST path=/api/pending_closures6414worker1 # [ 170.370397] nix-grpc-daemon[1846]: time=2026-09-22T16:06:59.000Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6415worker1 # [ 170.371984] nix-grpc-daemon[1846]: time=2026-09-22T16:06:59.000Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"6416lb # [ 170.365439] niks3-server[1110]: 2026/09/22 16:06:58 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst6417worker1 # [ 170.403584] nix-grpc-daemon[1846]: time=2026-09-22T16:06:59.034Z level=INFO msg="Uploading 1 narinfos"6418lb # [ 170.380079] niks3-server[1110]: 2026/09/22 16:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6419lb # [ 170.389951] niks3-server[1110]: 2026/09/22 16:06:59 INFO Signed narinfos id=59 count=16420worker1 # [ 170.436002] nix-grpc-daemon[1846]: time=2026-09-22T16:06:59.066Z level=INFO msg="Upload complete. (363ms)"6421lb # [ 170.402587] niks3-server[1110]: 2026/09/22 16:06:59 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6422lb # [ 170.419707] niks3-server[1110]: 2026/09/22 16:06:59 INFO Completed upload id=596423worker1 # [ 170.444123] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=7686424lb # [ 170.428906] niks3-server[1110]: 2026/09/22 16:06:59 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo6425worker1 # [ 170.458858] nix-grpc-daemon[1769]: ts=2026-09-22T16:06:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686426worker1 # [ 170.464966] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6427worker1 # [ 170.469955] nix-daemon[848]: reaped child process 1994, status = succeeded6428lb # [ 170.442960] niks3-server[1110]: 2026/09/22 16:06:59 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls6429client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...6430client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6431worker1 # [ 170.482788] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6432client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6433client # farm-top> LOG-farm-top-during-drain6434worker1 # [ 171.568794] nix-daemon[848]: reaped child process 2008, status = succeeded6435worker1 # [ 171.667922] nix-daemon[848]: accepted connection from pid 2024, user nix-grpc-daemon (trusted)6436worker1 # [ 171.689337] nix-daemon[848]: reaped child process 2027, status = succeeded6437lb # [ 171.669304] niks3-server[1110]: 2026/09/22 16:07:00 INFO Received uploads request method=POST path=/api/pending_closures6438worker1 # [ 171.712528] nix-grpc-daemon[1846]: time=2026-09-22T16:07:00.341Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6439worker1 # [ 171.714569] nix-grpc-daemon[1846]: time=2026-09-22T16:07:00.341Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"6440lb # [ 171.710579] niks3-server[1110]: 2026/09/22 16:07:00 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6441lb # [ 171.727747] niks3-server[1110]: 2026/09/22 16:07:00 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst6442lb # [ 171.741788] niks3-server[1110]: 2026/09/22 16:07:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6443worker1 # [ 171.768814] nix-grpc-daemon[1846]: time=2026-09-22T16:07:00.399Z level=INFO msg="Uploading 1 narinfos"6444lb # [ 171.749832] niks3-server[1110]: 2026/09/22 16:07:00 INFO Signed narinfos id=60 count=16445lb # [ 171.757998] niks3-server[1110]: 2026/09/22 16:07:00 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls6446lb # [ 171.767128] niks3-server[1110]: 2026/09/22 16:07:00 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6447lb # [ 171.781881] niks3-server[1110]: 2026/09/22 16:07:00 INFO Completed upload id=606448worker1 # [ 171.808495] nix-grpc-daemon[1846]: time=2026-09-22T16:07:00.439Z level=INFO msg="Upload complete. (313ms)"6449lb # [ 171.785660] niks3-server[1110]: 2026/09/22 16:07:00 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo6450worker1 # [ 171.821164] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=16451worker1 # [ 171.843093] nix-daemon[848]: reaped child process 2006, status = succeeded6452client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2, in 5.86 seconds)6453client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath6454client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath, in 0.18 seconds)6455worker2: must succeed: pkill -f 'read -t [9]0 x'6456worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6457client: waiting for success: ! systemctl is-active sw6458worker2 # [ 172.340891] nix-daemon[842]: reaped child process 1642, status = succeeded6459worker2 # [ 172.470308] nix-daemon[842]: accepted connection from pid 1815, user nix-grpc-daemon (trusted)6460worker2 # [ 172.493839] nix-daemon[842]: reaped child process 1818, status = succeeded6461lb # [ 172.457098] niks3-server[1110]: 2026/09/22 16:07:01 INFO Received uploads request method=POST path=/api/pending_closures6462worker2 # [ 172.503116] nix-grpc-daemon[1590]: time=2026-09-22T16:07:01.134Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6463worker2 # [ 172.504806] nix-grpc-daemon[1590]: time=2026-09-22T16:07:01.134Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"6464lb # [ 172.485844] niks3-server[1110]: 2026/09/22 16:07:01 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6465lb # [ 172.509912] niks3-server[1110]: 2026/09/22 16:07:01 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6466lb # [ 172.525042] niks3-server[1110]: 2026/09/22 16:07:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6467worker2 # [ 172.561981] nix-grpc-daemon[1590]: time=2026-09-22T16:07:01.192Z level=INFO msg="Uploading 1 narinfos"6468lb # [ 172.533211] niks3-server[1110]: 2026/09/22 16:07:01 INFO Signed narinfos id=61 count=16469lb # [ 172.540468] niks3-server[1110]: 2026/09/22 16:07:01 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6470worker2 # [ 172.581799] nix-grpc-daemon[1590]: time=2026-09-22T16:07:01.214Z level=INFO msg="Upload complete. (296ms)"6471lb # [ 172.550581] niks3-server[1110]: 2026/09/22 16:07:01 INFO Completed upload id=616472lb # [ 172.556405] niks3-server[1110]: 2026/09/22 16:07:01 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls6473worker2 # [ 172.597299] nix-grpc-daemon[1484]: ts=2026-09-22T16:07:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50716 duration_s=15 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=16474worker2 # [ 172.614425] nix-daemon[842]: reaped child process 1640, status = succeeded6475client # [ 172.622692] systemd[1]: sw.service: Deactivated successfully.6476client # [ 172.628280] systemd[1]: sw.service: Consumed 204ms CPU time over 16.138s wall clock time, 41.5M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.6477client: (finished: waiting for success: ! systemctl is-active sw, in 1.11 seconds)6478client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6479client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)6480worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6481worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.06 seconds)6482lb: waiting until exactly no endpoints of aarch64-linux are unhealthy6483lb: must succeed: curl -sf localhost:9901/clusters6484worker2 # [ 173.372393] nix-grpc-daemon[1484]: ts=2026-09-22T16:07:02Z level=info event=signal_exit6485lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6486lb: must succeed: curl -sf localhost:9901/clusters6487lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6488worker1 # [ 175.367733] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:397906489worker1 # [ 175.372945] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:03Z level=info event=worker_gone addr=192.168.1.4:500516490worker2 # [ 175.375958] nix-grpc-daemon[1484]: ts=2026-09-22T16:07:03Z level=info event=scheduler_restarting6491worker2 # [ 175.404509] nix-grpc-daemon[1484]: ts=2026-09-22T16:07:04Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6492worker2 # [ 175.428662] nix-daemon[842]: reaped child process 1540, status = succeeded6493lb: must succeed: curl -sf localhost:9901/clusters6494lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6495worker2 # [ 176.177813] nix-grpc-daemon[1484]: E0000 00:00:1790093224.809720 1529 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true6496worker2 # [ 176.178228] nix-grpc-daemon[1484]: E0000 00:00:1790093224.809989 1529 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6497worker2 # [ 176.414152] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6498worker2 # [ 176.420741] systemd[1]: nix-grpc-daemon.service: Consumed 942ms CPU time over 34.195s wall clock time, 35.2M memory peak, 20.9K incoming IP traffic, 28.6K outgoing IP traffic.6499lb: must succeed: curl -sf localhost:9901/clusters6500lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6501lb # [ 177.094868] envoy[896]: conn peer=[2001:db8:1::1]:33356 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9621 tx=4393 ms=56206502lb # [ 177.100176] envoy[896]: conn peer=[2001:db8:1::1]:60812 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=1543 ms=159046503lb # [ 177.105287] envoy[896]: conn peer=[2001:db8:1::4]:42108 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2255 tx=442 ms=329796504worker2 # [ 177.410474] systemd[1]: Starting scheduler-token.service...6505worker2 # [ 177.502468] systemd[1]: scheduler-token.service: Deactivated successfully.6506worker2 # [ 177.512764] systemd[1]: Finished scheduler-token.service.6507worker2 # [ 177.514774] systemd[1]: scheduler-token.service: Consumed 61ms CPU time over 96ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6508worker2 # [ 177.533964] systemd[1]: Starting Nix worker-protocol over gRPC...6509lb: must succeed: curl -sf localhost:9901/clusters6510worker2 # [ 177.659133] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:06Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6511worker2 # [ 177.661641] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6512worker2 # [ 177.665489] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16513lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6514worker2 # [ 177.672066] nix-grpc-daemon[1833]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6515worker2 # [ 177.673505] nix-grpc-daemon[1833]: E0000 00:00:1790093226.302208 1833 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6516worker2 # [ 177.675815] nix-grpc-daemon[1833]: E0000 00:00:1790093226.304365 1833 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6517worker2 # [ 177.690956] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6518worker2 # [ 177.726618] systemd[1]: Started Nix worker-protocol over gRPC.6519worker2 # [ 177.727624] nix-grpc-daemon[1833]: E0000 00:00:1790093226.323547 1875 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6520worker2 # [ 177.730161] nix-grpc-daemon[1833]: E0000 00:00:1790093226.340872 1875 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6521worker2 # [ 177.735191] nix-grpc-daemon[1833]: E0000 00:00:1790093226.341022 1875 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6522worker2 # [ 177.740211] nix-grpc-daemon[1833]: E0000 00:00:1790093226.355795 1875 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6523worker2 # [ 177.742751] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:06Z level=info event=scheduler_connected addr=lb:500516524worker1 # [ 177.735000] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:06Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:397906525worker1 # [ 177.740923] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06526lb: must succeed: curl -sf localhost:9901/clusters6527lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6528lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 5.41 seconds)6529lb: must succeed: curl -sf localhost:9901/clusters6530lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6531worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6532worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6533(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 22.43 seconds)6534subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6535client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16536worker1 # [ 179.080637] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346686537worker1 # [ 179.086962] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686538worker1 # [ 179.130812] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:07Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=06539worker1 # [ 179.137953] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:07Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=16540worker1 # [ 179.143962] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:07Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=06541worker1 # [ 179.149152] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:07Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=06542worker1 # [ 179.178770] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686543worker1 # [ 179.194951] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686544worker1 # [ 179.210191] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686545worker1 # [ 179.225232] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6546worker1 # [ 179.382810] nix-daemon[848]: accepted connection from pid 2036, user nix-grpc-daemon (trusted)6547worker1 # [ 179.404440] nix-daemon[848]: reaped child process 2039, status = succeeded6548worker1 # [ 179.511781] nix-daemon[848]: accepted connection from pid 2041, user nix-grpc-daemon (trusted)6549worker1 # [ 179.531412] nix-daemon[848]: reaped child process 2044, status = succeeded6550lb # [ 179.510839] niks3-server[1110]: 2026/09/22 16:07:08 INFO Received uploads request method=POST path=/api/pending_closures6551worker1 # [ 179.548199] nix-grpc-daemon[1846]: time=2026-09-22T16:07:08.178Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6552worker1 # [ 179.549700] nix-grpc-daemon[1846]: time=2026-09-22T16:07:08.178Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"6553lb # [ 179.541524] niks3-server[1110]: 2026/09/22 16:07:08 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst6554worker1 # [ 179.588551] nix-grpc-daemon[1846]: time=2026-09-22T16:07:08.219Z level=INFO msg="Uploading 1 narinfos"6555lb # [ 179.556533] niks3-server[1110]: 2026/09/22 16:07:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6556lb # [ 179.567521] niks3-server[1110]: 2026/09/22 16:07:08 INFO Signed narinfos id=62 count=16557lb # [ 179.573917] niks3-server[1110]: 2026/09/22 16:07:08 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls6558lb # [ 179.583041] niks3-server[1110]: 2026/09/22 16:07:08 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6559worker1 # [ 179.619729] nix-grpc-daemon[1846]: time=2026-09-22T16:07:08.250Z level=INFO msg="Upload complete. (377ms)"6560lb # [ 179.594557] niks3-server[1110]: 2026/09/22 16:07:08 INFO Completed upload id=626561lb # [ 179.598949] niks3-server[1110]: 2026/09/22 16:07:08 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo6562worker1 # [ 179.628282] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=5126563worker1 # [ 179.644356] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686564worker1 # [ 179.651180] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6565worker1 # [ 179.655663] nix-daemon[848]: reaped child process 2034, status = succeeded6566worker1 # [ 179.665640] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6567worker1 # [ 180.944758] nix-daemon[848]: reaped child process 2048, status = succeeded6568worker1 # [ 181.045471] nix-daemon[848]: accepted connection from pid 2064, user nix-grpc-daemon (trusted)6569worker1 # [ 181.067658] nix-daemon[848]: reaped child process 2067, status = succeeded6570lb # [ 181.047398] niks3-server[1110]: 2026/09/22 16:07:09 INFO Received uploads request method=POST path=/api/pending_closures6571worker1 # [ 181.084469] nix-grpc-daemon[1846]: time=2026-09-22T16:07:09.713Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6572worker1 # [ 181.086151] nix-grpc-daemon[1846]: time=2026-09-22T16:07:09.714Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"6573lb # [ 181.090529] niks3-server[1110]: 2026/09/22 16:07:09 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6574lb # [ 181.106141] niks3-server[1110]: 2026/09/22 16:07:09 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv6575lb # [ 181.117489] niks3-server[1110]: 2026/09/22 16:07:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6576worker1 # [ 181.150229] nix-grpc-daemon[1846]: time=2026-09-22T16:07:09.780Z level=INFO msg="Uploading 1 narinfos"6577lb # [ 181.130784] niks3-server[1110]: 2026/09/22 16:07:09 INFO Signed narinfos id=63 count=16578lb # [ 181.137211] niks3-server[1110]: 2026/09/22 16:07:09 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls6579lb # [ 181.147915] niks3-server[1110]: 2026/09/22 16:07:09 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6580worker1 # [ 181.181511] nix-grpc-daemon[1846]: time=2026-09-22T16:07:09.812Z level=INFO msg="Upload complete. (303ms)"6581lb # [ 181.154909] niks3-server[1110]: 2026/09/22 16:07:09 INFO Completed upload id=636582lb # [ 181.160577] niks3-server[1110]: 2026/09/22 16:07:09 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo6583worker1 # [ 181.199820] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=16584worker1 # [ 181.220410] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:09Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=16585worker1 # [ 181.233510] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686586worker1 # [ 181.240331] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:09Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=06587worker1 # [ 181.246559] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686588worker1 # [ 181.261839] nix-daemon[848]: reaped child process 2046, status = succeeded6589worker1 # [ 181.263884] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6590worker1 # [ 181.274778] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686591worker1 # [ 181.406730] nix-daemon[848]: accepted connection from pid 2073, user nix-grpc-daemon (trusted)6592worker1 # [ 181.431577] nix-daemon[848]: reaped child process 2076, status = succeeded6593worker1 # [ 181.529300] nix-daemon[848]: accepted connection from pid 2078, user nix-grpc-daemon (trusted)6594worker1 # [ 181.550148] nix-daemon[848]: reaped child process 2081, status = succeeded6595lb # [ 181.529267] niks3-server[1110]: 2026/09/22 16:07:10 INFO Received uploads request method=POST path=/api/pending_closures6596worker1 # [ 181.565962] nix-grpc-daemon[1846]: time=2026-09-22T16:07:10.196Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6597worker1 # [ 181.567463] nix-grpc-daemon[1846]: time=2026-09-22T16:07:10.196Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"6598lb # [ 181.560985] niks3-server[1110]: 2026/09/22 16:07:10 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst6599worker1 # [ 181.603162] nix-grpc-daemon[1846]: time=2026-09-22T16:07:10.233Z level=INFO msg="Uploading 1 narinfos"6600lb # [ 181.577770] niks3-server[1110]: 2026/09/22 16:07:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6601lb # [ 181.588533] niks3-server[1110]: 2026/09/22 16:07:10 INFO Signed narinfos id=64 count=16602lb # [ 181.594963] niks3-server[1110]: 2026/09/22 16:07:10 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls6603lb # [ 181.605691] niks3-server[1110]: 2026/09/22 16:07:10 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6604worker1 # [ 181.638144] nix-grpc-daemon[1846]: time=2026-09-22T16:07:10.268Z level=INFO msg="Upload complete. (364ms)"6605lb # [ 181.614179] niks3-server[1110]: 2026/09/22 16:07:10 INFO Completed upload id=646606lb # [ 181.617365] niks3-server[1110]: 2026/09/22 16:07:10 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo6607worker1 # [ 181.648364] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=5126608worker1 # [ 181.660766] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686609worker1 # [ 181.672633] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6610worker1 # [ 181.679634] nix-daemon[848]: reaped child process 2071, status = succeeded6611worker1 # [ 181.692259] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6612worker1 # [ 183.204848] nix-daemon[848]: reaped child process 2085, status = succeeded6613worker1 # [ 183.280119] nix-daemon[848]: accepted connection from pid 2101, user nix-grpc-daemon (trusted)6614worker1 # [ 183.300112] nix-daemon[848]: reaped child process 2104, status = succeeded6615lb # [ 183.279811] niks3-server[1110]: 2026/09/22 16:07:11 INFO Received uploads request method=POST path=/api/pending_closures6616worker1 # [ 183.320667] nix-grpc-daemon[1846]: time=2026-09-22T16:07:11.949Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6617worker1 # [ 183.322443] nix-grpc-daemon[1846]: time=2026-09-22T16:07:11.949Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"6618lb # [ 183.324807] niks3-server[1110]: 2026/09/22 16:07:11 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv6619lb # [ 183.344156] niks3-server[1110]: 2026/09/22 16:07:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6620worker1 # [ 183.376210] nix-grpc-daemon[1846]: time=2026-09-22T16:07:12.006Z level=INFO msg="Uploading 1 narinfos"6621lb # [ 183.356096] niks3-server[1110]: 2026/09/22 16:07:11 INFO Signed narinfos id=65 count=16622lb # [ 183.361663] niks3-server[1110]: 2026/09/22 16:07:11 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6623lb # [ 183.371819] niks3-server[1110]: 2026/09/22 16:07:11 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls6624worker1 # [ 183.403857] nix-grpc-daemon[1846]: time=2026-09-22T16:07:12.034Z level=INFO msg="Upload complete. (298ms)"6625lb # [ 183.380173] niks3-server[1110]: 2026/09/22 16:07:11 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6626lb # [ 183.383852] niks3-server[1110]: 2026/09/22 16:07:12 INFO Completed upload id=656627lb # [ 183.389650] niks3-server[1110]: 2026/09/22 16:07:12 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo6628worker1 # [ 183.422342] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=16629worker1 # [ 183.440292] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:12Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=16630worker1 # [ 183.452402] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686631worker1 # [ 183.458614] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:12Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=06632worker1 # [ 183.464570] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686633worker1 # [ 183.469992] nix-daemon[848]: reaped child process 2083, status = succeeded6634worker1 # [ 183.472204] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686635worker1 # [ 183.484095] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6636worker1 # [ 183.616577] nix-daemon[848]: accepted connection from pid 2110, user nix-grpc-daemon (trusted)6637worker1 # [ 183.635503] nix-daemon[848]: reaped child process 2113, status = succeeded6638worker1 # [ 183.735445] nix-daemon[848]: accepted connection from pid 2115, user nix-grpc-daemon (trusted)6639worker1 # [ 183.755389] nix-daemon[848]: reaped child process 2118, status = succeeded6640lb # [ 183.726622] niks3-server[1110]: 2026/09/22 16:07:12 INFO Received uploads request method=POST path=/api/pending_closures6641worker1 # [ 183.762151] nix-grpc-daemon[1846]: time=2026-09-22T16:07:12.392Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6642worker1 # [ 183.763641] nix-grpc-daemon[1846]: time=2026-09-22T16:07:12.392Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"6643lb # [ 183.755114] niks3-server[1110]: 2026/09/22 16:07:12 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst6644lb # [ 183.771369] niks3-server[1110]: 2026/09/22 16:07:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6645worker1 # [ 183.803624] nix-grpc-daemon[1846]: time=2026-09-22T16:07:12.434Z level=INFO msg="Uploading 1 narinfos"6646lb # [ 183.784560] niks3-server[1110]: 2026/09/22 16:07:12 INFO Signed narinfos id=66 count=16647lb # [ 183.795695] niks3-server[1110]: 2026/09/22 16:07:12 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls6648worker1 # [ 183.829163] nix-grpc-daemon[1846]: time=2026-09-22T16:07:12.459Z level=INFO msg="Upload complete. (335ms)"6649lb # [ 183.805024] niks3-server[1110]: 2026/09/22 16:07:12 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6650lb # [ 183.810291] niks3-server[1110]: 2026/09/22 16:07:12 INFO Completed upload id=666651worker1 # [ 183.836237] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=5126652lb # [ 183.814692] niks3-server[1110]: 2026/09/22 16:07:12 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo6653worker1 # [ 183.850006] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686654worker1 # [ 183.855692] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6655worker1 # [ 183.860961] nix-daemon[848]: reaped child process 2108, status = succeeded6656worker1 # [ 183.873216] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6657worker1 # [ 184.952995] nix-daemon[848]: reaped child process 2122, status = succeeded6658worker1 # [ 185.049472] nix-daemon[848]: accepted connection from pid 2138, user nix-grpc-daemon (trusted)6659worker1 # [ 185.069708] nix-daemon[848]: reaped child process 2141, status = succeeded6660lb # [ 185.050109] niks3-server[1110]: 2026/09/22 16:07:13 INFO Received uploads request method=POST path=/api/pending_closures6661worker1 # [ 185.087587] nix-grpc-daemon[1846]: time=2026-09-22T16:07:13.716Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6662worker1 # [ 185.089747] nix-grpc-daemon[1846]: time=2026-09-22T16:07:13.716Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"6663lb # [ 185.088247] niks3-server[1110]: 2026/09/22 16:07:13 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv6664lb # [ 185.101125] niks3-server[1110]: 2026/09/22 16:07:13 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6665worker1 # [ 185.141856] nix-grpc-daemon[1846]: time=2026-09-22T16:07:13.772Z level=INFO msg="Uploading 1 narinfos"6666lb # [ 185.115011] niks3-server[1110]: 2026/09/22 16:07:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6667lb # [ 185.125983] niks3-server[1110]: 2026/09/22 16:07:13 INFO Signed narinfos id=67 count=16668lb # [ 185.132877] niks3-server[1110]: 2026/09/22 16:07:13 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls6669lb # [ 185.144195] niks3-server[1110]: 2026/09/22 16:07:13 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6670lb # [ 185.152861] niks3-server[1110]: 2026/09/22 16:07:13 INFO Completed upload id=676671worker1 # [ 185.178960] nix-grpc-daemon[1846]: time=2026-09-22T16:07:13.809Z level=INFO msg="Upload complete. (296ms)"6672lb # [ 185.156903] niks3-server[1110]: 2026/09/22 16:07:13 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo6673worker1 # [ 185.197465] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=16674worker1 # [ 185.220639] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:13Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=16675worker1 # [ 185.224888] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686676worker1 # [ 185.230028] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:13Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=06677worker1 # [ 185.235367] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686678worker1 # [ 185.241499] nix-daemon[848]: reaped child process 2120, status = succeeded6679worker1 # [ 185.243416] nix-grpc-daemon[1846]: time=2026-09-22T16:07:13.870Z level=INFO msg="All 1 paths already cached"6680worker1 # [ 185.247279] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686681worker1 # [ 185.258573] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6682worker1 # [ 185.392051] nix-daemon[848]: accepted connection from pid 2147, user nix-grpc-daemon (trusted)6683worker1 # [ 185.411188] nix-daemon[848]: reaped child process 2150, status = succeeded6684worker1 # [ 185.520059] nix-daemon[848]: accepted connection from pid 2152, user nix-grpc-daemon (trusted)6685worker1 # [ 185.544389] nix-daemon[848]: reaped child process 2155, status = succeeded6686lb # [ 185.516105] niks3-server[1110]: 2026/09/22 16:07:14 INFO Received uploads request method=POST path=/api/pending_closures6687worker1 # [ 185.551981] nix-grpc-daemon[1846]: time=2026-09-22T16:07:14.182Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6688worker1 # [ 185.553830] nix-grpc-daemon[1846]: time=2026-09-22T16:07:14.182Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6689lb # [ 185.547280] niks3-server[1110]: 2026/09/22 16:07:14 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6690worker1 # [ 185.590336] nix-grpc-daemon[1846]: time=2026-09-22T16:07:14.220Z level=INFO msg="Uploading 1 narinfos"6691lb # [ 185.564726] niks3-server[1110]: 2026/09/22 16:07:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6692lb # [ 185.573741] niks3-server[1110]: 2026/09/22 16:07:14 INFO Signed narinfos id=68 count=16693lb # [ 185.580986] niks3-server[1110]: 2026/09/22 16:07:14 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6694lb # [ 185.592677] niks3-server[1110]: 2026/09/22 16:07:14 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6695worker1 # [ 185.625475] nix-grpc-daemon[1846]: time=2026-09-22T16:07:14.256Z level=INFO msg="Upload complete. (356ms)"6696lb # [ 185.600240] niks3-server[1110]: 2026/09/22 16:07:14 INFO Completed upload id=686697worker1 # [ 185.632281] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=6246698lb # [ 185.607629] niks3-server[1110]: 2026/09/22 16:07:14 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6699worker1 # [ 185.647749] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686700worker1 # [ 185.654996] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6701worker1 # [ 185.660817] nix-daemon[848]: reaped child process 2145, status = succeeded6702worker1 # [ 185.674851] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6703worker1 # [ 186.539100] nix-daemon[848]: reaped child process 2159, status = succeeded6704worker1 # [ 186.656447] nix-daemon[848]: accepted connection from pid 2175, user nix-grpc-daemon (trusted)6705worker1 # [ 186.674880] nix-daemon[848]: reaped child process 2178, status = succeeded6706lb # [ 186.657494] niks3-server[1110]: 2026/09/22 16:07:15 INFO Received uploads request method=POST path=/api/pending_closures6707worker1 # [ 186.696476] nix-grpc-daemon[1846]: time=2026-09-22T16:07:15.324Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6708worker1 # [ 186.698384] nix-grpc-daemon[1846]: time=2026-09-22T16:07:15.324Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6709lb # [ 186.707714] niks3-server[1110]: 2026/09/22 16:07:15 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6710lb # [ 186.723338] niks3-server[1110]: 2026/09/22 16:07:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6711worker1 # [ 186.760549] nix-grpc-daemon[1846]: time=2026-09-22T16:07:15.390Z level=INFO msg="Uploading 1 narinfos"6712lb # [ 186.736771] niks3-server[1110]: 2026/09/22 16:07:15 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6713lb # [ 186.746876] niks3-server[1110]: 2026/09/22 16:07:15 INFO Signed narinfos id=69 count=16714lb # [ 186.751487] niks3-server[1110]: 2026/09/22 16:07:15 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6715lb # [ 186.760582] niks3-server[1110]: 2026/09/22 16:07:15 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6716worker1 # [ 186.785996] nix-grpc-daemon[1846]: time=2026-09-22T16:07:15.416Z level=INFO msg="Upload complete. (301ms)"6717lb # [ 186.763270] niks3-server[1110]: 2026/09/22 16:07:15 INFO Completed upload id=696718lb # [ 186.768654] niks3-server[1110]: 2026/09/22 16:07:15 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6719worker1 # [ 186.799469] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=16720worker1 # [ 186.818456] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:15Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16721worker1 # [ 186.823681] nix-daemon[848]: reaped child process 2157, status = succeeded6722worker1 # [ 186.841823] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686723worker1 # [ 186.850927] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:15Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06724worker1 # [ 186.862363] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686725worker1 # [ 186.877411] nix-grpc-daemon[1846]: time=2026-09-22T16:07:15.508Z level=INFO msg="All 1 paths already cached"6726worker1 # [ 186.886465] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686727worker1 # [ 186.900132] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6728worker1 # [ 187.042379] nix-daemon[848]: accepted connection from pid 2184, user nix-grpc-daemon (trusted)6729worker1 # [ 187.069525] nix-daemon[848]: reaped child process 2187, status = succeeded6730worker1 # [ 187.161308] nix-daemon[848]: accepted connection from pid 2189, user nix-grpc-daemon (trusted)6731worker1 # [ 187.179739] nix-daemon[848]: reaped child process 2192, status = succeeded6732lb # [ 187.151977] niks3-server[1110]: 2026/09/22 16:07:15 INFO Received uploads request method=POST path=/api/pending_closures6733worker1 # [ 187.188156] nix-grpc-daemon[1846]: time=2026-09-22T16:07:15.818Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6734worker1 # [ 187.189607] nix-grpc-daemon[1846]: time=2026-09-22T16:07:15.818Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6735lb # [ 187.184791] niks3-server[1110]: 2026/09/22 16:07:15 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6736worker1 # [ 187.226195] nix-grpc-daemon[1846]: time=2026-09-22T16:07:15.856Z level=INFO msg="Uploading 1 narinfos"6737lb # [ 187.200645] niks3-server[1110]: 2026/09/22 16:07:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign6738lb # [ 187.210305] niks3-server[1110]: 2026/09/22 16:07:15 INFO Signed narinfos id=70 count=16739lb # [ 187.216884] niks3-server[1110]: 2026/09/22 16:07:15 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6740lb # [ 187.228123] niks3-server[1110]: 2026/09/22 16:07:15 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete6741lb # [ 187.235744] niks3-server[1110]: 2026/09/22 16:07:15 INFO Completed upload id=706742worker1 # [ 187.262203] nix-grpc-daemon[1846]: time=2026-09-22T16:07:15.892Z level=INFO msg="Upload complete. (347ms)"6743lb # [ 187.238485] niks3-server[1110]: 2026/09/22 16:07:15 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6744worker1 # [ 187.272208] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=6246745worker1 # [ 187.280868] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686746worker1 # [ 187.291303] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6747worker1 # [ 187.297000] nix-daemon[848]: reaped child process 2182, status = succeeded6748worker1 # [ 187.308222] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6749worker1 # [ 188.403068] nix-daemon[848]: reaped child process 2196, status = succeeded6750worker1 # [ 188.474006] nix-daemon[848]: accepted connection from pid 2212, user nix-grpc-daemon (trusted)6751worker1 # [ 188.493122] nix-daemon[848]: reaped child process 2215, status = succeeded6752lb # [ 188.465774] niks3-server[1110]: 2026/09/22 16:07:17 INFO Received uploads request method=POST path=/api/pending_closures6753worker1 # [ 188.502553] nix-grpc-daemon[1846]: time=2026-09-22T16:07:17.132Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6754worker1 # [ 188.504171] nix-grpc-daemon[1846]: time=2026-09-22T16:07:17.132Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6755lb # [ 188.495986] niks3-server[1110]: 2026/09/22 16:07:17 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6756lb # [ 188.515117] niks3-server[1110]: 2026/09/22 16:07:17 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6757worker1 # [ 188.551474] nix-grpc-daemon[1846]: time=2026-09-22T16:07:17.181Z level=INFO msg="Uploading 1 narinfos"6758lb # [ 188.527694] niks3-server[1110]: 2026/09/22 16:07:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign6759lb # [ 188.535693] niks3-server[1110]: 2026/09/22 16:07:17 INFO Signed narinfos id=71 count=16760worker1 # [ 188.568716] nix-grpc-daemon[1846]: time=2026-09-22T16:07:17.199Z level=INFO msg="Upload complete. (249ms)"6761lb # [ 188.542862] niks3-server[1110]: 2026/09/22 16:07:17 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete6762lb # [ 188.551875] niks3-server[1110]: 2026/09/22 16:07:17 INFO Completed upload id=716763lb # [ 188.555870] niks3-server[1110]: 2026/09/22 16:07:17 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6764lb # [ 188.560598] niks3-server[1110]: 2026/09/22 16:07:17 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6765worker1 # [ 188.584341] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=16766worker1 # [ 188.602987] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:17Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16767worker1 # [ 188.608488] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686768worker1 # [ 188.613919] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:17Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06769worker1 # [ 188.619439] nix-daemon[848]: reaped child process 2194, status = succeeded6770worker1 # [ 188.623435] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686771worker1 # [ 188.628733] nix-grpc-daemon[1846]: time=2026-09-22T16:07:17.258Z level=INFO msg="All 1 paths already cached"6772worker1 # [ 188.632725] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686773worker1 # [ 188.644099] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6774worker1 # [ 188.775886] nix-daemon[848]: accepted connection from pid 2221, user nix-grpc-daemon (trusted)6775worker1 # [ 188.793370] nix-daemon[848]: reaped child process 2224, status = succeeded6776worker1 # [ 188.895722] nix-daemon[848]: accepted connection from pid 2226, user nix-grpc-daemon (trusted)6777worker1 # [ 188.910395] nix-daemon[848]: reaped child process 2229, status = succeeded6778lb # [ 188.891682] niks3-server[1110]: 2026/09/22 16:07:17 INFO Received uploads request method=POST path=/api/pending_closures6779worker1 # [ 188.927186] nix-grpc-daemon[1846]: time=2026-09-22T16:07:17.557Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6780worker1 # [ 188.928804] nix-grpc-daemon[1846]: time=2026-09-22T16:07:17.557Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6781lb # [ 188.917362] niks3-server[1110]: 2026/09/22 16:07:17 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6782lb # [ 188.932418] niks3-server[1110]: 2026/09/22 16:07:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign6783worker1 # [ 188.965218] nix-grpc-daemon[1846]: time=2026-09-22T16:07:17.595Z level=INFO msg="Uploading 1 narinfos"6784lb # [ 188.945099] niks3-server[1110]: 2026/09/22 16:07:17 INFO Signed narinfos id=72 count=16785lb # [ 188.951992] niks3-server[1110]: 2026/09/22 16:07:17 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6786lb # [ 188.962456] niks3-server[1110]: 2026/09/22 16:07:17 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete6787worker1 # [ 188.993512] nix-grpc-daemon[1846]: time=2026-09-22T16:07:17.624Z level=INFO msg="Upload complete. (338ms)"6788lb # [ 188.968141] niks3-server[1110]: 2026/09/22 16:07:17 INFO Completed upload id=726789lb # [ 188.974472] niks3-server[1110]: 2026/09/22 16:07:17 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6790worker1 # [ 189.001565] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=6246791worker1 # [ 189.015457] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686792worker1 # [ 189.021193] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6793worker1 # [ 189.025814] nix-daemon[848]: reaped child process 2219, status = succeeded6794worker1 # [ 189.037307] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6795worker1 # [ 190.301922] nix-daemon[848]: reaped child process 2233, status = succeeded6796worker1 # [ 190.434609] nix-daemon[848]: accepted connection from pid 2249, user nix-grpc-daemon (trusted)6797worker1 # [ 190.454229] nix-daemon[848]: reaped child process 2252, status = succeeded6798lb # [ 190.428999] niks3-server[1110]: 2026/09/22 16:07:19 INFO Received uploads request method=POST path=/api/pending_closures6799worker1 # [ 190.464640] nix-grpc-daemon[1846]: time=2026-09-22T16:07:19.093Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6800worker1 # [ 190.466308] nix-grpc-daemon[1846]: time=2026-09-22T16:07:19.093Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6801lb # [ 190.464220] niks3-server[1110]: 2026/09/22 16:07:19 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6802lb # [ 190.483088] niks3-server[1110]: 2026/09/22 16:07:19 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6803worker1 # [ 190.517669] nix-grpc-daemon[1846]: time=2026-09-22T16:07:19.148Z level=INFO msg="Uploading 1 narinfos"6804lb # [ 190.495202] niks3-server[1110]: 2026/09/22 16:07:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign6805lb # [ 190.503975] niks3-server[1110]: 2026/09/22 16:07:19 INFO Signed narinfos id=73 count=16806lb # [ 190.509127] niks3-server[1110]: 2026/09/22 16:07:19 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6807worker1 # [ 190.544161] nix-grpc-daemon[1846]: time=2026-09-22T16:07:19.174Z level=INFO msg="Upload complete. (296ms)"6808lb # [ 190.519491] niks3-server[1110]: 2026/09/22 16:07:19 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete6809lb # [ 190.525318] niks3-server[1110]: 2026/09/22 16:07:19 INFO Completed upload id=736810lb # [ 190.528328] niks3-server[1110]: 2026/09/22 16:07:19 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6811worker1 # [ 190.562491] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16812worker1 # [ 190.580280] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:19Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16813worker1 # [ 190.589726] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686814worker1 # [ 190.594695] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:19Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06815worker1 # [ 190.599958] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686816worker1 # [ 190.605505] nix-daemon[848]: reaped child process 2231, status = succeeded6817worker1 # [ 190.607462] nix-grpc-daemon[1846]: time=2026-09-22T16:07:19.234Z level=INFO msg="All 2 paths already cached"6818worker1 # [ 190.611230] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686819worker1 # [ 190.626579] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6820worker1 # [ 190.752589] nix-daemon[848]: accepted connection from pid 2258, user nix-grpc-daemon (trusted)6821worker1 # [ 190.773120] nix-daemon[848]: reaped child process 2261, status = succeeded6822worker1 # [ 190.873732] nix-daemon[848]: accepted connection from pid 2263, user nix-grpc-daemon (trusted)6823worker1 # [ 190.893269] nix-daemon[848]: reaped child process 2266, status = succeeded6824lb # [ 190.864620] niks3-server[1110]: 2026/09/22 16:07:19 INFO Received uploads request method=POST path=/api/pending_closures6825worker1 # [ 190.899938] nix-grpc-daemon[1846]: time=2026-09-22T16:07:19.530Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6826worker1 # [ 190.901683] nix-grpc-daemon[1846]: time=2026-09-22T16:07:19.530Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6827lb # [ 190.891269] niks3-server[1110]: 2026/09/22 16:07:19 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6828lb # [ 190.905173] niks3-server[1110]: 2026/09/22 16:07:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign6829worker1 # [ 190.938040] nix-grpc-daemon[1846]: time=2026-09-22T16:07:19.568Z level=INFO msg="Uploading 1 narinfos"6830lb # [ 190.918038] niks3-server[1110]: 2026/09/22 16:07:19 INFO Signed narinfos id=74 count=16831lb # [ 190.923913] niks3-server[1110]: 2026/09/22 16:07:19 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6832worker1 # [ 190.965435] nix-grpc-daemon[1846]: time=2026-09-22T16:07:19.596Z level=INFO msg="Upload complete. (333ms)"6833lb # [ 190.934089] niks3-server[1110]: 2026/09/22 16:07:19 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete6834lb # [ 190.942366] niks3-server[1110]: 2026/09/22 16:07:19 INFO Completed upload id=746835worker1 # [ 190.971729] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=7526836lb # [ 190.946607] niks3-server[1110]: 2026/09/22 16:07:19 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6837worker1 # [ 190.985567] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686838worker1 # [ 190.990789] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6839worker1 # [ 190.995584] nix-daemon[848]: reaped child process 2256, status = succeeded6840worker1 # [ 191.007306] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6841worker1 # [ 192.319945] nix-daemon[848]: reaped child process 2270, status = succeeded6842worker1 # [ 192.392125] nix-daemon[848]: accepted connection from pid 2286, user nix-grpc-daemon (trusted)6843worker1 # [ 192.414760] nix-daemon[848]: reaped child process 2289, status = succeeded6844lb # [ 192.390904] niks3-server[1110]: 2026/09/22 16:07:21 INFO Received uploads request method=POST path=/api/pending_closures6845worker1 # [ 192.424486] nix-grpc-daemon[1846]: time=2026-09-22T16:07:21.054Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6846worker1 # [ 192.426045] nix-grpc-daemon[1846]: time=2026-09-22T16:07:21.054Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6847lb # [ 192.424319] niks3-server[1110]: 2026/09/22 16:07:21 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6848lb # [ 192.441532] niks3-server[1110]: 2026/09/22 16:07:21 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6849worker1 # [ 192.476436] nix-grpc-daemon[1846]: time=2026-09-22T16:07:21.106Z level=INFO msg="Uploading 1 narinfos"6850lb # [ 192.452230] niks3-server[1110]: 2026/09/22 16:07:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign6851lb # [ 192.462831] niks3-server[1110]: 2026/09/22 16:07:21 INFO Signed narinfos id=75 count=16852lb # [ 192.469721] niks3-server[1110]: 2026/09/22 16:07:21 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6853worker1 # [ 192.505342] nix-grpc-daemon[1846]: time=2026-09-22T16:07:21.136Z level=INFO msg="Upload complete. (288ms)"6854lb # [ 192.480583] niks3-server[1110]: 2026/09/22 16:07:21 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete6855lb # [ 192.484665] niks3-server[1110]: 2026/09/22 16:07:21 INFO Completed upload id=756856lb # [ 192.488362] niks3-server[1110]: 2026/09/22 16:07:21 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6857worker1 # [ 192.521697] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16858worker1 # [ 192.537860] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:21Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16859worker1 # [ 192.542568] nix-daemon[848]: reaped child process 2268, status = succeeded6860worker1 # [ 192.566744] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686861worker1 # [ 192.582075] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686862worker1 # [ 192.597413] nix-grpc-daemon[1846]: time=2026-09-22T16:07:21.228Z level=INFO msg="All 2 paths already cached"6863worker1 # [ 192.607629] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686864worker1 # [ 192.622139] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6865worker1 # [ 192.781803] nix-daemon[848]: accepted connection from pid 2293, user nix-grpc-daemon (trusted)6866worker1 # [ 192.805041] nix-daemon[848]: reaped child process 2296, status = succeeded6867worker1 # [ 192.903372] nix-daemon[848]: accepted connection from pid 2298, user nix-grpc-daemon (trusted)6868worker1 # [ 192.920605] nix-daemon[848]: reaped child process 2301, status = succeeded6869lb # [ 192.898908] niks3-server[1110]: 2026/09/22 16:07:21 INFO Received uploads request method=POST path=/api/pending_closures6870worker1 # [ 192.934176] nix-grpc-daemon[1846]: time=2026-09-22T16:07:21.564Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6871worker1 # [ 192.935662] nix-grpc-daemon[1846]: time=2026-09-22T16:07:21.564Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6872lb # [ 192.925410] niks3-server[1110]: 2026/09/22 16:07:21 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6873worker1 # [ 192.963777] nix-grpc-daemon[1846]: time=2026-09-22T16:07:21.594Z level=INFO msg="Uploading 1 narinfos"6874lb # [ 192.938375] niks3-server[1110]: 2026/09/22 16:07:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign6875lb # [ 192.949888] niks3-server[1110]: 2026/09/22 16:07:21 INFO Signed narinfos id=76 count=16876lb # [ 192.956562] niks3-server[1110]: 2026/09/22 16:07:21 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6877worker1 # [ 192.992817] nix-grpc-daemon[1846]: time=2026-09-22T16:07:21.623Z level=INFO msg="Upload complete. (355ms)"6878lb # [ 192.967415] niks3-server[1110]: 2026/09/22 16:07:21 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete6879lb # [ 192.973110] niks3-server[1110]: 2026/09/22 16:07:21 INFO Completed upload id=766880worker1 # [ 193.000273] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=7526881lb # [ 192.978648] niks3-server[1110]: 2026/09/22 16:07:21 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6882worker1 # [ 193.012370] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686883worker1 # [ 193.017993] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6884worker1 # [ 193.022802] nix-daemon[848]: reaped child process 2291, status = succeeded6885worker1 # [ 193.032565] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6886worker1 # [ 194.312709] nix-daemon[848]: reaped child process 2305, status = succeeded6887worker1 # [ 194.421795] nix-daemon[848]: accepted connection from pid 2321, user nix-grpc-daemon (trusted)6888worker1 # [ 194.439662] nix-daemon[848]: reaped child process 2324, status = succeeded6889lb # [ 194.421930] niks3-server[1110]: 2026/09/22 16:07:23 INFO Received uploads request method=POST path=/api/pending_closures6890worker1 # [ 194.459516] nix-grpc-daemon[1846]: time=2026-09-22T16:07:23.088Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6891worker1 # [ 194.461329] nix-grpc-daemon[1846]: time=2026-09-22T16:07:23.088Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6892lb # [ 194.459676] niks3-server[1110]: 2026/09/22 16:07:23 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6893lb # [ 194.473566] niks3-server[1110]: 2026/09/22 16:07:23 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6894lb # [ 194.484093] niks3-server[1110]: 2026/09/22 16:07:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign6895worker1 # [ 194.517072] nix-grpc-daemon[1846]: time=2026-09-22T16:07:23.147Z level=INFO msg="Uploading 1 narinfos"6896lb # [ 194.495663] niks3-server[1110]: 2026/09/22 16:07:23 INFO Signed narinfos id=77 count=16897lb # [ 194.501939] niks3-server[1110]: 2026/09/22 16:07:23 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6898worker1 # [ 194.541002] nix-grpc-daemon[1846]: time=2026-09-22T16:07:23.171Z level=INFO msg="Upload complete. (296ms)"6899lb # [ 194.516195] niks3-server[1110]: 2026/09/22 16:07:23 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete6900lb # [ 194.527293] niks3-server[1110]: 2026/09/22 16:07:23 INFO Completed upload id=776901lb # [ 194.533163] niks3-server[1110]: 2026/09/22 16:07:23 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6902worker1 # [ 194.554931] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16903worker1 # [ 194.576374] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:23Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16904worker1 # [ 194.581632] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686905worker1 # [ 194.587502] nix-daemon[848]: reaped child process 2303, status = succeeded6906worker1 # [ 194.591315] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686907worker1 # [ 194.599242] nix-grpc-daemon[1846]: time=2026-09-22T16:07:23.229Z level=INFO msg="All 2 paths already cached"6908worker1 # [ 194.608654] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346686909worker1 # [ 194.621556] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6910worker1 # [ 194.760450] nix-daemon[848]: accepted connection from pid 2328, user nix-grpc-daemon (trusted)6911worker1 # [ 194.781227] nix-daemon[848]: reaped child process 2331, status = succeeded6912worker1 # [ 194.884155] nix-daemon[848]: accepted connection from pid 2333, user nix-grpc-daemon (trusted)6913worker1 # [ 194.899703] nix-daemon[848]: reaped child process 2336, status = succeeded6914lb # [ 194.879966] niks3-server[1110]: 2026/09/22 16:07:23 INFO Received uploads request method=POST path=/api/pending_closures6915worker1 # [ 194.915266] nix-grpc-daemon[1846]: time=2026-09-22T16:07:23.545Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6916worker1 # [ 194.916849] nix-grpc-daemon[1846]: time=2026-09-22T16:07:23.545Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6917lb # [ 194.906628] niks3-server[1110]: 2026/09/22 16:07:23 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6918worker1 # [ 194.946506] nix-grpc-daemon[1846]: time=2026-09-22T16:07:23.577Z level=INFO msg="Uploading 1 narinfos"6919lb # [ 194.924255] niks3-server[1110]: 2026/09/22 16:07:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign6920lb # [ 194.934652] niks3-server[1110]: 2026/09/22 16:07:23 INFO Signed narinfos id=78 count=16921lb # [ 194.940993] niks3-server[1110]: 2026/09/22 16:07:23 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6922lb # [ 194.947895] niks3-server[1110]: 2026/09/22 16:07:23 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete6923worker1 # [ 194.980600] nix-grpc-daemon[1846]: time=2026-09-22T16:07:23.611Z level=INFO msg="Upload complete. (348ms)"6924lb # [ 194.957301] niks3-server[1110]: 2026/09/22 16:07:23 INFO Completed upload id=786925lb # [ 194.960631] niks3-server[1110]: 2026/09/22 16:07:23 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6926worker1 # [ 194.988138] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 paths=1 nar_bytes_in=7526927worker1 # [ 195.002213] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346686928worker1 # [ 195.008515] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6929worker1 # [ 195.013339] nix-daemon[848]: reaped child process 2326, status = succeeded6930worker1 # [ 195.024206] nix-daemon[848]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6931worker1 # [ 195.704126] nix-daemon[848]: reaped child process 2340, status = succeeded6932worker1 # [ 195.812420] nix-daemon[848]: accepted connection from pid 2356, user nix-grpc-daemon (trusted)6933worker1 # [ 195.832237] nix-daemon[848]: reaped child process 2359, status = succeeded6934lb # [ 195.811734] niks3-server[1110]: 2026/09/22 16:07:24 INFO Received uploads request method=POST path=/api/pending_closures6935worker1 # [ 195.848484] nix-grpc-daemon[1846]: time=2026-09-22T16:07:24.478Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6936worker1 # [ 195.850369] nix-grpc-daemon[1846]: time=2026-09-22T16:07:24.478Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6937lb # [ 195.852850] niks3-server[1110]: 2026/09/22 16:07:24 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6938lb # [ 195.864713] niks3-server[1110]: 2026/09/22 16:07:24 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6939worker1 # [ 195.903915] nix-grpc-daemon[1846]: time=2026-09-22T16:07:24.534Z level=INFO msg="Uploading 1 narinfos"6940lb # [ 195.877483] niks3-server[1110]: 2026/09/22 16:07:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign6941lb # [ 195.885573] niks3-server[1110]: 2026/09/22 16:07:24 INFO Signed narinfos id=79 count=16942lb # [ 195.893359] niks3-server[1110]: 2026/09/22 16:07:24 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6943lb # [ 195.903503] niks3-server[1110]: 2026/09/22 16:07:24 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete6944lb # [ 195.909927] niks3-server[1110]: 2026/09/22 16:07:24 INFO Completed upload id=796945worker1 # [ 195.935042] nix-grpc-daemon[1846]: time=2026-09-22T16:07:24.565Z level=INFO msg="Upload complete. (300ms)"6946lb # [ 195.913046] niks3-server[1110]: 2026/09/22 16:07:24 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6947worker1 # [ 195.950243] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34668 duration_s=0 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16948worker1 # [ 195.968456] nix-daemon[848]: reaped child process 2338, status = succeeded6949client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.16 seconds)6950worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6951worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6952client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]'6953client # [ 196.140767] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6954client # Running as unit: gpu.service; invocation ID: bff4d61db40d41ce957095d442e43c926955client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.08 seconds)6956lb: must succeed: curl -sf localhost:9901/clusters6957lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6958lb: must succeed: curl -sf localhost:9901/clusters6959lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6960worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6961client # [ 196.342906] nix[1520]: don't know how to build these paths:6962client # [ 196.344047] nix[1520]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv6963worker1 # [ 196.343405] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346686964worker1 # [ 196.356206] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346686965worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6966worker1 # [ 196.373782] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:25Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06967client # [ 196.373722] nix[1520]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}, waiting up to 30s for a worker6968lb # [ 197.096868] envoy[896]: conn peer=[2001:db8:1::1]:50816 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27170 tx=12425 ms=168886969lb: must succeed: curl -sf localhost:9901/clusters6970lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6971lb: must succeed: curl -sf localhost:9901/clusters6972lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6973worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6974worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6975client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6976client # [ 226.381309] nix[1520]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}6977client # [ 226.392083] nix[1520]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed6978client # [ 226.432963] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6979client # [ 226.441131] systemd[1]: gpu.service: Failed with result 'exit-code'.6980client # [ 226.444637] systemd[1]: gpu.service: Consumed 200ms CPU time over 30.297s wall clock time, 35.4M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic.6981client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.08 seconds)6982client: must succeed: journalctl -u gpu -o cat6983client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)6984lb: must succeed: curl -sf localhost:9901/clusters6985lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6986lb: must succeed: curl -sf localhost:9901/clusters6987lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6988worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6989worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6990(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 47.99 seconds)6991subtest: low disk drains a worker and builds go to the other6992worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6993lb # [ 227.096460] envoy[896]: conn peer=[2001:db8:1::1]:60434 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=579 ms=300616994worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.16 seconds)6995worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6996worker1 # [ 228.262727] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:56Z level=info event=unhealthy reason=min_free6997worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.10 seconds)6998client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&26999worker2 # [ 229.310845] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:558887000worker2 # [ 229.319230] nix-daemon[842]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7001client # don't know how to build these paths:7002client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7003worker2 # [ 229.334296] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558887004worker2 # [ 229.342360] nix-grpc-daemon[1833]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5)7005worker2 # [ 229.370266] nix-grpc-daemon[1833]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 2/5)7006worker2 # [ 229.464559] nix-grpc-daemon[1833]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 268 ms (attempt 3/5)7007worker2 # [ 229.734890] nix-grpc-daemon[1833]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 470 ms (attempt 4/5)7008worker2 # [ 230.211737] nix-grpc-daemon[1833]: disabling binary cache 'https://cache.nixos.org' for 60 seconds7009worker2 # [ 230.216561] nix-grpc-daemon[1833]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org7010worker1 # [ 230.239134] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:58Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=07011worker1 # [ 230.241908] nix-grpc-daemon[1769]: ts=2026-09-22T16:07:58Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=17012worker2 # [ 230.303157] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558887013worker2 # [ 230.319523] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558887014client # copying 1 paths to 'lb:50051'...7015client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...7016worker2 # [ 230.332305] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:558887017worker2 # [ 230.343312] nix-daemon[842]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7018worker2 # [ 230.365473] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:58Z level=info event=niks3_push_started pid=18937019worker2 # [ 230.531416] nix-grpc-daemon[1893]: time=2026-09-22T16:07:59.162Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""7020worker2 # [ 230.682801] nix-daemon[842]: accepted connection from pid 1906, user nix-grpc-daemon (trusted)7021worker2 # [ 230.716641] nix-daemon[842]: reaped child process 1909, status = succeeded7022worker2 # [ 230.855712] nix-daemon[842]: accepted connection from pid 1911, user nix-grpc-daemon (trusted)7023worker2 # [ 230.881640] nix-daemon[842]: reaped child process 1914, status = succeeded7024lb # [ 230.855388] niks3-server[1110]: 2026/09/22 16:07:59 INFO Received uploads request method=POST path=/api/pending_closures7025worker2 # [ 230.908171] nix-grpc-daemon[1893]: time=2026-09-22T16:07:59.539Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7026worker2 # [ 230.910710] nix-grpc-daemon[1893]: time=2026-09-22T16:07:59.539Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"7027lb # [ 230.915520] niks3-server[1110]: 2026/09/22 16:07:59 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst7028worker2 # [ 230.958204] nix-grpc-daemon[1893]: time=2026-09-22T16:07:59.589Z level=INFO msg="Uploading 1 narinfos"7029lb # [ 230.921947] niks3-server[1110]: 2026/09/22 16:07:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign7030lb # [ 230.927323] niks3-server[1110]: 2026/09/22 16:07:59 INFO Signed narinfos id=80 count=17031lb # [ 230.935875] niks3-server[1110]: 2026/09/22 16:07:59 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls7032lb # [ 230.944400] niks3-server[1110]: 2026/09/22 16:07:59 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete7033lb # [ 230.959332] niks3-server[1110]: 2026/09/22 16:07:59 INFO Completed upload id=807034worker2 # [ 230.994812] nix-grpc-daemon[1893]: time=2026-09-22T16:07:59.626Z level=INFO msg="Upload complete. (458ms)"7035lb # [ 230.964508] niks3-server[1110]: 2026/09/22 16:07:59 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo7036worker2 # [ 231.000323] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55888 duration_s=0 paths=1 nar_bytes_in=5127037worker2 # [ 231.009380] nix-grpc-daemon[1833]: ts=2026-09-22T16:07:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558887038worker2 # [ 231.022153] nix-daemon[842]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7039worker2 # [ 231.026862] nix-daemon[842]: reaped child process 1891, status = succeeded7040client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...7041client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7042worker2 # [ 231.041946] nix-daemon[842]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7043client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds7044client # farm-a> LOG-farm-a-drain7045worker2 # [ 232.272985] nix-daemon[842]: reaped child process 1918, status = succeeded7046worker2 # [ 232.416245] nix-daemon[842]: accepted connection from pid 1934, user nix-grpc-daemon (trusted)7047lb # [ 232.408531] niks3-server[1110]: 2026/09/22 16:08:01 INFO Received uploads request method=POST path=/api/pending_closures7048worker2 # [ 232.451047] nix-daemon[842]: reaped child process 1937, status = succeeded7049worker2 # [ 232.464660] nix-grpc-daemon[1893]: time=2026-09-22T16:08:01.092Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7050worker2 # [ 232.467147] nix-grpc-daemon[1893]: time=2026-09-22T16:08:01.092Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"7051lb # [ 232.453650] niks3-server[1110]: 2026/09/22 16:08:01 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7052lb # [ 232.468006] niks3-server[1110]: 2026/09/22 16:08:01 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst7053lb # [ 232.480278] niks3-server[1110]: 2026/09/22 16:08:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign7054worker2 # [ 232.523029] nix-grpc-daemon[1893]: time=2026-09-22T16:08:01.153Z level=INFO msg="Uploading 1 narinfos"7055lb # [ 232.488547] niks3-server[1110]: 2026/09/22 16:08:01 INFO Signed narinfos id=81 count=17056lb # [ 232.499847] niks3-server[1110]: 2026/09/22 16:08:01 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls7057lb # [ 232.509523] niks3-server[1110]: 2026/09/22 16:08:01 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete7058worker2 # [ 232.555600] nix-grpc-daemon[1893]: time=2026-09-22T16:08:01.187Z level=INFO msg="Upload complete. (299ms)"7059lb # [ 232.519617] niks3-server[1110]: 2026/09/22 16:08:01 INFO Completed upload id=817060worker2 # [ 232.560827] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55888 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=17061lb # [ 232.537837] niks3-server[1110]: 2026/09/22 16:08:01 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo7062worker2 # [ 232.574355] nix-daemon[842]: reaped child process 1916, status = succeeded7063worker1 # [ 232.570412] nix-grpc-daemon[1769]: ts=2026-09-22T16:08:01Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=07064worker1 # [ 232.574318] nix-grpc-daemon[1769]: ts=2026-09-22T16:08:01Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=17065worker2 # [ 232.626420] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558887066worker2 # [ 232.642797] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558887067worker2 # [ 232.656268] nix-grpc-daemon[1893]: time=2026-09-22T16:08:01.288Z level=INFO msg="All 1 paths already cached"7068client # copying 1 paths to 'lb:50051'...7069client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...7070worker2 # [ 232.667373] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:558887071worker2 # [ 232.678446] nix-daemon[842]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7072worker2 # [ 232.900452] nix-daemon[842]: accepted connection from pid 1941, user nix-grpc-daemon (trusted)7073worker2 # [ 232.937169] nix-daemon[842]: reaped child process 1944, status = succeeded7074worker2 # [ 233.070713] nix-daemon[842]: accepted connection from pid 1946, user nix-grpc-daemon (trusted)7075lb # [ 233.060980] niks3-server[1110]: 2026/09/22 16:08:01 INFO Received uploads request method=POST path=/api/pending_closures7076worker2 # [ 233.100653] nix-daemon[842]: reaped child process 1949, status = succeeded7077worker2 # [ 233.106676] nix-grpc-daemon[1893]: time=2026-09-22T16:08:01.738Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7078worker2 # [ 233.108671] nix-grpc-daemon[1893]: time=2026-09-22T16:08:01.738Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"7079lb # [ 233.090968] niks3-server[1110]: 2026/09/22 16:08:01 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst7080lb # [ 233.104151] niks3-server[1110]: 2026/09/22 16:08:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign7081worker2 # [ 233.140286] nix-grpc-daemon[1893]: time=2026-09-22T16:08:01.771Z level=INFO msg="Uploading 1 narinfos"7082lb # [ 233.107236] niks3-server[1110]: 2026/09/22 16:08:01 INFO Signed narinfos id=82 count=17083lb # [ 233.120242] niks3-server[1110]: 2026/09/22 16:08:01 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls7084lb # [ 233.126712] niks3-server[1110]: 2026/09/22 16:08:01 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete7085lb # [ 233.136669] niks3-server[1110]: 2026/09/22 16:08:01 INFO Completed upload id=827086worker2 # [ 233.172788] nix-grpc-daemon[1893]: time=2026-09-22T16:08:01.804Z level=INFO msg="Upload complete. (467ms)"7087worker2 # [ 233.180180] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55888 duration_s=0 paths=1 nar_bytes_in=6327088lb # [ 233.149992] niks3-server[1110]: 2026/09/22 16:08:01 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo7089worker2 # [ 233.192555] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558887090worker2 # [ 233.195670] nix-daemon[842]: reaped child process 1939, status = succeeded7091worker2 # [ 233.203383] nix-daemon[842]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7092client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...7093worker2 # [ 233.218959] nix-daemon[842]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7094client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7095client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds7096client # farm-b> LOG-farm-b-drain7097worker2 # [ 234.260480] nix-daemon[842]: reaped child process 1953, status = succeeded7098worker2 # [ 234.378507] nix-daemon[842]: accepted connection from pid 1969, user nix-grpc-daemon (trusted)7099lb # [ 234.370959] niks3-server[1110]: 2026/09/22 16:08:02 INFO Received uploads request method=POST path=/api/pending_closures7100worker2 # [ 234.410965] nix-daemon[842]: reaped child process 1972, status = succeeded7101worker2 # [ 234.416691] nix-grpc-daemon[1893]: time=2026-09-22T16:08:03.047Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7102worker2 # [ 234.419173] nix-grpc-daemon[1893]: time=2026-09-22T16:08:03.047Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"7103lb # [ 234.397920] niks3-server[1110]: 2026/09/22 16:08:03 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7104lb # [ 234.410926] niks3-server[1110]: 2026/09/22 16:08:03 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst7105worker2 # [ 234.460308] nix-grpc-daemon[1893]: time=2026-09-22T16:08:03.092Z level=INFO msg="Uploading 1 narinfos"7106lb # [ 234.424510] niks3-server[1110]: 2026/09/22 16:08:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign7107lb # [ 234.430344] niks3-server[1110]: 2026/09/22 16:08:03 INFO Signed narinfos id=83 count=17108lb # [ 234.444293] niks3-server[1110]: 2026/09/22 16:08:03 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls7109lb # [ 234.452111] niks3-server[1110]: 2026/09/22 16:08:03 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete7110worker2 # [ 234.487152] nix-grpc-daemon[1893]: time=2026-09-22T16:08:03.119Z level=INFO msg="Upload complete. (245ms)"7111lb # [ 234.454155] niks3-server[1110]: 2026/09/22 16:08:03 INFO Completed upload id=837112worker2 # [ 234.492820] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55888 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=17113lb # [ 234.458368] niks3-server[1110]: 2026/09/22 16:08:03 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo7114worker1 # [ 234.494722] nix-grpc-daemon[1769]: ts=2026-09-22T16:08:03Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=07115worker1 # [ 234.497357] nix-grpc-daemon[1769]: ts=2026-09-22T16:08:03Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=17116worker2 # [ 234.509562] nix-daemon[842]: reaped child process 1951, status = succeeded7117worker2 # [ 234.549047] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558887118worker2 # [ 234.565397] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558887119worker2 # [ 234.587775] nix-grpc-daemon[1893]: time=2026-09-22T16:08:03.219Z level=INFO msg="All 2 paths already cached"7120client # copying 1 paths to 'lb:50051'...7121client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...7122worker2 # [ 234.597353] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:558887123worker2 # [ 234.611700] nix-daemon[842]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7124worker2 # [ 234.771724] nix-daemon[842]: accepted connection from pid 1976, user nix-grpc-daemon (trusted)7125worker2 # [ 234.816158] nix-daemon[842]: reaped child process 1979, status = succeeded7126worker2 # [ 234.936361] nix-daemon[842]: accepted connection from pid 1981, user nix-grpc-daemon (trusted)7127lb # [ 234.927067] niks3-server[1110]: 2026/09/22 16:08:03 INFO Received uploads request method=POST path=/api/pending_closures7128worker2 # [ 234.968981] nix-grpc-daemon[1893]: time=2026-09-22T16:08:03.600Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7129worker2 # [ 234.971992] nix-grpc-daemon[1893]: time=2026-09-22T16:08:03.600Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"7130worker2 # [ 234.975641] nix-daemon[842]: reaped child process 1984, status = succeeded7131lb # [ 234.948897] niks3-server[1110]: 2026/09/22 16:08:03 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst7132lb # [ 234.957561] niks3-server[1110]: 2026/09/22 16:08:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign7133lb # [ 234.959509] niks3-server[1110]: 2026/09/22 16:08:03 INFO Signed narinfos id=84 count=17134worker2 # [ 234.998104] nix-grpc-daemon[1893]: time=2026-09-22T16:08:03.629Z level=INFO msg="Uploading 1 narinfos"7135lb # [ 234.969631] niks3-server[1110]: 2026/09/22 16:08:03 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls7136lb # [ 234.980303] niks3-server[1110]: 2026/09/22 16:08:03 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete7137lb # [ 234.988212] niks3-server[1110]: 2026/09/22 16:08:03 INFO Completed upload id=847138worker2 # [ 235.024242] nix-grpc-daemon[1893]: time=2026-09-22T16:08:03.656Z level=INFO msg="Upload complete. (400ms)"7139worker2 # [ 235.040252] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55888 duration_s=0 paths=1 nar_bytes_in=7607140lb # [ 235.004623] niks3-server[1110]: 2026/09/22 16:08:03 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo7141worker2 # [ 235.055331] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558887142worker2 # [ 235.071644] nix-daemon[842]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7143worker2 # [ 235.078113] nix-daemon[842]: reaped child process 1974, status = succeeded7144client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...7145client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7146worker2 # [ 235.091515] nix-daemon[842]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)7147client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds7148client # farm-top> LOG-farm-top-drain7149worker2 # [ 236.637001] nix-daemon[842]: reaped child process 1988, status = succeeded7150worker2 # [ 236.667205] nix-daemon[842]: accepted connection from pid 2004, user nix-grpc-daemon (trusted)7151worker2 # [ 236.700099] nix-daemon[842]: reaped child process 2007, status = succeeded7152lb # [ 236.677079] niks3-server[1110]: 2026/09/22 16:08:05 INFO Received uploads request method=POST path=/api/pending_closures7153worker2 # [ 236.720792] nix-grpc-daemon[1893]: time=2026-09-22T16:08:05.352Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7154worker2 # [ 236.722460] nix-grpc-daemon[1893]: time=2026-09-22T16:08:05.352Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"7155lb # [ 236.716551] niks3-server[1110]: 2026/09/22 16:08:05 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst7156lb # [ 236.724741] niks3-server[1110]: 2026/09/22 16:08:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign7157lb # [ 236.727568] niks3-server[1110]: 2026/09/22 16:08:05 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7158worker2 # [ 236.769320] nix-grpc-daemon[1893]: time=2026-09-22T16:08:05.401Z level=INFO msg="Uploading 1 narinfos"7159lb # [ 236.739697] niks3-server[1110]: 2026/09/22 16:08:05 INFO Signed narinfos id=85 count=17160lb # [ 236.744441] niks3-server[1110]: 2026/09/22 16:08:05 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls7161lb # [ 236.751818] niks3-server[1110]: 2026/09/22 16:08:05 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete7162worker2 # [ 236.795457] nix-grpc-daemon[1893]: time=2026-09-22T16:08:05.427Z level=INFO msg="Upload complete. (288ms)"7163lb # [ 236.759726] niks3-server[1110]: 2026/09/22 16:08:05 INFO Completed upload id=857164lb # [ 236.766860] niks3-server[1110]: 2026/09/22 16:08:05 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo7165worker2 # [ 236.802901] nix-grpc-daemon[1833]: ts=2026-09-22T16:08:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55888 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=17166worker2 # [ 236.817382] nix-daemon[842]: reaped child process 1986, status = succeeded7167client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2, in 7.72 seconds)7168client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath7169client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath, in 0.19 seconds)7170worker1: must succeed: rm /nix/.rw-store/fill7171lb # [ 237.092957] envoy[896]: conn peer=[2001:db8:1::1]:42276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9562 tx=4506 ms=75177172worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)7173worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7174worker1 # [ 237.271335] nix-grpc-daemon[1769]: ts=2026-09-22T16:08:05Z level=info event=healthy reason=min_free7175worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)7176(finished: subtest: low disk drains a worker and builds go to the other, in 11.47 seconds)7177(finished: run the VM test script, in 239.20 seconds)7178test script finished in 239.44s7179cleanup7180kill QemuMachine (pid 49)7181client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7182client # [2026-09-22T16:08:07Z INFO virtiofsd] Client disconnected, shutting down7183client # [2026-09-22T16:08:07Z INFO virtiofsd] Client disconnected, shutting down7184client # [2026-09-22T16:08:07Z INFO virtiofsd] Client disconnected, shutting down7185kill QemuMachine (pid 50)7186lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7187lb # [2026-09-22T16:08:07Z INFO virtiofsd] Client disconnected, shutting down7188lb # [2026-09-22T16:08:07Z INFO virtiofsd] Client disconnected, shutting down7189lb # [2026-09-22T16:08:07Z INFO virtiofsd] Client disconnected, shutting down7190kill QemuMachine (pid 51)7191worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7192worker1 # [2026-09-22T16:08:07Z INFO virtiofsd] Client disconnected, shutting down7193worker1 # [2026-09-22T16:08:07Z INFO virtiofsd] Client disconnected, shutting down7194worker1 # [2026-09-22T16:08:07Z INFO virtiofsd] Client disconnected, shutting down7195kill QemuMachine (pid 52)7196worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7197worker2 # [2026-09-22T16:08:08Z INFO virtiofsd] Client disconnected, shutting down7198worker2 # [2026-09-22T16:08:08Z INFO virtiofsd] Client disconnected, shutting down7199worker2 # [2026-09-22T16:08:08Z INFO virtiofsd] Client disconnected, shutting down7200(finished: cleanup, in 1.24 seconds)7201additionally exposed symbols:7202 client, lb, worker1, worker2,7203 vlan1,7204 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh