vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #510
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb: QEMU running (pid 50)13lb # Disk image does not exist, creating the virtualisation disk image...14worker1 # Disk image does not exist, creating the virtualisation disk image...15lb # Formatting '/build/vm-state-lb/tmp.0LIRLVjsLP', fmt=raw size=107374182416client: QEMU running (pid 49)17worker2 # Disk image does not exist, creating the virtualisation disk image...18worker2: QEMU running (pid 52)19lb # mke2fs 1.47.4 (6-Mar-2025)20worker1 # Formatting '/build/vm-state-worker1/tmp.98V5suDm6u', fmt=raw size=107374182421worker1: QEMU running (pid 51)22lb # Discarding device blocks: 0/262144 done23worker1 # mke2fs 1.47.4 (6-Mar-2025)24worker2 # Formatting '/build/vm-state-worker2/tmp.D4AR4fUwXJ', fmt=raw size=107374182425client # Disk image does not exist, creating the virtualisation disk image...26worker1 # Discarding device blocks: 0/262144 done27worker2 # mke2fs 1.47.4 (6-Mar-2025)28lb # Creating filesystem with 262144 4k blocks and 65536 inodes29worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes30worker2 # Discarding device blocks: 0/262144 done31lb # Filesystem UUID: bc531355-f379-4bef-808e-6fca3638f96932worker1 # Filesystem UUID: f16facbf-756e-4b78-8b39-9f768cbe5a6333worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes34lb # Superblock backups stored on blocks:35worker1 # Superblock backups stored on blocks:36worker2 # Filesystem UUID: 6cb9701f-9aa7-491b-b99b-d267fc165f9637lb # 32768, 98304, 163840, 22937638worker1 # 32768, 98304, 163840, 22937639worker2 # Superblock backups stored on blocks:40lb # 41worker1 # 42worker2 # 32768, 98304, 163840, 22937643lb # Allocating group tables: 0/8 done44worker1 # Allocating group tables: 0/8 done45worker2 # 46lb # Writing inode tables: 0/8 done47lb # Creating journal (8192 blocks): done48worker2 # Allocating group tables: 0/8 done49worker1 # Writing inode tables: 0/8 done50(finished: start all VMs, in 0.49 seconds)51worker2 # Writing inode tables: 0/8 done52lb # Writing superblocks and filesystem accounting information: 0/8 done53client # Formatting '/build/vm-state-client/tmp.C4x3XcvTyL', fmt=raw size=107374182454worker1 # Creating journal (8192 blocks): done55client: waiting for unit network-addresses-eth1.service56client # mke2fs 1.47.4 (6-Mar-2025)57worker1 # Writing superblocks and filesystem accounting information: 0/8 done58client: waiting for the VM to finish booting59client # Discarding device blocks: 0/262144 done60worker1 # 61worker2 # Creating journal (8192 blocks): done62lb # 63client # Creating filesystem with 262144 4k blocks and 65536 inodes64worker1 # Virtualisation disk image created.65worker2 # Writing superblocks and filesystem accounting information: 0/8 done66lb # Virtualisation disk image created.67client # Filesystem UUID: 33541339-3e7c-4c79-840a-75ec3b55bb2768worker1 # Starting virtiofs daemons...69worker2 # 70lb # Starting virtiofs daemons...71client # Superblock backups stored on blocks:72worker1 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)73worker2 # Virtualisation disk image created.74lb # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)75client # 32768, 98304, 163840, 22937676worker1 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether77worker2 # Starting virtiofs daemons...78lb # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether79client # 80worker1 # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...81worker2 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)82lb # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...83client # Allocating group tables: 0/8 done84worker1 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)85worker2 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)86lb # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)87client # Writing inode tables: 0/8 done88worker1 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether89worker2 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether90lb # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether91client # Creating journal (8192 blocks): done92worker1 # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...93worker2 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether94lb # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...95client # Writing superblocks and filesystem accounting information: 0/8 done96worker1 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)97worker2 # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...98lb # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)99client # 100worker1 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether101worker2 # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...102lb # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether103client # Virtualisation disk image created.104worker1 # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...105worker2 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)106lb # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...107client # Starting virtiofs daemons...108worker1 # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests109worker2 # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether110lb # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests111client # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)112worker1 # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests113worker2 # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...114lb # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests115client # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether116worker1 # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests117worker2 # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests118lb # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests119worker2 # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests120client # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...121worker2 # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests122client # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)123client # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether124client # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...125client # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)126client # [2026-09-22T22:22:23Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether127client # [2026-09-22T22:22:23Z INFO virtiofsd] Waiting for vhost-user socket connection...128client # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests129client # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests130client # [2026-09-22T22:22:23Z INFO virtiofsd] Client connected, servicing requests131lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]132lb # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026133lb # [ 0.000000] KASLR enabled134lb # [ 0.000000] random: crng init done135lb # [ 0.000000] Machine model: linux,dummy-virt136lb # [ 0.000000] efi: UEFI not found.137lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT138lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]139lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]140lb # [ 0.000000] Zone ranges:141lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]142lb # [ 0.000000] DMA32 empty143lb # [ 0.000000] Normal empty144lb # [ 0.000000] Device empty145lb # [ 0.000000] Movable zone start for each node146lb # [ 0.000000] Early memory node ranges147lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]148lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]149lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000150lb # [ 0.000000] psci: probing for conduit method from DT.151lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.152lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs153lb # [ 0.000000] psci: Trusted OS migration not required154lb # [ 0.000000] psci: SMC Calling Convention v1.1155lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)156lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296157lb # [ 0.000000] Detected PIPT I-cache on CPU0158lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)159lb # [ 0.000000] CPU features: detected: GICv3 CPU interface160lb # [ 0.000000] CPU features: detected: Spectre-v4161lb # [ 0.000000] CPU features: detected: Spectre-BHB162lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38163lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23164lb # [ 0.000000] alternatives: applying boot alternatives165lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qvl0xxkr124pdkzdvanphvcpy7197xra-nixos-system-lb-test/init regInfo=/nix/store/4y9byqv3ifqd7wzrdp7iwk6bnwmvvvvc-closure-info/registration console=ttyAMA0,115200n8 console=tty0166lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/4y9byqv3ifqd7wzrdp7iwk6bnwmvvvvc-closure-info/registration", will be passed to user space.167lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes168lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)169lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)170lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB171lb # [ 0.000000] software IO TLB: area num 1.172lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB173lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)174lb # [ 0.000000] Fallback order for Node 0: 0175lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216176lb # [ 0.000000] Policy zone: DMA177lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off178lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1179lb # [ 0.000000] allocated 3145728 bytes of page_ext180lb # [ 0.000000] ftrace: allocating 74950 entries in 294 pages181lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups182lb # [ 0.000000] rcu: Hierarchical RCU implementation.183lb # [ 0.000000] rcu: RCU event tracing is enabled.184lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.185lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.186lb # [ 0.000000] Rude variant of Tasks RCU enabled.187lb # [ 0.000000] Tracing variant of Tasks RCU enabled.188lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.189lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1190lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.191lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.192lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.193lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0194lb # [ 0.000000] GICv3: 256 SPIs implemented195lb # [ 0.000000] GICv3: 0 Extended SPIs implemented196lb # [ 0.000000] Root IRQ handler: gic_handle_irq197lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI198lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0199lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000200lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]201lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)202lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)203lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000204lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000205lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.206lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns207lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).208client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]209lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns210lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns211client # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026212lb # [ 0.000039] arm-pv: using stolen time PV213client # [ 0.000000] KASLR enabled214client # [ 0.000000] random: crng init done215client # [ 0.000000] Machine model: linux,dummy-virt216lb # [ 0.000784] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)217client # [ 0.000000] efi: UEFI not found.218lb # [ 0.000980] Console: colour dummy device 80x25219lb # [ 0.000988] printk: legacy console [tty0] enabled220client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT221client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]222lb # [ 0.001189] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)223client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]224lb # [ 0.001196] pid_max: default: 32768 minimum: 301225client # [ 0.000000] Zone ranges:226lb # [ 0.001308] LSM: initializing lsm=capability,landlock,yama,bpf,ima227client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]228client # [ 0.000000] DMA32 empty229lb # [ 0.001508] landlock: Up and running.230client # [ 0.000000] Normal empty231lb # [ 0.001511] Yama: becoming mindful.232client # [ 0.000000] Device empty233lb # [ 0.002176] LSM support for eBPF active234client # [ 0.000000] Movable zone start for each node235client # [ 0.000000] Early memory node ranges236lb # [ 0.002359] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)237client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]238lb # [ 0.002393] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)239client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]240lb # [ 0.004502] rcu: Hierarchical SRCU implementation.241client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000242lb # [ 0.004508] rcu: Max phase no-delay instances is 1000.243client # [ 0.000000] psci: probing for conduit method from DT.244lb # [ 0.005954] fsl-mc MSI: its@8080000 domain created245client # [ 0.000000] psci: PSCIv1.3 detected in firmware.246lb # [ 0.006056] EFI services will not be available.247client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs248lb # [ 0.006137] smp: Bringing up secondary CPUs ...249lb # [ 0.006147] smp: Brought up 1 node, 1 CPU250client # [ 0.000000] psci: Trusted OS migration not required251lb # [ 0.006150] SMP: Total of 1 processors activated.252client # [ 0.000000] psci: SMC Calling Convention v1.1253lb # [ 0.006155] CPU: All CPU(s) started at EL1254client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)255lb # [ 0.006166] CPU features: detected: Branch Target Identification256client # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296257lb # [ 0.006171] CPU features: detected: ARMv8.4 Translation Table Level258client # [ 0.000000] Detected PIPT I-cache on CPU0259lb # [ 0.006174] CPU features: detected: Instruction cache invalidation not required for I/D coherence260client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)261client # [ 0.000000] CPU features: detected: GICv3 CPU interface262lb # [ 0.006178] CPU features: detected: Data cache clean to the PoU not required for I/D coherence263client # [ 0.000000] CPU features: detected: Spectre-v4264lb # [ 0.006181] CPU features: detected: Common not Private translations265client # [ 0.000000] CPU features: detected: Spectre-BHB266lb # [ 0.006185] CPU features: detected: CRC32 instructions267client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38268lb # [ 0.006187] CPU features: detected: Data cache clean to Point of Deep Persistence269client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23270client # [ 0.000000] alternatives: applying boot alternatives271lb # [ 0.006191] CPU features: detected: Data cache clean to Point of Persistence272lb # [ 0.006194] CPU features: detected: Data independent timing control (DIT)273lb # [ 0.006197] CPU features: detected: E0PD274lb # [ 0.006200] CPU features: detected: Enhanced Counter Virtualization275lb # [ 0.006203] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)276lb # [ 0.006206] CPU features: detected: Enhanced Virtualization Traps277client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pka8rsnbb5rl489pq588cv7y1qycbh45-nixos-system-client-test/init regInfo=/nix/store/gmykddx7xl27s6hilr51wva292wc8vv2-closure-info/registration console=ttyAMA0,115200n8 console=tty0278lb # [ 0.006210] CPU features: detected: Fine Grained Traps279lb # [ 0.006213] CPU features: detected: Generic authentication (architected QARMA5 algorithm)280client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/gmykddx7xl27s6hilr51wva292wc8vv2-closure-info/registration", will be passed to user space.281lb # [ 0.006219] CPU features: detected: RCpc load-acquire (LDAPR)282client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes283lb # [ 0.006221] CPU features: detected: LSE atomic instructions284client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)285lb # [ 0.006224] CPU features: detected: Privileged Access Never286lb # [ 0.006227] CPU features: detected: PMUv3287client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)288lb # [ 0.006230] CPU features: detected: RAS Extension Support289client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB290lb # [ 0.006233] CPU features: detected: RASv1p1 Extension Support291client # [ 0.000000] software IO TLB: area num 1.292lb # [ 0.006236] CPU features: detected: Random Number Generator293client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB294lb # [ 0.006238] CPU features: detected: Speculation barrier (SB)295client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)296lb # [ 0.006241] CPU features: detected: Stage-2 Force Write-Back297client # [ 0.000000] Fallback order for Node 0: 0298lb # [ 0.006244] CPU features: detected: TLB range maintenance instructions299client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216300client # [ 0.000000] Policy zone: DMA301lb # [ 0.006249] CPU features: detected: Speculative Store Bypassing Safe (SSBS)302client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off303lb # [ 0.006289] alternatives: applying system-wide alternatives304client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1305lb # [ 0.009366] CPU features: detected: BBM Level 2 without TLB conflict abort306client # [ 0.000000] allocated 3145728 bytes of page_ext307client # [ 0.000000] ftrace: allocating 74950 entries in 294 pages308client # [ 0.000000] ftrace: allocated 294 pages with 4 groups309lb # [ 0.009580] Memory: 1405684K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124636K reserved, 32768K cma-reserved)310client # [ 0.000000] rcu: Hierarchical RCU implementation.311lb # [ 0.010085] devtmpfs: initialized312client # [ 0.000000] rcu: RCU event tracing is enabled.313lb # [ 0.011940] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)314client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.315client # [ 0.000000] Trampoline variant of Tasks RCU enabled.316lb # [ 0.011968] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).317worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]318client # [ 0.000000] Rude variant of Tasks RCU enabled.319lb # [ 0.012169] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL320client # [ 0.000000] Tracing variant of Tasks RCU enabled.321lb # [ 0.012173] 0 pages in range for non-PLT usage322lb # [ 0.012174] 508272 pages in range for PLT usage323client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.324worker1 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026325worker1 # [ 0.000000] KASLR enabled326lb # [ 0.012295] pinctrl core: initialized pinctrl subsystem327worker1 # [ 0.000000] random: crng init done328client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1329lb # [ 0.013216] DMI not present or invalid.330worker1 # [ 0.000000] Machine model: linux,dummy-virt331worker1 # [ 0.000000] efi: UEFI not found.332lb # [ 0.017310] NET: Registered PF_NETLINK/PF_ROUTE protocol family333client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.334worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT335client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.336worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]337worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]338client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.339worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]340worker1 # [ 0.000000] Zone ranges:341client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0342worker2 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026343worker2 # [ 0.000000] KASLR enabled344client # [ 0.000000] GICv3: 256 SPIs implemented345worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]346worker2 # [ 0.000000] random: crng init done347worker1 # [ 0.000000] DMA32 empty348client # [ 0.000000] GICv3: 0 Extended SPIs implemented349worker1 # [ 0.000000] Normal empty350worker2 # [ 0.000000] Machine model: linux,dummy-virt351client # [ 0.000000] Root IRQ handler: gic_handle_irq352worker1 # [ 0.000000] Device empty353worker2 # [ 0.000000] efi: UEFI not found.354worker1 # [ 0.000000] Movable zone start for each node355client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI356worker1 # [ 0.000000] Early memory node ranges357worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT358client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0359worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]360worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]361client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000362client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]363worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]364worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]365worker2 # [ 0.000000] Zone ranges:366worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000367client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)368worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]369worker1 # [ 0.000000] psci: probing for conduit method from DT.370worker2 # [ 0.000000] DMA32 empty371worker2 # [ 0.000000] Normal empty372worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.373worker2 # [ 0.000000] Device empty374lb # [ 0.019569] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations375client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)376worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs377worker2 # [ 0.000000] Movable zone start for each node378worker1 # [ 0.000000] psci: Trusted OS migration not required379client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000380lb # [ 0.019776] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations381worker2 # [ 0.000000] Early memory node ranges382worker1 # [ 0.000000] psci: SMC Calling Convention v1.1383client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000384worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]385lb # [ 0.019994] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations386worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)387client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.388worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]389lb # [ 0.020019] audit: initializing netlink subsys (disabled)390worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000391worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296392lb # [ 0.020655] thermal_sys: Registered thermal governor 'fair_share'393client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns394worker1 # [ 0.000000] Detected PIPT I-cache on CPU0395worker2 # [ 0.000000] psci: probing for conduit method from DT.396lb # [ 0.020657] thermal_sys: Registered thermal governor 'bang_bang'397worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.398client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).399worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)400worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs401lb # [ 0.020661] thermal_sys: Registered thermal governor 'step_wise'402worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface403worker2 # [ 0.000000] psci: Trusted OS migration not required404lb # [ 0.020664] thermal_sys: Registered thermal governor 'user_space'405client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns406worker1 # [ 0.000000] CPU features: detected: Spectre-v4407worker2 # [ 0.000000] psci: SMC Calling Convention v1.1408worker1 # [ 0.000000] CPU features: detected: Spectre-BHB409lb # [ 0.020668] thermal_sys: Registered thermal governor 'power_allocator'410client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns411worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38412worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)413client # [ 0.000040] arm-pv: using stolen time PV414lb # [ 0.020693] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1415worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23416lb # [ 0.020703] cpuidle: using governor ladder417worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296418lb # [ 0.020709] cpuidle: using governor menu419client # [ 0.000615] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)420worker1 # [ 0.000000] alternatives: applying boot alternatives421worker2 # [ 0.000000] Detected PIPT I-cache on CPU0422client # [ 0.000815] Console: colour dummy device 80x25423lb # [ 0.020911] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.424worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)425client # [ 0.000823] printk: legacy console [tty0] enabled426lb # [ 0.020929] ASID allocator initialised with 65536 entries427worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface428lb # [ 0.022386] Serial: AMBA PL011 UART driver429worker2 # [ 0.000000] CPU features: detected: Spectre-v4430client # [ 0.001025] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)431worker2 # [ 0.000000] CPU features: detected: Spectre-BHB432client # [ 0.001032] pid_max: default: 32768 minimum: 301433lb # [ 0.028049] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1434worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38435lb # [ 0.028214] printk: console [ttyAMA0] enabled436client # [ 0.001108] LSM: initializing lsm=capability,landlock,yama,bpf,ima437worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/i9c4dcq9i981i967gfs22mhmyydrkc8s-nixos-system-worker1-test/init regInfo=/nix/store/q0yhvq411jnv0dm976pqpl3xd1a1rg1q-closure-info/registration console=ttyAMA0,115200n8 console=tty0438client # [ 0.001281] landlock: Up and running.439worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23440client # [ 0.001284] Yama: becoming mindful.441worker2 # [ 0.000000] alternatives: applying boot alternatives442client # [ 0.001908] LSM support for eBPF active443lb # [ 0.155898] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages444worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/q0yhvq411jnv0dm976pqpl3xd1a1rg1q-closure-info/registration", will be passed to user space.445client # [ 0.002094] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)446lb # [ 0.155921] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page447worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes448client # [ 0.002127] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)449lb # [ 0.155926] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages450worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)451client # [ 0.004107] rcu: Hierarchical SRCU implementation.452lb # [ 0.155930] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page453client # [ 0.004113] rcu: Max phase no-delay instances is 1000.454worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)455lb # [ 0.155934] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages456client # [ 0.005347] fsl-mc MSI: its@8080000 domain created457worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gnimypw801f4lzy6a5zb7cjxr1n5hqxf-nixos-system-worker2-test/init regInfo=/nix/store/gpp1yfkwxlp6j7wbj4qdvyv3hsy2wnhd-closure-info/registration console=ttyAMA0,115200n8 console=tty0458worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB459client # [ 0.005440] EFI services will not be available.460lb # [ 0.155938] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page461worker1 # [ 0.000000] software IO TLB: area num 1.462client # [ 0.005521] smp: Bringing up secondary CPUs ...463lb # [ 0.155943] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages464client # [ 0.005529] smp: Brought up 1 node, 1 CPU465worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/gpp1yfkwxlp6j7wbj4qdvyv3hsy2wnhd-closure-info/registration", will be passed to user space.466worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB467lb # [ 0.155947] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page468client # [ 0.005532] SMP: Total of 1 processors activated.469worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)470worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes471client # [ 0.005537] CPU: All CPU(s) started at EL1472worker1 # [ 0.000000] Fallback order for Node 0: 0473client # [ 0.005548] CPU features: detected: Branch Target Identification474worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)475worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216476client # [ 0.005553] CPU features: detected: ARMv8.4 Translation Table Level477worker1 # [ 0.000000] Policy zone: DMA478lb # [ 0.163465] fbcon: Taking over console479worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)480lb # [ 0.163484] ACPI: Interpreter disabled.481worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off482client # [ 0.005556] CPU features: detected: Instruction cache invalidation not required for I/D coherence483worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB484worker2 # [ 0.000000] software IO TLB: area num 1.485worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1486lb # [ 0.165506] iommu: Default domain type: Translated487client # [ 0.005560] CPU features: detected: Data cache clean to the PoU not required for I/D coherence488worker1 # [ 0.000000] allocated 3145728 bytes of page_ext489worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB490lb # [ 0.165517] iommu: DMA domain TLB invalidation policy: strict mode491client # [ 0.005564] CPU features: detected: Common not Private translations492worker1 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages493worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)494client # [ 0.005567] CPU features: detected: CRC32 instructions495worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups496worker2 # [ 0.000000] Fallback order for Node 0: 0497worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.498client # [ 0.005570] CPU features: detected: Data cache clean to Point of Deep Persistence499worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216500worker1 # [ 0.000000] rcu: RCU event tracing is enabled.501worker2 # [ 0.000000] Policy zone: DMA502client # [ 0.005573] CPU features: detected: Data cache clean to Point of Persistence503worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.504worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off505worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.506client # [ 0.005576] CPU features: detected: Data independent timing control (DIT)507worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1508client # [ 0.005579] CPU features: detected: E0PD509worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.510worker2 # [ 0.000000] allocated 3145728 bytes of page_ext511worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.512client # [ 0.005582] CPU features: detected: Enhanced Counter Virtualization513worker2 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages514worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.515client # [ 0.005585] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)516worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups517client # [ 0.005589] CPU features: detected: Enhanced Virtualization Traps518worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.519worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1520lb # [ 0.172493] SCSI subsystem initialized521client # [ 0.005591] CPU features: detected: Fine Grained Traps522worker2 # [ 0.000000] rcu: RCU event tracing is enabled.523worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.524worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.525client # [ 0.005595] CPU features: detected: Generic authentication (architected QARMA5 algorithm)526lb # [ 0.173215] usbcore: registered new interface driver usbfs527worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.528worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.529client # [ 0.005601] CPU features: detected: RCpc load-acquire (LDAPR)530lb # [ 0.173254] usbcore: registered new interface driver hub531worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.532lb # [ 0.173279] usbcore: registered new device driver usb533client # [ 0.005604] CPU features: detected: LSE atomic instructions534worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.535worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.536lb # [ 0.173566] pps_core: LinuxPPS API ver. 1 registered537client # [ 0.005607] CPU features: detected: Privileged Access Never538worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0539worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.540client # [ 0.005609] CPU features: detected: PMUv3541worker1 # [ 0.000000] GICv3: 256 SPIs implemented542lb # [ 0.173573] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>543client # [ 0.005612] CPU features: detected: RAS Extension Support544worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1545worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented546lb # [ 0.173582] PTP clock support registered547client # [ 0.005615] CPU features: detected: RASv1p1 Extension Support548worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq549lb # [ 0.173637] EDAC MC: Ver: 3.0.0550worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.551worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI552client # [ 0.005617] CPU features: detected: Random Number Generator553lb # [ 0.178121] scmi_core: SCMI protocol bus registered554worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0555client # [ 0.005620] CPU features: detected: Speculation barrier (SB)556worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.557client # [ 0.005623] CPU features: detected: Stage-2 Force Write-Back558lb # [ 0.179096] FPGA manager framework559worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000560worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]561lb # [ 0.180091] vgaarb: loaded562worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.563client # [ 0.005626] CPU features: detected: TLB range maintenance instructions564worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0565client # [ 0.005630] CPU features: detected: Speculative Store Bypassing Safe (SSBS)566lb # [ 0.180775] clocksource: Switched to clocksource arch_sys_counter567worker2 # [ 0.000000] GICv3: 256 SPIs implemented568worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)569client # [ 0.005672] alternatives: applying system-wide alternatives570worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented571worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq572worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)573client # [ 0.008727] CPU features: detected: BBM Level 2 without TLB conflict abort574worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI575worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000576worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0577worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000578worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000579client # [ 0.008969] Memory: 1405612K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124660K reserved, 32768K cma-reserved)580client # [ 0.009544] devtmpfs: initialized581worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]582worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.583client # [ 0.011417] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)584worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)585worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns586client # [ 0.011439] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).587worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).588worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)589client # [ 0.011653] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL590lb # [ 0.186916] VFS: Disk quotas dquot_6.6.0591worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000592client # [ 0.011657] 0 pages in range for non-PLT usage593worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns594lb # [ 0.186960] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)595client # [ 0.011658] 508272 pages in range for PLT usage596worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000597worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns598client # [ 0.011769] pinctrl core: initialized pinctrl subsystem599lb # [ 0.188606] netfs: FS-Cache loaded600worker1 # [ 0.000041] arm-pv: using stolen time PV601lb # [ 0.188743] pnp: PnP ACPI: disabled602worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.603client # [ 0.012502] DMI not present or invalid.604client # [ 0.016110] NET: Registered PF_NETLINK/PF_ROUTE protocol family605worker1 # [ 0.000459] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)606worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns607client # [ 0.018337] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations608worker1 # [ 0.000657] Console: colour dummy device 80x25609worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).610worker1 # [ 0.000665] printk: legacy console [tty0] enabled611client # [ 0.018539] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations612worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns613client # [ 0.018741] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations614worker1 # [ 0.000869] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)615client # [ 0.018764] audit: initializing netlink subsys (disabled)616worker1 # [ 0.000876] pid_max: default: 32768 minimum: 301617worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns618worker2 # [ 0.000038] arm-pv: using stolen time PV619worker1 # [ 0.000976] LSM: initializing lsm=capability,landlock,yama,bpf,ima620client # [ 0.019344] thermal_sys: Registered thermal governor 'fair_share'621worker1 # [ 0.001126] landlock: Up and running.622client # [ 0.019346] thermal_sys: Registered thermal governor 'bang_bang'623worker1 # [ 0.001129] Yama: becoming mindful.624worker2 # [ 0.000501] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)625worker1 # [ 0.001590] LSM support for eBPF active626client # [ 0.019350] thermal_sys: Registered thermal governor 'step_wise'627worker2 # [ 0.000663] Console: colour dummy device 80x25628client # [ 0.019353] thermal_sys: Registered thermal governor 'user_space'629worker1 # [ 0.001739] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)630worker2 # [ 0.000671] printk: legacy console [tty0] enabled631client # [ 0.019358] thermal_sys: Registered thermal governor 'power_allocator'632worker1 # [ 0.001772] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)633lb # [ 0.192796] NET: Registered PF_INET protocol family634worker2 # [ 0.000927] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)635worker1 # [ 0.003754] rcu: Hierarchical SRCU implementation.636client # [ 0.019384] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1637worker2 # [ 0.000935] pid_max: default: 32768 minimum: 301638lb # [ 0.193061] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)639worker1 # [ 0.003760] rcu: Max phase no-delay instances is 1000.640client # [ 0.019392] cpuidle: using governor ladder641worker2 # [ 0.001038] LSM: initializing lsm=capability,landlock,yama,bpf,ima642client # [ 0.019397] cpuidle: using governor menu643worker1 # [ 0.005105] fsl-mc MSI: its@8080000 domain created644worker2 # [ 0.001179] landlock: Up and running.645worker1 # [ 0.005216] EFI services will not be available.646client # [ 0.019612] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.647worker2 # [ 0.001184] Yama: becoming mindful.648worker1 # [ 0.005333] smp: Bringing up secondary CPUs ...649worker2 # [ 0.001675] LSM support for eBPF active650client # [ 0.019634] ASID allocator initialised with 65536 entries651worker1 # [ 0.005343] smp: Brought up 1 node, 1 CPU652client # [ 0.020929] Serial: AMBA PL011 UART driver653worker2 # [ 0.001870] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)654worker1 # [ 0.005346] SMP: Total of 1 processors activated.655worker1 # [ 0.005351] CPU: All CPU(s) started at EL1656client # [ 0.026413] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1657worker2 # [ 0.001904] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)658worker1 # [ 0.005362] CPU features: detected: Branch Target Identification659client # [ 0.026605] printk: console [ttyAMA0] enabled660worker2 # [ 0.004319] rcu: Hierarchical SRCU implementation.661worker1 # [ 0.005367] CPU features: detected: ARMv8.4 Translation Table Level662worker2 # [ 0.004325] rcu: Max phase no-delay instances is 1000.663worker2 # [ 0.005819] fsl-mc MSI: its@8080000 domain created664worker1 # [ 0.005370] CPU features: detected: Instruction cache invalidation not required for I/D coherence665worker2 # [ 0.005949] EFI services will not be available.666worker2 # [ 0.006066] smp: Bringing up secondary CPUs ...667worker1 # [ 0.005374] CPU features: detected: Data cache clean to the PoU not required for I/D coherence668worker2 # [ 0.006092] smp: Brought up 1 node, 1 CPU669worker2 # [ 0.006103] SMP: Total of 1 processors activated.670worker1 # [ 0.005377] CPU features: detected: Common not Private translations671worker2 # [ 0.006121] CPU: All CPU(s) started at EL1672worker1 # [ 0.005381] CPU features: detected: CRC32 instructions673worker2 # [ 0.006136] CPU features: detected: Branch Target Identification674worker1 # [ 0.005383] CPU features: detected: Data cache clean to Point of Deep Persistence675worker2 # [ 0.006141] CPU features: detected: ARMv8.4 Translation Table Level676worker1 # [ 0.005387] CPU features: detected: Data cache clean to Point of Persistence677worker2 # [ 0.006144] CPU features: detected: Instruction cache invalidation not required for I/D coherence678worker1 # [ 0.005390] CPU features: detected: Data independent timing control (DIT)679worker1 # [ 0.005393] CPU features: detected: E0PD680worker2 # [ 0.006148] CPU features: detected: Data cache clean to the PoU not required for I/D coherence681client # [ 0.146928] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages682worker1 # [ 0.005395] CPU features: detected: Enhanced Counter Virtualization683worker2 # [ 0.006152] CPU features: detected: Common not Private translations684client # [ 0.146952] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page685worker2 # [ 0.006155] CPU features: detected: CRC32 instructions686worker1 # [ 0.005398] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)687client # [ 0.146957] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages688worker1 # [ 0.005402] CPU features: detected: Enhanced Virtualization Traps689worker2 # [ 0.006158] CPU features: detected: Data cache clean to Point of Deep Persistence690client # [ 0.146962] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page691worker1 # [ 0.005405] CPU features: detected: Fine Grained Traps692worker2 # [ 0.006161] CPU features: detected: Data cache clean to Point of Persistence693client # [ 0.146966] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages694worker1 # [ 0.005409] CPU features: detected: Generic authentication (architected QARMA5 algorithm)695worker2 # [ 0.006164] CPU features: detected: Data independent timing control (DIT)696client # [ 0.146971] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page697worker2 # [ 0.006168] CPU features: detected: E0PD698worker1 # [ 0.005413] CPU features: detected: RCpc load-acquire (LDAPR)699worker1 # [ 0.005416] CPU features: detected: LSE atomic instructions700client # [ 0.146975] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages701worker2 # [ 0.006170] CPU features: detected: Enhanced Counter Virtualization702worker1 # [ 0.005419] CPU features: detected: Privileged Access Never703client # [ 0.146979] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page704worker2 # [ 0.006173] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)705worker1 # [ 0.005421] CPU features: detected: PMUv3706worker2 # [ 0.006177] CPU features: detected: Enhanced Virtualization Traps707worker2 # [ 0.006180] CPU features: detected: Fine Grained Traps708worker1 # [ 0.005424] CPU features: detected: RAS Extension Support709client # [ 0.154579] fbcon: Taking over console710worker2 # [ 0.006183] CPU features: detected: Generic authentication (architected QARMA5 algorithm)711worker1 # [ 0.005427] CPU features: detected: RASv1p1 Extension Support712client # [ 0.154598] ACPI: Interpreter disabled.713worker2 # [ 0.006198] CPU features: detected: RCpc load-acquire (LDAPR)714worker1 # [ 0.005429] CPU features: detected: Random Number Generator715worker2 # [ 0.006207] CPU features: detected: LSE atomic instructions716worker1 # [ 0.005432] CPU features: detected: Speculation barrier (SB)717worker2 # [ 0.006210] CPU features: detected: Privileged Access Never718worker1 # [ 0.005435] CPU features: detected: Stage-2 Force Write-Back719worker2 # [ 0.006212] CPU features: detected: PMUv3720worker1 # [ 0.005438] CPU features: detected: TLB range maintenance instructions721worker2 # [ 0.006215] CPU features: detected: RAS Extension Support722worker2 # [ 0.006218] CPU features: detected: RASv1p1 Extension Support723worker1 # [ 0.005443] CPU features: detected: Speculative Store Bypassing Safe (SSBS)724worker2 # [ 0.006221] CPU features: detected: Random Number Generator725worker1 # [ 0.005481] alternatives: applying system-wide alternatives726worker2 # [ 0.006223] CPU features: detected: Speculation barrier (SB)727worker1 # [ 0.009433] CPU features: detected: BBM Level 2 without TLB conflict abort728worker2 # [ 0.006226] CPU features: detected: Stage-2 Force Write-Back729worker2 # [ 0.006229] CPU features: detected: TLB range maintenance instructions730worker1 # [ 0.009615] Memory: 1405644K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124664K reserved, 32768K cma-reserved)731worker2 # [ 0.006234] CPU features: detected: Speculative Store Bypassing Safe (SSBS)732worker1 # [ 0.010101] devtmpfs: initialized733worker2 # [ 0.006276] alternatives: applying system-wide alternatives734worker1 # [ 0.012061] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)735client # [ 0.163705] iommu: Default domain type: Translated736worker2 # [ 0.010397] CPU features: detected: BBM Level 2 without TLB conflict abort737client # [ 0.163718] iommu: DMA domain TLB invalidation policy: strict mode738worker1 # [ 0.012084] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).739client # [ 0.164084] SCSI subsystem initialized740worker1 # [ 0.012301] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL741worker2 # [ 0.010581] Memory: 1405680K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124632K reserved, 32768K cma-reserved)742worker1 # [ 0.012305] 0 pages in range for non-PLT usage743client # [ 0.166030] usbcore: registered new interface driver usbfs744worker1 # [ 0.012306] 508272 pages in range for PLT usage745lb # [ 0.222463] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)746client # [ 0.166077] usbcore: registered new interface driver hub747worker2 # [ 0.011190] devtmpfs: initialized748worker1 # [ 0.012422] pinctrl core: initialized pinctrl subsystem749lb # [ 0.222511] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)750worker1 # [ 0.013237] DMI not present or invalid.751client # [ 0.166092] usbcore: registered new device driver usb752worker2 # [ 0.013066] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)753client # [ 0.166369] pps_core: LinuxPPS API ver. 1 registered754worker1 # [ 0.016373] NET: Registered PF_NETLINK/PF_ROUTE protocol family755lb # [ 0.222539] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)756worker2 # [ 0.013089] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).757worker1 # [ 0.018805] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations758client # [ 0.166374] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>759lb # [ 0.222612] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)760client # [ 0.166383] PTP clock support registered761worker2 # [ 0.013277] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL762worker1 # [ 0.019015] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations763lb # [ 0.222757] TCP: Hash tables configured (established 16384 bind 16384)764client # [ 0.166447] EDAC MC: Ver: 3.0.0765worker2 # [ 0.013296] 0 pages in range for non-PLT usage766worker2 # [ 0.013297] 508272 pages in range for PLT usage767worker1 # [ 0.019215] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations768client # [ 0.170937] scmi_core: SCMI protocol bus registered769lb # [ 0.222845] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)770worker2 # [ 0.013386] pinctrl core: initialized pinctrl subsystem771worker1 # [ 0.019240] audit: initializing netlink subsys (disabled)772lb # [ 0.222883] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)773worker2 # [ 0.014213] DMI not present or invalid.774client # [ 0.171969] FPGA manager framework775worker1 # [ 0.019871] thermal_sys: Registered thermal governor 'fair_share'776client # [ 0.172887] vgaarb: loaded777lb # [ 0.222918] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)778worker2 # [ 0.017550] NET: Registered PF_NETLINK/PF_ROUTE protocol family779worker1 # [ 0.019873] thermal_sys: Registered thermal governor 'bang_bang'780lb # [ 0.223026] NET: Registered PF_UNIX/PF_LOCAL protocol family781worker2 # [ 0.019763] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations782client # [ 0.173500] clocksource: Switched to clocksource arch_sys_counter783worker1 # [ 0.019876] thermal_sys: Registered thermal governor 'step_wise'784lb # [ 0.223067] NET: Registered PF_XDP protocol family785worker2 # [ 0.019960] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations786lb # [ 0.223087] PCI: CLS 0 bytes, default 64787worker1 # [ 0.019879] thermal_sys: Registered thermal governor 'user_space'788lb # [ 0.223366] Trying to unpack rootfs image as initramfs...789worker2 # [ 0.020155] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations790worker1 # [ 0.019884] thermal_sys: Registered thermal governor 'power_allocator'791worker2 # [ 0.020189] audit: initializing netlink subsys (disabled)792worker1 # [ 0.019911] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1793worker2 # [ 0.020770] thermal_sys: Registered thermal governor 'fair_share'794worker1 # [ 0.019920] cpuidle: using governor ladder795worker1 # [ 0.019926] cpuidle: using governor menu796worker2 # [ 0.020773] thermal_sys: Registered thermal governor 'bang_bang'797worker1 # [ 0.020133] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.798worker2 # [ 0.020776] thermal_sys: Registered thermal governor 'step_wise'799client # [ 0.178487] VFS: Disk quotas dquot_6.6.0800worker1 # [ 0.020150] ASID allocator initialised with 65536 entries801worker2 # [ 0.020779] thermal_sys: Registered thermal governor 'user_space'802worker1 # [ 0.021467] Serial: AMBA PL011 UART driver803client # [ 0.178530] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)804worker2 # [ 0.020784] thermal_sys: Registered thermal governor 'power_allocator'805worker1 # [ 0.026917] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1806worker2 # [ 0.020815] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1807worker1 # [ 0.027065] printk: console [ttyAMA0] enabled808worker2 # [ 0.020824] cpuidle: using governor ladder809worker2 # [ 0.020830] cpuidle: using governor menu810client # [ 0.182194] netfs: FS-Cache loaded811worker2 # [ 0.021015] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.812client # [ 0.182314] pnp: PnP ACPI: disabled813worker2 # [ 0.021030] ASID allocator initialised with 65536 entries814worker2 # [ 0.022346] Serial: AMBA PL011 UART driver815worker2 # [ 0.027939] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1816worker2 # [ 0.028103] printk: console [ttyAMA0] enabled817client # [ 0.186211] NET: Registered PF_INET protocol family818worker1 # [ 0.148248] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages819lb # [ 0.244814] kvm [1]: HYP mode not available820client # [ 0.186471] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)821worker1 # [ 0.148270] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page822worker1 # [ 0.148276] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages823worker1 # [ 0.148281] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page824worker1 # [ 0.148285] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages825worker1 # [ 0.148290] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page826worker2 # [ 0.148947] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages827worker1 # [ 0.148294] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages828worker2 # [ 0.148965] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page829worker1 # [ 0.148298] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page830worker2 # [ 0.148971] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages831worker2 # [ 0.148975] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page832worker2 # [ 0.148980] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages833worker1 # [ 0.156006] fbcon: Taking over console834worker2 # [ 0.148984] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page835worker1 # [ 0.156022] ACPI: Interpreter disabled.836worker2 # [ 0.148988] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages837worker2 # [ 0.148992] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page838worker2 # [ 0.156522] fbcon: Taking over console839worker2 # [ 0.156540] ACPI: Interpreter disabled.840worker1 # [ 0.164654] iommu: Default domain type: Translated841worker1 # [ 0.164665] iommu: DMA domain TLB invalidation policy: strict mode842worker1 # [ 0.165178] SCSI subsystem initialized843worker1 # [ 0.167212] usbcore: registered new interface driver usbfs844worker1 # [ 0.167250] usbcore: registered new interface driver hub845worker1 # [ 0.167269] usbcore: registered new device driver usb846worker2 # [ 0.165231] iommu: Default domain type: Translated847worker1 # [ 0.167568] pps_core: LinuxPPS API ver. 1 registered848worker2 # [ 0.165243] iommu: DMA domain TLB invalidation policy: strict mode849worker2 # [ 0.165648] SCSI subsystem initialized850worker1 # [ 0.167578] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>851worker1 # [ 0.167590] PTP clock support registered852worker1 # [ 0.167642] EDAC MC: Ver: 3.0.0853worker2 # [ 0.167680] usbcore: registered new interface driver usbfs854worker2 # [ 0.167712] usbcore: registered new interface driver hub855worker1 # [ 0.172366] scmi_core: SCMI protocol bus registered856worker2 # [ 0.167728] usbcore: registered new device driver usb857worker1 # [ 0.173400] FPGA manager framework858worker2 # [ 0.168026] pps_core: LinuxPPS API ver. 1 registered859worker1 # [ 0.174436] vgaarb: loaded860worker2 # [ 0.168036] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>861worker1 # [ 0.175095] clocksource: Switched to clocksource arch_sys_counter862worker2 # [ 0.168046] PTP clock support registered863worker2 # [ 0.168108] EDAC MC: Ver: 3.0.0864worker2 # [ 0.172823] scmi_core: SCMI protocol bus registered865worker2 # [ 0.173855] FPGA manager framework866worker1 # [ 0.177922] VFS: Disk quotas dquot_6.6.0867worker2 # [ 0.174830] vgaarb: loaded868worker1 # [ 0.177960] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)869worker2 # [ 0.175512] clocksource: Switched to clocksource arch_sys_counter870client # [ 0.215609] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)871client # [ 0.215656] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)872worker1 # [ 0.181885] netfs: FS-Cache loaded873worker1 # [ 0.182022] pnp: PnP ACPI: disabled874client # [ 0.215684] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)875client # [ 0.215759] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)876worker2 # [ 0.180204] VFS: Disk quotas dquot_6.6.0877client # [ 0.215904] TCP: Hash tables configured (established 16384 bind 16384)878worker2 # [ 0.180250] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)879client # [ 0.215990] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)880worker2 # [ 0.181976] netfs: FS-Cache loaded881worker2 # [ 0.182109] pnp: PnP ACPI: disabled882client # [ 0.216034] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)883client # [ 0.216072] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)884worker1 # [ 0.186180] NET: Registered PF_INET protocol family885client # [ 0.216171] NET: Registered PF_UNIX/PF_LOCAL protocol family886worker1 # [ 0.186472] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)887client # [ 0.216199] NET: Registered PF_XDP protocol family888client # [ 0.216217] PCI: CLS 0 bytes, default 64889client # [ 0.216460] Trying to unpack rootfs image as initramfs...890worker2 # [ 0.186205] NET: Registered PF_INET protocol family891worker2 # [ 0.186480] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)892client # [ 0.231404] kvm [1]: HYP mode not available893worker1 # [ 0.216567] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)894worker1 # [ 0.216623] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)895worker1 # [ 0.216651] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)896worker1 # [ 0.216725] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)897worker1 # [ 0.216868] TCP: Hash tables configured (established 16384 bind 16384)898worker2 # [ 0.216353] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)899worker1 # [ 0.216982] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)900worker2 # [ 0.216404] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)901worker1 # [ 0.217021] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)902worker2 # [ 0.216432] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)903worker1 # [ 0.217059] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)904worker1 # [ 0.217178] NET: Registered PF_UNIX/PF_LOCAL protocol family905worker2 # [ 0.216514] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)906worker1 # [ 0.217199] NET: Registered PF_XDP protocol family907worker2 # [ 0.216656] TCP: Hash tables configured (established 16384 bind 16384)908worker1 # [ 0.217218] PCI: CLS 0 bytes, default 64909worker2 # [ 0.216741] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)910worker1 # [ 0.217474] Trying to unpack rootfs image as initramfs...911worker2 # [ 0.216775] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)912worker2 # [ 0.216810] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)913lb # [ 0.337329] Initialise system trusted keyrings914worker2 # [ 0.216907] NET: Registered PF_UNIX/PF_LOCAL protocol family915lb # [ 0.338147] workingset: timestamp_bits=42 max_order=19 bucket_order=0916worker2 # [ 0.216945] NET: Registered PF_XDP protocol family917worker1 # [ 0.232900] kvm [1]: HYP mode not available918worker2 # [ 0.216964] PCI: CLS 0 bytes, default 64919lb # [ 0.339461] squashfs: version 4.0 (2009/01/31) Phillip Lougher920worker2 # [ 0.217242] Trying to unpack rootfs image as initramfs...921lb # [ 0.340246] 9p: Installing v9fs 9p2000 file system support922worker2 # [ 0.233376] kvm [1]: HYP mode not available923lb # [ 0.368940] Key type asymmetric registered924lb # [ 0.368969] Asymmetric key parser 'x509' registered925lb # [ 0.369045] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)926lb # [ 0.371188] io scheduler mq-deadline registered927lb # [ 0.371199] io scheduler kyber registered928lb # [ 0.380924] pl061_gpio 9030000.pl061: PL061 GPIO chip registered929lb # [ 0.382363] ledtrig-cpu: registered to indicate activity on CPUs930lb # [ 0.382777] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:931lb # [ 0.382796] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000932lb # [ 0.382808] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000933client # [ 0.326087] Initialise system trusted keyrings934lb # [ 0.382817] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000935client # [ 0.326857] workingset: timestamp_bits=42 max_order=19 bucket_order=0936lb # [ 0.382839] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits937client # [ 0.328158] squashfs: version 4.0 (2009/01/31) Phillip Lougher938lb # [ 0.382865] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]939lb # [ 0.382950] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00940lb # [ 0.382959] pci_bus 0000:00: root bus resource [bus 00-ff]941lb # [ 0.382966] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]942lb # [ 0.382971] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]943lb # [ 0.382976] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]944lb # [ 0.383064] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint945lb # [ 0.383498] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint946lb # [ 0.383681] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]947lb # [ 0.383697] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]948lb # [ 0.383727] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]949client # [ 0.333556] 9p: Installing v9fs 9p2000 file system support950lb # [ 0.383743] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]951lb # [ 0.384196] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint952lb # [ 0.384377] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]953lb # [ 0.384392] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]954lb # [ 0.384421] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]955client # [ 0.354352] Key type asymmetric registered956lb # [ 0.408935] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint957client # [ 0.354377] Asymmetric key parser 'x509' registered958lb # [ 0.409148] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]959client # [ 0.354461] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)960lb # [ 0.409166] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]961client # [ 0.356657] io scheduler mq-deadline registered962lb # [ 0.409196] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]963client # [ 0.356668] io scheduler kyber registered964lb # [ 0.409695] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint965lb # [ 0.409876] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]966lb # [ 0.409892] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]967lb # [ 0.409921] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]968lb # [ 0.409940] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]969lb # [ 0.410390] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint970lb # [ 0.410573] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]971lb # [ 0.410602] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]972lb # [ 0.411052] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint973lb # [ 0.411233] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]974lb # [ 0.411263] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]975lb # [ 0.411641] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint976lb # [ 0.411819] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]977lb # [ 0.412301] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint978lb # [ 0.412487] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]979lb # [ 0.412516] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]980client # [ 0.369886] pl061_gpio 9030000.pl061: PL061 GPIO chip registered981lb # [ 0.412994] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint982lb # [ 0.413176] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]983lb # [ 0.413205] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]984client # [ 0.371336] ledtrig-cpu: registered to indicate activity on CPUs985lb # [ 0.413648] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint986client # [ 0.371752] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:987lb # [ 0.413831] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]988lb # [ 0.413861] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]989client # [ 0.371770] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000990lb # [ 0.414310] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint991client # [ 0.371789] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000992worker1 # [ 0.335703] Initialise system trusted keyrings993lb # [ 0.414589] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]994client # [ 0.371798] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000995lb # [ 0.414607] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]996worker1 # [ 0.336456] workingset: timestamp_bits=42 max_order=19 bucket_order=0997lb # [ 0.414636] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]998client # [ 0.371819] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits999worker1 # [ 0.337763] squashfs: version 4.0 (2009/01/31) Phillip Lougher1000lb # [ 0.415088] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1001client # [ 0.371843] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1002worker1 # [ 0.338527] 9p: Installing v9fs 9p2000 file system support1003lb # [ 0.415270] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1004client # [ 0.371919] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001005lb # [ 0.415286] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1006client # [ 0.371929] pci_bus 0000:00: root bus resource [bus 00-ff]1007lb # [ 0.415315] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1008client # [ 0.371935] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1009lb # [ 0.415879] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1010client # [ 0.371941] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1011lb # [ 0.415890] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1012client # [ 0.371945] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1013lb # [ 0.415896] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1014client # [ 0.372003] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1015lb # [ 0.415940] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1016client # [ 0.372439] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1017client # [ 0.372625] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1018lb # [ 0.415986] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1019client # [ 0.372641] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1020lb # [ 0.416033] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1021client # [ 0.372671] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1022lb # [ 0.416080] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1023client # [ 0.372687] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1024lb # [ 0.416127] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1025client # [ 0.373140] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1026client # [ 0.373328] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1027lb # [ 0.416173] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1028client # [ 0.373344] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1029lb # [ 0.416220] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1030client # [ 0.373374] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1031lb # [ 0.416266] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1032lb # [ 0.416312] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1033lb # [ 0.416386] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1034lb # [ 0.416431] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1035lb # [ 0.416453] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1036lb # [ 0.416475] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1037lb # [ 0.416496] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1038lb # [ 0.416517] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1039lb # [ 0.416539] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1040lb # [ 0.416569] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1041lb # [ 0.416595] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1042client # [ 0.397952] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1043lb # [ 0.416617] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1044client # [ 0.398176] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1045lb # [ 0.416639] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1046client # [ 0.398194] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1047lb # [ 0.416662] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1048client # [ 0.398224] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1049lb # [ 0.416686] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1050client # [ 0.398685] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1051lb # [ 0.416707] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1052client # [ 0.398870] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1053lb # [ 0.416728] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1054client # [ 0.398886] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1055lb # [ 0.416750] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1056client # [ 0.398916] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1057lb # [ 0.416771] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1058client # [ 0.398935] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1059worker1 # [ 0.367341] Key type asymmetric registered1060client # [ 0.399386] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1061worker1 # [ 0.367370] Asymmetric key parser 'x509' registered1062client # [ 0.399574] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1063worker1 # [ 0.367446] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1064client # [ 0.399604] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1065worker1 # [ 0.369646] io scheduler mq-deadline registered1066worker1 # [ 0.369658] io scheduler kyber registered1067client # [ 0.400064] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1068client # [ 0.400254] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1069client # [ 0.400285] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1070client # [ 0.400672] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1071client # [ 0.400852] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1072client # [ 0.401098] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1073client # [ 0.401287] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1074client # [ 0.401318] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1075lb # [ 0.476868] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1076lb # [ 0.476908] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1077lb # [ 0.476943] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1078lb # [ 0.476953] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1079lb # [ 0.476958] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1080worker1 # [ 0.379262] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1081lb # [ 0.477793] pci 0000:00:07.0: enabling device (0000 -> 0002)1082client # [ 0.418294] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1083client # [ 0.418485] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1084client # [ 0.418515] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1085worker2 # [ 0.378892] Initialise system trusted keyrings1086client # [ 0.418973] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1087worker1 # [ 0.380739] ledtrig-cpu: registered to indicate activity on CPUs1088worker2 # [ 0.379685] workingset: timestamp_bits=42 max_order=19 bucket_order=01089client # [ 0.419163] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1090worker1 # [ 0.381189] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1091worker2 # [ 0.380951] squashfs: version 4.0 (2009/01/31) Phillip Lougher1092client # [ 0.419193] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1093worker1 # [ 0.381207] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001094client # [ 0.419650] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1095worker1 # [ 0.381220] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001096client # [ 0.419945] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1097client # [ 0.419962] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1098worker1 # [ 0.381229] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001099client # [ 0.419992] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1100worker1 # [ 0.381254] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1101client # [ 0.420462] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1102worker1 # [ 0.381282] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1103client # [ 0.420645] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1104client # [ 0.420661] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1105worker1 # [ 0.381378] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001106worker1 # [ 0.381389] pci_bus 0000:00: root bus resource [bus 00-ff]1107client # [ 0.420691] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1108worker1 # [ 0.381396] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1109client # [ 0.421282] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1110worker1 # [ 0.381401] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1111client # [ 0.421293] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1112worker1 # [ 0.381407] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1113client # [ 0.421299] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1114worker1 # [ 0.381474] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1115client # [ 0.421344] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1116worker1 # [ 0.381944] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1117client # [ 0.421391] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1118worker1 # [ 0.382133] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1119client # [ 0.421437] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1120worker1 # [ 0.382150] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1121worker1 # [ 0.382179] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1122client # [ 0.421484] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1123worker1 # [ 0.382196] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1124worker2 # [ 0.387581] 9p: Installing v9fs 9p2000 file system support1125worker1 # [ 0.382661] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1126worker1 # [ 0.382845] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1127worker1 # [ 0.382861] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1128worker1 # [ 0.382891] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1129worker1 # [ 0.402555] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1130worker1 # [ 0.402738] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1131worker1 # [ 0.402755] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1132lb # [ 0.507681] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1133worker1 # [ 0.402785] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1134client # [ 0.445611] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1135client # [ 0.445676] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1136client # [ 0.445725] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1137client # [ 0.445772] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1138worker2 # [ 0.407705] Key type asymmetric registered1139worker2 # [ 0.407731] Asymmetric key parser 'x509' registered1140client # [ 0.445819] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1141worker2 # [ 0.407799] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1142client # [ 0.445947] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1143worker2 # [ 0.410043] io scheduler mq-deadline registered1144worker2 # [ 0.410055] io scheduler kyber registered1145client # [ 0.446004] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1146client # [ 0.446027] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1147client # [ 0.446064] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1148client # [ 0.446087] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1149client # [ 0.446109] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1150lb # [ 0.518087] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1151client # [ 0.446131] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1152client # [ 0.446152] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1153worker1 # [ 0.411325] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1154client # [ 0.446179] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1155worker1 # [ 0.411533] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1156client # [ 0.446201] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1157worker1 # [ 0.411551] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1158client # [ 0.446223] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1159lb # [ 0.522411] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1160worker1 # [ 0.411581] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1161worker1 # [ 0.411601] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1162client # [ 0.446245] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1163lb # [ 0.524362] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1164client # [ 0.446267] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1165worker1 # [ 0.412084] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1166client # [ 0.446288] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1167worker2 # [ 0.419654] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1168worker1 # [ 0.412271] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1169client # [ 0.446309] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1170worker1 # [ 0.412301] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1171client # [ 0.446330] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1172worker1 # [ 0.412755] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1173client # [ 0.446351] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1174worker1 # [ 0.412967] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1175client # [ 0.446372] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1176worker2 # [ 0.421078] ledtrig-cpu: registered to indicate activity on CPUs1177worker1 # [ 0.412998] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1178client # [ 0.446393] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1179worker2 # [ 0.421475] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1180client # [ 0.446423] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1181worker1 # [ 0.413417] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1182client # [ 0.446432] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1183worker2 # [ 0.421492] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001184worker1 # [ 0.413598] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1185client # [ 0.446437] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1186worker1 # [ 0.413846] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1187worker2 # [ 0.421505] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001188lb # [ 0.530076] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1189client # [ 0.447252] pci 0000:00:07.0: enabling device (0000 -> 0002)1190worker1 # [ 0.414032] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1191lb # [ 0.532238] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1192worker2 # [ 0.421513] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001193worker1 # [ 0.414062] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1194worker2 # [ 0.421537] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1195worker1 # [ 0.414510] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1196worker2 # [ 0.421564] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1197worker1 # [ 0.414696] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1198worker2 # [ 0.421648] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001199worker1 # [ 0.414726] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1200worker2 # [ 0.421658] pci_bus 0000:00: root bus resource [bus 00-ff]1201worker1 # [ 0.415193] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1202worker2 # [ 0.421665] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1203worker1 # [ 0.415378] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1204worker2 # [ 0.421670] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1205worker1 # [ 0.415408] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1206worker2 # [ 0.421675] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1207worker1 # [ 0.415867] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1208worker2 # [ 0.421739] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1209worker1 # [ 0.416186] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1210worker1 # [ 0.416203] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1211worker2 # [ 0.422209] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1212worker2 # [ 0.422396] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1213worker1 # [ 0.416233] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1214worker2 # [ 0.422413] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1215worker1 # [ 0.416712] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1216lb # [ 0.542276] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1217worker2 # [ 0.422443] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1218worker1 # [ 0.416914] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1219lb # [ 0.544534] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1220worker2 # [ 0.422459] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1221worker1 # [ 0.416930] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1222worker2 # [ 0.422915] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1223worker1 # [ 0.416961] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1224worker2 # [ 0.423097] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1225worker1 # [ 0.417549] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1226worker2 # [ 0.423112] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1227worker1 # [ 0.417560] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1228worker2 # [ 0.423141] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1229worker1 # [ 0.417566] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1230worker1 # [ 0.417612] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1231worker1 # [ 0.417659] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1232worker1 # [ 0.417707] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1233worker1 # [ 0.417755] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1234worker1 # [ 0.417802] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1235worker1 # [ 0.417850] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1236worker1 # [ 0.417898] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1237lb # [ 0.555657] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1238worker1 # [ 0.417951] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1239worker1 # [ 0.417999] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1240worker2 # [ 0.447656] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1241worker2 # [ 0.447882] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1242worker1 # [ 0.418082] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1243client # [ 0.496081] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1244worker2 # [ 0.447899] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1245worker1 # [ 0.418128] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1246lb # [ 0.558696] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1247worker2 # [ 0.447929] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1248worker1 # [ 0.418151] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1249worker2 # [ 0.448439] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1250worker1 # [ 0.418173] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1251worker2 # [ 0.448636] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1252worker1 # [ 0.418196] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1253worker2 # [ 0.448653] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1254worker1 # [ 0.418218] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1255worker2 # [ 0.448683] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1256client # [ 0.499122] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1257worker1 # [ 0.418241] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1258worker2 # [ 0.448702] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1259client # [ 0.501186] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1260worker1 # [ 0.418263] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1261worker2 # [ 0.449163] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1262worker1 # [ 0.418290] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1263worker2 # [ 0.449412] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1264worker1 # [ 0.418312] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1265worker2 # [ 0.449448] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1266worker1 # [ 0.418334] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1267worker2 # [ 0.449913] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1268worker1 # [ 0.418357] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1269worker2 # [ 0.450103] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1270worker1 # [ 0.418380] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1271worker2 # [ 0.450133] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1272worker1 # [ 0.418401] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1273worker1 # [ 0.418422] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1274worker2 # [ 0.450562] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1275worker1 # [ 0.418444] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1276worker2 # [ 0.450746] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1277worker1 # [ 0.418465] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1278lb # [ 0.569026] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1279worker2 # [ 0.450999] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1280worker1 # [ 0.418487] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1281worker2 # [ 0.451187] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1282worker1 # [ 0.418508] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1283worker2 # [ 0.451216] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1284worker1 # [ 0.418535] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1285worker1 # [ 0.418545] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1286client # [ 0.510945] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1287worker1 # [ 0.418550] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1288client # [ 0.512909] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1289lb # [ 0.582036] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1290worker1 # [ 0.479470] pci 0000:00:07.0: enabling device (0000 -> 0002)1291client # [ 0.524368] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1292lb # [ 0.584832] msm_serial: driver initialized1293lb # [ 0.584989] SuperH (H)SCI(F) driver initialized1294lb # [ 0.585056] STM32 USART driver initialized1295worker2 # [ 0.475797] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1296worker2 # [ 0.476011] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1297worker2 # [ 0.476044] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1298worker2 # [ 0.476518] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1299worker2 # [ 0.476710] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1300worker2 # [ 0.476741] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1301worker2 # [ 0.477207] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1302worker2 # [ 0.477519] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1303client # [ 0.527102] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1304worker2 # [ 0.477537] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1305worker2 # [ 0.477567] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1306worker2 # [ 0.478052] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1307client # [ 0.528904] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1308worker2 # [ 0.478242] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1309client # [ 0.530942] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1310worker2 # [ 0.478258] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1311client # [ 0.532826] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1312worker2 # [ 0.478288] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1313worker2 # [ 0.478881] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1314worker2 # [ 0.478893] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1315worker2 # [ 0.478898] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1316worker2 # [ 0.478944] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1317worker2 # [ 0.478993] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1318worker2 # [ 0.479040] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1319worker1 # [ 0.501042] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1320worker2 # [ 0.479088] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1321worker2 # [ 0.479136] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1322worker2 # [ 0.479183] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1323worker2 # [ 0.479234] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1324worker2 # [ 0.479281] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1325client # [ 0.547104] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1326worker2 # [ 0.479329] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1327worker2 # [ 0.479407] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1328worker2 # [ 0.479456] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1329worker2 # [ 0.479477] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1330worker2 # [ 0.479499] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1331worker2 # [ 0.479537] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1332worker2 # [ 0.479559] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1333worker2 # [ 0.479580] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1334worker1 # [ 0.511364] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1335worker2 # [ 0.479602] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1336lb # [ 0.618150] loop: module loaded1337worker1 # [ 0.515085] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1338worker2 # [ 0.479629] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1339lb # [ 0.618348] virtio_blk virtio2: 1/0/0 default/read/poll queues1340worker2 # [ 0.479651] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1341lb # [ 0.619204] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1342worker2 # [ 0.479673] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1343worker2 # [ 0.479695] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1344worker2 # [ 0.479718] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1345worker2 # [ 0.479739] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1346worker2 # [ 0.479760] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1347worker2 # [ 0.479781] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1348worker2 # [ 0.479802] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1349worker2 # [ 0.479823] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1350client # [ 0.564225] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1351worker2 # [ 0.479844] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1352worker2 # [ 0.479870] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1353worker2 # [ 0.479879] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1354worker2 # [ 0.479884] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1355worker1 # [ 0.525206] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1356worker2 # [ 0.480709] pci 0000:00:07.0: enabling device (0000 -> 0002)1357client # [ 0.566842] msm_serial: driver initialized1358client # [ 0.566990] SuperH (H)SCI(F) driver initialized1359client # [ 0.567043] STM32 USART driver initialized1360worker1 # [ 0.528044] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1361worker1 # [ 0.530153] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1362lb # [ 0.629488] megasas: 07.734.00.00-rc11363lb # [ 0.630243] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1364lb # [ 0.632575] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001365lb # [ 0.632609] Intel/Sharp Extended Query Table at 0x00311366lb # [ 0.634266] Using buffer write method1367lb # [ 0.634333] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1368lb # [ 0.636063] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001369lb # [ 0.636086] Intel/Sharp Extended Query Table at 0x00311370worker1 # [ 0.540291] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1371worker1 # [ 0.542328] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1372worker1 # [ 0.545750] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1373lb # [ 0.654919] Using buffer write method1374worker2 # [ 0.546257] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1375lb # [ 0.654954] Concatenating MTD devices:1376lb # [ 0.654959] (0): "0.flash"1377lb # [ 0.654962] (1): "0.flash"1378lb # [ 0.654972] into device "0.flash"1379worker1 # [ 0.552591] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1380client # [ 0.596513] loop: module loaded1381client # [ 0.596693] virtio_blk virtio2: 1/0/0 default/read/poll queues1382client # [ 0.598718] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1383worker2 # [ 0.552624] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1384worker2 # [ 0.554649] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1385worker1 # [ 0.559696] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1386worker2 # [ 0.564832] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1387worker2 # [ 0.566794] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1388worker1 # [ 0.572915] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1389client # [ 0.610173] megasas: 07.734.00.00-rc11390client # [ 0.610922] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1391client # [ 0.613152] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001392client # [ 0.613179] Intel/Sharp Extended Query Table at 0x00311393client # [ 0.614829] Using buffer write method1394client # [ 0.614896] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1395client # [ 0.616556] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001396worker1 # [ 0.580177] msm_serial: driver initialized1397worker2 # [ 0.577892] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1398worker1 # [ 0.580342] SuperH (H)SCI(F) driver initialized1399client # [ 0.616579] Intel/Sharp Extended Query Table at 0x00311400worker1 # [ 0.580396] STM32 USART driver initialized1401worker2 # [ 0.580395] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1402worker2 # [ 0.582309] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1403client # [ 0.634158] Using buffer write method1404client # [ 0.634194] Concatenating MTD devices:1405client # [ 0.634199] (0): "0.flash"1406client # [ 0.634203] (1): "0.flash"1407client # [ 0.634212] into device "0.flash"1408worker2 # [ 0.592080] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1409worker2 # [ 0.593952] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1410worker2 # [ 0.597769] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1411worker1 # [ 0.610077] loop: module loaded1412worker1 # [ 0.610282] virtio_blk virtio2: 1/0/0 default/read/poll queues1413worker1 # [ 0.612312] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1414worker2 # [ 0.612819] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1415worker2 # [ 0.615427] msm_serial: driver initialized1416worker2 # [ 0.616124] SuperH (H)SCI(F) driver initialized1417worker2 # [ 0.616181] STM32 USART driver initialized1418worker1 # [ 0.623830] megasas: 07.734.00.00-rc11419worker1 # [ 0.624560] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1420worker1 # [ 0.626431] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001421worker1 # [ 0.626463] Intel/Sharp Extended Query Table at 0x00311422worker1 # [ 0.628138] Using buffer write method1423worker1 # [ 0.628205] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1424worker1 # [ 0.629984] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001425worker1 # [ 0.630009] Intel/Sharp Extended Query Table at 0x00311426worker1 # [ 0.643733] Using buffer write method1427worker1 # [ 0.643762] Concatenating MTD devices:1428worker1 # [ 0.643766] (0): "0.flash"1429worker1 # [ 0.643770] (1): "0.flash"1430worker1 # [ 0.643780] into device "0.flash"1431worker2 # [ 0.648710] loop: module loaded1432worker2 # [ 0.648907] virtio_blk virtio2: 1/0/0 default/read/poll queues1433worker2 # [ 0.649715] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1434worker2 # [ 0.656161] megasas: 07.734.00.00-rc11435worker2 # [ 0.656909] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1436worker2 # [ 0.659215] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001437worker2 # [ 0.659273] Intel/Sharp Extended Query Table at 0x00311438worker2 # [ 0.668566] Using buffer write method1439worker2 # [ 0.668639] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1440worker2 # [ 0.679572] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001441worker2 # [ 0.679614] Intel/Sharp Extended Query Table at 0x00311442worker2 # [ 0.681129] Using buffer write method1443worker2 # [ 0.681158] Concatenating MTD devices:1444worker2 # [ 0.681162] (0): "0.flash"1445worker2 # [ 0.681166] (1): "0.flash"1446worker2 # [ 0.681175] into device "0.flash"1447lb # [ 0.918402] Freeing initrd memory: 26948K1448lb # [ 0.924610] tun: Universal TUN/TAP device driver, 1.61449lb # [ 0.928532] thunder_xcv, ver 1.01450lb # [ 0.928599] thunder_bgx, ver 1.01451lb # [ 0.928621] nicpf, ver 1.01452lb # [ 0.930437] e1000: Intel(R) PRO/1000 Network Driver1453lb # [ 0.930449] e1000: Copyright (c) 1999-2006 Intel Corporation.1454lb # [ 0.930473] e1000e: Intel(R) PRO/1000 Network Driver1455lb # [ 0.930480] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1456lb # [ 0.930509] igb: Intel(R) Gigabit Ethernet Network Driver1457lb # [ 0.930515] igb: Copyright (c) 2007-2014 Intel Corporation.1458lb # [ 0.930552] igbvf: Intel(R) Gigabit Virtual Function Network Driver1459lb # [ 0.930558] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1460lb # [ 0.930696] sky2: driver version 1.301461lb # [ 0.932337] usbcore: registered new interface driver usb-storage1462lb # [ 0.932416] usbcore: registered new interface driver usbserial_generic1463lb # [ 0.932433] usbserial: USB Serial support registered for generic1464lb # [ 0.933514] ehci-pci 0000:00:07.0: EHCI Host Controller1465lb # [ 0.933544] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11466lb # [ 0.933835] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001467lb # [ 0.944837] hv_vmbus: registering driver hyperv_keyboard1468lb # [ 0.946180] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001469lb # [ 0.947225] hub 1-0:1.0: USB hub found1470lb # [ 0.947716] hub 1-0:1.0: 6 ports detected1471lb # [ 0.948866] rtc-pl031 9010000.pl031: registered as rtc01472lb # [ 0.948892] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T22:22:24 UTC (1790115744)1473lb # [ 0.949220] i2c_dev: i2c /dev entries driver1474lb # [ 0.954691] sdhci: Secure Digital Host Controller Interface driver1475lb # [ 0.954702] sdhci: Copyright(c) Pierre Ossman1476lb # [ 0.954971] Synopsys Designware Multimedia Card Interface Driver1477lb # [ 0.955359] sdhci-pltfm: SDHCI platform and OF driver helper1478lb # [ 0.959667] hid: raw HID events driver (C) Jiri Kosina1479lb # [ 0.959910] usbcore: registered new interface driver usbhid1480lb # [ 0.959916] usbhid: USB HID core driver1481lb # [ 0.962852] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1482lb # [ 0.964477] drop_monitor: Initializing network drop monitor service1483lb # [ 0.964644] NET: Registered PF_INET6 protocol family1484lb # [ 0.967669] Segment Routing with IPv61485client # [ 0.905219] Freeing initrd memory: 26972K1486lb # [ 0.967690] In-situ OAM (IOAM) with IPv61487lb # [ 0.967720] NET: Registered PF_PACKET protocol family1488lb # [ 0.969612] 9pnet: Installing 9P2000 support1489lb # [ 0.969662] Key type dns_resolver registered1490client # [ 0.911265] tun: Universal TUN/TAP device driver, 1.61491lb # [ 0.976212] registered taskstats version 11492lb # [ 0.976371] Loading compiled-in X.509 certificates1493client # [ 0.915061] thunder_xcv, ver 1.01494client # [ 0.915105] thunder_bgx, ver 1.01495client # [ 0.915128] nicpf, ver 1.01496client # [ 0.915693] e1000: Intel(R) PRO/1000 Network Driver1497client # [ 0.915700] e1000: Copyright (c) 1999-2006 Intel Corporation.1498client # [ 0.915724] e1000e: Intel(R) PRO/1000 Network Driver1499client # [ 0.915732] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1500client # [ 0.915761] igb: Intel(R) Gigabit Ethernet Network Driver1501lb # [ 0.985003] Demotion targets for Node 0: null1502client # [ 0.915767] igb: Copyright (c) 2007-2014 Intel Corporation.1503lb # [ 0.985110] Key type .fscrypt registered1504lb # [ 0.985116] Key type fscrypt-provisioning registered1505client # [ 0.915789] igbvf: Intel(R) Gigabit Virtual Function Network Driver1506lb # [ 0.985223] ima: No TPM chip found, activating TPM-bypass!1507client # [ 0.915795] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1508client # [ 0.915928] sky2: driver version 1.301509lb # [ 0.985243] ima: Allocated hash algorithm: sha11510lb # [ 0.985267] ima: No architecture policies found1511client # [ 0.917480] usbcore: registered new interface driver usb-storage1512client # [ 0.918315] ehci-pci 0000:00:07.0: EHCI Host Controller1513lb # [ 0.989616] input: gpio-keys as /devices/platform/gpio-keys/input/input01514client # [ 0.918346] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11515client # [ 0.918624] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001516client # [ 0.928941] usbcore: registered new interface driver usbserial_generic1517client # [ 0.928959] usbserial: USB Serial support registered for generic1518client # [ 0.929548] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001519client # [ 0.929877] hub 1-0:1.0: USB hub found1520client # [ 0.929897] hub 1-0:1.0: 6 ports detected1521client # [ 0.933531] hv_vmbus: registering driver hyperv_keyboard1522client # [ 0.935064] rtc-pl031 9010000.pl031: registered as rtc01523client # [ 0.935090] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T22:22:24 UTC (1790115744)1524client # [ 0.935390] i2c_dev: i2c /dev entries driver1525client # [ 0.940656] sdhci: Secure Digital Host Controller Interface driver1526client # [ 0.940668] sdhci: Copyright(c) Pierre Ossman1527client # [ 0.940927] Synopsys Designware Multimedia Card Interface Driver1528client # [ 0.941291] sdhci-pltfm: SDHCI platform and OF driver helper1529lb # [ 1.007794] clk: Disabling unused clocks1530lb # [ 1.007817] PM: genpd: Disabling unused power domains1531client # [ 0.945535] hid: raw HID events driver (C) Jiri Kosina1532worker1 # [ 0.904492] Freeing initrd memory: 26976K1533client # [ 0.945777] usbcore: registered new interface driver usbhid1534client # [ 0.945783] usbhid: USB HID core driver1535client # [ 0.948676] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1536lb # [ 1.013269] Freeing unused kernel memory: 4736K1537client # [ 0.951299] drop_monitor: Initializing network drop monitor service1538lb # [ 1.013634] Run /init as init process1539worker1 # [ 0.910747] tun: Universal TUN/TAP device driver, 1.61540client # [ 0.951451] NET: Registered PF_INET6 protocol family1541client # [ 0.953366] Segment Routing with IPv61542client # [ 0.953385] In-situ OAM (IOAM) with IPv61543client # [ 0.953412] NET: Registered PF_PACKET protocol family1544worker1 # [ 0.914500] thunder_xcv, ver 1.01545worker1 # [ 0.914545] thunder_bgx, ver 1.01546worker1 # [ 0.914569] nicpf, ver 1.01547client # [ 0.955283] 9pnet: Installing 9P2000 support1548client # [ 0.955333] Key type dns_resolver registered1549worker1 # [ 0.916389] e1000: Intel(R) PRO/1000 Network Driver1550worker1 # [ 0.916398] e1000: Copyright (c) 1999-2006 Intel Corporation.1551worker1 # [ 0.916424] e1000e: Intel(R) PRO/1000 Network Driver1552worker1 # [ 0.916431] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1553worker1 # [ 0.916465] igb: Intel(R) Gigabit Ethernet Network Driver1554worker1 # [ 0.916473] igb: Copyright (c) 2007-2014 Intel Corporation.1555worker1 # [ 0.916496] igbvf: Intel(R) Gigabit Virtual Function Network Driver1556client # [ 0.961816] registered taskstats version 11557client # [ 0.961959] Loading compiled-in X.509 certificates1558worker1 # [ 0.916504] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1559worker1 # [ 0.916643] sky2: driver version 1.301560worker2 # [ 0.922564] Freeing initrd memory: 26944K1561worker1 # [ 0.918281] usbcore: registered new interface driver usb-storage1562worker1 # [ 0.918379] usbcore: registered new interface driver usbserial_generic1563lb # [ 1.031089] systemd[1]: Successfully made /usr/ read-only.1564worker1 # [ 0.918394] usbserial: USB Serial support registered for generic1565worker1 # [ 0.918993] hv_vmbus: registering driver hyperv_keyboard1566worker1 # [ 0.919831] ehci-pci 0000:00:07.0: EHCI Host Controller1567client # [ 0.970654] Demotion targets for Node 0: null1568worker1 # [ 0.919855] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11569client # [ 0.970817] Key type .fscrypt registered1570worker1 # [ 0.920171] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001571client # [ 0.970823] Key type fscrypt-provisioning registered1572client # [ 0.970928] ima: No TPM chip found, activating TPM-bypass!1573worker1 # [ 0.931352] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001574client # [ 0.970946] ima: Allocated hash algorithm: sha11575worker2 # [ 0.928685] tun: Universal TUN/TAP device driver, 1.61576worker1 # [ 0.931660] hub 1-0:1.0: USB hub found1577client # [ 0.970967] ima: No architecture policies found1578worker1 # [ 0.931680] hub 1-0:1.0: 6 ports detected1579client # [ 0.974964] input: gpio-keys as /devices/platform/gpio-keys/input/input01580worker1 # [ 0.934583] rtc-pl031 9010000.pl031: registered as rtc01581worker1 # [ 0.934615] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T22:22:24 UTC (1790115744)1582worker1 # [ 0.934922] i2c_dev: i2c /dev entries driver1583worker2 # [ 0.932535] thunder_xcv, ver 1.01584worker2 # [ 0.932578] thunder_bgx, ver 1.01585worker2 # [ 0.932599] nicpf, ver 1.01586worker2 # [ 0.933170] e1000: Intel(R) PRO/1000 Network Driver1587worker2 # [ 0.933176] e1000: Copyright (c) 1999-2006 Intel Corporation.1588worker2 # [ 0.933201] e1000e: Intel(R) PRO/1000 Network Driver1589worker2 # [ 0.933209] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1590worker1 # [ 0.940246] sdhci: Secure Digital Host Controller Interface driver1591worker1 # [ 0.940255] sdhci: Copyright(c) Pierre Ossman1592worker2 # [ 0.933239] igb: Intel(R) Gigabit Ethernet Network Driver1593worker1 # [ 0.940520] Synopsys Designware Multimedia Card Interface Driver1594worker2 # [ 0.933245] igb: Copyright (c) 2007-2014 Intel Corporation.1595worker1 # [ 0.940899] sdhci-pltfm: SDHCI platform and OF driver helper1596worker2 # [ 0.933268] igbvf: Intel(R) Gigabit Virtual Function Network Driver1597worker1 # [ 0.942444] hid: raw HID events driver (C) Jiri Kosina1598worker2 # [ 0.933284] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1599worker1 # [ 0.942736] usbcore: registered new interface driver usbhid1600worker2 # [ 0.933419] sky2: driver version 1.301601worker1 # [ 0.942742] usbhid: USB HID core driver1602worker2 # [ 0.934978] usbcore: registered new interface driver usb-storage1603worker2 # [ 0.935092] usbcore: registered new interface driver usbserial_generic1604worker2 # [ 0.935106] usbserial: USB Serial support registered for generic1605worker2 # [ 0.936230] ehci-pci 0000:00:07.0: EHCI Host Controller1606worker2 # [ 0.936254] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11607worker1 # [ 0.948404] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1608worker2 # [ 0.936484] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001609worker1 # [ 0.949950] drop_monitor: Initializing network drop monitor service1610worker1 # [ 0.950094] NET: Registered PF_INET6 protocol family1611client # [ 0.993238] clk: Disabling unused clocks1612worker2 # [ 0.948088] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001613client # [ 0.993260] PM: genpd: Disabling unused power domains1614worker2 # [ 0.948432] hub 1-0:1.0: USB hub found1615worker1 # [ 0.953137] Segment Routing with IPv61616worker2 # [ 0.948447] hub 1-0:1.0: 6 ports detected1617worker1 # [ 0.953156] In-situ OAM (IOAM) with IPv61618worker1 # [ 0.953183] NET: Registered PF_PACKET protocol family1619worker2 # [ 0.950696] hv_vmbus: registering driver hyperv_keyboard1620worker1 # [ 0.954847] 9pnet: Installing 9P2000 support1621worker1 # [ 0.954896] Key type dns_resolver registered1622client # [ 0.997374] Freeing unused kernel memory: 4736K1623worker2 # [ 0.952274] rtc-pl031 9010000.pl031: registered as rtc01624client # [ 0.998164] Run /init as init process1625worker2 # [ 0.952301] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T22:22:24 UTC (1790115744)1626worker2 # [ 0.952599] i2c_dev: i2c /dev entries driver1627worker1 # [ 0.962126] registered taskstats version 11628worker2 # [ 0.957953] sdhci: Secure Digital Host Controller Interface driver1629worker1 # [ 0.962278] Loading compiled-in X.509 certificates1630worker2 # [ 0.957964] sdhci: Copyright(c) Pierre Ossman1631worker2 # [ 0.958239] Synopsys Designware Multimedia Card Interface Driver1632worker2 # [ 0.958603] sdhci-pltfm: SDHCI platform and OF driver helper1633worker2 # [ 0.962832] hid: raw HID events driver (C) Jiri Kosina1634worker2 # [ 0.963082] usbcore: registered new interface driver usbhid1635worker2 # [ 0.963088] usbhid: USB HID core driver1636client # [ 1.011650] systemd[1]: Successfully made /usr/ read-only.1637worker1 # [ 0.971035] Demotion targets for Node 0: null1638worker2 # [ 0.965981] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1639worker1 # [ 0.971924] Key type .fscrypt registered1640worker2 # [ 0.968616] drop_monitor: Initializing network drop monitor service1641worker1 # [ 0.971935] Key type fscrypt-provisioning registered1642worker2 # [ 0.968761] NET: Registered PF_INET6 protocol family1643worker1 # [ 0.972039] ima: No TPM chip found, activating TPM-bypass!1644worker1 # [ 0.972058] ima: Allocated hash algorithm: sha11645worker2 # [ 0.970740] Segment Routing with IPv61646worker1 # [ 0.972090] ima: No architecture policies found1647worker2 # [ 0.970759] In-situ OAM (IOAM) with IPv61648worker2 # [ 0.970790] NET: Registered PF_PACKET protocol family1649worker1 # [ 0.975570] input: gpio-keys as /devices/platform/gpio-keys/input/input01650worker2 # [ 0.972680] 9pnet: Installing 9P2000 support1651worker2 # [ 0.972730] Key type dns_resolver registered1652worker2 # [ 0.979616] registered taskstats version 11653worker2 # [ 0.979779] Loading compiled-in X.509 certificates1654worker2 # [ 0.988481] Demotion targets for Node 0: null1655worker2 # [ 0.988588] Key type .fscrypt registered1656worker2 # [ 0.988594] Key type fscrypt-provisioning registered1657worker2 # [ 0.988696] ima: No TPM chip found, activating TPM-bypass!1658worker2 # [ 0.988715] ima: Allocated hash algorithm: sha11659worker1 # [ 0.994011] clk: Disabling unused clocks1660worker2 # [ 0.988745] ima: No architecture policies found1661worker1 # [ 0.994032] PM: genpd: Disabling unused power domains1662worker2 # [ 0.992720] input: gpio-keys as /devices/platform/gpio-keys/input/input01663worker1 # [ 0.998308] Freeing unused kernel memory: 4736K1664worker1 # [ 0.998532] Run /init as init process1665worker1 # [ 1.013296] systemd[1]: Successfully made /usr/ read-only.1666worker2 # [ 1.010323] clk: Disabling unused clocks1667worker2 # [ 1.010346] PM: genpd: Disabling unused power domains1668worker2 # [ 1.014510] Freeing unused kernel memory: 4736K1669worker2 # [ 1.014731] Run /init as init process1670worker2 # [ 1.029768] systemd[1]: Successfully made /usr/ read-only.1671lb # [ 1.192822] usb 1-1: new high-speed USB device number 2 using ehci-pci1672client # [ 1.177537] usb 1-1: new high-speed USB device number 2 using ehci-pci1673worker1 # [ 1.179180] usb 1-1: new high-speed USB device number 2 using ehci-pci1674worker2 # [ 1.195588] usb 1-1: new high-speed USB device number 2 using ehci-pci1675lb # [ 1.347070] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11676lb # [ 1.365961] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1677lb # [ 1.378168] systemd[1]: Detected virtualization qemu.1678lb # [ 1.380165] systemd[1]: Detected architecture arm64.1679lb # [ 1.382147] systemd[1]: Running in initrd.1680lb # [ 1.384709] systemd[1]: Initializing machine ID from random generator.1681lb # [ 1.387761] systemd[1]: Hostname set to <lb>.1682client # [ 1.332286] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11683client # [ 1.346515] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1684client # [ 1.358753] systemd[1]: Detected virtualization qemu.1685client # [ 1.360815] systemd[1]: Detected architecture arm64.1686client # [ 1.362847] systemd[1]: Running in initrd.1687client # [ 1.365407] systemd[1]: Initializing machine ID from random generator.1688client # [ 1.368399] systemd[1]: Hostname set to <client>.1689worker1 # [ 1.328642] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11690lb # [ 1.433056] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01691worker1 # [ 1.348038] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1692worker2 # [ 1.347875] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11693worker1 # [ 1.355839] systemd[1]: Detected virtualization qemu.1694worker1 # [ 1.357116] systemd[1]: Detected architecture arm64.1695worker1 # [ 1.358446] systemd[1]: Running in initrd.1696worker1 # [ 1.360116] systemd[1]: Initializing machine ID from random generator.1697worker1 # [ 1.362091] systemd[1]: Hostname set to <worker1>.1698worker2 # [ 1.364440] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1699worker2 # [ 1.371260] systemd[1]: Detected virtualization qemu.1700client # [ 1.413827] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01701worker2 # [ 1.372471] systemd[1]: Detected architecture arm64.1702worker2 # [ 1.373588] systemd[1]: Running in initrd.1703worker2 # [ 1.375117] systemd[1]: Initializing machine ID from random generator.1704worker2 # [ 1.376744] systemd[1]: Hostname set to <worker2>.1705worker1 # [ 1.411315] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01706worker2 # [ 1.431823] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01707lb # [ 1.560861] usb 1-2: new high-speed USB device number 3 using ehci-pci1708client # [ 1.537547] usb 1-2: new high-speed USB device number 3 using ehci-pci1709worker1 # [ 1.531138] usb 1-2: new high-speed USB device number 3 using ehci-pci1710worker2 # [ 1.551567] usb 1-2: new high-speed USB device number 3 using ehci-pci1711lb # [ 1.676579] systemd[1]: bpf-restrict-fs: LSM BPF program attached1712lb # [ 1.714868] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21713worker1 # [ 1.614322] systemd[1]: bpf-restrict-fs: LSM BPF program attached1714lb # [ 1.717363] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01715lb # [ 1.748905] systemd[1]: Queued start job for default target Initrd Default Target.1716client # [ 1.691535] systemd[1]: bpf-restrict-fs: LSM BPF program attached1717lb # [ 1.758758] systemd[1]: Created slice Slice /system/modprobe.1718lb # [ 1.759704] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1719lb # [ 1.760766] systemd[1]: Expecting device /dev/disk/by-label/nixos...1720lb # [ 1.761744] systemd[1]: Reached target Path Units.1721lb # [ 1.762472] systemd[1]: Reached target Slice Units.1722lb # [ 1.763217] systemd[1]: Reached target Swaps.1723lb # [ 1.763888] systemd[1]: Reached target Timer Units.1724lb # [ 1.764841] systemd[1]: Listening on D-Bus System Message Bus Socket.1725lb # [ 1.765944] systemd[1]: Listening on Journal Socket (/dev/log).1726lb # [ 1.766967] systemd[1]: Listening on Journal Sockets.1727lb # [ 1.767854] systemd[1]: Listening on udev Control Socket.1728lb # [ 1.768833] systemd[1]: Listening on udev Kernel Socket.1729lb # [ 1.769646] systemd[1]: Reached target Socket Units.1730lb # [ 1.771920] systemd[1]: Starting Create List of Static Device Nodes...1731client # [ 1.705654] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21732worker1 # [ 1.668800] systemd[1]: Queued start job for default target Initrd Default Target.1733lb # [ 1.773037] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1734client # [ 1.711306] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01735worker1 # [ 1.677147] systemd[1]: Created slice Slice /system/modprobe.1736lb # [ 1.780923] systemd[1]: Mounting Kernel Configuration File System...1737worker1 # [ 1.678155] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1738worker1 # [ 1.679422] systemd[1]: Expecting device /dev/disk/by-label/nixos...1739worker1 # [ 1.679456] systemd[1]: Reached target Path Units.1740worker1 # [ 1.679475] systemd[1]: Reached target Slice Units.1741worker1 # [ 1.679491] systemd[1]: Reached target Swaps.1742worker1 # [ 1.679508] systemd[1]: Reached target Timer Units.1743worker2 # [ 1.679125] systemd[1]: bpf-restrict-fs: LSM BPF program attached1744worker1 # [ 1.683152] systemd[1]: Listening on D-Bus System Message Bus Socket.1745lb # [ 1.789035] systemd[1]: Starting Journal Service...1746worker1 # [ 1.683338] systemd[1]: Listening on Journal Socket (/dev/log).1747worker1 # [ 1.683465] systemd[1]: Listening on Journal Sockets.1748worker1 # [ 1.683575] systemd[1]: Listening on udev Control Socket.1749worker1 # [ 1.683669] systemd[1]: Listening on udev Kernel Socket.1750worker1 # [ 1.683689] systemd[1]: Reached target Socket Units.1751worker1 # [ 1.689767] systemd[1]: Starting Create List of Static Device Nodes...1752worker1 # [ 1.690834] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1753worker1 # [ 1.696229] systemd[1]: Mounting Kernel Configuration File System...1754worker1 # [ 1.699287] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21755worker1 # [ 1.701179] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01756lb # [ 1.811769] systemd[1]: Starting Load Kernel Modules...1757lb # [ 1.813029] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1758worker2 # [ 1.708239] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21759worker1 # [ 1.719510] systemd[1]: Starting Journal Service...1760worker2 # [ 1.713525] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01761lb # [ 1.831116] systemd-journald[72]: Collecting audit messages is disabled.1762lb # [ 1.832287] systemd[1]: Starting Coldplug All udev Devices...1763worker1 # [ 1.739275] systemd[1]: Starting Load Kernel Modules...1764worker1 # [ 1.739394] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1765lb # [ 1.848986] systemd[1]: Finished Create List of Static Device Nodes.1766worker1 # [ 1.747297] systemd[1]: Starting Coldplug All udev Devices...1767worker1 # [ 1.751252] systemd[1]: Finished Create List of Static Device Nodes.1768lb # [ 1.857169] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1769client # [ 1.794886] systemd[1]: Queued start job for default target Initrd Default Target.1770lb # [ 1.858427] systemd[1]: Mounted Kernel Configuration File System.1771client # [ 1.803971] systemd[1]: Created slice Slice /system/modprobe.1772client # [ 1.805146] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1773client # [ 1.806538] systemd[1]: Expecting device /dev/disk/by-label/nixos...1774client # [ 1.807571] systemd[1]: Reached target Path Units.1775client # [ 1.808344] systemd[1]: Reached target Slice Units.1776client # [ 1.809130] systemd[1]: Reached target Swaps.1777client # [ 1.809884] systemd[1]: Reached target Timer Units.1778client # [ 1.810867] systemd[1]: Listening on D-Bus System Message Bus Socket.1779client # [ 1.812186] systemd[1]: Listening on Journal Socket (/dev/log).1780client # [ 1.813269] systemd[1]: Listening on Journal Sockets.1781worker1 # [ 1.773773] systemd-journald[72]: Collecting audit messages is disabled.1782client # [ 1.814296] systemd[1]: Listening on udev Control Socket.1783client # [ 1.814424] systemd[1]: Listening on udev Kernel Socket.1784client # [ 1.814447] systemd[1]: Reached target Socket Units.1785client # [ 1.818569] systemd[1]: Starting Create List of Static Device Nodes...1786client # [ 1.818649] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1787client # [ 1.829689] systemd[1]: Mounting Kernel Configuration File System...1788worker1 # [ 1.785134] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1789worker1 # [ 1.788438] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1790worker1 # [ 1.788772] systemd[1]: Mounted Kernel Configuration File System.1791lb # [ 1.892647] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1792client # [ 1.837817] systemd[1]: Starting Journal Service...1793worker2 # [ 1.794531] systemd[1]: Queued start job for default target Initrd Default Target.1794lb # [ 1.909405] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1795worker2 # [ 1.806038] systemd[1]: Created slice Slice /system/modprobe.1796worker2 # [ 1.807250] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1797worker1 # [ 1.811232] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1798worker2 # [ 1.808718] systemd[1]: Expecting device /dev/disk/by-label/nixos...1799worker2 # [ 1.808756] systemd[1]: Reached target Path Units.1800worker2 # [ 1.808778] systemd[1]: Reached target Slice Units.1801lb # [ 1.912993] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1802worker2 # [ 1.808800] systemd[1]: Reached target Swaps.1803worker2 # [ 1.808820] systemd[1]: Reached target Timer Units.1804lb # [ 1.919057] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01805lb # [ 1.919336] [drm] features: -virgl +edid -resource_blob -host_visible1806worker2 # [ 1.809020] systemd[1]: Listening on D-Bus System Message Bus Socket.1807lb # [ 1.919346] [drm] features: -context_init1808lb # [ 1.920067] [drm] number of scanouts: 11809worker2 # [ 1.809177] systemd[1]: Listening on Journal Socket (/dev/log).1810lb # [ 1.920085] [drm] number of cap sets: 01811client # [ 1.861756] systemd[1]: Starting Load Kernel Modules...1812worker2 # [ 1.809341] systemd[1]: Listening on Journal Sockets.1813worker2 # [ 1.809476] systemd[1]: Listening on udev Control Socket.1814client # [ 1.862731] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1815worker2 # [ 1.809593] systemd[1]: Listening on udev Kernel Socket.1816worker2 # [ 1.809616] systemd[1]: Reached target Socket Units.1817worker1 # [ 1.820362] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01818worker1 # [ 1.820609] [drm] features: -virgl +edid -resource_blob -host_visible1819worker2 # [ 1.820887] systemd[1]: Starting Create List of Static Device Nodes...1820worker1 # [ 1.820620] [drm] features: -context_init1821worker1 # [ 1.821373] [drm] number of scanouts: 11822worker1 # [ 1.821391] [drm] number of cap sets: 01823worker2 # [ 1.822066] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1824lb # [ 1.925165] systemd[1]: Starting Create Static Device Nodes in /dev...1825worker2 # [ 1.831778] systemd[1]: Mounting Kernel Configuration File System...1826worker2 # [ 1.839849] systemd[1]: Starting Journal Service...1827lb # [ 1.945187] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1828lb # [ 1.945207] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01829worker1 # [ 1.847766] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1830worker1 # [ 1.850337] systemd[1]: Starting Create Static Device Nodes in /dev...1831client # [ 1.888285] systemd-journald[72]: Collecting audit messages is disabled.1832client # [ 1.893766] systemd[1]: Starting Coldplug All udev Devices...1833worker1 # [ 1.855247] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1834worker1 # [ 1.855267] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01835worker2 # [ 1.864956] systemd[1]: Starting Load Kernel Modules...1836worker2 # [ 1.865088] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1837client # [ 1.909660] systemd[1]: Finished Create List of Static Device Nodes.1838lb # [ 1.969277] Console: switching to colour frame buffer device 160x501839client # [ 1.910469] systemd[1]: Mounted Kernel Configuration File System.1840client # [ 1.915568] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1841worker1 # [ 1.879736] Console: switching to colour frame buffer device 160x501842lb # [ 1.989480] systemd[1]: Finished Create Static Device Nodes in /dev.1843lb # [ 1.989687] systemd[1]: Reached target Preparation for Local File Systems.1844lb # [ 1.989711] systemd[1]: Reached target Local File Systems.1845worker2 # [ 1.887044] systemd-journald[72]: Collecting audit messages is disabled.1846worker2 # [ 1.887210] systemd[1]: Starting Coldplug All udev Devices...1847lb # [ 1.997158] systemd[1]: Starting Rule-based Manager for Device Events and Files...1848client # [ 1.939355] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1849lb # [ 2.005495] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1850worker2 # [ 1.900210] systemd[1]: Finished Create List of Static Device Nodes.1851worker2 # [ 1.900893] systemd[1]: Mounted Kernel Configuration File System.1852worker1 # [ 1.907768] systemd[1]: Finished Create Static Device Nodes in /dev.1853worker1 # [ 1.908005] systemd[1]: Reached target Preparation for Local File Systems.1854worker1 # [ 1.908032] systemd[1]: Reached target Local File Systems.1855worker1 # [ 1.912067] systemd[1]: Starting Rule-based Manager for Device Events and Files...1856worker1 # [ 1.916936] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1857client # [ 1.960410] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1858lb # [ 2.025063] systemd[1]: Finished Load Kernel Modules.1859lb # [ 2.011596] systemd-modules-load[74]: Inserted module 'dm_mod'1860lb # [ 2.012939] systemd-modules-load[74]: Module 'virtio_balloon' is built in1861client # [ 1.966213] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1862lb # [ 2.014032] systemd-modules-load[74]: Module 'virtio_console' is built in1863worker2 # [ 1.923709] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1864lb # [ 2.015090] systemd-modules-load[74]: Inserted module 'virtio_gpu'1865worker1 # [ 1.927712] systemd[1]: Finished Load Kernel Modules.1866lb # [ 2.037343] systemd[1]: Starting Apply Kernel Variables...1867lb # [ 2.037543] systemd[1]: Started Journal Service.1868worker2 # [ 1.931249] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1869client # [ 1.977915] systemd[1]: Starting Create Static Device Nodes in /dev...1870worker1 # [ 1.939635] systemd[1]: Starting Apply Kernel Variables...1871lb # [ 2.031702] systemd-modules-load[74]: Module 'virtio_rng' is built in1872client # [ 1.989956] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01873client # [ 1.990219] [drm] features: -virgl +edid -resource_blob -host_visible1874client # [ 1.990230] [drm] features: -context_init1875client # [ 1.990949] [drm] number of scanouts: 11876client # [ 1.990967] [drm] number of cap sets: 01877worker1 # [ 1.938125] systemd-modules-load[73]: Inserted module 'dm_mod'1878worker1 # [ 1.939212] systemd-modules-load[73]: Module 'virtio_balloon' is built in1879worker1 # [ 1.955348] systemd[1]: Started Journal Service.1880client # [ 1.997977] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1881client # [ 1.997991] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01882worker2 # [ 1.957122] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1883worker1 # [ 1.948393] systemd-modules-load[73]: Module 'virtio_console' is built in1884worker1 # [ 1.949568] systemd-modules-load[73]: Inserted module 'virtio_gpu'1885worker1 # [ 1.950601] systemd-modules-load[73]: Module 'virtio_rng' is built in1886worker2 # [ 1.964206] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1887worker2 # [ 1.967922] systemd[1]: Starting Create Static Device Nodes in /dev...1888lb # [ 2.064686] systemd[1]: Starting Create System Files and Directories...1889worker1 # [ 1.968072] systemd[1]: Starting Create System Files and Directories...1890worker2 # [ 1.980684] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01891worker2 # [ 1.980917] [drm] features: -virgl +edid -resource_blob -host_visible1892worker2 # [ 1.980927] [drm] features: -context_init1893worker2 # [ 1.981666] [drm] number of scanouts: 11894worker2 # [ 1.981685] [drm] number of cap sets: 01895lb # [ 2.077649] systemd[1]: Finished Apply Kernel Variables.1896client # [ 2.029848] Console: switching to colour frame buffer device 160x501897client # [ 2.036907] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1898worker2 # [ 1.991969] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1899worker2 # [ 1.991989] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01900lb # [ 2.090206] systemd-udevd[78]: Using default interface naming scheme 'v261'.1901worker1 # [ 1.989349] systemd[1]: Finished Apply Kernel Variables.1902client # [ 2.049715] systemd[1]: Finished Create Static Device Nodes in /dev.1903client # [ 2.050146] systemd[1]: Reached target Preparation for Local File Systems.1904client # [ 2.050183] systemd[1]: Reached target Local File Systems.1905lb # [ 2.101415] systemd[1]: Finished Create System Files and Directories.1906client # [ 2.055350] systemd[1]: Starting Rule-based Manager for Device Events and Files...1907worker1 # [ 2.004975] systemd[1]: Finished Create System Files and Directories.1908worker1 # [ 2.013638] systemd-udevd[79]: Using default interface naming scheme 'v261'.1909worker2 # [ 2.019036] Console: switching to colour frame buffer device 160x501910client # [ 2.074090] systemd[1]: Finished Load Kernel Modules.1911client # [ 2.060537] systemd-modules-load[74]: Inserted module 'dm_mod'1912client # [ 2.061616] systemd-modules-load[74]: Module 'virtio_balloon' is built in1913lb # [ 2.124998] systemd[1]: Started Rule-based Manager for Device Events and Files.1914client # [ 2.080322] systemd[1]: Starting Apply Kernel Variables...1915worker2 # [ 2.036236] systemd[1]: Finished Create Static Device Nodes in /dev.1916client # [ 2.080482] systemd[1]: Started Journal Service.1917worker2 # [ 2.036623] systemd[1]: Reached target Preparation for Local File Systems.1918client # [ 2.066627] systemd-modules-load[74]: Module 'virtio_console' is built in1919worker2 # [ 2.036650] systemd[1]: Reached target Local File Systems.1920worker2 # [ 2.040622] systemd[1]: Starting Rule-based Manager for Device Events and Files...1921client # [ 2.076215] systemd-modules-load[74]: Inserted module 'virtio_gpu'1922client # [ 2.077315] systemd-modules-load[74]: Module 'virtio_rng' is built in1923worker1 # [ 2.041533] systemd[1]: Started Rule-based Manager for Device Events and Files.1924client # [ 2.080949] systemd[1]: Starting Create System Files and Directories...1925worker2 # [ 2.052149] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1926worker2 # [ 2.064307] systemd[1]: Finished Load Kernel Modules.1927worker2 # [ 2.069234] systemd[1]: Starting Apply Kernel Variables...1928worker2 # [ 2.060689] systemd-modules-load[74]: Inserted module 'dm_mod'1929worker2 # [ 2.068577] systemd-modules-load[74]: Module 'virtio_balloon' is built in1930worker2 # [ 2.071328] systemd-modules-load[74]: Module 'virtio_console' is built in1931lb # [ 2.180588] systemd[1]: Starting Virtual Console Setup...1932client # [ 2.120916] systemd[1]: Finished Apply Kernel Variables.1933worker2 # [ 2.084504] systemd-modules-load[74]: Inserted module 'virtio_gpu'1934worker2 # [ 2.085538] systemd-modules-load[74]: Module 'virtio_rng' is built in1935worker2 # [ 2.102591] systemd[1]: Started Journal Service.1936client # [ 2.136799] systemd[1]: Finished Create System Files and Directories.1937worker1 # [ 2.102895] systemd[1]: Starting Virtual Console Setup...1938client # [ 2.155308] systemd-udevd[78]: Using default interface naming scheme 'v261'.1939worker2 # [ 2.116132] systemd[1]: Starting Create System Files and Directories...1940worker2 # [ 2.120953] systemd[1]: Finished Apply Kernel Variables.1941lb # [ 2.237306] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1942lb # [ 2.240090] systemd[1]: Finished Virtual Console Setup.1943worker2 # [ 2.137569] systemd-udevd[78]: Using default interface naming scheme 'v261'.1944client # [ 2.185345] systemd[1]: Started Rule-based Manager for Device Events and Files.1945worker2 # [ 2.153533] systemd[1]: Finished Create System Files and Directories.1946worker2 # [ 2.171055] systemd[1]: Started Rule-based Manager for Device Events and Files.1947worker1 # [ 2.176528] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1948worker1 # [ 2.182805] systemd[1]: Finished Virtual Console Setup.1949client # [ 2.244157] systemd[1]: Starting Virtual Console Setup...1950worker2 # [ 2.227829] systemd[1]: Starting Virtual Console Setup...1951client # [ 2.288444] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones.1952client # [ 2.291948] systemd[1]: Finished Virtual Console Setup.1953worker2 # [ 2.280463] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1954worker2 # [ 2.284116] systemd[1]: Finished Virtual Console Setup.1955lb # [ 2.824648] systemd[1]: Finished Coldplug All udev Devices.1956lb # [ 2.825651] systemd[1]: Reached target System Initialization.1957lb # [ 2.826466] systemd[1]: Reached target Basic System.1958worker1 # [ 2.808370] systemd[1]: Finished Coldplug All udev Devices.1959worker1 # [ 2.809306] systemd[1]: Reached target System Initialization.1960worker1 # [ 2.810142] systemd[1]: Reached target Basic System.1961client # [ 2.869861] systemd[1]: Finished Coldplug All udev Devices.1962client # [ 2.876151] systemd[1]: Reached target System Initialization.1963client # [ 2.877038] systemd[1]: Reached target Basic System.1964lb # [ 2.963915] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1965lb # [ 2.986347] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1966lb # [ 2.997781] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1967worker2 # [ 2.896426] systemd[1]: Finished Coldplug All udev Devices.1968worker2 # [ 2.898006] systemd[1]: Reached target System Initialization.1969worker2 # [ 2.898873] systemd[1]: Reached target Basic System.1970worker1 # [ 2.948493] (udev-worker)[90]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1971worker1 # [ 2.952814] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line.1972client # [ 3.008275] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1973lb # [ 3.081649] systemd[1]: Found device /dev/disk/by-label/nixos.1974lb # [ 3.085156] systemd[1]: Reached target Initrd Root Device.1975lb # [ 3.090455] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976client # [ 3.036240] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1977worker1 # [ 2.999141] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1978client # [ 3.051761] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1979lb # [ 3.138352] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks1980worker2 # [ 3.035374] (udev-worker)[104]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1981lb # [ 3.146733] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1982lb # [ 3.152232] systemd[1]: Mounting /sysroot...1983worker2 # [ 3.067132] (udev-worker)[104]: Network interface NamePolicy= disabled on kernel command line.1984worker1 # [ 3.079087] systemd[1]: Found device /dev/disk/by-label/nixos.1985worker1 # [ 3.081323] systemd[1]: Reached target Initrd Root Device.1986client # [ 3.121449] systemd[1]: Found device /dev/disk/by-label/nixos.1987worker1 # [ 3.085299] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1988lb # [ 3.202947] EXT4-fs (vda): mounted filesystem bc531355-f379-4bef-808e-6fca3638f969 r/w with ordered data mode. Quota mode: none.1989worker2 # [ 3.082274] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1990lb # [ 3.191570] systemd[1]: Mounted /sysroot.1991lb # [ 3.194291] systemd[1]: Reached target Initrd Root File System.1992client # [ 3.131521] systemd[1]: Reached target Initrd Root Device.1993lb # [ 3.198794] systemd[1]: Starting Mountpoints Configured in the Real Root...1994client # [ 3.135571] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1995lb # [ 3.227870] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload.1996lb # [ 3.234033] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)...1997worker1 # [ 3.134196] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1998lb # [ 3.237863] systemd[1]: Reloading...1999worker1 # [ 3.143172] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.2000worker1 # [ 3.148752] systemd[1]: Mounting /sysroot...
loading 2,313 hidden lines…
4314lb # [ 52.187404] niks3-server[961]: 2026/09/22 22:23:15 INFO Registered completed upload object_key=nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst4315lb # [ 52.197563] niks3-server[961]: 2026/09/22 22:23:15 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls4316worker2 # [ 52.095552] nix-grpc-daemon[909]: time=2026-09-22T22:23:15.658Z level=INFO msg="Upload complete. (224ms)"4317lb # [ 52.204147] niks3-server[961]: 2026/09/22 22:23:15 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4318lb # [ 52.208203] niks3-server[961]: 2026/09/22 22:23:15 INFO Completed upload id=94319lb # [ 52.211936] niks3-server[961]: 2026/09/22 22:23:15 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo4320worker2 # [ 52.104297] nix-grpc-daemon[770]: ts=2026-09-22T22:23:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=0 paths=1 nar_bytes_in=5124321worker2 # [ 52.117235] nix-grpc-daemon[770]: ts=2026-09-22T22:23:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924322worker2 # [ 52.127419] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4323worker2 # [ 52.132216] nix-daemon[856]: reaped child process 907, status = succeeded4324client # building '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' on lb:50051...4325worker2 # [ 52.142132] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4326client # farm-a> worker2: building 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4327client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4328client # farm-a> LOG-farm-a-sig4329worker2 # [ 53.246621] nix-daemon[856]: reaped child process 928, status = succeeded4330worker2 # [ 53.321364] nix-daemon[856]: accepted connection from pid 944, user nix-grpc-daemon (trusted)4331worker2 # [ 53.340401] nix-daemon[856]: reaped child process 947, status = succeeded4332lb # [ 53.452821] niks3-server[961]: 2026/09/22 22:23:17 INFO Received uploads request method=POST path=/api/pending_closures4333worker2 # [ 53.360430] nix-grpc-daemon[909]: time=2026-09-22T22:23:16.921Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4334worker2 # [ 53.362171] nix-grpc-daemon[909]: time=2026-09-22T22:23:16.921Z level=INFO msg="Uploading 2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a (128B)"4335lb # [ 53.494518] niks3-server[961]: 2026/09/22 22:23:17 INFO Registered completed upload object_key=log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4336lb # [ 53.508227] niks3-server[961]: 2026/09/22 22:23:17 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4337worker2 # [ 53.419413] nix-grpc-daemon[909]: time=2026-09-22T22:23:16.981Z level=INFO msg="Uploading 1 narinfos"4338lb # [ 53.518580] niks3-server[961]: 2026/09/22 22:23:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4339lb # [ 53.530409] niks3-server[961]: 2026/09/22 22:23:17 INFO Signed narinfos id=10 count=14340lb # [ 53.539487] niks3-server[961]: 2026/09/22 22:23:17 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4341worker2 # [ 53.439615] nix-grpc-daemon[909]: time=2026-09-22T22:23:17.002Z level=INFO msg="Upload complete. (288ms)"4342lb # [ 53.546597] niks3-server[961]: 2026/09/22 22:23:17 INFO Completed upload id=104343lb # [ 53.554490] niks3-server[961]: 2026/09/22 22:23:17 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo4344lb # [ 53.559004] niks3-server[961]: 2026/09/22 22:23:17 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.ls4345worker2 # [ 53.457246] nix-grpc-daemon[770]: ts=2026-09-22T22:23:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=1 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv assign_id=5 outputs=14346worker2 # [ 53.478670] nix-grpc-daemon[770]: ts=2026-09-22T22:23:17Z level=debug event=want client=4 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv cached=04347worker2 # [ 53.483558] nix-grpc-daemon[770]: ts=2026-09-22T22:23:17Z level=debug event=assigned drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker=192.168.1.4:50051 clients=14348worker2 # [ 53.488585] nix-daemon[856]: reaped child process 926, status = succeeded4349worker2 # [ 53.514762] nix-grpc-daemon[770]: ts=2026-09-22T22:23:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924350worker2 # [ 53.530326] nix-grpc-daemon[770]: ts=2026-09-22T22:23:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407924351worker2 # [ 53.544572] nix-grpc-daemon[909]: time=2026-09-22T22:23:17.107Z level=INFO msg="All 1 paths already cached"4352client # copying 1 paths to 'lb:50051'...4353client # copying path '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' to 'lb:50051'...4354worker2 # [ 53.555675] nix-grpc-daemon[770]: ts=2026-09-22T22:23:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:407924355worker2 # [ 53.571857] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4356worker2 # [ 53.727815] nix-daemon[856]: accepted connection from pid 953, user nix-grpc-daemon (trusted)4357worker2 # [ 53.750028] nix-daemon[856]: reaped child process 956, status = succeeded4358lb # [ 53.860373] niks3-server[961]: 2026/09/22 22:23:17 INFO Received uploads request method=POST path=/api/pending_closures4359worker2 # [ 53.763432] nix-grpc-daemon[909]: time=2026-09-22T22:23:17.326Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4360worker2 # [ 53.765150] nix-grpc-daemon[909]: time=2026-09-22T22:23:17.326Z level=INFO msg="Uploading z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv (624B)"4361lb # [ 53.891265] niks3-server[961]: 2026/09/22 22:23:17 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.ls4362worker2 # [ 53.797154] nix-grpc-daemon[909]: time=2026-09-22T22:23:17.359Z level=INFO msg="Uploading 1 narinfos"4363lb # [ 53.906162] niks3-server[961]: 2026/09/22 22:23:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4364lb # [ 53.917009] niks3-server[961]: 2026/09/22 22:23:17 INFO Signed narinfos id=11 count=14365lb # [ 53.925959] niks3-server[961]: 2026/09/22 22:23:17 INFO Registered completed upload object_key=nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst4366lb # [ 53.936479] niks3-server[961]: 2026/09/22 22:23:17 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4367lb # [ 53.941699] niks3-server[961]: 2026/09/22 22:23:17 INFO Completed upload id=114368worker2 # [ 53.829661] nix-grpc-daemon[909]: time=2026-09-22T22:23:17.392Z level=INFO msg="Upload complete. (243ms)"4369lb # [ 53.945531] niks3-server[961]: 2026/09/22 22:23:17 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo4370worker2 # [ 53.840244] nix-grpc-daemon[770]: ts=2026-09-22T22:23:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=0 paths=1 nar_bytes_in=6244371worker2 # [ 53.848333] nix-grpc-daemon[770]: ts=2026-09-22T22:23:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924372worker2 # [ 53.859973] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4373worker2 # [ 53.865117] nix-daemon[856]: reaped child process 951, status = succeeded4374client # building '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' on lb:50051...4375worker2 # [ 53.876203] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4376client # farm-b> worker2: building z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4377client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4378client # farm-b> LOG-farm-b-sig4379worker2 # [ 55.325887] nix-daemon[856]: reaped child process 960, status = succeeded4380worker2 # [ 55.430228] nix-daemon[856]: accepted connection from pid 976, user nix-grpc-daemon (trusted)4381worker2 # [ 55.451622] nix-daemon[856]: reaped child process 979, status = succeeded4382lb # [ 55.556969] niks3-server[961]: 2026/09/22 22:23:19 INFO Received uploads request method=POST path=/api/pending_closures4383worker2 # [ 55.462834] nix-grpc-daemon[909]: time=2026-09-22T22:23:19.024Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4384worker2 # [ 55.464440] nix-grpc-daemon[909]: time=2026-09-22T22:23:19.024Z level=INFO msg="Uploading h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b (176B)"4385lb # [ 55.599190] niks3-server[961]: 2026/09/22 22:23:19 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls4386worker2 # [ 55.502861] nix-grpc-daemon[909]: time=2026-09-22T22:23:19.065Z level=INFO msg="Uploading 1 narinfos"4387lb # [ 55.610508] niks3-server[961]: 2026/09/22 22:23:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4388lb # [ 55.622362] niks3-server[961]: 2026/09/22 22:23:19 INFO Signed narinfos id=12 count=14389lb # [ 55.629110] niks3-server[961]: 2026/09/22 22:23:19 INFO Registered completed upload object_key=nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst4390worker2 # [ 55.537447] nix-grpc-daemon[909]: time=2026-09-22T22:23:19.100Z level=INFO msg="Upload complete. (250ms)"4391lb # [ 55.645311] niks3-server[961]: 2026/09/22 22:23:19 INFO Registered completed upload object_key=log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4392lb # [ 55.651267] niks3-server[961]: 2026/09/22 22:23:19 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4393lb # [ 55.656184] niks3-server[961]: 2026/09/22 22:23:19 INFO Completed upload id=124394worker2 # [ 55.549029] nix-grpc-daemon[770]: ts=2026-09-22T22:23:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=1 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv assign_id=6 outputs=14395lb # [ 55.658456] niks3-server[961]: 2026/09/22 22:23:19 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo4396worker2 # [ 55.570028] nix-grpc-daemon[770]: ts=2026-09-22T22:23:19Z level=debug event=want client=4 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv cached=04397worker2 # [ 55.574731] nix-grpc-daemon[770]: ts=2026-09-22T22:23:19Z level=debug event=assigned drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker=192.168.1.4:50051 clients=14398worker2 # [ 55.579302] nix-daemon[856]: reaped child process 958, status = succeeded4399worker2 # [ 55.614610] nix-grpc-daemon[770]: ts=2026-09-22T22:23:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924400worker2 # [ 55.629995] nix-grpc-daemon[770]: ts=2026-09-22T22:23:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407924401worker2 # [ 55.644967] nix-grpc-daemon[909]: time=2026-09-22T22:23:19.208Z level=INFO msg="All 2 paths already cached"4402client # copying 1 paths to 'lb:50051'...4403client # copying path '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' to 'lb:50051'...4404worker2 # [ 55.656651] nix-grpc-daemon[770]: ts=2026-09-22T22:23:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:407924405worker2 # [ 55.670917] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4406worker2 # [ 55.826527] nix-daemon[856]: accepted connection from pid 985, user nix-grpc-daemon (trusted)4407worker2 # [ 55.846237] nix-daemon[856]: reaped child process 988, status = succeeded4408lb # [ 55.958793] niks3-server[961]: 2026/09/22 22:23:19 INFO Received uploads request method=POST path=/api/pending_closures4409worker2 # [ 55.861777] nix-grpc-daemon[909]: time=2026-09-22T22:23:19.424Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4410worker2 # [ 55.863296] nix-grpc-daemon[909]: time=2026-09-22T22:23:19.424Z level=INFO msg="Uploading knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv (752B)"4411lb # [ 55.989676] niks3-server[961]: 2026/09/22 22:23:19 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls4412worker2 # [ 55.903086] nix-grpc-daemon[909]: time=2026-09-22T22:23:19.465Z level=INFO msg="Uploading 1 narinfos"4413lb # [ 56.003038] niks3-server[961]: 2026/09/22 22:23:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4414lb # [ 56.015526] niks3-server[961]: 2026/09/22 22:23:19 INFO Signed narinfos id=13 count=14415lb # [ 56.023103] niks3-server[961]: 2026/09/22 22:23:19 INFO Registered completed upload object_key=nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst4416lb # [ 56.039499] niks3-server[961]: 2026/09/22 22:23:19 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4417worker2 # [ 55.932815] nix-grpc-daemon[909]: time=2026-09-22T22:23:19.495Z level=INFO msg="Upload complete. (246ms)"4418lb # [ 56.044782] niks3-server[961]: 2026/09/22 22:23:19 INFO Completed upload id=134419lb # [ 56.048553] niks3-server[961]: 2026/09/22 22:23:19 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo4420worker2 # [ 55.944376] nix-grpc-daemon[770]: ts=2026-09-22T22:23:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=0 paths=1 nar_bytes_in=7524421worker2 # [ 55.960289] nix-grpc-daemon[770]: ts=2026-09-22T22:23:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924422worker2 # [ 55.970012] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4423worker2 # [ 55.974951] nix-daemon[856]: reaped child process 983, status = succeeded4424client # building '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' on lb:50051...4425client # farm-top> worker2: building knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4426worker2 # [ 55.988680] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4427client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4428client # farm-top> LOG-farm-top-sig4429worker2 # [ 57.239736] nix-daemon[856]: reaped child process 992, status = succeeded4430worker2 # [ 57.381309] nix-daemon[856]: accepted connection from pid 1008, user nix-grpc-daemon (trusted)4431worker2 # [ 57.401020] nix-daemon[856]: reaped child process 1011, status = succeeded4432lb # [ 57.514064] niks3-server[961]: 2026/09/22 22:23:21 INFO Received uploads request method=POST path=/api/pending_closures4433worker2 # [ 57.420459] nix-grpc-daemon[909]: time=2026-09-22T22:23:20.981Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4434worker2 # [ 57.422336] nix-grpc-daemon[909]: time=2026-09-22T22:23:20.981Z level=INFO msg="Uploading 4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top (232B)"4435lb # [ 57.555660] niks3-server[961]: 2026/09/22 22:23:21 INFO Registered completed upload object_key=nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst4436worker2 # [ 57.462603] nix-grpc-daemon[909]: time=2026-09-22T22:23:21.025Z level=INFO msg="Uploading 1 narinfos"4437lb # [ 57.569237] niks3-server[961]: 2026/09/22 22:23:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4438lb # [ 57.580045] niks3-server[961]: 2026/09/22 22:23:21 INFO Signed narinfos id=14 count=14439lb # [ 57.582345] niks3-server[961]: 2026/09/22 22:23:21 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls4440worker2 # [ 57.490662] nix-grpc-daemon[909]: time=2026-09-22T22:23:21.053Z level=INFO msg="Upload complete. (285ms)"4441lb # [ 57.591869] niks3-server[961]: 2026/09/22 22:23:21 INFO Registered completed upload object_key=log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4442lb # [ 57.605518] niks3-server[961]: 2026/09/22 22:23:21 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4443lb # [ 57.610045] niks3-server[961]: 2026/09/22 22:23:21 INFO Completed upload id=144444lb # [ 57.614071] niks3-server[961]: 2026/09/22 22:23:21 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo4445worker2 # [ 57.505357] nix-grpc-daemon[770]: ts=2026-09-22T22:23:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=1 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv assign_id=7 outputs=14446worker2 # [ 57.524239] nix-daemon[856]: reaped child process 990, status = succeeded4447client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&2, in 6.19 seconds)4448client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath4449client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath, in 0.13 seconds)4450client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4451worker1 # [ 57.807608] nix-grpc-daemon[768]: ts=2026-09-22T22:23:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:373144452client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):4453client # /nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a4454client # /nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b4455client # /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4456worker1 # [ 57.837497] nix-grpc-daemon[768]: ts=2026-09-22T22:23:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:373144457worker1 # [ 57.846622] nix-grpc-daemon[768]: copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'http://lb:5751'...4458worker1 # [ 57.862895] nix-grpc-daemon[768]: copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'http://lb:5751'...4459worker1 # [ 57.876918] nix-grpc-daemon[768]: copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'http://lb:5751'...4460client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.25 seconds)4461client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4462worker2 # [ 58.095531] nix-grpc-daemon[770]: ts=2026-09-22T22:23:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:394384463worker2 # [ 58.139066] nix-grpc-daemon[770]: ts=2026-09-22T22:23:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:394384464client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.29 seconds)4465client: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4466client # finding garbage collector roots...4467client # removing stale temporary roots file "/nix/var/nix/temproots/933"4468client # removing stale temporary roots file "/nix/var/nix/temproots/904"4469client # removing stale temporary roots file "/nix/var/nix/temproots/912"4470client # removing stale temporary roots file "/nix/var/nix/temproots/871"4471client # removing stale temporary roots file "/nix/var/nix/temproots/948"4472client # removing stale temporary roots file "/nix/var/nix/temproots/892"4473client # removing stale temporary roots file "/nix/var/nix/temproots/925"4474client # removing stale temporary roots file "/nix/var/nix/temproots/854"4475client # deleting specified paths...4476client # deleting '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top'4477client # deleting unused links...4478client # note: hard linking is currently saving 0.0 KiB4479worker1 # [ 58.557957] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582564480worker1 # [ 58.566129] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582564481worker1 # [ 58.578877] nix-grpc-daemon[847]: time=2026-09-22T22:23:22.158Z level=INFO msg="All 1 paths already cached"4482worker2 # [ 58.585312] nix-grpc-daemon[770]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407924483worker1 # [ 58.599117] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582564484client # copying 3 paths...4485worker2 # [ 58.610377] nix-grpc-daemon[770]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407924486client # copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'grpc://lb:50051'...4487worker2 # [ 58.636815] nix-grpc-daemon[770]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:407924488worker2 # [ 58.644269] nix-grpc-daemon[770]: ts=2026-09-22T22:23:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=0 paths=1 nar_bytes_out=2324489worker1 # [ 58.653451] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582564490worker1 # [ 58.661287] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_out=1764491worker1 # [ 58.670351] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582564492worker1 # [ 58.675475] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_out=1284493client # copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'grpc://lb:50051'...4494client # copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'grpc://lb:50051'...4495client: (finished: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.54 seconds)4496(finished: subtest: outputs read back through any worker carry the cache signature, in 7.41 seconds)4497subtest: two clients wanting the same drv build it once4498client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4499client # [ 58.845339] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4500client # Running as unit: dedup1.service; invocation ID: 4c76a6cb71a04847adbb5961f66fad284501client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 0.06 seconds)4502client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4503worker2 # [ 58.984682] nix-grpc-daemon[770]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:407924504client # [ 59.035655] nix[1001]: don't know how to build these paths:4505client # [ 59.036938] nix[1001]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4506worker2 # [ 59.001071] nix-grpc-daemon[770]: ts=2026-09-22T22:23:22Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04507worker2 # [ 59.007067] nix-grpc-daemon[770]: ts=2026-09-22T22:23:22Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14508worker1 # [ 59.053571] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564509worker1 # [ 59.065077] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582564510client # [ 59.116258] nix[1001]: copying 1 paths to 'lb:50051'...4511client # [ 59.120168] nix[1001]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4512worker1 # [ 59.081913] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582564513worker1 # [ 59.097128] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4514worker1 # [ 59.266635] nix-daemon[834]: accepted connection from pid 998, user nix-grpc-daemon (trusted)4515worker1 # [ 59.287635] nix-daemon[834]: reaped child process 1001, status = succeeded4516lb # [ 59.389098] niks3-server[961]: 2026/09/22 22:23:22 INFO Received uploads request method=POST path=/api/pending_closures4517worker1 # [ 59.296923] nix-grpc-daemon[847]: time=2026-09-22T22:23:22.876Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4518worker1 # [ 59.298397] nix-grpc-daemon[847]: time=2026-09-22T22:23:22.876Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4519lb # [ 59.424148] niks3-server[961]: 2026/09/22 22:23:22 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4520worker1 # [ 59.333646] nix-grpc-daemon[847]: time=2026-09-22T22:23:22.913Z level=INFO msg="Uploading 1 narinfos"4521lb # [ 59.436414] niks3-server[961]: 2026/09/22 22:23:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4522lb # [ 59.446711] niks3-server[961]: 2026/09/22 22:23:23 INFO Signed narinfos id=15 count=14523lb # [ 59.453143] niks3-server[961]: 2026/09/22 22:23:23 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4524worker1 # [ 59.364033] nix-grpc-daemon[847]: time=2026-09-22T22:23:22.944Z level=INFO msg="Upload complete. (249ms)"4525lb # [ 59.466327] niks3-server[961]: 2026/09/22 22:23:23 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4526lb # [ 59.473780] niks3-server[961]: 2026/09/22 22:23:23 INFO Completed upload id=154527lb # [ 59.477458] niks3-server[961]: 2026/09/22 22:23:23 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4528worker1 # [ 59.376295] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_in=4324529worker1 # [ 59.391937] nix-grpc-daemon[768]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564530worker1 # [ 59.399218] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4531worker1 # [ 59.404192] nix-daemon[834]: reaped child process 996, status = succeeded4532worker1 # [ 59.416150] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4533client # [ 59.453466] nix[1001]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4534lb # [ 59.712465] envoy[906]: conn peer=[2001:db8:1::1]:52822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4198 tx=1895 ms=22014535lb # [ 59.717410] envoy[906]: conn peer=[2001:db8:1::1]:35816 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9528 tx=4430 ms=59464536lb # [ 59.723019] envoy[906]: conn peer=[2001:db8:1::1]:35824 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2889 ms=1884537lb # [ 59.727969] envoy[906]: conn peer=[2001:db8:1::1]:35826 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=409 ms=1064538lb # [ 59.732646] envoy[906]: conn peer=[2001:db8:1::1]:35852 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=329 ms=804539lb # [ 59.738659] envoy[906]: conn peer=[2001:db8:1::1]:35842 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=375 ms=934540client # [ 59.938555] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4541client # Running as unit: dedup2.service; invocation ID: 2b5954d7d96d492eb22cdc1501ae9cb44542client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 1.11 seconds)4543client # [ 60.143647] nix[1017]: don't know how to build these paths:4544worker2 # [ 60.099909] nix-grpc-daemon[770]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:407924545client # [ 60.145523] nix[1017]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4546worker2 # [ 60.109334] nix-grpc-daemon[770]: ts=2026-09-22T22:23:23Z level=debug event=want client=6 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04547client # [ 60.164544] nix[1017]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4548worker1 # [ 60.125153] nix-grpc-daemon[768]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564549client: must succeed: sleep 24550client: (finished: must succeed: sleep 2, in 2.05 seconds)4551client: waiting for success: ! systemctl is-active dedup1 dedup24552worker1 # [ 63.471968] nix-daemon[834]: reaped child process 1005, status = succeeded4553worker1 # [ 63.591315] nix-daemon[834]: accepted connection from pid 1035, user nix-grpc-daemon (trusted)4554worker1 # [ 63.608894] nix-daemon[834]: reaped child process 1038, status = succeeded4555lb # [ 63.716916] niks3-server[961]: 2026/09/22 22:23:27 INFO Received uploads request method=POST path=/api/pending_closures4556worker1 # [ 63.628179] nix-grpc-daemon[847]: time=2026-09-22T22:23:27.205Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4557worker1 # [ 63.629716] nix-grpc-daemon[847]: time=2026-09-22T22:23:27.205Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4558lb # [ 63.762775] niks3-server[961]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4559worker1 # [ 63.672377] nix-grpc-daemon[847]: time=2026-09-22T22:23:27.252Z level=INFO msg="Uploading 1 narinfos"4560lb # [ 63.772493] niks3-server[961]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4561lb # [ 63.785875] niks3-server[961]: 2026/09/22 22:23:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4562lb # [ 63.796692] niks3-server[961]: 2026/09/22 22:23:27 INFO Signed narinfos id=16 count=14563lb # [ 63.798818] niks3-server[961]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4564worker1 # [ 63.703182] nix-grpc-daemon[847]: time=2026-09-22T22:23:27.283Z level=INFO msg="Upload complete. (254ms)"4565lb # [ 63.807028] niks3-server[961]: 2026/09/22 22:23:27 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4566lb # [ 63.811159] niks3-server[961]: 2026/09/22 22:23:27 INFO Completed upload id=164567lb # [ 63.815547] niks3-server[961]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4568worker1 # [ 63.717162] nix-grpc-daemon[768]: ts=2026-09-22T22:23:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14569worker1 # [ 63.732443] nix-grpc-daemon[768]: ts=2026-09-22T22:23:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14570worker1 # [ 63.741027] nix-daemon[834]: reaped child process 1003, status = succeeded4571client # [ 63.792595] systemd[1]: dedup1.service: Deactivated successfully.4572client # [ 63.796951] systemd[1]: dedup1.service: Consumed 172ms CPU time over 4.950s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.4573client # [ 63.843891] systemd[1]: dedup2.service: Deactivated successfully.4574client # [ 63.847449] systemd[1]: dedup2.service: Consumed 188ms CPU time over 3.908s wall clock time, 33.2M memory peak, 6.1K incoming IP traffic, 5.7K outgoing IP traffic.4575client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.12 seconds)4576client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4577client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.06 seconds)4578worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4579worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4580worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4581worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4582worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4583worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4584worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4585worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4586(finished: subtest: two clients wanting the same drv build it once, in 6.12 seconds)4587subtest: --timeout and --max-silent-time reach the builder4588worker1 # [ 65.097351] nix-grpc-daemon[768]: ts=2026-09-22T22:23:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582564589worker2 # [ 65.112655] nix-grpc-daemon[770]: ts=2026-09-22T22:23:28Z level=debug event=want client=7 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=04590worker2 # [ 65.113010] nix-grpc-daemon[770]: ts=2026-09-22T22:23:28Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.4:50051 clients=14591worker2 # [ 65.163473] nix-grpc-daemon[770]: ts=2026-09-22T22:23:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924592worker2 # [ 65.179539] nix-grpc-daemon[770]: ts=2026-09-22T22:23:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407924593worker2 # [ 65.194354] nix-grpc-daemon[770]: ts=2026-09-22T22:23:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:407924594worker2 # [ 65.209485] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4595worker2 # [ 65.369540] nix-daemon[856]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)4596worker2 # [ 65.390498] nix-daemon[856]: reaped child process 1045, status = succeeded4597lb # [ 65.501626] niks3-server[961]: 2026/09/22 22:23:29 INFO Received uploads request method=POST path=/api/pending_closures4598worker2 # [ 65.405773] nix-grpc-daemon[909]: time=2026-09-22T22:23:28.968Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4599worker2 # [ 65.407329] nix-grpc-daemon[909]: time=2026-09-22T22:23:28.968Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)"4600lb # [ 65.531542] niks3-server[961]: 2026/09/22 22:23:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4601worker2 # [ 65.435056] nix-grpc-daemon[909]: time=2026-09-22T22:23:28.997Z level=INFO msg="Uploading 1 narinfos"4602lb # [ 65.544956] niks3-server[961]: 2026/09/22 22:23:29 INFO Signed narinfos id=17 count=14603lb # [ 65.555434] niks3-server[961]: 2026/09/22 22:23:29 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst4604lb # [ 65.570555] niks3-server[961]: 2026/09/22 22:23:29 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls4605worker2 # [ 65.472040] nix-grpc-daemon[909]: time=2026-09-22T22:23:29.035Z level=INFO msg="Upload complete. (245ms)"4606lb # [ 65.579498] niks3-server[961]: 2026/09/22 22:23:29 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4607lb # [ 65.585481] niks3-server[961]: 2026/09/22 22:23:29 INFO Completed upload id=174608worker2 # [ 65.484624] nix-grpc-daemon[770]: ts=2026-09-22T22:23:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=0 paths=1 nar_bytes_in=4244609lb # [ 65.591802] niks3-server[961]: 2026/09/22 22:23:29 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo4610worker2 # [ 65.499175] nix-grpc-daemon[770]: ts=2026-09-22T22:23:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924611worker2 # [ 65.505934] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4612worker2 # [ 65.511006] nix-daemon[856]: reaped child process 1040, status = succeeded4613worker2 # [ 65.525721] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4614lb # [ 69.710225] envoy[906]: conn peer=[2001:db8:1::1]:35864 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3018 tx=1536 ms=47464615lb # [ 69.715206] envoy[906]: conn peer=[2001:db8:1::1]:35880 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1197 ms=36794616worker2 # [ 71.741447] nix-grpc-daemon[770]: ts=2026-09-22T22:23:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=9 outputs=04617worker2 # [ 71.762128] nix-daemon[856]: reaped child process 1047, status = succeeded4618worker2 # [ 71.763453] nix-daemon[856]: reaped child process 1049, status = succeeded4619worker2 # [ 71.985165] nix-grpc-daemon[770]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:407924620worker2 # [ 72.002102] nix-grpc-daemon[770]: ts=2026-09-22T22:23:35Z level=debug event=want client=8 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=04621worker1 # [ 72.011449] nix-grpc-daemon[768]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564622worker2 # [ 72.008600] nix-grpc-daemon[770]: ts=2026-09-22T22:23:35Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.3:50051 clients=14623worker1 # [ 72.027942] nix-grpc-daemon[768]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582564624worker1 # [ 72.042565] nix-grpc-daemon[768]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582564625worker1 # [ 72.058249] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4626worker1 # [ 72.229021] nix-daemon[834]: accepted connection from pid 1051, user nix-grpc-daemon (trusted)4627worker1 # [ 72.250797] nix-daemon[834]: reaped child process 1054, status = succeeded4628lb # [ 72.359503] niks3-server[961]: 2026/09/22 22:23:35 INFO Received uploads request method=POST path=/api/pending_closures4629worker1 # [ 72.267473] nix-grpc-daemon[847]: time=2026-09-22T22:23:35.847Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4630worker1 # [ 72.269845] nix-grpc-daemon[847]: time=2026-09-22T22:23:35.849Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)"4631worker1 # [ 72.307148] nix-grpc-daemon[847]: time=2026-09-22T22:23:35.887Z level=INFO msg="Uploading 1 narinfos"4632lb # [ 72.399017] niks3-server[961]: 2026/09/22 22:23:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4633lb # [ 72.412989] niks3-server[961]: 2026/09/22 22:23:35 INFO Signed narinfos id=18 count=14634lb # [ 72.420330] niks3-server[961]: 2026/09/22 22:23:35 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst4635lb # [ 72.432442] niks3-server[961]: 2026/09/22 22:23:35 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls4636lb # [ 72.442980] niks3-server[961]: 2026/09/22 22:23:36 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4637lb # [ 72.448272] niks3-server[961]: 2026/09/22 22:23:36 INFO Completed upload id=184638worker1 # [ 72.346091] nix-grpc-daemon[847]: time=2026-09-22T22:23:35.926Z level=INFO msg="Upload complete. (269ms)"4639lb # [ 72.451616] niks3-server[961]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo4640worker1 # [ 72.357512] nix-grpc-daemon[768]: ts=2026-09-22T22:23:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_in=4244641worker1 # [ 72.372978] nix-grpc-daemon[768]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564642worker1 # [ 72.384120] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4643worker1 # [ 72.392420] nix-daemon[834]: reaped child process 1049, status = succeeded4644worker1 # [ 72.403821] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4645worker1 # [ 78.820669] nix-grpc-daemon[768]: ts=2026-09-22T22:23:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=6 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=10 outputs=04646worker1 # [ 78.855316] nix-daemon[834]: reaped child process 1056, status = succeeded4647worker1 # [ 78.857679] nix-daemon[834]: reaped child process 1058, status = succeeded4648(finished: subtest: --timeout and --max-silent-time reach the builder, in 14.12 seconds)4649subtest: the first client leaving does not fail the second4650client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4651client # [ 79.105137] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4652client # Running as unit: share1.service; invocation ID: 8654fe8f41f1441db9b7be81edcf376e4653client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 0.09 seconds)4654client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4655worker1 # [ 79.274903] nix-grpc-daemon[768]: ts=2026-09-22T22:23:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582564656client # [ 79.320960] nix[1091]: don't know how to build these paths:4657client # [ 79.322174] nix[1091]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4658worker2 # [ 79.292956] nix-grpc-daemon[770]: ts=2026-09-22T22:23:42Z level=debug event=want client=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04659worker2 # [ 79.300739] nix-grpc-daemon[770]: ts=2026-09-22T22:23:42Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.4:50051 clients=14660worker2 # [ 79.308763] nix-grpc-daemon[770]: ts=2026-09-22T22:23:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924661worker2 # [ 79.321108] nix-grpc-daemon[770]: ts=2026-09-22T22:23:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407924662client # [ 79.371699] nix[1091]: copying 1 paths to 'lb:50051'...4663client # [ 79.375791] nix[1091]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'...4664worker2 # [ 79.333149] nix-grpc-daemon[770]: ts=2026-09-22T22:23:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:407924665worker2 # [ 79.347977] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4666worker2 # [ 79.510398] nix-daemon[856]: accepted connection from pid 1076, user nix-grpc-daemon (trusted)4667worker2 # [ 79.528835] nix-daemon[856]: reaped child process 1079, status = succeeded4668lb # [ 79.642138] niks3-server[961]: 2026/09/22 22:23:43 INFO Received uploads request method=POST path=/api/pending_closures4669worker2 # [ 79.547414] nix-grpc-daemon[909]: time=2026-09-22T22:23:43.108Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4670worker2 # [ 79.549605] nix-grpc-daemon[909]: time=2026-09-22T22:23:43.109Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)"4671lb # [ 79.680540] niks3-server[961]: 2026/09/22 22:23:43 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls4672worker2 # [ 79.584255] nix-grpc-daemon[909]: time=2026-09-22T22:23:43.146Z level=INFO msg="Uploading 1 narinfos"4673lb # [ 79.692628] niks3-server[961]: 2026/09/22 22:23:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4674lb # [ 79.705469] niks3-server[961]: 2026/09/22 22:23:43 INFO Signed narinfos id=19 count=14675lb # [ 79.711555] niks3-server[961]: 2026/09/22 22:23:43 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst4676lb # [ 79.725770] niks3-server[961]: 2026/09/22 22:23:43 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4677worker2 # [ 79.626644] nix-grpc-daemon[909]: time=2026-09-22T22:23:43.189Z level=INFO msg="Upload complete. (261ms)"4678lb # [ 79.732444] niks3-server[961]: 2026/09/22 22:23:43 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo4679lb # [ 79.737798] envoy[906]: conn peer=[2001:db8:1::1]:57038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2988 tx=954 ms=66714680lb # [ 79.744461] envoy[906]: conn peer=[2001:db8:1::1]:51004 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2976 tx=951 ms=68504681worker2 # [ 79.636391] nix-grpc-daemon[770]: ts=2026-09-22T22:23:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=0 paths=1 nar_bytes_in=4324682lb # [ 79.749779] niks3-server[961]: 2026/09/22 22:23:43 INFO Completed upload id=194683worker2 # [ 79.656747] nix-grpc-daemon[770]: ts=2026-09-22T22:23:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924684worker2 # [ 79.664394] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4685worker2 # [ 79.670489] nix-daemon[856]: reaped child process 1074, status = succeeded4686client # [ 79.725101] nix[1091]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4687worker2 # [ 79.683752] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4688client # [ 80.209442] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4689client # Running as unit: share2.service; invocation ID: 21fe3bcd4abb404a92912ee1cafd32b34690client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 1.12 seconds)4691worker1 # [ 80.395510] nix-grpc-daemon[768]: ts=2026-09-22T22:23:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582564692client # [ 80.442589] nix[1107]: don't know how to build these paths:4693client # [ 80.443724] nix[1107]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4694worker2 # [ 80.410134] nix-grpc-daemon[770]: ts=2026-09-22T22:23:43Z level=debug event=want client=10 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04695worker2 # [ 80.415955] nix-grpc-daemon[770]: ts=2026-09-22T22:23:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924696client # [ 80.462627] nix[1107]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4697client: must succeed: sleep 2; systemctl kill -s INT share14698client # [ 83.584980] systemd[1]: share1.service: Sent signal SIGINT to main process 1091 (nix) on client request.4699client # [ 83.595539] nix[1091]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)4700client # [ 83.609309] nix[1091]: error: interrupted by the user4701client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.10 seconds)4702client: waiting for success: ! systemctl is-active share14703client # [ 83.677120] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE4704client # [ 83.679238] systemd[1]: share1.service: Failed with result 'exit-code'.4705client # [ 83.682578] systemd[1]: share1.service: Consumed 182ms CPU time over 4.572s wall clock time, 41.4M memory peak, 6.2K incoming IP traffic, 8.2K outgoing IP traffic.4706client: (finished: waiting for success: ! systemctl is-active share1, in 1.12 seconds)4707client: waiting for success: ! systemctl is-active share24708worker2 # [ 85.197722] nix-daemon[856]: reaped child process 1083, status = succeeded4709worker2 # [ 85.265763] nix-daemon[856]: accepted connection from pid 1119, user nix-grpc-daemon (trusted)4710worker2 # [ 85.284289] nix-daemon[856]: reaped child process 1122, status = succeeded4711lb # [ 85.397669] niks3-server[961]: 2026/09/22 22:23:48 INFO Received uploads request method=POST path=/api/pending_closures4712worker2 # [ 85.306538] nix-grpc-daemon[909]: time=2026-09-22T22:23:48.866Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4713worker2 # [ 85.308401] nix-grpc-daemon[909]: time=2026-09-22T22:23:48.866Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)"4714lb # [ 85.446573] niks3-server[961]: 2026/09/22 22:23:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4715worker2 # [ 85.352328] nix-grpc-daemon[909]: time=2026-09-22T22:23:48.914Z level=INFO msg="Uploading 1 narinfos"4716lb # [ 85.461203] niks3-server[961]: 2026/09/22 22:23:49 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4717lb # [ 85.470879] niks3-server[961]: 2026/09/22 22:23:49 INFO Signed narinfos id=20 count=14718lb # [ 85.477371] niks3-server[961]: 2026/09/22 22:23:49 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst4719lb # [ 85.491359] niks3-server[961]: 2026/09/22 22:23:49 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls4720worker2 # [ 85.390701] nix-grpc-daemon[909]: time=2026-09-22T22:23:48.953Z level=INFO msg="Upload complete. (285ms)"4721lb # [ 85.498469] niks3-server[961]: 2026/09/22 22:23:49 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4722lb # [ 85.505545] niks3-server[961]: 2026/09/22 22:23:49 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo4723lb # [ 85.509695] niks3-server[961]: 2026/09/22 22:23:49 INFO Completed upload id=204724worker2 # [ 85.405201] nix-grpc-daemon[770]: ts=2026-09-22T22:23:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=5 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14725worker2 # [ 85.420579] nix-grpc-daemon[770]: ts=2026-09-22T22:23:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=4 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14726worker2 # [ 85.429736] nix-daemon[856]: reaped child process 1081, status = succeeded4727client # [ 85.520787] systemd[1]: share2.service: Deactivated successfully.4728client # [ 85.526143] systemd[1]: share2.service: Consumed 203ms CPU time over 5.313s wall clock time, 35.3M memory peak, 6.1K incoming IP traffic, 5.7K outgoing IP traffic.4729client: (finished: waiting for success: ! systemctl is-active share2, in 1.12 seconds)4730client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }4731client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.05 seconds)4732(finished: subtest: the first client leaving does not fail the second, in 7.11 seconds)4733subtest: build hook: nix-daemon with builders = grpc://lb4734client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log4735client # [ 86.275963] systemd[1]: Started Nix Daemon.4736client # [ 86.390889] nix-daemon[1159]: accepted connection from pid 1156, user root (trusted)4737worker2 # [ 86.508516] nix-grpc-daemon[770]: ts=2026-09-22T22:23:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:407924738worker2 # [ 86.514873] nix-grpc-daemon[770]: ts=2026-09-22T22:23:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407924739worker2 # [ 86.533799] nix-grpc-daemon[770]: ts=2026-09-22T22:23:50Z level=debug event=want client=11 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04740worker2 # [ 86.540481] nix-grpc-daemon[770]: ts=2026-09-22T22:23:50Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14741worker1 # [ 86.549395] nix-grpc-daemon[768]: ts=2026-09-22T22:23:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564742worker1 # [ 86.565417] nix-grpc-daemon[768]: ts=2026-09-22T22:23:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582564743worker1 # [ 86.577574] nix-grpc-daemon[768]: ts=2026-09-22T22:23:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582564744worker1 # [ 86.593727] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4745worker1 # [ 86.763159] nix-daemon[834]: accepted connection from pid 1097, user nix-grpc-daemon (trusted)4746worker1 # [ 86.781999] nix-daemon[834]: reaped child process 1100, status = succeeded4747lb # [ 86.894104] niks3-server[961]: 2026/09/22 22:23:50 INFO Received uploads request method=POST path=/api/pending_closures4748worker1 # [ 86.801060] nix-grpc-daemon[847]: time=2026-09-22T22:23:50.380Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4749worker1 # [ 86.802602] nix-grpc-daemon[847]: time=2026-09-22T22:23:50.380Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4750lb # [ 86.926821] niks3-server[961]: 2026/09/22 22:23:50 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4751worker1 # [ 86.835659] nix-grpc-daemon[847]: time=2026-09-22T22:23:50.415Z level=INFO msg="Uploading 1 narinfos"4752lb # [ 86.941161] niks3-server[961]: 2026/09/22 22:23:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4753lb # [ 86.952270] niks3-server[961]: 2026/09/22 22:23:50 INFO Signed narinfos id=21 count=14754lb # [ 86.958377] niks3-server[961]: 2026/09/22 22:23:50 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4755worker1 # [ 86.861653] nix-grpc-daemon[847]: time=2026-09-22T22:23:50.442Z level=INFO msg="Upload complete. (250ms)"4756lb # [ 86.965768] niks3-server[961]: 2026/09/22 22:23:50 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4757lb # [ 86.970428] niks3-server[961]: 2026/09/22 22:23:50 INFO Completed upload id=214758lb # [ 86.973569] niks3-server[961]: 2026/09/22 22:23:50 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4759worker1 # [ 86.872663] nix-grpc-daemon[768]: ts=2026-09-22T22:23:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_in=5124760worker1 # [ 86.882881] nix-grpc-daemon[768]: ts=2026-09-22T22:23:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564761worker1 # [ 86.894591] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4762worker1 # [ 86.899419] nix-daemon[834]: reaped child process 1095, status = succeeded4763worker1 # [ 86.911949] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4764worker1 # [ 88.146056] nix-daemon[834]: reaped child process 1104, status = succeeded4765worker1 # [ 88.240537] nix-daemon[834]: accepted connection from pid 1120, user nix-grpc-daemon (trusted)4766worker1 # [ 88.258085] nix-daemon[834]: reaped child process 1123, status = succeeded4767lb # [ 88.367864] niks3-server[961]: 2026/09/22 22:23:51 INFO Received uploads request method=POST path=/api/pending_closures4768worker1 # [ 88.278380] nix-grpc-daemon[847]: time=2026-09-22T22:23:51.856Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4769worker1 # [ 88.279816] nix-grpc-daemon[847]: time=2026-09-22T22:23:51.857Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4770lb # [ 88.415865] niks3-server[961]: 2026/09/22 22:23:51 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4771worker1 # [ 88.323739] nix-grpc-daemon[847]: time=2026-09-22T22:23:51.903Z level=INFO msg="Uploading 1 narinfos"4772lb # [ 88.423911] niks3-server[961]: 2026/09/22 22:23:51 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4773lb # [ 88.438322] niks3-server[961]: 2026/09/22 22:23:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4774lb # [ 88.449535] niks3-server[961]: 2026/09/22 22:23:51 INFO Signed narinfos id=22 count=14775worker1 # [ 88.352565] nix-grpc-daemon[847]: time=2026-09-22T22:23:51.932Z level=INFO msg="Upload complete. (231ms)"4776lb # [ 88.456454] niks3-server[961]: 2026/09/22 22:23:52 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4777lb # [ 88.462048] niks3-server[961]: 2026/09/22 22:23:52 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4778lb # [ 88.468831] niks3-server[961]: 2026/09/22 22:23:52 INFO Completed upload id=224779worker1 # [ 88.364799] nix-grpc-daemon[768]: ts=2026-09-22T22:23:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=12 outputs=14780lb # [ 88.471601] niks3-server[961]: 2026/09/22 22:23:52 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4781worker1 # [ 88.378404] nix-daemon[834]: reaped child process 1102, status = succeeded4782worker1 # [ 88.411052] nix-grpc-daemon[768]: ts=2026-09-22T22:23:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582564783worker2 # [ 88.438678] nix-grpc-daemon[770]: ts=2026-09-22T22:23:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:407924784worker2 # [ 88.453782] nix-grpc-daemon[770]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4785worker2 # [ 88.472590] nix-grpc-daemon[770]: ts=2026-09-22T22:23:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=0 paths=1 nar_bytes_out=1284786worker1 # [ 88.767035] nix-grpc-daemon[768]: ts=2026-09-22T22:23:52Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582564787worker1 # [ 88.775120] nix-grpc-daemon[768]: ts=2026-09-22T22:23:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582564788worker1 # [ 88.782912] nix-grpc-daemon[847]: time=2026-09-22T22:23:52.361Z level=INFO msg="All 1 paths already cached"4789worker2 # [ 88.792447] nix-grpc-daemon[770]: ts=2026-09-22T22:23:52Z level=debug event=want client=12 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04790worker2 # [ 88.799112] nix-grpc-daemon[770]: ts=2026-09-22T22:23:52Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14791worker1 # [ 88.806336] nix-grpc-daemon[768]: ts=2026-09-22T22:23:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564792worker1 # [ 88.821821] nix-grpc-daemon[768]: ts=2026-09-22T22:23:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582564793worker1 # [ 88.836500] nix-grpc-daemon[847]: time=2026-09-22T22:23:52.416Z level=INFO msg="All 1 paths already cached"4794worker1 # [ 88.844145] nix-grpc-daemon[768]: ts=2026-09-22T22:23:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582564795worker1 # [ 88.858646] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4796worker1 # [ 89.024674] nix-daemon[834]: accepted connection from pid 1127, user nix-grpc-daemon (trusted)4797worker1 # [ 89.044636] nix-daemon[834]: reaped child process 1130, status = succeeded4798lb # [ 89.148155] niks3-server[961]: 2026/09/22 22:23:52 INFO Received uploads request method=POST path=/api/pending_closures4799worker1 # [ 89.055720] nix-grpc-daemon[847]: time=2026-09-22T22:23:52.635Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4800worker1 # [ 89.057695] nix-grpc-daemon[847]: time=2026-09-22T22:23:52.635Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4801lb # [ 89.176998] niks3-server[961]: 2026/09/22 22:23:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4802worker1 # [ 89.082704] nix-grpc-daemon[847]: time=2026-09-22T22:23:52.662Z level=INFO msg="Uploading 1 narinfos"4803lb # [ 89.192558] niks3-server[961]: 2026/09/22 22:23:52 INFO Signed narinfos id=23 count=14804lb # [ 89.195716] niks3-server[961]: 2026/09/22 22:23:52 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4805lb # [ 89.211861] niks3-server[961]: 2026/09/22 22:23:52 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4806worker1 # [ 89.115363] nix-grpc-daemon[847]: time=2026-09-22T22:23:52.695Z level=INFO msg="Upload complete. (239ms)"4807lb # [ 89.217966] niks3-server[961]: 2026/09/22 22:23:52 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4808lb # [ 89.226670] niks3-server[961]: 2026/09/22 22:23:52 INFO Completed upload id=234809worker1 # [ 89.123611] nix-grpc-daemon[768]: ts=2026-09-22T22:23:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_in=6244810lb # [ 89.229067] niks3-server[961]: 2026/09/22 22:23:52 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4811worker1 # [ 89.139008] nix-grpc-daemon[768]: ts=2026-09-22T22:23:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564812worker1 # [ 89.147378] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4813worker1 # [ 89.152735] nix-daemon[834]: reaped child process 1125, status = succeeded4814worker1 # [ 89.165487] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4815lb # [ 89.720725] envoy[906]: conn peer=[2001:db8:1::1]:51018 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3029 tx=788 ms=43024816lb # [ 89.725780] envoy[906]: conn peer=[2001:db8:1::1]:51030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1456 tx=1197 ms=50634817lb # [ 89.730652] envoy[906]: conn peer=[2001:db8:1::1]:44146 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3446 tx=1966 ms=20244818lb # [ 89.735473] envoy[906]: conn peer=[2001:db8:1::1]:44158 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=984819worker1 # [ 90.033878] nix-daemon[834]: reaped child process 1134, status = succeeded4820worker1 # [ 90.151355] nix-daemon[834]: accepted connection from pid 1150, user nix-grpc-daemon (trusted)4821worker1 # [ 90.170290] nix-daemon[834]: reaped child process 1153, status = succeeded4822lb # [ 90.281716] niks3-server[961]: 2026/09/22 22:23:53 INFO Received uploads request method=POST path=/api/pending_closures4823worker1 # [ 90.190858] nix-grpc-daemon[847]: time=2026-09-22T22:23:53.767Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4824worker1 # [ 90.192799] nix-grpc-daemon[847]: time=2026-09-22T22:23:53.768Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4825lb # [ 90.323484] niks3-server[961]: 2026/09/22 22:23:53 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4826worker1 # [ 90.233904] nix-grpc-daemon[847]: time=2026-09-22T22:23:53.813Z level=INFO msg="Uploading 1 narinfos"4827lb # [ 90.338484] niks3-server[961]: 2026/09/22 22:23:53 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4828lb # [ 90.349023] niks3-server[961]: 2026/09/22 22:23:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4829lb # [ 90.357609] niks3-server[961]: 2026/09/22 22:23:53 INFO Signed narinfos id=24 count=14830lb # [ 90.361634] niks3-server[961]: 2026/09/22 22:23:53 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4831worker1 # [ 90.259857] nix-grpc-daemon[847]: time=2026-09-22T22:23:53.840Z level=INFO msg="Upload complete. (283ms)"4832lb # [ 90.366864] niks3-server[961]: 2026/09/22 22:23:53 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4833lb # [ 90.371127] niks3-server[961]: 2026/09/22 22:23:53 INFO Completed upload id=244834lb # [ 90.373549] niks3-server[961]: 2026/09/22 22:23:53 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4835worker1 # [ 90.273203] nix-grpc-daemon[768]: ts=2026-09-22T22:23:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=13 outputs=14836worker1 # [ 90.289902] nix-daemon[834]: reaped child process 1132, status = succeeded4837worker2 # [ 90.319576] nix-grpc-daemon[770]: ts=2026-09-22T22:23:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407924838worker2 # [ 90.327848] nix-grpc-daemon[770]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4839worker1 # [ 90.371805] nix-grpc-daemon[768]: ts=2026-09-22T22:23:53Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582564840worker1 # [ 90.379215] nix-grpc-daemon[768]: ts=2026-09-22T22:23:53Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_out=1764841worker1 # [ 90.619437] nix-grpc-daemon[768]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582564842worker2 # [ 90.619511] nix-grpc-daemon[770]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407924843worker2 # [ 90.631256] nix-grpc-daemon[909]: time=2026-09-22T22:23:54.193Z level=INFO msg="All 2 paths already cached"4844worker2 # [ 90.649763] nix-grpc-daemon[770]: ts=2026-09-22T22:23:54Z level=debug event=want client=13 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04845worker2 # [ 90.656499] nix-grpc-daemon[770]: ts=2026-09-22T22:23:54Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14846worker1 # [ 90.663390] nix-grpc-daemon[768]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564847worker1 # [ 90.678291] nix-grpc-daemon[768]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582564848worker1 # [ 90.690565] nix-grpc-daemon[847]: time=2026-09-22T22:23:54.270Z level=INFO msg="All 2 paths already cached"4849worker1 # [ 90.701244] nix-grpc-daemon[768]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582564850worker1 # [ 90.716679] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4851worker1 # [ 90.880249] nix-daemon[834]: accepted connection from pid 1157, user nix-grpc-daemon (trusted)4852worker1 # [ 90.903156] nix-daemon[834]: reaped child process 1160, status = succeeded4853lb # [ 91.011507] niks3-server[961]: 2026/09/22 22:23:54 INFO Received uploads request method=POST path=/api/pending_closures4854worker1 # [ 90.920650] nix-grpc-daemon[847]: time=2026-09-22T22:23:54.500Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4855worker1 # [ 90.922414] nix-grpc-daemon[847]: time=2026-09-22T22:23:54.500Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4856lb # [ 91.047470] niks3-server[961]: 2026/09/22 22:23:54 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4857worker1 # [ 90.954722] nix-grpc-daemon[847]: time=2026-09-22T22:23:54.534Z level=INFO msg="Uploading 1 narinfos"4858lb # [ 91.062399] niks3-server[961]: 2026/09/22 22:23:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4859lb # [ 91.073413] niks3-server[961]: 2026/09/22 22:23:54 INFO Signed narinfos id=25 count=14860lb # [ 91.075748] niks3-server[961]: 2026/09/22 22:23:54 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4861worker1 # [ 90.985899] nix-grpc-daemon[847]: time=2026-09-22T22:23:54.566Z level=INFO msg="Upload complete. (253ms)"4862lb # [ 91.088404] niks3-server[961]: 2026/09/22 22:23:54 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4863lb # [ 91.093284] niks3-server[961]: 2026/09/22 22:23:54 INFO Completed upload id=254864worker1 # [ 90.992177] nix-grpc-daemon[768]: ts=2026-09-22T22:23:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_in=7524865lb # [ 91.097251] niks3-server[961]: 2026/09/22 22:23:54 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4866worker1 # [ 91.004307] nix-grpc-daemon[768]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582564867worker1 # [ 91.009347] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4868worker1 # [ 91.014484] nix-daemon[834]: reaped child process 1155, status = succeeded4869worker1 # [ 91.023517] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)4870worker1 # [ 92.096534] nix-daemon[834]: reaped child process 1164, status = succeeded4871worker1 # [ 92.202555] nix-daemon[834]: accepted connection from pid 1180, user nix-grpc-daemon (trusted)4872worker1 # [ 92.220374] nix-daemon[834]: reaped child process 1183, status = succeeded4873lb # [ 92.328749] niks3-server[961]: 2026/09/22 22:23:55 INFO Received uploads request method=POST path=/api/pending_closures4874worker1 # [ 92.239676] nix-grpc-daemon[847]: time=2026-09-22T22:23:55.817Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4875worker1 # [ 92.241501] nix-grpc-daemon[847]: time=2026-09-22T22:23:55.817Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4876lb # [ 92.370243] niks3-server[961]: 2026/09/22 22:23:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4877worker1 # [ 92.281054] nix-grpc-daemon[847]: time=2026-09-22T22:23:55.861Z level=INFO msg="Uploading 1 narinfos"4878lb # [ 92.385069] niks3-server[961]: 2026/09/22 22:23:55 INFO Signed narinfos id=26 count=14879lb # [ 92.392888] niks3-server[961]: 2026/09/22 22:23:55 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4880lb # [ 92.405388] niks3-server[961]: 2026/09/22 22:23:55 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4881worker1 # [ 92.303353] nix-grpc-daemon[847]: time=2026-09-22T22:23:55.883Z level=INFO msg="Upload complete. (267ms)"4882lb # [ 92.416092] niks3-server[961]: 2026/09/22 22:23:55 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4883worker1 # [ 92.314661] nix-grpc-daemon[768]: ts=2026-09-22T22:23:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=14 outputs=14884lb # [ 92.421262] niks3-server[961]: 2026/09/22 22:23:55 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4885lb # [ 92.425657] niks3-server[961]: 2026/09/22 22:23:55 INFO Completed upload id=264886lb # [ 92.428092] niks3-server[961]: 2026/09/22 22:23:55 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4887worker1 # [ 92.334800] nix-grpc-daemon[768]: ts=2026-09-22T22:23:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582564888worker1 # [ 92.339631] nix-daemon[834]: reaped child process 1162, status = succeeded4889worker2 # [ 92.349507] nix-grpc-daemon[770]: ts=2026-09-22T22:23:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:407924890worker2 # [ 92.362713] nix-grpc-daemon[770]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4891worker2 # [ 92.379927] nix-grpc-daemon[770]: ts=2026-09-22T22:23:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=0 paths=1 nar_bytes_out=2324892client # [ 92.548726] nix-daemon[1159]: reaped child process 1161, status = succeeded4893client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.42 seconds)4894client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4895client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4896client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4897client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4898client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4899client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4900(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.54 seconds)4901subtest: an input only one worker has still reaches the builder4902client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only4903client # this derivation will be built:4904client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4905client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4906client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only, in 0.29 seconds)4907client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4908client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.12 seconds)4909worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4910worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.19 seconds)4911worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4912worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds)4913client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&24914client # [ 93.496413] nix-daemon[1159]: accepted connection from pid 1242, user root (trusted)4915client # this derivation will be built:4916client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4917client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...4918worker2 # [ 93.602490] nix-grpc-daemon[770]: ts=2026-09-22T22:23:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:407924919worker1 # [ 93.611233] nix-grpc-daemon[768]: ts=2026-09-22T22:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582564920worker1 # [ 93.789259] nix-daemon[834]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)4921worker1 # [ 93.806604] nix-daemon[834]: reaped child process 1193, status = succeeded4922lb # [ 93.917387] niks3-server[961]: 2026/09/22 22:23:57 INFO Received uploads request method=POST path=/api/pending_closures4923worker1 # [ 93.824610] nix-grpc-daemon[847]: time=2026-09-22T22:23:57.403Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4924worker1 # [ 93.826585] nix-grpc-daemon[847]: time=2026-09-22T22:23:57.403Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4925worker1 # [ 93.851774] nix-grpc-daemon[847]: time=2026-09-22T22:23:57.431Z level=INFO msg="Uploading 1 narinfos"4926lb # [ 93.947309] niks3-server[961]: 2026/09/22 22:23:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4927lb # [ 93.962567] niks3-server[961]: 2026/09/22 22:23:57 INFO Signed narinfos id=27 count=14928lb # [ 93.969050] niks3-server[961]: 2026/09/22 22:23:57 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4929lb # [ 93.982822] niks3-server[961]: 2026/09/22 22:23:57 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4930worker1 # [ 93.886485] nix-grpc-daemon[847]: time=2026-09-22T22:23:57.466Z level=INFO msg="Upload complete. (269ms)"4931lb # [ 93.988817] niks3-server[961]: 2026/09/22 22:23:57 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4932lb # [ 93.996355] niks3-server[961]: 2026/09/22 22:23:57 INFO Completed upload id=274933lb # [ 94.000405] niks3-server[961]: 2026/09/22 22:23:57 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4934worker2 # [ 93.906543] nix-grpc-daemon[770]: ts=2026-09-22T22:23:57Z level=debug event=want client=14 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04935worker2 # [ 93.914156] nix-grpc-daemon[770]: ts=2026-09-22T22:23:57Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14936worker2 # [ 93.954479] nix-grpc-daemon[770]: ts=2026-09-22T22:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924937worker2 # [ 93.969977] nix-grpc-daemon[770]: ts=2026-09-22T22:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407924938client # copying 2 paths to 'lb:50051'...4939client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4940worker2 # [ 93.989855] nix-grpc-daemon[770]: ts=2026-09-22T22:23:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:407924941client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4942worker2 # [ 94.004984] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4943worker2 # [ 94.169446] nix-daemon[856]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)4944worker2 # [ 94.190335] nix-daemon[856]: reaped child process 1143, status = succeeded4945lb # [ 94.300709] niks3-server[961]: 2026/09/22 22:23:57 INFO Received uploads request method=POST path=/api/pending_closures4946lb # [ 94.310274] niks3-server[961]: 2026/09/22 22:23:57 INFO Received uploads request method=POST path=/api/pending_closures4947worker2 # [ 94.216508] nix-grpc-daemon[909]: time=2026-09-22T22:23:57.777Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4948worker2 # [ 94.218553] nix-grpc-daemon[909]: time=2026-09-22T22:23:57.777Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4949worker2 # [ 94.222657] nix-grpc-daemon[909]: time=2026-09-22T22:23:57.777Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4950lb # [ 94.345912] niks3-server[961]: 2026/09/22 22:23:57 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4951lb # [ 94.371533] niks3-server[961]: 2026/09/22 22:23:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4952worker2 # [ 94.277005] nix-grpc-daemon[909]: time=2026-09-22T22:23:57.839Z level=INFO msg="Uploading 3 narinfos"4953lb # [ 94.385937] niks3-server[961]: 2026/09/22 22:23:57 INFO Signed narinfos id=28 count=14954lb # [ 94.392716] niks3-server[961]: 2026/09/22 22:23:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4955lb # [ 94.400343] niks3-server[961]: 2026/09/22 22:23:57 INFO Signed narinfos id=29 count=24956lb # [ 94.404874] niks3-server[961]: 2026/09/22 22:23:57 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4957lb # [ 94.407957] niks3-server[961]: 2026/09/22 22:23:57 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4958lb # [ 94.420205] niks3-server[961]: 2026/09/22 22:23:57 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4959lb # [ 94.431543] niks3-server[961]: 2026/09/22 22:23:57 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4960lb # [ 94.442075] niks3-server[961]: 2026/09/22 22:23:58 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4961lb # [ 94.446551] niks3-server[961]: 2026/09/22 22:23:58 INFO Completed upload id=284962lb # [ 94.448504] niks3-server[961]: 2026/09/22 22:23:58 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4963lb # [ 94.451282] niks3-server[961]: 2026/09/22 22:23:58 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4964lb # [ 94.454732] niks3-server[961]: 2026/09/22 22:23:58 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4965worker2 # [ 94.340746] nix-grpc-daemon[909]: time=2026-09-22T22:23:57.903Z level=INFO msg="Upload complete. (316ms)"4966lb # [ 94.458922] niks3-server[961]: 2026/09/22 22:23:58 INFO Completed upload id=294967worker2 # [ 94.353734] nix-grpc-daemon[770]: ts=2026-09-22T22:23:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=0 paths=2 nar_bytes_in=9844968worker2 # [ 94.371323] nix-grpc-daemon[770]: ts=2026-09-22T22:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407924969worker2 # [ 94.380855] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4970worker2 # [ 94.387420] nix-daemon[856]: reaped child process 1138, status = succeeded4971worker2 # [ 94.405982] nix-grpc-daemon[770]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4972client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4973worker2 # [ 94.423200] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)4974client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4975client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds4976worker2 # [ 95.464535] nix-daemon[856]: reaped child process 1148, status = succeeded4977worker2 # [ 95.580090] nix-daemon[856]: accepted connection from pid 1164, user nix-grpc-daemon (trusted)4978worker2 # [ 95.595331] nix-daemon[856]: reaped child process 1167, status = succeeded4979lb # [ 95.709379] niks3-server[961]: 2026/09/22 22:23:59 INFO Received uploads request method=POST path=/api/pending_closures4980worker2 # [ 95.619359] nix-grpc-daemon[909]: time=2026-09-22T22:23:59.178Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4981lb # [ 95.749766] niks3-server[961]: 2026/09/22 22:23:59 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4982worker2 # [ 95.654093] nix-grpc-daemon[909]: time=2026-09-22T22:23:59.216Z level=INFO msg="Uploading 1 narinfos"4983lb # [ 95.764181] niks3-server[961]: 2026/09/22 22:23:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4984lb # [ 95.772217] niks3-server[961]: 2026/09/22 22:23:59 INFO Signed narinfos id=30 count=14985lb # [ 95.776916] niks3-server[961]: 2026/09/22 22:23:59 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4986lb # [ 95.787244] niks3-server[961]: 2026/09/22 22:23:59 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4987lb # [ 95.794830] niks3-server[961]: 2026/09/22 22:23:59 INFO Completed upload id=304988worker2 # [ 95.687694] nix-grpc-daemon[909]: time=2026-09-22T22:23:59.250Z level=INFO msg="Upload complete. (247ms)"4989lb # [ 95.797427] niks3-server[961]: 2026/09/22 22:23:59 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4990client # copying 1 paths...4991worker2 # [ 95.705559] nix-grpc-daemon[770]: ts=2026-09-22T22:23:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=15 outputs=14992worker2 # [ 95.718312] nix-grpc-daemon[770]: ts=2026-09-22T22:23:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407924993worker2 # [ 95.722819] nix-daemon[856]: reaped child process 1145, status = succeeded4994client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4995worker1 # [ 95.754954] nix-grpc-daemon[768]: ts=2026-09-22T22:23:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582564996worker1 # [ 95.768267] nix-grpc-daemon[768]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4997worker1 # [ 95.784418] nix-grpc-daemon[768]: ts=2026-09-22T22:23:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_out=1204998client # [ 95.947342] nix-daemon[1159]: reaped child process 1245, status = succeeded4999client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.64 seconds)5000client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&25001client # [ 96.119600] nix-daemon[1159]: accepted connection from pid 1264, user root (trusted)5002client # this derivation will be built:5003client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5004worker1 # [ 96.228772] nix-grpc-daemon[768]: ts=2026-09-22T22:23:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582565005worker2 # [ 96.229565] nix-grpc-daemon[770]: ts=2026-09-22T22:23:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407925006client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5007worker2 # [ 96.236462] nix-grpc-daemon[909]: time=2026-09-22T22:23:59.799Z level=INFO msg="All 1 paths already cached"5008worker2 # [ 96.253037] nix-grpc-daemon[770]: ts=2026-09-22T22:23:59Z level=debug event=want client=15 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=05009worker2 # [ 96.259401] nix-grpc-daemon[770]: ts=2026-09-22T22:23:59Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15010worker1 # [ 96.302339] nix-grpc-daemon[768]: ts=2026-09-22T22:23:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582565011worker1 # [ 96.318005] nix-grpc-daemon[768]: ts=2026-09-22T22:23:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582565012client # copying 1 paths to 'lb:50051'...5013client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...5014worker1 # [ 96.340123] nix-grpc-daemon[768]: ts=2026-09-22T22:23:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582565015worker1 # [ 96.355872] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)5016worker1 # [ 96.379168] nix-grpc-daemon[768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 1/5)5017worker1 # [ 96.473792] nix-grpc-daemon[768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 164 ms (attempt 2/5)5018worker1 # [ 96.639883] nix-grpc-daemon[768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 330 ms (attempt 3/5)5019worker1 # [ 96.973348] nix-grpc-daemon[768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 563 ms (attempt 4/5)5020worker1 # [ 97.537772] nix-grpc-daemon[768]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5021worker1 # [ 97.545815] nix-grpc-daemon[768]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5022worker1 # [ 97.553130] nix-grpc-daemon[768]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...5023worker1 # [ 97.732740] nix-daemon[834]: accepted connection from pid 1203, user nix-grpc-daemon (trusted)5024worker1 # [ 97.751926] nix-daemon[834]: reaped child process 1206, status = succeeded5025lb # [ 97.861735] niks3-server[961]: 2026/09/22 22:24:01 INFO Received uploads request method=POST path=/api/pending_closures5026worker1 # [ 97.770433] nix-grpc-daemon[847]: time=2026-09-22T22:24:01.350Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5027worker1 # [ 97.772107] nix-grpc-daemon[847]: time=2026-09-22T22:24:01.350Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"5028lb # [ 97.899176] niks3-server[961]: 2026/09/22 22:24:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5029worker1 # [ 97.806447] nix-grpc-daemon[847]: time=2026-09-22T22:24:01.386Z level=INFO msg="Uploading 1 narinfos"5030lb # [ 97.909540] niks3-server[961]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls5031lb # [ 97.917256] niks3-server[961]: 2026/09/22 22:24:01 INFO Signed narinfos id=31 count=15032lb # [ 97.923234] niks3-server[961]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst5033lb # [ 97.937460] niks3-server[961]: 2026/09/22 22:24:01 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5034lb # [ 97.945928] niks3-server[961]: 2026/09/22 22:24:01 INFO Completed upload id=315035worker1 # [ 97.842458] nix-grpc-daemon[847]: time=2026-09-22T22:24:01.422Z level=INFO msg="Upload complete. (269ms)"5036lb # [ 97.949800] niks3-server[961]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo5037worker1 # [ 97.852593] nix-grpc-daemon[768]: ts=2026-09-22T22:24:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=1 paths=1 nar_bytes_in=5685038worker1 # [ 97.868742] nix-grpc-daemon[768]: ts=2026-09-22T22:24:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582565039worker1 # [ 97.882435] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)5040worker1 # [ 97.889746] nix-daemon[834]: reaped child process 1196, status = succeeded5041client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...5042worker1 # [ 97.904726] nix-daemon[834]: accepted connection from pid 768, user nix-grpc-daemon (trusted)5043client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5044client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds5045worker1 # [ 98.561951] nix-daemon[834]: reaped child process 1210, status = succeeded5046worker1 # [ 98.694179] nix-daemon[834]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5047worker1 # [ 98.712086] nix-daemon[834]: reaped child process 1229, status = succeeded5048lb # [ 98.819421] niks3-server[961]: 2026/09/22 22:24:02 INFO Received uploads request method=POST path=/api/pending_closures5049worker1 # [ 98.728108] nix-grpc-daemon[847]: time=2026-09-22T22:24:02.306Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5050lb # [ 98.850059] niks3-server[961]: 2026/09/22 22:24:02 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls5051worker1 # [ 98.759918] nix-grpc-daemon[847]: time=2026-09-22T22:24:02.340Z level=INFO msg="Uploading 1 narinfos"5052lb # [ 98.865387] niks3-server[961]: 2026/09/22 22:24:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5053lb # [ 98.876258] niks3-server[961]: 2026/09/22 22:24:02 INFO Signed narinfos id=32 count=15054lb # [ 98.884704] niks3-server[961]: 2026/09/22 22:24:02 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5055worker1 # [ 98.783734] nix-grpc-daemon[847]: time=2026-09-22T22:24:02.363Z level=INFO msg="Upload complete. (268ms)"5056client # copying 1 paths...5057lb # [ 98.895537] niks3-server[961]: 2026/09/22 22:24:02 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5058worker1 # [ 98.794713] nix-grpc-daemon[768]: ts=2026-09-22T22:24:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=16 outputs=15059lb # [ 98.901471] niks3-server[961]: 2026/09/22 22:24:02 INFO Completed upload id=325060worker2 # [ 98.797451] nix-grpc-daemon[770]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407925061lb # [ 98.905440] niks3-server[961]: 2026/09/22 22:24:02 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo5062worker1 # [ 98.812685] nix-daemon[834]: reaped child process 1208, status = succeeded5063worker2 # [ 98.810817] nix-grpc-daemon[770]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...5064client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...5065worker1 # [ 98.858484] nix-grpc-daemon[768]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582565066worker1 # [ 98.865320] nix-grpc-daemon[768]: ts=2026-09-22T22:24:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_out=1205067client # [ 98.985405] nix-daemon[1159]: reaped child process 1267, status = succeeded5068client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.04 seconds)5069client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&25070client # [ 99.155595] nix-daemon[1159]: accepted connection from pid 1286, user root (trusted)5071client # this derivation will be built:5072client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5073worker2 # [ 99.262040] nix-grpc-daemon[770]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:407925074client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5075worker2 # [ 99.269624] nix-grpc-daemon[770]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407925076worker2 # [ 99.277092] nix-grpc-daemon[909]: time=2026-09-22T22:24:02.838Z level=INFO msg="All 1 paths already cached"5077worker2 # [ 99.288229] nix-grpc-daemon[770]: ts=2026-09-22T22:24:02Z level=debug event=want client=16 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=05078worker2 # [ 99.297858] nix-grpc-daemon[770]: ts=2026-09-22T22:24:02Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15079worker2 # [ 99.306720] nix-grpc-daemon[770]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407925080worker2 # [ 99.314567] nix-grpc-daemon[770]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:407925081worker2 # [ 99.325948] nix-grpc-daemon[909]: time=2026-09-22T22:24:02.888Z level=INFO msg="All 1 paths already cached"5082client # copying 1 paths to 'lb:50051'...5083client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...5084worker2 # [ 99.336623] nix-grpc-daemon[770]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:407925085worker2 # [ 99.351579] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)5086worker2 # [ 99.502313] nix-daemon[856]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5087worker2 # [ 99.519729] nix-daemon[856]: reaped child process 1179, status = succeeded5088lb # [ 99.631233] niks3-server[961]: 2026/09/22 22:24:03 INFO Received uploads request method=POST path=/api/pending_closures5089worker2 # [ 99.535885] nix-grpc-daemon[909]: time=2026-09-22T22:24:03.098Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5090worker2 # [ 99.537742] nix-grpc-daemon[909]: time=2026-09-22T22:24:03.098Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"5091worker2 # [ 99.561439] nix-grpc-daemon[909]: time=2026-09-22T22:24:03.124Z level=INFO msg="Uploading 1 narinfos"5092lb # [ 99.661035] niks3-server[961]: 2026/09/22 22:24:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5093lb # [ 99.673945] niks3-server[961]: 2026/09/22 22:24:03 INFO Signed narinfos id=33 count=15094lb # [ 99.684351] niks3-server[961]: 2026/09/22 22:24:03 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst5095lb # [ 99.696282] niks3-server[961]: 2026/09/22 22:24:03 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls5096worker2 # [ 99.595376] nix-grpc-daemon[909]: time=2026-09-22T22:24:03.158Z level=INFO msg="Upload complete. (229ms)"5097lb # [ 99.704693] niks3-server[961]: 2026/09/22 22:24:03 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5098lb # [ 99.711067] niks3-server[961]: 2026/09/22 22:24:03 INFO Completed upload id=335099worker2 # [ 99.604309] nix-grpc-daemon[770]: ts=2026-09-22T22:24:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=0 paths=1 nar_bytes_in=5685100lb # [ 99.715036] niks3-server[961]: 2026/09/22 22:24:03 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo5101lb # [ 99.720566] envoy[906]: conn peer=[2001:db8:1::1]:44174 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=295102worker2 # [ 99.619872] nix-grpc-daemon[770]: ts=2026-09-22T22:24:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:407925103lb # [ 99.727738] envoy[906]: conn peer=[2001:db8:1::1]:44162 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3887 tx=2153 ms=16345104worker2 # [ 99.626798] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)5105lb # [ 99.731952] envoy[906]: conn peer=[2001:db8:1::1]:44190 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4353 tx=2414 ms=18235106worker2 # [ 99.631762] nix-daemon[856]: reaped child process 1174, status = succeeded5107lb # [ 99.736157] envoy[906]: conn peer=[2001:db8:1::1]:42018 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=407 ms=945108lb # [ 99.740766] envoy[906]: conn peer=[2001:db8:1::1]:42028 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3865 tx=2069 ms=22375109lb # [ 99.745324] envoy[906]: conn peer=[2001:db8:1::1]:42038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=945110worker2 # [ 99.643298] nix-daemon[856]: accepted connection from pid 770, user nix-grpc-daemon (trusted)5111client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...5112lb # [ 99.749994] envoy[906]: conn peer=[2001:db8:1::1]:42048 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=2108 ms=26525113client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5114lb # [ 99.754737] envoy[906]: conn peer=[2001:db8:1::1]:42062 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=285115client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds5116worker2 # [ 100.953326] nix-daemon[856]: reaped child process 1183, status = succeeded5117worker2 # [ 101.026765] nix-daemon[856]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5118worker2 # [ 101.045461] nix-daemon[856]: reaped child process 1202, status = succeeded5119lb # [ 101.158231] niks3-server[961]: 2026/09/22 22:24:04 INFO Received uploads request method=POST path=/api/pending_closures5120worker2 # [ 101.060382] nix-grpc-daemon[909]: time=2026-09-22T22:24:04.622Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5121lb # [ 101.184683] niks3-server[961]: 2026/09/22 22:24:04 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls5122lb # [ 101.198192] niks3-server[961]: 2026/09/22 22:24:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5123worker2 # [ 101.102861] nix-grpc-daemon[909]: time=2026-09-22T22:24:04.665Z level=INFO msg="Uploading 1 narinfos"5124lb # [ 101.212560] niks3-server[961]: 2026/09/22 22:24:04 INFO Signed narinfos id=34 count=15125lb # [ 101.219351] niks3-server[961]: 2026/09/22 22:24:04 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5126lb # [ 101.231941] niks3-server[961]: 2026/09/22 22:24:04 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5127lb # [ 101.241176] niks3-server[961]: 2026/09/22 22:24:04 INFO Completed upload id=345128worker2 # [ 101.134124] nix-grpc-daemon[909]: time=2026-09-22T22:24:04.697Z level=INFO msg="Upload complete. (277ms)"5129lb # [ 101.244294] niks3-server[961]: 2026/09/22 22:24:04 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo5130worker2 # [ 101.149132] nix-grpc-daemon[770]: ts=2026-09-22T22:24:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40792 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=17 outputs=15131worker2 # [ 101.164520] nix-daemon[856]: reaped child process 1181, status = succeeded5132client # copying 1 paths...5133worker2 # [ 101.192152] nix-grpc-daemon[770]: ts=2026-09-22T22:24:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:407925134client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...5135worker1 # [ 101.231296] nix-grpc-daemon[768]: ts=2026-09-22T22:24:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582565136worker1 # [ 101.244637] nix-grpc-daemon[768]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...5137worker1 # [ 101.261207] nix-grpc-daemon[768]: ts=2026-09-22T22:24:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58256 duration_s=0 paths=1 nar_bytes_out=1205138client # [ 101.423054] nix-daemon[1159]: reaped child process 1289, status = succeeded5139client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.44 seconds)5140(finished: subtest: an input only one worker has still reaches the builder, in 8.75 seconds)5141subtest: upload whose reference the worker lacks is completed from the cache5142client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache5143client # this derivation will be built:5144client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv5145client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...5146client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache, in 0.33 seconds)5147client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache5148client # this derivation will be built:5149client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv5150client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...5151client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache, in 0.28 seconds)5152client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure5153client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.12 seconds)5154worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5155worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.19 seconds)5156worker2 # [ 102.374672] systemd[1]: Stopping Nix worker-protocol over gRPC...5157worker2 # [ 102.988421] nix-grpc-daemon[770]: ts=2026-09-22T22:24:06Z level=info event=signal_exit5158lb # [ 103.437504] niks3-server[961]: 2026/09/22 22:24:07 INFO lead: released remote=192.168.1.4:505825159worker1 # [ 104.339386] nix-grpc-daemon[768]: ts=2026-09-22T22:24:07Z level=info event=scheduler_restarting addr=lb:500515160worker2 # [ 104.341523] nix-grpc-daemon[770]: ts=2026-09-22T22:24:07Z level=info event=scheduler_restarting5161worker2 # [ 104.341931] nix-grpc-daemon[770]: ts=2026-09-22T22:24:07Z level=info event=scheduler_restarting addr=lb:500515162worker2 # [ 104.342071] nix-grpc-daemon[770]: ts=2026-09-22T22:24:07Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:407905163worker2 # [ 104.342226] nix-grpc-daemon[770]: ts=2026-09-22T22:24:07Z level=info event=worker_gone addr=192.168.1.4:500515164worker2 # [ 104.342353] nix-grpc-daemon[770]: ts=2026-09-22T22:24:07Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:407905165worker2 # [ 104.342461] nix-grpc-daemon[770]: ts=2026-09-22T22:24:07Z level=info event=worker_gone addr=192.168.1.3:500515166worker2 # [ 104.390295] nix-daemon[856]: reaped child process 858, status = succeeded5167worker1 # [ 104.539577] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=info event=scheduler_connected addr=lb:500515168worker1 # [ 104.546334] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5169worker2 # [ 104.549021] nix-grpc-daemon[770]: ts=2026-09-22T22:24:08Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5170worker1 # [ 104.747004] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=info event=scheduler_connected addr=lb:500515171worker1 # [ 104.752388] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5172worker2 # [ 104.949542] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5173worker1 # [ 104.953231] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=info event=scheduler_connected addr=lb:500515174worker1 # [ 104.958469] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5175worker2 # [ 104.957320] systemd[1]: Stopped Nix worker-protocol over gRPC.5176worker2 # [ 104.959869] systemd[1]: nix-grpc-daemon.service: Consumed 2.856s CPU time over 1min 25.207s wall clock time, 68.4M memory peak, 89.5K incoming IP traffic, 219.3K outgoing IP traffic.5177lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy5178lb: must succeed: curl -sf localhost:9901/clusters5179worker2 # [ 104.986280] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5180worker2 # [ 104.988594] systemd[1]: Closed Nix worker-protocol over gRPC.5181worker2 # [ 104.990264] systemd[1]: nix-grpc-daemon.socket: Consumed 551us CPU time over 1min 34.732s wall clock time, 256K memory peak, 109.9K incoming IP traffic, 94.4K outgoing IP traffic.5182lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5183lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds)5184client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&25185worker1 # [ 105.159463] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=info event=scheduler_connected addr=lb:500515186worker1 # [ 105.165452] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5187worker1 # [ 105.275534] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582565188worker1 # [ 105.284802] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582565189client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5190client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.25 seconds)5191worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5192worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds)5193worker1 # [ 105.368437] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=info event=scheduler_connected addr=lb:500515194worker1 # [ 105.372574] nix-grpc-daemon[768]: ts=2026-09-22T22:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5195worker2 # [ 105.406914] systemd[1]: Listening on Nix worker-protocol over gRPC.5196worker1 # [ 105.481154] systemd[1]: Stopping Nix worker-protocol over gRPC...5197worker1 # [ 105.569039] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=scheduler_connected addr=lb:500515198worker1 # [ 105.574507] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5199worker1 # [ 105.775453] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=scheduler_connected addr=lb:500515200worker1 # [ 105.781173] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5201worker1 # [ 105.893837] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=signal_exit5202worker1 # [ 105.982007] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=scheduler_connected addr=lb:500515203worker1 # [ 105.987438] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5204worker2 # [ 106.155380] systemd[1]: Starting scheduler-token.service...5205worker1 # [ 106.188266] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=scheduler_connected addr=lb:500515206worker1 # [ 106.193624] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5207worker2 # [ 106.243289] systemd[1]: scheduler-token.service: Deactivated successfully.5208worker2 # [ 106.249460] systemd[1]: Finished scheduler-token.service.5209worker2 # [ 106.251814] systemd[1]: scheduler-token.service: Consumed 59ms CPU time over 92ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5210worker2 # [ 106.277492] systemd[1]: Starting Nix worker-protocol over gRPC...5211worker1 # [ 106.396875] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=scheduler_connected addr=lb:500515212worker1 # [ 106.401131] nix-grpc-daemon[768]: ts=2026-09-22T22:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5213worker2 # [ 106.405259] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:09Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5214worker2 # [ 106.407411] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5215worker2 # [ 106.411473] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15216worker2 # [ 106.417388] nix-grpc-daemon[1226]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5217worker2 # [ 106.418865] nix-grpc-daemon[1226]: E0000 00:00:1790115849.979781 1226 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5218lb # [ 106.545607] niks3-server[961]: 2026/09/22 22:24:10 INFO lead: acquired remote=192.168.1.4:445345219worker2 # [ 106.464218] nix-grpc-daemon[1226]: E0000 00:00:1790115849.986073 1226 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5220worker2 # [ 106.472768] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5221worker2 # [ 106.474957] nix-grpc-daemon[1226]: E0000 00:00:1790115849.998359 1269 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5222worker2 # [ 106.477665] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:10Z level=info event=scheduler_take_over5223worker2 # [ 106.478780] nix-grpc-daemon[1226]: E0000 00:00:1790115850.016676 1269 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5224worker2 # [ 106.483779] nix-grpc-daemon[1226]: E0000 00:00:1790115850.016810 1269 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5225worker2 # [ 106.488650] systemd[1]: Started Nix worker-protocol over gRPC.5226worker2 # [ 106.489764] nix-grpc-daemon[1226]: E0000 00:00:1790115850.035003 1269 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5227worker2 # [ 106.492894] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:10Z level=info event=scheduler_connected addr=lb:500515228worker2 # [ 106.499553] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:10Z level=info event=oidc_jwks provider=mock keys=15229worker2 # [ 106.501187] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:10Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:340305230worker2 # [ 106.502901] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05231worker1 # [ 106.597738] nix-grpc-daemon[768]: ts=2026-09-22T22:24:10Z level=info event=scheduler_connected addr=lb:500515232worker2 # [ 106.595992] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:10Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:340305233worker2 # [ 106.601729] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:10Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05234worker1 # [ 107.347714] nix-grpc-daemon[768]: ts=2026-09-22T22:24:10Z level=info event=scheduler_restarting5235worker2 # [ 107.355496] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:340305236worker2 # [ 107.355975] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:10Z level=info event=worker_gone addr=192.168.1.3:500515237worker1 # [ 107.390979] nix-grpc-daemon[768]: ts=2026-09-22T22:24:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5238worker1 # [ 107.410621] nix-daemon[834]: reaped child process 836, status = succeeded5239worker1 # [ 108.044988] nix-grpc-daemon[768]: E0000 00:00:1790115851.623898 814 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true5240worker1 # [ 108.056858] nix-grpc-daemon[768]: E0000 00:00:1790115851.637084 814 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5241worker1 # [ 108.893757] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5242worker1 # [ 108.898487] systemd[1]: Stopped Nix worker-protocol over gRPC.5243worker1 # [ 108.904731] systemd[1]: nix-grpc-daemon.service: Consumed 3.832s CPU time over 1min 29.284s wall clock time, 65.1M memory peak, 105.6K incoming IP traffic, 190.9K outgoing IP traffic.5244worker1 # [ 108.921314] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5245worker1 # [ 108.928651] systemd[1]: Closed Nix worker-protocol over gRPC.5246worker1 # [ 108.930537] systemd[1]: nix-grpc-daemon.socket: Consumed 615us CPU time over 1min 38.965s wall clock time, 256K memory peak, 106.5K incoming IP traffic, 90.9K outgoing IP traffic.5247lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy5248lb: must succeed: curl -sf localhost:9901/clusters5249lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5250lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds)5251client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&25252worker2 # [ 109.236737] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340425253worker2 # [ 109.252261] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5254worker2 # [ 109.278054] nix-grpc-daemon[1226]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 1/5)5255worker2 # [ 109.353677] nix-grpc-daemon[1226]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 160 ms (attempt 2/5)5256worker2 # [ 109.515623] nix-grpc-daemon[1226]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 284 ms (attempt 3/5)5257lb # [ 109.721357] envoy[906]: conn peer=[2001:db8:1::1]:42066 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3778 tx=2101 ms=20525258lb # [ 109.726408] envoy[906]: conn peer=[2001:db8:1::1]:42030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=925259lb # [ 109.731272] envoy[906]: conn peer=[2001:db8:1::4]:57878 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=51222 tx=2969 ms=845355260lb # [ 109.736447] envoy[906]: conn peer=[2001:db8:1::1]:42032 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=305261lb # [ 109.741138] envoy[906]: conn peer=[2001:db8:1::3]:36744 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=12561 tx=3579 ms=874645262worker2 # [ 109.810079] nix-grpc-daemon[1226]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 496 ms (attempt 4/5)5263worker2 # [ 110.311480] nix-grpc-daemon[1226]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5264worker2 # [ 110.318246] nix-grpc-daemon[1226]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5265client # copying 2 paths...5266client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...5267worker2 # [ 110.344071] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340425268client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...5269worker2 # [ 110.364782] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5270worker2 # [ 110.392987] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:13Z level=info event=niks3_push_started pid=12875271worker2 # [ 110.551581] nix-grpc-daemon[1287]: time=2026-09-22T22:24:14.112Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""5272worker2 # [ 110.662110] nix-daemon[856]: accepted connection from pid 1300, user nix-grpc-daemon (trusted)5273worker2 # [ 110.691388] nix-daemon[856]: reaped child process 1303, status = succeeded5274lb # [ 110.798583] niks3-server[961]: 2026/09/22 22:24:14 INFO Received uploads request method=POST path=/api/pending_closures5275lb # [ 110.808729] niks3-server[961]: 2026/09/22 22:24:14 INFO Received uploads request method=POST path=/api/pending_closures5276worker2 # [ 110.714495] nix-grpc-daemon[1287]: time=2026-09-22T22:24:14.275Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5277worker2 # [ 110.717713] nix-grpc-daemon[1287]: time=2026-09-22T22:24:14.275Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"5278worker2 # [ 110.720380] nix-grpc-daemon[1287]: time=2026-09-22T22:24:14.275Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"5279lb # [ 110.882730] niks3-server[961]: 2026/09/22 22:24:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5280lb # [ 110.899259] niks3-server[961]: 2026/09/22 22:24:14 INFO Signed narinfos id=35 count=15281lb # [ 110.908374] niks3-server[961]: 2026/09/22 22:24:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5282worker2 # [ 110.804137] nix-grpc-daemon[1287]: time=2026-09-22T22:24:14.364Z level=INFO msg="Uploading 3 narinfos"5283lb # [ 110.919691] niks3-server[961]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls5284lb # [ 110.926550] niks3-server[961]: 2026/09/22 22:24:14 INFO Signed narinfos id=36 count=25285lb # [ 110.932846] niks3-server[961]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5286lb # [ 110.943696] niks3-server[961]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst5287lb # [ 110.950021] niks3-server[961]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls5288lb # [ 110.966790] niks3-server[961]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5289lb # [ 110.977910] niks3-server[961]: 2026/09/22 22:24:14 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5290lb # [ 110.982610] niks3-server[961]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5291lb # [ 110.990111] niks3-server[961]: 2026/09/22 22:24:14 INFO Completed upload id=355292lb # [ 110.991629] niks3-server[961]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo5293lb # [ 110.994812] niks3-server[961]: 2026/09/22 22:24:14 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5294lb # [ 110.997288] niks3-server[961]: 2026/09/22 22:24:14 INFO Completed upload id=365295worker2 # [ 110.889092] nix-grpc-daemon[1287]: time=2026-09-22T22:24:14.451Z level=INFO msg="Upload complete. (338ms)"5296worker2 # [ 110.904757] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34042 duration_s=0 paths=2 nar_bytes_in=3125297worker2 # [ 110.933389] nix-daemon[856]: reaped child process 1285, status = succeeded5298client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.95 seconds)5299worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache5300worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)5301worker1 # [ 111.108941] systemd[1]: Listening on Nix worker-protocol over gRPC.5302worker1 # [ 111.120600] systemd[1]: Starting Nix worker-protocol over gRPC...5303worker1 # [ 111.299364] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:14Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5304worker1 # [ 111.303466] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5305worker1 # [ 111.354615] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15306lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5307lb: must succeed: curl -sf localhost:9901/clusters5308worker1 # [ 111.377686] nix-grpc-daemon[1253]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5309worker1 # [ 111.380000] nix-grpc-daemon[1253]: E0000 00:00:1790115854.895977 1253 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5310worker1 # [ 111.382556] nix-grpc-daemon[1253]: E0000 00:00:1790115854.899455 1253 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5311worker1 # [ 111.384932] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5312worker1 # [ 111.386590] nix-grpc-daemon[1253]: E0000 00:00:1790115854.914989 1296 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5313worker1 # [ 111.389029] nix-grpc-daemon[1253]: E0000 00:00:1790115854.934705 1296 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5314worker1 # [ 111.396859] systemd[1]: Started Nix worker-protocol over gRPC.5315worker1 # [ 111.398008] nix-grpc-daemon[1253]: E0000 00:00:1790115854.937451 1296 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5316worker1 # [ 111.401098] nix-grpc-daemon[1253]: E0000 00:00:1790115854.956480 1296 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5317worker1 # [ 111.405871] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:14Z level=info event=scheduler_connected addr=lb:500515318worker2 # [ 111.411336] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:14Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:340305319worker2 # [ 111.418343] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05320lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)5321lb: must succeed: curl -sf localhost:9901/clusters5322lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5323lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.21 seconds)5324(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.18 seconds)5325subtest: a niks3 restart does not cost the leader its role5326lb: must succeed: curl -sf localhost:9901/clusters5327lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5328lb: must succeed: curl -sf localhost:9901/clusters5329lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5330lb # [ 112.825216] niks3-server[961]: 2026/09/22 22:24:16 INFO Shutdown signal received, draining in-flight requests timeout=10s5331worker2 # [ 112.723244] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:16Z level=info event=scheduler_lock_lost status=2005332lb # [ 112.828714] niks3-server[961]: 2026/09/22 22:24:16 INFO lead: released remote=192.168.1.4:445345333worker1 # [ 112.730969] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:16Z level=info event=scheduler_lock_lost status=2005334lb # [ 112.864716] systemd[1]: Stopping niks3 server...5335lb # [ 112.877317] systemd[1]: niks3.service: Deactivated successfully.5336lb # [ 112.881824] systemd[1]: Stopped niks3 server.5337lb # [ 112.886227] systemd[1]: niks3.service: Consumed 670ms CPU time over 1min 30.663s wall clock time, 27.7M memory peak, 99.9K incoming IP traffic, 143K outgoing IP traffic.5338lb # [ 112.900208] systemd[1]: Starting niks3 server...5339lb # [ 112.988860] niks3-server[1100]: 2026/09/22 22:24:16 goose: no migrations to run. current version: 202609200000005340lb # [ 112.998908] niks3-server[1100]: 2026/09/22 22:24:16 OK 1_commit_pending_closure.sql (11.42ms)5341lb # [ 113.005613] niks3-server[1100]: 2026/09/22 22:24:16 OK 2_object_stats_trigger.sql (6.25ms)5342lb # [ 113.006832] niks3-server[1100]: 2026/09/22 22:24:16 goose: up to current file version: 25343lb # [ 113.008737] niks3-server[1100]: 2026/09/22 22:24:16 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key5344lb # [ 113.033198] niks3-server[1100]: 2026/09/22 22:24:16 INFO Read proxy enabled — serving cache objects from S35345lb # [ 113.038564] niks3-server[1100]: 2026/09/22 22:24:16 INFO Using socket-activated listener address=0.0.0.0:57515346lb # [ 113.039910] niks3-server[1100]: 2026/09/22 22:24:16 INFO systemd watchdog enabled interval=15s5347lb # [ 113.043793] niks3-server[1100]: 2026/09/22 22:24:16 INFO Starting HTTP server address=0.0.0.0:57515348lb # [ 113.047031] systemd[1]: Started niks3 server.5349lb: waiting for unit niks3.service5350lb: (finished: waiting for unit niks3.service, in 0.04 seconds)5351lb: must succeed: curl -sf localhost:9901/clusters5352lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5353worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5354worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds)5355lb: must succeed: curl -sf localhost:9901/clusters5356lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5357lb: must succeed: curl -sf localhost:9901/clusters5358lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5359worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5360worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.06 seconds)5361client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&25362worker1 # [ 113.621472] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:426365363worker1 # [ 113.654926] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5364client # don't know how to build these paths:5365client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5366worker1 # [ 113.712240] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426365367worker1 # [ 113.739082] nix-grpc-daemon[1253]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 1/5)5368lb # [ 113.849732] niks3-server[1100]: 2026/09/22 22:24:17 INFO lead: acquired remote=192.168.1.4:404105369worker1 # [ 113.764326] nix-grpc-daemon[1253]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 2/5)5370worker1 # [ 113.840706] nix-grpc-daemon[1253]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 225 ms (attempt 3/5)5371worker1 # [ 114.079852] nix-grpc-daemon[1253]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 4/5)5372worker1 # [ 114.099158] nix-grpc-daemon[1253]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5373worker1 # [ 114.104107] nix-grpc-daemon[1253]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5374worker2 # [ 114.172568] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:17Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=05375worker2 # [ 114.173185] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:17Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.4:50051 clients=15376worker2 # [ 114.219872] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340425377worker2 # [ 114.249193] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340425378client # copying 1 paths to 'lb:50051'...5379client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'...5380worker2 # [ 114.271483] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340425381worker2 # [ 114.290823] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5382worker2 # [ 114.577973] nix-daemon[856]: accepted connection from pid 1322, user nix-grpc-daemon (trusted)5383worker2 # [ 114.603700] nix-daemon[856]: reaped child process 1325, status = succeeded5384lb # [ 114.718259] niks3-server[1100]: 2026/09/22 22:24:18 INFO Received uploads request method=POST path=/api/pending_closures5385worker2 # [ 114.636169] nix-grpc-daemon[1287]: time=2026-09-22T22:24:18.197Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5386worker2 # [ 114.637941] nix-grpc-daemon[1287]: time=2026-09-22T22:24:18.197Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)"5387lb # [ 114.806983] niks3-server[1100]: 2026/09/22 22:24:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5388lb # [ 114.853528] niks3-server[1100]: 2026/09/22 22:24:18 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls5389lb # [ 114.879626] niks3-server[1100]: 2026/09/22 22:24:18 INFO Signed narinfos id=37 count=15390worker2 # [ 114.780330] nix-grpc-daemon[1287]: time=2026-09-22T22:24:18.341Z level=INFO msg="Uploading 1 narinfos"5391lb # [ 114.896451] niks3-server[1100]: 2026/09/22 22:24:18 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst5392lb # [ 114.915513] niks3-server[1100]: 2026/09/22 22:24:18 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5393lb # [ 114.936533] niks3-server[1100]: 2026/09/22 22:24:18 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo5394lb # [ 114.946929] niks3-server[1100]: 2026/09/22 22:24:18 INFO Completed upload id=375395worker2 # [ 114.842821] nix-grpc-daemon[1287]: time=2026-09-22T22:24:18.404Z level=INFO msg="Upload complete. (513ms)"5396worker2 # [ 114.853883] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34042 duration_s=0 paths=1 nar_bytes_in=5445397worker2 # [ 114.873140] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340425398worker2 # [ 114.895073] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5399worker2 # [ 114.907284] nix-daemon[856]: reaped child process 1320, status = succeeded5400client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051...5401client # farm-a> worker2: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5402worker2 # [ 114.934016] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5403client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5404client # farm-a> LOG-farm-a-after-niks3-restart5405worker2 # [ 115.763844] nix-daemon[856]: reaped child process 1329, status = succeeded5406worker2 # [ 115.874120] nix-daemon[856]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5407worker2 # [ 115.893961] nix-daemon[856]: reaped child process 1348, status = succeeded5408lb # [ 116.006578] niks3-server[1100]: 2026/09/22 22:24:19 INFO Received uploads request method=POST path=/api/pending_closures5409worker2 # [ 115.912411] nix-grpc-daemon[1287]: time=2026-09-22T22:24:19.474Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5410worker2 # [ 115.913945] nix-grpc-daemon[1287]: time=2026-09-22T22:24:19.474Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)"5411worker2 # [ 115.964907] nix-grpc-daemon[1287]: time=2026-09-22T22:24:19.527Z level=INFO msg="Uploading 1 narinfos"5412lb # [ 116.064468] niks3-server[1100]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5413lb # [ 116.079339] niks3-server[1100]: 2026/09/22 22:24:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5414lb # [ 116.088508] niks3-server[1100]: 2026/09/22 22:24:19 INFO Signed narinfos id=38 count=15415lb # [ 116.091191] niks3-server[1100]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5416lb # [ 116.097405] niks3-server[1100]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls5417lb # [ 116.111479] niks3-server[1100]: 2026/09/22 22:24:19 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5418lb # [ 116.120549] niks3-server[1100]: 2026/09/22 22:24:19 INFO Completed upload id=385419worker2 # [ 116.003925] nix-grpc-daemon[1287]: time=2026-09-22T22:24:19.566Z level=INFO msg="Upload complete. (254ms)"5420lb # [ 116.125905] niks3-server[1100]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo5421worker2 # [ 116.027936] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34042 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=15422worker2 # [ 116.045570] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:19Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=05423worker2 # [ 116.050223] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:19Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.4:50051 clients=15424worker2 # [ 116.055589] nix-daemon[856]: reaped child process 1327, status = succeeded5425worker2 # [ 116.082851] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340425426worker2 # [ 116.098500] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340425427worker2 # [ 116.115055] nix-grpc-daemon[1287]: time=2026-09-22T22:24:19.678Z level=INFO msg="All 1 paths already cached"5428client # copying 1 paths to 'lb:50051'...5429client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'...5430worker2 # [ 116.126733] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340425431worker2 # [ 116.143993] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5432worker2 # [ 116.301643] nix-daemon[856]: accepted connection from pid 1354, user nix-grpc-daemon (trusted)5433worker2 # [ 116.321784] nix-daemon[856]: reaped child process 1357, status = succeeded5434lb # [ 116.425937] niks3-server[1100]: 2026/09/22 22:24:19 INFO Received uploads request method=POST path=/api/pending_closures5435worker2 # [ 116.333968] nix-grpc-daemon[1287]: time=2026-09-22T22:24:19.896Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5436worker2 # [ 116.335619] nix-grpc-daemon[1287]: time=2026-09-22T22:24:19.896Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)"5437lb # [ 116.463358] niks3-server[1100]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst5438worker2 # [ 116.367568] nix-grpc-daemon[1287]: time=2026-09-22T22:24:19.930Z level=INFO msg="Uploading 1 narinfos"5439lb # [ 116.477475] niks3-server[1100]: 2026/09/22 22:24:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5440lb # [ 116.488527] niks3-server[1100]: 2026/09/22 22:24:20 INFO Signed narinfos id=39 count=15441lb # [ 116.500904] niks3-server[1100]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls5442worker2 # [ 116.403456] nix-grpc-daemon[1287]: time=2026-09-22T22:24:19.966Z level=INFO msg="Upload complete. (242ms)"5443lb # [ 116.509605] niks3-server[1100]: 2026/09/22 22:24:20 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5444lb # [ 116.516729] niks3-server[1100]: 2026/09/22 22:24:20 INFO Completed upload id=395445lb # [ 116.520607] niks3-server[1100]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo5446worker2 # [ 116.415406] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34042 duration_s=0 paths=1 nar_bytes_in=6565447worker2 # [ 116.432195] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340425448worker2 # [ 116.439816] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5449worker2 # [ 116.445450] nix-daemon[856]: reaped child process 1352, status = succeeded5450client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051...5451client # farm-b> worker2: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5452worker2 # [ 116.459977] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5453client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5454client # farm-b> LOG-farm-b-after-niks3-restart5455worker2 # [ 117.561688] nix-daemon[856]: reaped child process 1361, status = succeeded5456worker2 # [ 117.628055] nix-daemon[856]: accepted connection from pid 1377, user nix-grpc-daemon (trusted)5457worker2 # [ 117.644987] nix-daemon[856]: reaped child process 1380, status = succeeded5458lb # [ 117.757845] niks3-server[1100]: 2026/09/22 22:24:21 INFO Received uploads request method=POST path=/api/pending_closures5459worker2 # [ 117.664071] nix-grpc-daemon[1287]: time=2026-09-22T22:24:21.226Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5460worker2 # [ 117.665623] nix-grpc-daemon[1287]: time=2026-09-22T22:24:21.226Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)"5461lb # [ 117.797309] niks3-server[1100]: 2026/09/22 22:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5462worker2 # [ 117.700886] nix-grpc-daemon[1287]: time=2026-09-22T22:24:21.263Z level=INFO msg="Uploading 1 narinfos"5463lb # [ 117.814986] niks3-server[1100]: 2026/09/22 22:24:21 INFO Signed narinfos id=40 count=15464lb # [ 117.820427] niks3-server[1100]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst5465lb # [ 117.834492] niks3-server[1100]: 2026/09/22 22:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5466lb # [ 117.842083] niks3-server[1100]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5467worker2 # [ 117.739900] nix-grpc-daemon[1287]: time=2026-09-22T22:24:21.302Z level=INFO msg="Upload complete. (265ms)"5468lb # [ 117.849835] niks3-server[1100]: 2026/09/22 22:24:21 INFO Completed upload id=405469lb # [ 117.851804] niks3-server[1100]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls5470lb # [ 117.856458] niks3-server[1100]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo5471worker2 # [ 117.753354] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34042 duration_s=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=15472worker2 # [ 117.776505] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:21Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=05473worker2 # [ 117.781790] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:21Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.4:50051 clients=15474worker2 # [ 117.786075] nix-daemon[856]: reaped child process 1359, status = succeeded5475worker2 # [ 117.818896] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340425476worker2 # [ 117.834728] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340425477worker2 # [ 117.849252] nix-grpc-daemon[1287]: time=2026-09-22T22:24:21.412Z level=INFO msg="All 2 paths already cached"5478client # copying 1 paths to 'lb:50051'...5479worker2 # [ 117.860640] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340425480client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'...5481worker2 # [ 117.877487] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5482worker2 # [ 118.032196] nix-daemon[856]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)5483worker2 # [ 118.050150] nix-daemon[856]: reaped child process 1389, status = succeeded5484lb # [ 118.160812] niks3-server[1100]: 2026/09/22 22:24:21 INFO Received uploads request method=POST path=/api/pending_closures5485worker2 # [ 118.064104] nix-grpc-daemon[1287]: time=2026-09-22T22:24:21.626Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5486worker2 # [ 118.065672] nix-grpc-daemon[1287]: time=2026-09-22T22:24:21.626Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)"5487lb # [ 118.191328] niks3-server[1100]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst5488worker2 # [ 118.098983] nix-grpc-daemon[1287]: time=2026-09-22T22:24:21.661Z level=INFO msg="Uploading 1 narinfos"5489lb # [ 118.208393] niks3-server[1100]: 2026/09/22 22:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5490lb # [ 118.218492] niks3-server[1100]: 2026/09/22 22:24:21 INFO Signed narinfos id=41 count=15491lb # [ 118.228217] niks3-server[1100]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls5492worker2 # [ 118.130612] nix-grpc-daemon[1287]: time=2026-09-22T22:24:21.693Z level=INFO msg="Upload complete. (235ms)"5493lb # [ 118.237433] niks3-server[1100]: 2026/09/22 22:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5494lb # [ 118.243939] niks3-server[1100]: 2026/09/22 22:24:21 INFO Completed upload id=415495worker2 # [ 118.140361] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34042 duration_s=0 paths=1 nar_bytes_in=7845496lb # [ 118.248561] niks3-server[1100]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo5497worker2 # [ 118.155892] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340425498worker2 # [ 118.162988] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5499worker2 # [ 118.169203] nix-daemon[856]: reaped child process 1384, status = succeeded5500client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051...5501worker2 # [ 118.180653] nix-daemon[856]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5502client # farm-top> worker2: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5503client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5504client # farm-top> LOG-farm-top-after-niks3-restart5505worker2 # [ 119.228511] nix-daemon[856]: reaped child process 1393, status = succeeded5506worker2 # [ 119.351771] nix-daemon[856]: accepted connection from pid 1409, user nix-grpc-daemon (trusted)5507worker2 # [ 119.369730] nix-daemon[856]: reaped child process 1412, status = succeeded5508lb # [ 119.485860] niks3-server[1100]: 2026/09/22 22:24:23 INFO Received uploads request method=POST path=/api/pending_closures5509worker2 # [ 119.388390] nix-grpc-daemon[1287]: time=2026-09-22T22:24:22.951Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5510worker2 # [ 119.389999] nix-grpc-daemon[1287]: time=2026-09-22T22:24:22.951Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)"5511lb # [ 119.524706] niks3-server[1100]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5512worker2 # [ 119.433202] nix-grpc-daemon[1287]: time=2026-09-22T22:24:22.996Z level=INFO msg="Uploading 1 narinfos"5513lb # [ 119.541698] niks3-server[1100]: 2026/09/22 22:24:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5514lb # [ 119.553011] niks3-server[1100]: 2026/09/22 22:24:23 INFO Signed narinfos id=42 count=15515lb # [ 119.555769] niks3-server[1100]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls5516lb # [ 119.570922] niks3-server[1100]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst5517worker2 # [ 119.473348] nix-grpc-daemon[1287]: time=2026-09-22T22:24:23.036Z level=INFO msg="Upload complete. (280ms)"5518lb # [ 119.579884] niks3-server[1100]: 2026/09/22 22:24:23 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5519lb # [ 119.584910] niks3-server[1100]: 2026/09/22 22:24:23 INFO Completed upload id=425520lb # [ 119.588379] niks3-server[1100]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo5521worker2 # [ 119.485207] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34042 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=15522worker2 # [ 119.505779] nix-daemon[856]: reaped child process 1391, status = succeeded5523client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2, in 6.24 seconds)5524client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath5525lb # [ 119.722052] envoy[906]: conn peer=[2001:db8:1::1]:42046 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=282 ms=16905526lb # [ 119.727068] envoy[906]: conn peer=[2001:db8:1::1]:36958 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9723 tx=4456 ms=59165527client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath, in 0.19 seconds)5528(finished: subtest: a niks3 restart does not cost the leader its role, in 7.16 seconds)5529subtest: scheduler down: the other node takes the lock and keeps it5530lb: must succeed: curl -sf localhost:9901/clusters5531lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5532lb: must succeed: curl -sf localhost:9901/clusters5533lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5534lb: must succeed: curl -sf localhost:9901/clusters5535lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5536lb: must succeed: curl -sf localhost:9901/clusters5537lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5538worker2 # [ 119.987329] systemd[1]: Stopping Nix worker-protocol over gRPC...5539worker2 # [ 120.434506] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:23Z level=info event=signal_exit5540lb # [ 120.855987] niks3-server[1100]: 2026/09/22 22:24:24 INFO lead: released remote=192.168.1.4:404105541worker1 # [ 121.750508] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:25Z level=info event=scheduler_restarting addr=lb:500515542worker2 # [ 121.749749] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:25Z level=info event=scheduler_restarting5543worker2 # [ 121.755131] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:25Z level=info event=scheduler_restarting addr=lb:500515544worker2 # [ 121.759815] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:340305545worker2 # [ 121.765102] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:25Z level=info event=worker_gone addr=192.168.1.4:500515546worker2 # [ 121.770498] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:340305547worker2 # [ 121.775555] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:25Z level=info event=worker_gone addr=192.168.1.3:500515548worker2 # [ 121.800153] nix-daemon[856]: reaped child process 1279, status = succeeded5549worker1 # [ 121.956675] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:25Z level=info event=scheduler_connected addr=lb:500515550worker1 # [ 121.961978] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5551worker2 # [ 121.970325] nix-grpc-daemon[1226]: ts=2026-09-22T22:24:25Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5552worker1 # [ 122.162625] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:25Z level=info event=scheduler_connected addr=lb:500515553worker1 # [ 122.167834] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5554worker1 # [ 122.368616] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:25Z level=info event=scheduler_connected addr=lb:500515555worker1 # [ 122.373876] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5556worker2 # [ 122.481968] nix-grpc-daemon[1226]: E0000 00:00:1790115866.044653 1272 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5557worker2 # [ 122.488667] nix-grpc-daemon[1226]: E0000 00:00:1790115866.044976 1272 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5558worker1 # [ 122.574738] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:26Z level=info event=scheduler_connected addr=lb:500515559worker1 # [ 122.580069] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5560worker1 # [ 122.782656] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:26Z level=info event=scheduler_connected addr=lb:500515561worker1 # [ 122.786818] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5562worker1 # [ 122.983434] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:26Z level=info event=scheduler_connected addr=lb:500515563worker1 # [ 122.988731] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5564worker2 # [ 123.169309] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5565worker2 # [ 123.176902] systemd[1]: Stopped Nix worker-protocol over gRPC.5566worker2 # [ 123.179448] systemd[1]: nix-grpc-daemon.service: Consumed 1.524s CPU time over 16.906s wall clock time, 39M memory peak, 46.2K incoming IP traffic, 78.1K outgoing IP traffic.5567worker1 # [ 123.189861] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:26Z level=info event=scheduler_connected addr=lb:500515568worker1 # [ 123.195186] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5569worker2 # [ 123.197240] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5570worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5571worker2 # [ 123.212839] systemd[1]: Closed Nix worker-protocol over gRPC.5572worker2 # [ 123.214724] systemd[1]: nix-grpc-daemon.socket: Consumed 862us CPU time over 17.807s wall clock time, 256K memory peak, 38.7K incoming IP traffic, 29K outgoing IP traffic.5573worker1 # [ 123.396187] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:26Z level=info event=scheduler_connected addr=lb:500515574worker1 # [ 123.401640] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5575worker1 # [ 123.602368] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:27Z level=info event=scheduler_connected addr=lb:500515576worker1 # [ 123.607732] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5577worker1 # [ 123.745127] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:27Z level=info event=scheduler_take_over5578lb # [ 123.847678] niks3-server[1100]: 2026/09/22 22:24:27 INFO lead: acquired remote=192.168.1.3:448385579worker1 # [ 123.810395] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:27Z level=info event=scheduler_connected addr=lb:500515580worker1 # [ 123.814542] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5581worker1 # [ 124.011119] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:27Z level=info event=scheduler_connected addr=lb:500515582worker1 # [ 124.021123] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:27Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:532425583worker1 # [ 124.027120] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05584worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.17 seconds)5585worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5586worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5587client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&25588client # don't know how to build these paths:5589client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5590worker1 # [ 124.650042] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:426365591worker1 # [ 124.656771] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426365592worker1 # [ 124.685484] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:28Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05593worker1 # [ 124.692152] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:28Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=15594worker1 # [ 124.738524] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426365595worker1 # [ 124.756234] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426365596client # copying 1 paths to 'lb:50051'...5597client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5598worker1 # [ 124.773040] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:426365599worker1 # [ 124.789769] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5600worker1 # [ 124.820436] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:28Z level=info event=niks3_push_started pid=13335601worker1 # [ 124.978302] nix-grpc-daemon[1333]: time=2026-09-22T22:24:28.556Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""5602worker1 # [ 125.084758] nix-daemon[834]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5603worker1 # [ 125.106917] nix-daemon[834]: reaped child process 1348, status = succeeded5604lb # [ 125.210092] niks3-server[1100]: 2026/09/22 22:24:28 INFO Received uploads request method=POST path=/api/pending_closures5605worker1 # [ 125.118006] nix-grpc-daemon[1333]: time=2026-09-22T22:24:28.697Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5606worker1 # [ 125.119544] nix-grpc-daemon[1333]: time=2026-09-22T22:24:28.697Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5607lb # [ 125.255553] niks3-server[1100]: 2026/09/22 22:24:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5608worker1 # [ 125.160649] nix-grpc-daemon[1333]: time=2026-09-22T22:24:28.740Z level=INFO msg="Uploading 1 narinfos"5609lb # [ 125.270617] niks3-server[1100]: 2026/09/22 22:24:28 INFO Signed narinfos id=43 count=15610lb # [ 125.278160] niks3-server[1100]: 2026/09/22 22:24:28 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5611worker1 # [ 125.189131] nix-grpc-daemon[1333]: time=2026-09-22T22:24:28.769Z level=INFO msg="Upload complete. (212ms)"5612lb # [ 125.291005] niks3-server[1100]: 2026/09/22 22:24:28 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5613worker1 # [ 125.196248] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42636 duration_s=0 paths=1 nar_bytes_in=5205614lb # [ 125.299452] niks3-server[1100]: 2026/09/22 22:24:28 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5615lb # [ 125.303554] niks3-server[1100]: 2026/09/22 22:24:28 INFO Completed upload id=435616lb # [ 125.306219] niks3-server[1100]: 2026/09/22 22:24:28 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5617worker1 # [ 125.209792] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426365618worker1 # [ 125.215710] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5619worker1 # [ 125.221004] nix-daemon[834]: reaped child process 1331, status = succeeded5620client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5621worker1 # [ 125.233551] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5622client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5623client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5624client # farm-a> LOG-farm-a-on-standby5625worker1 # [ 126.267928] nix-daemon[834]: reaped child process 1352, status = succeeded5626worker1 # [ 126.369961] nix-daemon[834]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5627worker1 # [ 126.386945] nix-daemon[834]: reaped child process 1371, status = succeeded5628lb # [ 126.497243] niks3-server[1100]: 2026/09/22 22:24:30 INFO Received uploads request method=POST path=/api/pending_closures5629worker1 # [ 126.406951] nix-grpc-daemon[1333]: time=2026-09-22T22:24:29.985Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5630worker1 # [ 126.409509] nix-grpc-daemon[1333]: time=2026-09-22T22:24:29.985Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5631lb # [ 126.533834] niks3-server[1100]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5632lb # [ 126.549781] niks3-server[1100]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5633lb # [ 126.561933] niks3-server[1100]: 2026/09/22 22:24:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5634worker1 # [ 126.465318] nix-grpc-daemon[1333]: time=2026-09-22T22:24:30.045Z level=INFO msg="Uploading 1 narinfos"5635lb # [ 126.573685] niks3-server[1100]: 2026/09/22 22:24:30 INFO Signed narinfos id=44 count=15636lb # [ 126.575911] niks3-server[1100]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5637lb # [ 126.587830] niks3-server[1100]: 2026/09/22 22:24:30 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5638worker1 # [ 126.490651] nix-grpc-daemon[1333]: time=2026-09-22T22:24:30.070Z level=INFO msg="Upload complete. (248ms)"5639lb # [ 126.595973] niks3-server[1100]: 2026/09/22 22:24:30 INFO Completed upload id=445640lb # [ 126.600747] niks3-server[1100]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5641worker1 # [ 126.512934] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42636 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15642worker1 # [ 126.528306] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:30Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05643worker1 # [ 126.531569] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:30Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15644worker1 # [ 126.536569] nix-daemon[834]: reaped child process 1350, status = succeeded5645worker1 # [ 126.554723] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426365646worker1 # [ 126.569952] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426365647worker1 # [ 126.584824] nix-grpc-daemon[1333]: time=2026-09-22T22:24:30.165Z level=INFO msg="All 1 paths already cached"5648client # copying 1 paths to 'lb:50051'...5649client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5650worker1 # [ 126.595703] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:426365651worker1 # [ 126.609140] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5652worker1 # [ 126.761352] nix-daemon[834]: accepted connection from pid 1377, user nix-grpc-daemon (trusted)5653worker1 # [ 126.778704] nix-daemon[834]: reaped child process 1380, status = succeeded5654lb # [ 126.887638] niks3-server[1100]: 2026/09/22 22:24:30 INFO Received uploads request method=POST path=/api/pending_closures5655worker1 # [ 126.795117] nix-grpc-daemon[1333]: time=2026-09-22T22:24:30.375Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5656worker1 # [ 126.796826] nix-grpc-daemon[1333]: time=2026-09-22T22:24:30.375Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5657lb # [ 126.915666] niks3-server[1100]: 2026/09/22 22:24:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5658worker1 # [ 126.821681] nix-grpc-daemon[1333]: time=2026-09-22T22:24:30.401Z level=INFO msg="Uploading 1 narinfos"5659lb # [ 126.930480] niks3-server[1100]: 2026/09/22 22:24:30 INFO Signed narinfos id=45 count=15660lb # [ 126.938638] niks3-server[1100]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5661worker1 # [ 126.852476] nix-grpc-daemon[1333]: time=2026-09-22T22:24:30.432Z level=INFO msg="Upload complete. (228ms)"5662lb # [ 126.955114] niks3-server[1100]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5663lb # [ 126.960901] niks3-server[1100]: 2026/09/22 22:24:30 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5664worker1 # [ 126.860554] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42636 duration_s=0 paths=1 nar_bytes_in=6405665lb # [ 126.965429] niks3-server[1100]: 2026/09/22 22:24:30 INFO Completed upload id=455666lb # [ 126.967756] niks3-server[1100]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5667worker1 # [ 126.875258] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426365668worker1 # [ 126.881710] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5669worker1 # [ 126.886628] nix-daemon[834]: reaped child process 1375, status = succeeded5670client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5671worker1 # [ 126.897250] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5672client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5673client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5674client # farm-b> LOG-farm-b-on-standby5675worker1 # [ 128.414509] nix-daemon[834]: reaped child process 1384, status = succeeded5676worker1 # [ 128.487610] nix-daemon[834]: accepted connection from pid 1400, user nix-grpc-daemon (trusted)5677worker1 # [ 128.506647] nix-daemon[834]: reaped child process 1403, status = succeeded5678lb # [ 128.613849] niks3-server[1100]: 2026/09/22 22:24:32 INFO Received uploads request method=POST path=/api/pending_closures5679worker1 # [ 128.523888] nix-grpc-daemon[1333]: time=2026-09-22T22:24:32.103Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5680worker1 # [ 128.525810] nix-grpc-daemon[1333]: time=2026-09-22T22:24:32.103Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5681lb # [ 128.655923] niks3-server[1100]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5682worker1 # [ 128.564471] nix-grpc-daemon[1333]: time=2026-09-22T22:24:32.144Z level=INFO msg="Uploading 1 narinfos"5683lb # [ 128.672264] niks3-server[1100]: 2026/09/22 22:24:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5684lb # [ 128.675832] niks3-server[1100]: 2026/09/22 22:24:32 INFO Signed narinfos id=46 count=15685lb # [ 128.687728] niks3-server[1100]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5686worker1 # [ 128.591840] nix-grpc-daemon[1333]: time=2026-09-22T22:24:32.172Z level=INFO msg="Upload complete. (277ms)"5687lb # [ 128.695648] niks3-server[1100]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5688lb # [ 128.698973] niks3-server[1100]: 2026/09/22 22:24:32 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5689lb # [ 128.703954] niks3-server[1100]: 2026/09/22 22:24:32 INFO Completed upload id=465690lb # [ 128.706827] niks3-server[1100]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5691worker1 # [ 128.607478] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42636 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15692worker1 # [ 128.625341] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:32Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05693worker1 # [ 128.633579] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:32Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15694worker1 # [ 128.638499] nix-daemon[834]: reaped child process 1382, status = succeeded5695worker1 # [ 128.670572] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426365696worker1 # [ 128.686194] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426365697worker1 # [ 128.701511] nix-grpc-daemon[1333]: time=2026-09-22T22:24:32.281Z level=INFO msg="All 2 paths already cached"5698client # copying 1 paths to 'lb:50051'...5699client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5700worker1 # [ 128.713220] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:426365701worker1 # [ 128.726684] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5702worker1 # [ 128.878742] nix-daemon[834]: accepted connection from pid 1409, user nix-grpc-daemon (trusted)5703worker1 # [ 128.897229] nix-daemon[834]: reaped child process 1412, status = succeeded5704lb # [ 129.006498] niks3-server[1100]: 2026/09/22 22:24:32 INFO Received uploads request method=POST path=/api/pending_closures5705worker1 # [ 128.913947] nix-grpc-daemon[1333]: time=2026-09-22T22:24:32.493Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5706worker1 # [ 128.915890] nix-grpc-daemon[1333]: time=2026-09-22T22:24:32.493Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5707lb # [ 129.036279] niks3-server[1100]: 2026/09/22 22:24:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5708worker1 # [ 128.943039] nix-grpc-daemon[1333]: time=2026-09-22T22:24:32.523Z level=INFO msg="Uploading 1 narinfos"5709lb # [ 129.049749] niks3-server[1100]: 2026/09/22 22:24:32 INFO Signed narinfos id=47 count=15710lb # [ 129.059949] niks3-server[1100]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5711lb # [ 129.073506] niks3-server[1100]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5712worker1 # [ 128.978105] nix-grpc-daemon[1333]: time=2026-09-22T22:24:32.558Z level=INFO msg="Upload complete. (235ms)"5713lb # [ 129.083381] niks3-server[1100]: 2026/09/22 22:24:32 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5714lb # [ 129.089393] niks3-server[1100]: 2026/09/22 22:24:32 INFO Completed upload id=475715lb # [ 129.093799] niks3-server[1100]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5716worker1 # [ 128.988367] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42636 duration_s=0 paths=1 nar_bytes_in=7685717worker1 # [ 129.004987] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426365718worker1 # [ 129.014748] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5719worker1 # [ 129.017756] nix-daemon[834]: reaped child process 1407, status = succeeded5720client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5721worker1 # [ 129.032211] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5722client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5723client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5724lb # [ 129.720967] envoy[906]: conn peer=[2001:db8:1::4]:46248 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1691 tx=425 ms=154725725client # farm-top> LOG-farm-top-on-standby5726worker1 # [ 129.860591] nix-daemon[834]: reaped child process 1416, status = succeeded5727worker1 # [ 129.960517] nix-daemon[834]: accepted connection from pid 1432, user nix-grpc-daemon (trusted)5728worker1 # [ 129.976223] nix-daemon[834]: reaped child process 1435, status = succeeded5729lb # [ 130.087158] niks3-server[1100]: 2026/09/22 22:24:33 INFO Received uploads request method=POST path=/api/pending_closures5730worker1 # [ 129.996370] nix-grpc-daemon[1333]: time=2026-09-22T22:24:33.575Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5731worker1 # [ 129.997875] nix-grpc-daemon[1333]: time=2026-09-22T22:24:33.575Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5732lb # [ 130.132630] niks3-server[1100]: 2026/09/22 22:24:33 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5733lb # [ 130.153488] niks3-server[1100]: 2026/09/22 22:24:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5734lb # [ 130.167932] niks3-server[1100]: 2026/09/22 22:24:33 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5735lb # [ 130.175028] niks3-server[1100]: 2026/09/22 22:24:33 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5736worker1 # [ 130.080860] nix-grpc-daemon[1333]: time=2026-09-22T22:24:33.660Z level=INFO msg="Uploading 1 narinfos"5737lb # [ 130.184861] niks3-server[1100]: 2026/09/22 22:24:33 INFO Signed narinfos id=48 count=15738lb # [ 130.192126] niks3-server[1100]: 2026/09/22 22:24:33 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5739lb # [ 130.205656] niks3-server[1100]: 2026/09/22 22:24:33 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5740lb # [ 130.215298] niks3-server[1100]: 2026/09/22 22:24:33 INFO Completed upload id=485741worker1 # [ 130.113801] nix-grpc-daemon[1333]: time=2026-09-22T22:24:33.694Z level=INFO msg="Upload complete. (270ms)"5742worker1 # [ 130.129174] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42636 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15743worker1 # [ 130.146810] nix-daemon[834]: reaped child process 1414, status = succeeded5744client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2, in 5.74 seconds)5745client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath5746client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath, in 0.18 seconds)5747worker2 # [ 130.422902] systemd[1]: Listening on Nix worker-protocol over gRPC.5748worker2 # [ 130.431573] systemd[1]: Starting scheduler-token.service...5749worker2 # [ 130.515056] systemd[1]: scheduler-token.service: Deactivated successfully.5750worker2 # [ 130.523858] systemd[1]: Finished scheduler-token.service.5751worker2 # [ 130.532297] systemd[1]: scheduler-token.service: Consumed 46ms CPU time over 86ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5752worker2 # [ 130.543405] systemd[1]: Starting Nix worker-protocol over gRPC...5753worker2 # [ 130.658350] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:34Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5754worker2 # [ 130.660607] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5755worker2 # [ 130.664794] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15756worker2 # [ 130.670411] nix-grpc-daemon[1433]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5757worker2 # [ 130.671868] nix-grpc-daemon[1433]: E0000 00:00:1790115874.232993 1433 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5758lb: must succeed: curl -sf localhost:9901/clusters5759worker2 # [ 130.716218] nix-grpc-daemon[1433]: E0000 00:00:1790115874.239238 1433 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5760worker2 # [ 130.718480] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5761worker2 # [ 130.722184] nix-grpc-daemon[1433]: E0000 00:00:1790115874.246147 1474 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5762worker2 # [ 130.725179] nix-grpc-daemon[1433]: E0000 00:00:1790115874.264362 1474 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5763worker2 # [ 130.727591] nix-grpc-daemon[1433]: E0000 00:00:1790115874.264521 1474 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5764worker2 # [ 130.730153] systemd[1]: Started Nix worker-protocol over gRPC.5765worker2 # [ 130.730952] nix-grpc-daemon[1433]: E0000 00:00:1790115874.284204 1474 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5766worker2 # [ 130.739337] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:34Z level=info event=scheduler_connected addr=lb:500515767worker1 # [ 130.759241] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:34Z level=info event=oidc_jwks provider=mock keys=15768worker1 # [ 130.764050] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:34Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:532425769worker1 # [ 130.769391] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05770lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5771worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5772worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5773lb: must succeed: curl -sf localhost:9901/clusters5774lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5775lb: must succeed: curl -sf localhost:9901/clusters5776lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5777worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5778worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5779(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.29 seconds)5780subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5781client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs5782client # [ 131.143143] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs.5783client # Running as unit: rs.service; invocation ID: 2063e915fe164f95b6cb0e960ece38305784client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs, in 0.10 seconds)5785client # [ 131.353036] nix[1413]: don't know how to build these paths:5786client # [ 131.354300] nix[1413]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5787worker1 # [ 131.313235] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:426365788worker1 # [ 131.329596] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:34Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05789worker1 # [ 131.338054] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:34Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15790worker1 # [ 131.374298] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426365791worker1 # [ 131.389743] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426365792client # [ 131.440113] nix[1413]: copying 1 paths to 'lb:50051'...5793worker1 # [ 131.403163] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:426365794client # [ 131.445093] nix[1413]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5795worker1 # [ 131.419062] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5796worker1 # [ 131.573869] nix-daemon[834]: accepted connection from pid 1448, user nix-grpc-daemon (trusted)5797worker1 # [ 131.594446] nix-daemon[834]: reaped child process 1451, status = succeeded5798lb # [ 131.699928] niks3-server[1100]: 2026/09/22 22:24:35 INFO Received uploads request method=POST path=/api/pending_closures5799worker1 # [ 131.610367] nix-grpc-daemon[1333]: time=2026-09-22T22:24:35.190Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5800worker1 # [ 131.611862] nix-grpc-daemon[1333]: time=2026-09-22T22:24:35.190Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5801lb # [ 131.733435] niks3-server[1100]: 2026/09/22 22:24:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5802worker1 # [ 131.640900] nix-grpc-daemon[1333]: time=2026-09-22T22:24:35.221Z level=INFO msg="Uploading 1 narinfos"5803lb # [ 131.750749] niks3-server[1100]: 2026/09/22 22:24:35 INFO Signed narinfos id=49 count=15804lb # [ 131.757320] niks3-server[1100]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5805lb # [ 131.769655] niks3-server[1100]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5806worker1 # [ 131.673959] nix-grpc-daemon[1333]: time=2026-09-22T22:24:35.254Z level=INFO msg="Upload complete. (238ms)"5807lb # [ 131.776404] niks3-server[1100]: 2026/09/22 22:24:35 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5808lb # [ 131.779356] niks3-server[1100]: 2026/09/22 22:24:35 INFO Completed upload id=495809lb # [ 131.782447] niks3-server[1100]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5810worker1 # [ 131.685165] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42636 duration_s=0 paths=1 nar_bytes_in=4165811worker1 # [ 131.699611] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426365812worker1 # [ 131.706066] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5813worker1 # [ 131.710705] nix-daemon[834]: reaped child process 1446, status = succeeded5814worker1 # [ 131.721328] nix-daemon[834]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5815client # [ 131.759414] nix[1413]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5816lb: must succeed: curl -sf localhost:9901/clusters5817lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5818lb: must succeed: curl -sf localhost:9901/clusters5819lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5820lb: must succeed: curl -sf localhost:9901/clusters5821lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5822lb: must succeed: curl -sf localhost:9901/clusters5823lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5824worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5825worker2 # [ 133.908565] systemd-journald[270]: Received client request to rotate journal, rotating.5826worker2 # [ 133.932429] systemd-journald[270]: Vacuuming done, freed 0B of archived journals from /var/log/journal/cea2dc34dad445ad9eff0141befa3f2d.5827worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5828worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5829worker1 # [ 133.991504] systemd[1]: Stopping Nix worker-protocol over gRPC...5830worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5831client: must succeed: sleep 5.05832worker1 # [ 134.338036] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:37Z level=info event=draining5833client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5834worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5835worker1 # [ 139.383351] nix-daemon[834]: reaped child process 1455, status = succeeded5836worker1 # [ 139.490274] nix-daemon[834]: accepted connection from pid 1496, user nix-grpc-daemon (trusted)5837worker1 # [ 139.510560] nix-daemon[834]: reaped child process 1499, status = succeeded5838lb # [ 139.616088] niks3-server[1100]: 2026/09/22 22:24:43 INFO Received uploads request method=POST path=/api/pending_closures5839worker1 # [ 139.524445] nix-grpc-daemon[1333]: time=2026-09-22T22:24:43.103Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5840worker1 # [ 139.526260] nix-grpc-daemon[1333]: time=2026-09-22T22:24:43.103Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5841lb # [ 139.647132] niks3-server[1100]: 2026/09/22 22:24:43 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5842worker1 # [ 139.552806] nix-grpc-daemon[1333]: time=2026-09-22T22:24:43.132Z level=INFO msg="Uploading 1 narinfos"5843lb # [ 139.654997] niks3-server[1100]: 2026/09/22 22:24:43 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5844lb # [ 139.661513] niks3-server[1100]: 2026/09/22 22:24:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5845lb # [ 139.667113] niks3-server[1100]: 2026/09/22 22:24:43 INFO Signed narinfos id=50 count=15846lb # [ 139.673473] niks3-server[1100]: 2026/09/22 22:24:43 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5847worker1 # [ 139.574523] nix-grpc-daemon[1333]: time=2026-09-22T22:24:43.154Z level=INFO msg="Upload complete. (237ms)"5848lb # [ 139.677065] niks3-server[1100]: 2026/09/22 22:24:43 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5849lb # [ 139.679391] niks3-server[1100]: 2026/09/22 22:24:43 INFO Completed upload id=505850lb # [ 139.684939] niks3-server[1100]: 2026/09/22 22:24:43 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5851worker1 # [ 139.583874] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42636 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15852worker1 # [ 139.598787] nix-daemon[834]: reaped child process 1453, status = succeeded5853lb # [ 139.722316] envoy[906]: conn peer=[2001:db8:1::1]:59964 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9619 tx=4368 ms=54885854client # [ 139.659582] systemd[1]: rs.service: Deactivated successfully.5855lb # [ 139.725682] envoy[906]: conn peer=[2001:db8:1::1]:42328 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1540 ms=82885856client # [ 139.664929] systemd[1]: rs.service: Consumed 195ms CPU time over 8.518s wall clock time, 41.2M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.5857worker1 # [ 140.341448] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:43Z level=info event=signal_exit5858lb # [ 140.857296] niks3-server[1100]: 2026/09/22 22:24:44 INFO lead: released remote=192.168.1.3:448385859worker2 # [ 141.747055] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:45Z level=info event=scheduler_restarting addr=lb:500515860worker1 # [ 141.755370] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:45Z level=info event=scheduler_restarting5861worker1 # [ 141.760474] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:45Z level=info event=scheduler_restarting addr=lb:500515862worker1 # [ 141.765075] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:532425863worker1 # [ 141.770621] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:45Z level=info event=worker_gone addr=192.168.1.3:500515864worker1 # [ 141.775433] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:532425865worker1 # [ 141.780575] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:45Z level=info event=worker_gone addr=192.168.1.4:500515866worker1 # [ 141.805867] nix-daemon[834]: reaped child process 1306, status = succeeded5867worker2 # [ 141.947131] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:45Z level=info event=scheduler_connected addr=lb:500515868worker2 # [ 141.952737] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5869worker1 # [ 141.974862] nix-grpc-daemon[1253]: ts=2026-09-22T22:24:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5870worker1 # [ 141.980598] nix-grpc-daemon[1253]: E0000 00:00:1790115885.554948 1299 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true5871worker1 # [ 141.987264] nix-grpc-daemon[1253]: E0000 00:00:1790115885.555197 1299 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5872worker2 # [ 142.153711] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:45Z level=info event=scheduler_connected addr=lb:500515873worker2 # [ 142.159026] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5874worker2 # [ 142.360067] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:45Z level=info event=scheduler_connected addr=lb:500515875worker2 # [ 142.365200] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5876worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.24 seconds)5877client: waiting for success: ! systemctl is-active rs5878worker2 # [ 142.566544] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:46Z level=info event=scheduler_connected addr=lb:500515879worker2 # [ 142.571936] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5880client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5881client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5882client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5883client: must fail: journalctl -u rs | grep -q 'reconnecting'5884client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5885lb: must succeed: curl -sf localhost:9901/clusters5886lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5887worker2 # [ 142.774646] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:46Z level=info event=scheduler_connected addr=lb:500515888worker2 # [ 142.778815] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5889worker1 # [ 142.900798] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5890worker1 # [ 142.905790] systemd[1]: Stopped Nix worker-protocol over gRPC.5891worker1 # [ 142.910525] systemd[1]: nix-grpc-daemon.service: Consumed 1.629s CPU time over 31.785s wall clock time, 39M memory peak, 46.8K incoming IP traffic, 90.6K outgoing IP traffic.5892worker1 # [ 142.931998] systemd[1]: Starting Nix worker-protocol over gRPC...5893worker2 # [ 142.975858] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:46Z level=info event=scheduler_connected addr=lb:500515894worker2 # [ 142.981218] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5895worker1 # [ 143.073262] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:46Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5896worker1 # [ 143.075594] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:46Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5897worker1 # [ 143.079718] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:46Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15898worker1 # [ 143.086736] nix-grpc-daemon[1506]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5899lb # [ 143.199284] niks3-server[1100]: 2026/09/22 22:24:46 INFO lead: acquired remote=192.168.1.3:588125900worker1 # [ 143.102250] nix-grpc-daemon[1506]: E0000 00:00:1790115886.664929 1506 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5901worker1 # [ 143.128972] nix-grpc-daemon[1506]: E0000 00:00:1790115886.666988 1506 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5902worker1 # [ 143.131867] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:46Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5903worker1 # [ 143.133907] nix-grpc-daemon[1506]: E0000 00:00:1790115886.675706 1549 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5904worker1 # [ 143.139609] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:46Z level=info event=scheduler_take_over5905worker1 # [ 143.143162] nix-grpc-daemon[1506]: E0000 00:00:1790115886.693907 1549 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5906worker1 # [ 143.145759] nix-grpc-daemon[1506]: E0000 00:00:1790115886.694084 1549 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5907worker1 # [ 143.148624] nix-grpc-daemon[1506]: E0000 00:00:1790115886.708448 1549 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5908worker1 # [ 143.151310] systemd[1]: Started Nix worker-protocol over gRPC.5909worker1 # [ 143.152295] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:46Z level=info event=scheduler_connected addr=lb:500515910worker1 # [ 143.153766] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5911worker2 # [ 143.182417] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:46Z level=info event=scheduler_connected addr=lb:500515912worker2 # [ 143.187924] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5913worker1 # [ 143.344309] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:46Z level=info event=scheduler_connected addr=lb:500515914worker1 # [ 143.349506] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5915worker2 # [ 143.388934] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:46Z level=info event=scheduler_connected addr=lb:500515916worker2 # [ 143.394460] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5917worker1 # [ 143.550225] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:47Z level=info event=scheduler_connected addr=lb:500515918worker1 # [ 143.555517] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5919worker2 # [ 143.595547] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:47Z level=info event=scheduler_connected addr=lb:500515920worker2 # [ 143.601204] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5921worker1 # [ 143.756349] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:47Z level=info event=scheduler_connected addr=lb:500515922lb: must succeed: curl -sf localhost:9901/clusters5923worker1 # [ 143.761502] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5924worker2 # [ 143.804760] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:47Z level=info event=scheduler_connected addr=lb:500515925worker2 # [ 143.809189] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5926lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5927worker1 # [ 143.962277] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:47Z level=info event=scheduler_connected addr=lb:500515928worker1 # [ 143.970869] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:347885929worker1 # [ 143.976341] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05930worker2 # [ 144.005566] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:47Z level=info event=scheduler_connected addr=lb:500515931worker1 # [ 144.019378] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:47Z level=info event=oidc_jwks provider=mock keys=15932worker1 # [ 144.023939] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:47Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:347885933worker1 # [ 144.029205] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05934lb: must succeed: curl -sf localhost:9901/clusters5935lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5936worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5937worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5938(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.94 seconds)5939subtest: scheduler restart mid-build: build finishes, no double build5940client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid5941client # [ 145.069322] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid.5942client # Running as unit: mid.service; invocation ID: 988e2155f8fa457bbaa8e7f87cff51f55943client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid, in 0.09 seconds)5944worker1 # [ 145.230410] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:348045945worker1 # [ 145.245513] nix-daemon[834]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5946client # [ 145.302610] nix[1449]: don't know how to build these paths:5947client # [ 145.304072] nix[1449]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5948worker1 # [ 145.277022] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:48Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05949worker1 # [ 145.283975] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:48Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15950worker1 # [ 145.330891] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348045951worker1 # [ 145.347230] nix-grpc-daemon[1506]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5)5952worker1 # [ 145.438543] nix-grpc-daemon[1506]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 2/5)5953worker1 # [ 145.593715] nix-grpc-daemon[1506]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 329 ms (attempt 3/5)5954worker1 # [ 145.925076] nix-grpc-daemon[1506]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 449 ms (attempt 4/5)5955worker1 # [ 146.377542] nix-grpc-daemon[1506]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5956worker1 # [ 146.384660] nix-grpc-daemon[1506]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5957worker1 # [ 146.405311] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348045958client # [ 146.461158] nix[1449]: copying 1 paths to 'lb:50051'...5959worker1 # [ 146.422967] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348045960client # [ 146.465543] nix[1449]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5961worker1 # [ 146.438610] nix-daemon[834]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5962worker1 # [ 146.466642] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:50Z level=info event=niks3_push_started pid=15805963worker1 # [ 146.613370] nix-grpc-daemon[1580]: time=2026-09-22T22:24:50.193Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""5964worker1 # [ 146.723469] nix-daemon[834]: accepted connection from pid 1593, user nix-grpc-daemon (trusted)5965worker1 # [ 146.740951] nix-daemon[834]: reaped child process 1596, status = succeeded5966lb # [ 146.850343] niks3-server[1100]: 2026/09/22 22:24:50 INFO Received uploads request method=POST path=/api/pending_closures5967worker1 # [ 146.759960] nix-grpc-daemon[1580]: time=2026-09-22T22:24:50.339Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5968worker1 # [ 146.763931] nix-grpc-daemon[1580]: time=2026-09-22T22:24:50.339Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5969lb # [ 146.892378] niks3-server[1100]: 2026/09/22 22:24:50 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5970worker1 # [ 146.799972] nix-grpc-daemon[1580]: time=2026-09-22T22:24:50.380Z level=INFO msg="Uploading 1 narinfos"5971lb # [ 146.906051] niks3-server[1100]: 2026/09/22 22:24:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5972lb # [ 146.917760] niks3-server[1100]: 2026/09/22 22:24:50 INFO Signed narinfos id=51 count=15973lb # [ 146.923229] niks3-server[1100]: 2026/09/22 22:24:50 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5974lb # [ 146.935982] niks3-server[1100]: 2026/09/22 22:24:50 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5975worker1 # [ 146.840189] nix-grpc-daemon[1580]: time=2026-09-22T22:24:50.420Z level=INFO msg="Upload complete. (223ms)"5976lb # [ 146.941883] niks3-server[1100]: 2026/09/22 22:24:50 INFO Completed upload id=515977lb # [ 146.946379] niks3-server[1100]: 2026/09/22 22:24:50 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5978worker1 # [ 146.849384] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34804 duration_s=0 paths=1 nar_bytes_in=4245979worker1 # [ 146.866164] nix-grpc-daemon[1506]: ts=2026-09-22T22:24:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348045980worker1 # [ 146.872635] nix-daemon[834]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5981worker1 # [ 146.877956] nix-daemon[834]: reaped child process 1578, status = succeeded5982client # [ 146.927553] nix[1449]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5983worker1 # [ 146.889899] nix-daemon[834]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5984lb: must succeed: curl -sf localhost:9901/clusters5985lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5986lb: must succeed: curl -sf localhost:9901/clusters5987lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5988worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5989worker1 # [ 148.922009] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1506 (nix-grpc-daemon) on client request.5990worker1 # [ 148.923638] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5991lb # [ 149.035745] niks3-server[1100]: 2026/09/22 22:24:52 INFO lead: released remote=192.168.1.3:588125992worker1 # [ 148.944421] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5993worker1 # [ 148.946048] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5994client # [ 148.981162] nix[1449]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5995worker1 # [ 148.947318] systemd[1]: nix-grpc-daemon.service: Consumed 472ms CPU time over 6.008s wall clock time, 34.4M memory peak, 14K incoming IP traffic, 19K outgoing IP traffic.5996worker2 # [ 148.937870] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5997client # [ 148.987718] nix[1449]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5998worker1 # [ 148.973261] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.5999worker1 # [ 148.974787] systemd[1]: Starting Nix worker-protocol over gRPC...6000worker1 # [ 149.023461] nix-daemon[834]: reaped child process 1598, status = succeeded6001worker1 # [ 149.033178] nix-daemon[1600]: unexpected Nix daemon error: error: interrupted by the user6002worker1 # [ 149.041516] nix-daemon[834]: reaped child process 1566, status = succeeded6003worker1 # [ 149.095266] nix-daemon[834]: reaped child process 1600, status = failed with exit code 16004worker1 # [ 149.119442] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6005worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.24 seconds)6006client: must succeed: sleep 5.06007lb # [ 149.228716] niks3-server[1100]: 2026/09/22 22:24:52 INFO lead: acquired remote=192.168.1.3:588686008worker1 # [ 149.141540] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6009worker1 # [ 149.143196] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16010worker2 # [ 149.147102] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:52Z level=info event=scheduler_connected addr=lb:500516011worker1 # [ 149.166001] nix-grpc-daemon[1637]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6012worker1 # [ 149.167984] nix-grpc-daemon[1637]: E0000 00:00:1790115892.685418 1637 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6013worker1 # [ 149.170674] nix-grpc-daemon[1637]: E0000 00:00:1790115892.687438 1637 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6014worker1 # [ 149.175733] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6015worker1 # [ 149.179883] nix-grpc-daemon[1637]: E0000 00:00:1790115892.705029 1678 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6016worker1 # [ 149.182914] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=scheduler_take_over6017worker1 # [ 149.184160] systemd[1]: Started Nix worker-protocol over gRPC.6018worker1 # [ 149.185010] nix-grpc-daemon[1637]: E0000 00:00:1790115892.726393 1678 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6019worker1 # [ 149.187241] nix-grpc-daemon[1637]: E0000 00:00:1790115892.726555 1678 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6020worker1 # [ 149.189698] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=oidc_jwks provider=mock keys=16021worker1 # [ 149.190917] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:348426022worker1 # [ 149.192678] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06023worker1 # [ 149.194416] nix-grpc-daemon[1637]: E0000 00:00:1790115892.745597 1678 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6024worker1 # [ 149.196726] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=scheduler_connected addr=lb:500516025worker1 # [ 149.198020] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:348426026worker1 # [ 149.199553] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=06027worker1 # [ 149.453847] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:53Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=06028worker1 # [ 149.460000] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:53Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=16029worker2 # [ 149.509529] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532346030worker2 # [ 149.524826] nix-daemon[856]: accepted connection from pid 1433, user nix-grpc-daemon (trusted)6031worker2 # [ 149.551909] nix-grpc-daemon[1433]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5)6032worker2 # [ 149.612322] nix-grpc-daemon[1433]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 144 ms (attempt 2/5)6033lb # [ 149.725863] envoy[906]: conn peer=[2001:db8:1::3]:37928 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2818 tx=943 ms=305716034lb # [ 149.731026] envoy[906]: conn peer=[2001:db8:1::3]:35588 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1015 tx=434 ms=58076035worker2 # [ 149.758171] nix-grpc-daemon[1433]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 373 ms (attempt 3/5)6036worker2 # [ 150.141770] nix-grpc-daemon[1433]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 4/5)6037worker2 # [ 150.222162] nix-grpc-daemon[1433]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6038worker2 # [ 150.230103] nix-grpc-daemon[1433]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6039worker2 # [ 150.248656] nix-grpc-daemon[1433]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...6040worker2 # [ 150.272975] nix-daemon[856]: accepted connection from pid 1433, user nix-grpc-daemon (trusted)6041worker2 # [ 150.295359] nix-daemon[856]: accepted connection from pid 1433, user nix-grpc-daemon (trusted)6042client # [ 150.338162] nix[1449]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...6043client: (finished: must succeed: sleep 5.0, in 5.05 seconds)6044client: waiting for success: ! systemctl is-active mid6045worker2 # [ 154.522206] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:58Z level=info event=niks3_push_started pid=15966046worker2 # [ 154.552601] nix-daemon[856]: reaped child process 1571, status = succeeded6047worker2 # [ 154.674046] nix-grpc-daemon[1596]: time=2026-09-22T22:24:58.234Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""6048worker2 # [ 154.784143] nix-daemon[856]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6049worker2 # [ 154.804189] nix-daemon[856]: reaped child process 1612, status = succeeded6050lb # [ 154.918741] niks3-server[1100]: 2026/09/22 22:24:58 INFO Received uploads request method=POST path=/api/pending_closures6051worker2 # [ 154.834623] nix-grpc-daemon[1596]: time=2026-09-22T22:24:58.395Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6052worker2 # [ 154.838539] nix-grpc-daemon[1596]: time=2026-09-22T22:24:58.395Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"6053worker2 # [ 154.891979] nix-grpc-daemon[1596]: time=2026-09-22T22:24:58.453Z level=INFO msg="Uploading 1 narinfos"6054lb # [ 154.990308] niks3-server[1100]: 2026/09/22 22:24:58 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6055lb # [ 155.003773] niks3-server[1100]: 2026/09/22 22:24:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6056lb # [ 155.013426] niks3-server[1100]: 2026/09/22 22:24:58 INFO Signed narinfos id=52 count=16057lb # [ 155.021607] niks3-server[1100]: 2026/09/22 22:24:58 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv6058lb # [ 155.037742] niks3-server[1100]: 2026/09/22 22:24:58 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6059lb # [ 155.046744] niks3-server[1100]: 2026/09/22 22:24:58 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls6060lb # [ 155.053618] niks3-server[1100]: 2026/09/22 22:24:58 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo6061lb # [ 155.061781] niks3-server[1100]: 2026/09/22 22:24:58 INFO Completed upload id=526062worker2 # [ 154.956388] nix-grpc-daemon[1596]: time=2026-09-22T22:24:58.519Z level=INFO msg="Upload complete. (283ms)"6063worker2 # [ 154.968300] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53234 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=16064worker2 # [ 154.987788] nix-daemon[856]: reaped child process 1569, status = succeeded6065client # [ 155.046163] systemd[1]: mid.service: Deactivated successfully.6066client # [ 155.050366] systemd[1]: mid.service: Consumed 201ms CPU time over 9.980s wall clock time, 41.4M memory peak, 8.6K incoming IP traffic, 10.5K outgoing IP traffic.6067client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds)6068client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6069client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)6070(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.64 seconds)6071subtest: interrupting the client stops the build on the worker6072client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr6073client # [ 155.687369] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr.6074client # Running as unit: intr.service; invocation ID: c470d29196994604b7cb20c32bd1df2c6075client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr, in 0.05 seconds)6076client # [ 155.861156] nix[1485]: don't know how to build these paths:6077client # [ 155.862169] nix[1485]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6078worker2 # [ 155.817219] nix-grpc-daemon[1433]: ts=2026-09-22T22:24:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:532346079worker1 # [ 155.839450] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:59Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=06080worker1 # [ 155.839769] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:59Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=16081worker1 # [ 155.897576] nix-grpc-daemon[1637]: ts=2026-09-22T22:24:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426082worker1 # [ 155.912988] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6083worker1 # [ 155.935463] nix-grpc-daemon[1637]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 1/5)6084worker1 # [ 155.984193] nix-grpc-daemon[1637]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 2/5)6085worker1 # [ 156.122303] nix-grpc-daemon[1637]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 377 ms (attempt 3/5)6086worker1 # [ 156.501573] nix-grpc-daemon[1637]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 4/5)6087worker1 # [ 156.548689] nix-grpc-daemon[1637]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6088worker1 # [ 156.552836] nix-grpc-daemon[1637]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6089worker1 # [ 156.574856] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426090client # [ 156.628239] nix[1485]: copying 1 paths to 'lb:50051'...6091worker1 # [ 156.590294] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426092client # [ 156.628562] nix[1485]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...6093worker1 # [ 156.602879] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6094worker1 # [ 156.632724] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:00Z level=info event=niks3_push_started pid=17146095worker1 # [ 156.787889] nix-grpc-daemon[1714]: time=2026-09-22T22:25:00.367Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""6096worker1 # [ 156.918808] nix-daemon[834]: accepted connection from pid 1730, user nix-grpc-daemon (trusted)6097worker1 # [ 156.940836] nix-daemon[834]: reaped child process 1734, status = succeeded6098lb # [ 157.041356] niks3-server[1100]: 2026/09/22 22:25:00 INFO Received uploads request method=POST path=/api/pending_closures6099worker1 # [ 156.952076] nix-grpc-daemon[1714]: time=2026-09-22T22:25:00.531Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6100worker1 # [ 156.953560] nix-grpc-daemon[1714]: time=2026-09-22T22:25:00.532Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"6101lb # [ 157.090250] niks3-server[1100]: 2026/09/22 22:25:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6102worker1 # [ 157.003545] nix-grpc-daemon[1714]: time=2026-09-22T22:25:00.582Z level=INFO msg="Uploading 1 narinfos"6103lb # [ 157.106715] niks3-server[1100]: 2026/09/22 22:25:00 INFO Signed narinfos id=53 count=16104lb # [ 157.114264] niks3-server[1100]: 2026/09/22 22:25:00 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls6105lb # [ 157.121309] niks3-server[1100]: 2026/09/22 22:25:00 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst6106lb # [ 157.131762] niks3-server[1100]: 2026/09/22 22:25:00 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6107worker1 # [ 157.033312] nix-grpc-daemon[1714]: time=2026-09-22T22:25:00.613Z level=INFO msg="Upload complete. (241ms)"6108lb # [ 157.135721] niks3-server[1100]: 2026/09/22 22:25:00 INFO Completed upload id=536109lb # [ 157.138172] niks3-server[1100]: 2026/09/22 22:25:00 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo6110worker1 # [ 157.045881] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=4246111worker1 # [ 157.056185] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426112worker1 # [ 157.063045] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6113worker1 # [ 157.067861] nix-daemon[834]: reaped child process 1712, status = succeeded6114worker1 # [ 157.078575] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6115client # [ 157.117603] nix[1485]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...6116client: must succeed: systemctl kill -s INT intr6117worker1 # [ 158.170635] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:01Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6118client # [ 158.207840] systemd[1]: intr.service: Sent signal SIGINT to main process 1485 (nix) on client request.6119client # [ 158.218875] nix[1485]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6120client # [ 158.231788] nix[1485]: error: interrupted by the user6121client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)6122client # [ 158.257083] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6123client # [ 158.262326] systemd[1]: intr.service: Failed with result 'exit-code'.6124client # [ 158.265021] systemd[1]: intr.service: Consumed 167ms CPU time over 2.573s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic.6125worker1 # [ 158.305873] nix-daemon[1738]: unexpected Nix daemon error: error: interrupted by the user6126worker1 # [ 158.309205] nix-daemon[834]: reaped child process 1736, status = succeeded6127worker1 # [ 158.315962] nix-daemon[834]: reaped child process 1738, status = failed with exit code 16128(finished: subtest: interrupting the client stops the build on the worker, in 3.87 seconds)6129subtest: a deploy mid-build drains: the build finishes, the new generation takes over6130client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw6131client # [ 159.577764] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw.6132client # Running as unit: sw.service; invocation ID: 7142bf0f0ca14e07a5a82a89277c04e96133client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw, in 0.08 seconds)6134lb # [ 159.728412] envoy[906]: conn peer=[2001:db8:1::1]:57716 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3940 tx=1940 ms=97626135lb # [ 159.728667] envoy[906]: conn peer=[2001:db8:1::1]:39926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2987 tx=826 ms=23846136client # [ 159.770424] nix[1506]: don't know how to build these paths:6137client # [ 159.771468] nix[1506]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6138worker1 # [ 159.731038] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:394426139worker1 # [ 159.745572] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:03Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=06140worker1 # [ 159.751720] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:03Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=16141worker2 # [ 159.789765] nix-grpc-daemon[1433]: ts=2026-09-22T22:25:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532346142worker2 # [ 159.801387] nix-grpc-daemon[1433]: ts=2026-09-22T22:25:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532346143client # [ 159.856447] nix[1506]: copying 1 paths to 'lb:50051'...6144client # [ 159.862241] nix[1506]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...6145worker2 # [ 159.818682] nix-grpc-daemon[1433]: ts=2026-09-22T22:25:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532346146worker2 # [ 159.833562] nix-daemon[856]: accepted connection from pid 1433, user nix-grpc-daemon (trusted)6147worker2 # [ 160.006937] nix-daemon[856]: accepted connection from pid 1640, user nix-grpc-daemon (trusted)6148worker2 # [ 160.025266] nix-daemon[856]: reaped child process 1643, status = succeeded6149lb # [ 160.137209] niks3-server[1100]: 2026/09/22 22:25:03 INFO Received uploads request method=POST path=/api/pending_closures6150worker2 # [ 160.041569] nix-grpc-daemon[1596]: time=2026-09-22T22:25:03.603Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6151worker2 # [ 160.043116] nix-grpc-daemon[1596]: time=2026-09-22T22:25:03.603Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"6152lb # [ 160.168589] niks3-server[1100]: 2026/09/22 22:25:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6153worker2 # [ 160.072070] nix-grpc-daemon[1596]: time=2026-09-22T22:25:03.634Z level=INFO msg="Uploading 1 narinfos"6154lb # [ 160.185557] niks3-server[1100]: 2026/09/22 22:25:03 INFO Signed narinfos id=54 count=16155lb # [ 160.193212] niks3-server[1100]: 2026/09/22 22:25:03 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst6156lb # [ 160.207617] niks3-server[1100]: 2026/09/22 22:25:03 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls6157lb # [ 160.215028] niks3-server[1100]: 2026/09/22 22:25:03 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6158lb # [ 160.219323] niks3-server[1100]: 2026/09/22 22:25:03 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo6159lb # [ 160.223052] niks3-server[1100]: 2026/09/22 22:25:03 INFO Completed upload id=546160worker2 # [ 160.109278] nix-grpc-daemon[1596]: time=2026-09-22T22:25:03.672Z level=INFO msg="Upload complete. (258ms)"6161worker2 # [ 160.120894] nix-grpc-daemon[1433]: ts=2026-09-22T22:25:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53234 duration_s=0 paths=1 nar_bytes_in=4166162worker2 # [ 160.136551] nix-grpc-daemon[1433]: ts=2026-09-22T22:25:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532346163worker2 # [ 160.144194] nix-daemon[856]: accepted connection from pid 1433, user nix-grpc-daemon (trusted)6164worker2 # [ 160.149096] nix-daemon[856]: reaped child process 1638, status = succeeded6165client # [ 160.201006] nix[1506]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...6166worker2 # [ 160.161377] nix-daemon[856]: accepted connection from pid 1433, user nix-grpc-daemon (trusted)6167worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26168worker2 # Checking switch inhibitors... done6169worker2 # [ 162.543811] nixos[1679]: switching to system configuration /nix/store/x8kjjmji2ck289pjncrbp4826lif72v0-nixos-system-worker2-test6170worker2 # activating the configuration...6171worker2 # [ 162.552532] systemd[1]: Stopped target Local File Systems.6172worker2 # [ 162.553357] systemd[1]: Stopped target Remote File Systems.6173worker2 # setting up /etc...6174worker2 # [ 163.101447] systemd[1]: Reload requested from client PID 1679 ('.switch-to-conf') (unit backdoor.service)...6175worker2 # [ 163.104209] systemd[1]: Reloading...6176worker2 # [ 167.986000] systemd[1]: Reloading finished in 4880 ms.6177worker2 # restarting sysinit-reactivation.target6178worker2 # [ 168.115020] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6179worker2 # [ 168.246410] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6180worker2 # [ 168.247592] systemd[1]: Reached target Reactivate sysinit units.6181worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6182worker2 # [ 168.252262] systemd[1]: Reloading D-Bus System Message Bus...6183worker2 # [ 168.254080] dbus-broker-launch[494]: Caught SIGHUP, trigger reload.6184worker2 # [ 168.264390] systemd[1]: Reloading Nix worker-protocol over gRPC...6185worker2 # [ 168.287203] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'...6186worker2 # [ 168.296977] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync'6187worker2 # [ 168.297975] dbus-broker-launch[494]: Invalid user-name in /nix/store/ng2ydfkv03gvmdws4f4mjf9wj6qj3kq6-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6188worker2 # [ 168.303126] systemd[1]: Reloaded Nix worker-protocol over gRPC.6189worker2 # [ 168.320374] systemd[1]: Reloaded D-Bus System Message Bus.6190worker2 # [ 168.326248] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6191worker2 # [ 168.336517] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6192worker2 # [ 168.337794] systemd[1]: Reached target Local File Systems.6193worker2 # [ 168.338548] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6194worker2 # [ 168.339963] systemd[1]: Starting Create SUID/SGID Wrappers...6195worker2 # [ 168.352153] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6196worker2 # [ 168.353392] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676197worker2 # [ 168.355479] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6198worker2 # [ 168.364530] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6199worker2 # [ 168.366774] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6200worker2 # [ 168.372445] systemd[1]: Reached target Remote File Systems.6201worker2 # [ 168.675138] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6202worker2 # [ 168.677965] systemd[1]: Finished Create SUID/SGID Wrappers.6203worker2 # [ 168.678763] systemd[1]: Starting linger-users.service...6204worker2 # [ 168.691286] nix-grpc-daemon[1433]: ts=2026-09-22T22:25:12Z level=info event=draining6205worker2 # [ 168.730480] systemd[1]: linger-users.service: Deactivated successfully.6206worker2 # [ 168.731429] systemd[1]: Finished linger-users.service.6207worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6208worker2 # [ 168.988577] nixos[1679]: finished switching to system configuration /nix/store/x8kjjmji2ck289pjncrbp4826lif72v0-nixos-system-worker2-test6209worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 6.89 seconds)6210worker2: must succeed: pgrep -f 'read -t [9]0 x'6211worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6212client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&26213client # don't know how to build these paths:6214client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6215worker1 # [ 169.291842] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:394426216worker1 # [ 169.299681] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426217worker1 # [ 169.326697] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:12Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=06218worker1 # [ 169.333720] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:12Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=16219worker1 # [ 169.380052] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426220worker1 # [ 169.395063] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426221client # copying 1 paths to 'lb:50051'...6222worker1 # [ 169.410849] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426223client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...6224worker1 # [ 169.435520] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6225worker1 # [ 169.571603] nix-daemon[834]: accepted connection from pid 1789, user nix-grpc-daemon (trusted)6226worker1 # [ 169.589840] nix-daemon[834]: reaped child process 1792, status = succeeded6227lb # [ 169.697816] niks3-server[1100]: 2026/09/22 22:25:13 INFO Received uploads request method=POST path=/api/pending_closures6228worker1 # [ 169.609524] nix-grpc-daemon[1714]: time=2026-09-22T22:25:13.188Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6229worker1 # [ 169.610988] nix-grpc-daemon[1714]: time=2026-09-22T22:25:13.189Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"6230lb # [ 169.735961] niks3-server[1100]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst6231worker1 # [ 169.649774] nix-grpc-daemon[1714]: time=2026-09-22T22:25:13.229Z level=INFO msg="Uploading 1 narinfos"6232lb # [ 169.753709] niks3-server[1100]: 2026/09/22 22:25:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6233lb # [ 169.766930] niks3-server[1100]: 2026/09/22 22:25:13 INFO Signed narinfos id=55 count=16234lb # [ 169.771370] niks3-server[1100]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls6235lb # [ 169.780176] niks3-server[1100]: 2026/09/22 22:25:13 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6236lb # [ 169.785872] niks3-server[1100]: 2026/09/22 22:25:13 INFO Completed upload id=556237worker1 # [ 169.683502] nix-grpc-daemon[1714]: time=2026-09-22T22:25:13.263Z level=INFO msg="Upload complete. (230ms)"6238lb # [ 169.787962] niks3-server[1100]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo6239worker1 # [ 169.696370] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=5286240worker1 # [ 169.712781] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426241worker1 # [ 169.719266] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6242worker1 # [ 169.725919] nix-daemon[834]: reaped child process 1787, status = succeeded6243client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...6244client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6245worker1 # [ 169.740161] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6246client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6247client # farm-a> LOG-farm-a-during-drain6248worker1 # [ 171.020174] nix-daemon[834]: reaped child process 1796, status = succeeded6249worker1 # [ 171.119676] nix-daemon[834]: accepted connection from pid 1812, user nix-grpc-daemon (trusted)6250worker1 # [ 171.146029] nix-daemon[834]: reaped child process 1815, status = succeeded6251lb # [ 171.246586] niks3-server[1100]: 2026/09/22 22:25:14 INFO Received uploads request method=POST path=/api/pending_closures6252worker1 # [ 171.159732] nix-grpc-daemon[1714]: time=2026-09-22T22:25:14.738Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6253worker1 # [ 171.162713] nix-grpc-daemon[1714]: time=2026-09-22T22:25:14.738Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"6254lb # [ 171.296458] niks3-server[1100]: 2026/09/22 22:25:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6255worker1 # [ 171.203554] nix-grpc-daemon[1714]: time=2026-09-22T22:25:14.783Z level=INFO msg="Uploading 1 narinfos"6256lb # [ 171.311590] niks3-server[1100]: 2026/09/22 22:25:14 INFO Signed narinfos id=56 count=16257lb # [ 171.322635] niks3-server[1100]: 2026/09/22 22:25:14 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6258lb # [ 171.331982] niks3-server[1100]: 2026/09/22 22:25:14 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls6259lb # [ 171.335657] niks3-server[1100]: 2026/09/22 22:25:14 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6260lb # [ 171.348031] niks3-server[1100]: 2026/09/22 22:25:14 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6261lb # [ 171.354492] niks3-server[1100]: 2026/09/22 22:25:14 INFO Completed upload id=566262worker1 # [ 171.252334] nix-grpc-daemon[1714]: time=2026-09-22T22:25:14.832Z level=INFO msg="Upload complete. (300ms)"6263lb # [ 171.358311] niks3-server[1100]: 2026/09/22 22:25:14 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo6264worker1 # [ 171.272710] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=16265worker1 # [ 171.288596] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:14Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=06266worker1 # [ 171.297114] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:14Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=16267worker1 # [ 171.302510] nix-daemon[834]: reaped child process 1794, status = succeeded6268worker1 # [ 171.321090] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426269worker1 # [ 171.336946] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426270worker1 # [ 171.352384] nix-grpc-daemon[1714]: time=2026-09-22T22:25:14.932Z level=INFO msg="All 1 paths already cached"6271client # copying 1 paths to 'lb:50051'...6272worker1 # [ 171.363259] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426273client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...6274worker1 # [ 171.386052] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6275worker1 # [ 171.550574] nix-daemon[834]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6276worker1 # [ 171.570004] nix-daemon[834]: reaped child process 1824, status = succeeded6277lb # [ 171.677411] niks3-server[1100]: 2026/09/22 22:25:15 INFO Received uploads request method=POST path=/api/pending_closures6278worker1 # [ 171.584981] nix-grpc-daemon[1714]: time=2026-09-22T22:25:15.165Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6279worker1 # [ 171.586554] nix-grpc-daemon[1714]: time=2026-09-22T22:25:15.165Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"6280lb # [ 171.708997] niks3-server[1100]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls6281worker1 # [ 171.617241] nix-grpc-daemon[1714]: time=2026-09-22T22:25:15.197Z level=INFO msg="Uploading 1 narinfos"6282lb # [ 171.723271] niks3-server[1100]: 2026/09/22 22:25:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6283lb # [ 171.732831] niks3-server[1100]: 2026/09/22 22:25:15 INFO Signed narinfos id=57 count=16284worker1 # [ 171.640952] nix-grpc-daemon[1714]: time=2026-09-22T22:25:15.221Z level=INFO msg="Upload complete. (236ms)"6285lb # [ 171.737606] niks3-server[1100]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst6286lb # [ 171.747857] niks3-server[1100]: 2026/09/22 22:25:15 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6287worker1 # [ 171.650089] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=6406288lb # [ 171.755682] niks3-server[1100]: 2026/09/22 22:25:15 INFO Completed upload id=576289lb # [ 171.758054] niks3-server[1100]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo6290worker1 # [ 171.660621] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426291worker1 # [ 171.670775] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6292worker1 # [ 171.675195] nix-daemon[834]: reaped child process 1819, status = succeeded6293worker1 # [ 171.685553] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6294client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...6295client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6296client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6297client # farm-b> LOG-farm-b-during-drain6298worker1 # [ 172.792230] nix-daemon[834]: reaped child process 1828, status = succeeded6299worker1 # [ 172.862908] nix-daemon[834]: accepted connection from pid 1844, user nix-grpc-daemon (trusted)6300worker1 # [ 172.882929] nix-daemon[834]: reaped child process 1847, status = succeeded6301lb # [ 172.984631] niks3-server[1100]: 2026/09/22 22:25:16 INFO Received uploads request method=POST path=/api/pending_closures6302worker1 # [ 172.894503] nix-grpc-daemon[1714]: time=2026-09-22T22:25:16.473Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6303worker1 # [ 172.896088] nix-grpc-daemon[1714]: time=2026-09-22T22:25:16.473Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"6304lb # [ 173.021914] niks3-server[1100]: 2026/09/22 22:25:16 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls6305worker1 # [ 172.932385] nix-grpc-daemon[1714]: time=2026-09-22T22:25:16.512Z level=INFO msg="Uploading 1 narinfos"6306lb # [ 173.034831] niks3-server[1100]: 2026/09/22 22:25:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6307lb # [ 173.048662] niks3-server[1100]: 2026/09/22 22:25:16 INFO Signed narinfos id=58 count=16308lb # [ 173.055741] niks3-server[1100]: 2026/09/22 22:25:16 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6309lb # [ 173.060569] niks3-server[1100]: 2026/09/22 22:25:16 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst6310lb # [ 173.069048] niks3-server[1100]: 2026/09/22 22:25:16 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6311lb # [ 173.074857] niks3-server[1100]: 2026/09/22 22:25:16 INFO Completed upload id=586312worker1 # [ 172.972322] nix-grpc-daemon[1714]: time=2026-09-22T22:25:16.552Z level=INFO msg="Upload complete. (275ms)"6313lb # [ 173.077429] niks3-server[1100]: 2026/09/22 22:25:16 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo6314worker1 # [ 172.993018] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=16315worker1 # [ 173.007756] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:16Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=06316worker1 # [ 173.011988] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:16Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=16317worker1 # [ 173.016599] nix-daemon[834]: reaped child process 1826, status = succeeded6318worker1 # [ 173.035061] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426319worker1 # [ 173.049603] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426320worker1 # [ 173.063555] nix-grpc-daemon[1714]: time=2026-09-22T22:25:16.643Z level=INFO msg="All 2 paths already cached"6321client # copying 1 paths to 'lb:50051'...6322worker1 # [ 173.074824] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426323client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...6324worker1 # [ 173.104464] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6325worker1 # [ 173.263847] nix-daemon[834]: accepted connection from pid 1853, user nix-grpc-daemon (trusted)6326worker1 # [ 173.282657] nix-daemon[834]: reaped child process 1856, status = succeeded6327lb # [ 173.388851] niks3-server[1100]: 2026/09/22 22:25:16 INFO Received uploads request method=POST path=/api/pending_closures6328worker1 # [ 173.295889] nix-grpc-daemon[1714]: time=2026-09-22T22:25:16.875Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6329worker1 # [ 173.297732] nix-grpc-daemon[1714]: time=2026-09-22T22:25:16.875Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"6330lb # [ 173.418212] niks3-server[1100]: 2026/09/22 22:25:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6331worker1 # [ 173.323140] nix-grpc-daemon[1714]: time=2026-09-22T22:25:16.903Z level=INFO msg="Uploading 1 narinfos"6332lb # [ 173.433779] niks3-server[1100]: 2026/09/22 22:25:16 INFO Signed narinfos id=59 count=16333lb # [ 173.440841] niks3-server[1100]: 2026/09/22 22:25:16 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst6334lb # [ 173.455184] niks3-server[1100]: 2026/09/22 22:25:17 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls6335worker1 # [ 173.359001] nix-grpc-daemon[1714]: time=2026-09-22T22:25:16.939Z level=INFO msg="Upload complete. (237ms)"6336lb # [ 173.461282] niks3-server[1100]: 2026/09/22 22:25:17 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6337worker1 # [ 173.368573] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=7686338lb # [ 173.472882] niks3-server[1100]: 2026/09/22 22:25:17 INFO Completed upload id=596339lb # [ 173.475798] niks3-server[1100]: 2026/09/22 22:25:17 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo6340worker1 # [ 173.381150] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426341worker1 # [ 173.387668] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6342worker1 # [ 173.393334] nix-daemon[834]: reaped child process 1851, status = succeeded6343client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...6344worker1 # [ 173.406348] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6345client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6346client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6347client # farm-top> LOG-farm-top-during-drain6348worker1 # [ 174.859934] nix-daemon[834]: reaped child process 1860, status = succeeded6349worker1 # [ 174.991414] nix-daemon[834]: accepted connection from pid 1876, user nix-grpc-daemon (trusted)6350worker1 # [ 175.007574] nix-daemon[834]: reaped child process 1879, status = succeeded6351lb # [ 175.118418] niks3-server[1100]: 2026/09/22 22:25:18 INFO Received uploads request method=POST path=/api/pending_closures6352worker1 # [ 175.028265] nix-grpc-daemon[1714]: time=2026-09-22T22:25:18.606Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6353worker1 # [ 175.030135] nix-grpc-daemon[1714]: time=2026-09-22T22:25:18.606Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"6354lb # [ 175.157241] niks3-server[1100]: 2026/09/22 22:25:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6355worker1 # [ 175.064106] nix-grpc-daemon[1714]: time=2026-09-22T22:25:18.644Z level=INFO msg="Uploading 1 narinfos"6356lb # [ 175.170753] niks3-server[1100]: 2026/09/22 22:25:18 INFO Signed narinfos id=60 count=16357lb # [ 175.180763] niks3-server[1100]: 2026/09/22 22:25:18 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls6358lb # [ 175.187746] niks3-server[1100]: 2026/09/22 22:25:18 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6359lb # [ 175.198421] niks3-server[1100]: 2026/09/22 22:25:18 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst6360worker1 # [ 175.097406] nix-grpc-daemon[1714]: time=2026-09-22T22:25:18.677Z level=INFO msg="Upload complete. (281ms)"6361lb # [ 175.206612] niks3-server[1100]: 2026/09/22 22:25:18 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6362lb # [ 175.211838] niks3-server[1100]: 2026/09/22 22:25:18 INFO Completed upload id=606363lb # [ 175.214895] niks3-server[1100]: 2026/09/22 22:25:18 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo6364worker1 # [ 175.111611] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=16365worker1 # [ 175.131752] nix-daemon[834]: reaped child process 1858, status = succeeded6366client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2, in 6.11 seconds)6367client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath6368client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath, in 0.18 seconds)6369worker2: must succeed: pkill -f 'read -t [9]0 x'6370worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6371client: waiting for success: ! systemctl is-active sw6372worker2 # [ 175.664943] nix-daemon[856]: reaped child process 1647, status = succeeded6373worker2 # [ 175.768576] nix-daemon[856]: accepted connection from pid 1819, user nix-grpc-daemon (trusted)6374worker2 # [ 175.789435] nix-daemon[856]: reaped child process 1822, status = succeeded6375lb # [ 175.894304] niks3-server[1100]: 2026/09/22 22:25:19 INFO Received uploads request method=POST path=/api/pending_closures6376worker2 # [ 175.798878] nix-grpc-daemon[1596]: time=2026-09-22T22:25:19.361Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6377worker2 # [ 175.800487] nix-grpc-daemon[1596]: time=2026-09-22T22:25:19.361Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"6378worker2 # [ 175.835442] nix-grpc-daemon[1596]: time=2026-09-22T22:25:19.398Z level=INFO msg="Uploading 1 narinfos"6379lb # [ 175.934925] niks3-server[1100]: 2026/09/22 22:25:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6380lb # [ 175.950582] niks3-server[1100]: 2026/09/22 22:25:19 INFO Signed narinfos id=61 count=16381lb # [ 175.958571] niks3-server[1100]: 2026/09/22 22:25:19 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls6382worker2 # [ 175.866358] nix-grpc-daemon[1596]: time=2026-09-22T22:25:19.429Z level=INFO msg="Upload complete. (273ms)"6383lb # [ 175.972321] niks3-server[1100]: 2026/09/22 22:25:19 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6384lb # [ 175.988524] niks3-server[1100]: 2026/09/22 22:25:19 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6385worker2 # [ 175.881152] nix-grpc-daemon[1433]: ts=2026-09-22T22:25:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53234 duration_s=15 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=16386lb # [ 175.992731] niks3-server[1100]: 2026/09/22 22:25:19 INFO Completed upload id=616387lb # [ 175.994922] niks3-server[1100]: 2026/09/22 22:25:19 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6388lb # [ 175.999083] niks3-server[1100]: 2026/09/22 22:25:19 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo6389worker2 # [ 175.895500] nix-daemon[856]: reaped child process 1645, status = succeeded6390client # [ 175.956765] systemd[1]: sw.service: Deactivated successfully.6391client # [ 175.962007] systemd[1]: sw.service: Consumed 189ms CPU time over 16.383s wall clock time, 41.2M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.6392client: (finished: waiting for success: ! systemctl is-active sw, in 1.07 seconds)6393client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6394client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6395worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6396worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.06 seconds)6397lb: waiting until exactly no endpoints of aarch64-linux are unhealthy6398lb: must succeed: curl -sf localhost:9901/clusters6399lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6400worker2 # [ 176.695158] nix-grpc-daemon[1433]: ts=2026-09-22T22:25:20Z level=info event=signal_exit6401lb: must succeed: curl -sf localhost:9901/clusters6402lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6403lb: must succeed: curl -sf localhost:9901/clusters6404worker1 # [ 178.699230] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:348426405worker1 # [ 178.704166] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:22Z level=info event=worker_gone addr=192.168.1.4:500516406worker2 # [ 178.712437] nix-grpc-daemon[1433]: ts=2026-09-22T22:25:22Z level=info event=scheduler_restarting6407worker2 # [ 178.720715] nix-grpc-daemon[1433]: ts=2026-09-22T22:25:22Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6408worker2 # [ 178.746737] nix-daemon[856]: reaped child process 1562, status = succeeded6409lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6410worker2 # [ 179.099268] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6411worker2 # [ 179.106421] systemd[1]: nix-grpc-daemon.service: Consumed 950ms CPU time over 48.574s wall clock time, 35.7M memory peak, 24.8K incoming IP traffic, 43.1K outgoing IP traffic.6412worker2 # [ 179.308003] systemd[1]: Starting scheduler-token.service...6413worker2 # [ 179.392112] systemd[1]: scheduler-token.service: Deactivated successfully.6414worker2 # [ 179.398057] systemd[1]: Finished scheduler-token.service.6415worker2 # [ 179.404771] systemd[1]: scheduler-token.service: Consumed 56ms CPU time over 87ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6416worker2 # [ 179.411925] systemd[1]: Starting Nix worker-protocol over gRPC...6417worker2 # [ 179.543155] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:23Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6418worker2 # [ 179.545524] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6419worker2 # [ 179.549331] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16420worker2 # [ 179.555855] nix-grpc-daemon[1837]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6421worker2 # [ 179.567267] nix-grpc-daemon[1837]: E0000 00:00:1790115923.116789 1837 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6422worker2 # [ 179.576224] nix-grpc-daemon[1837]: E0000 00:00:1790115923.118856 1837 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6423worker2 # [ 179.578511] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6424worker2 # [ 179.607759] nix-grpc-daemon[1837]: E0000 00:00:1790115923.134828 1878 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6425worker2 # [ 179.610853] systemd[1]: Started Nix worker-protocol over gRPC.6426worker2 # [ 179.611817] nix-grpc-daemon[1837]: E0000 00:00:1790115923.155709 1878 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6427worker2 # [ 179.614266] nix-grpc-daemon[1837]: E0000 00:00:1790115923.155848 1878 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6428worker2 # [ 179.619321] nix-grpc-daemon[1837]: E0000 00:00:1790115923.170223 1878 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6429worker2 # [ 179.623643] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:23Z level=info event=scheduler_connected addr=lb:500516430worker1 # [ 179.630025] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:23Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:348426431lb # [ 179.732762] envoy[906]: conn peer=[2001:db8:1::1]:38480 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9608 tx=4425 ms=58436432lb # [ 179.737847] envoy[906]: conn peer=[2001:db8:1::1]:39934 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2991 tx=1516 ms=161716433worker1 # [ 179.636389] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06434lb # [ 179.742798] envoy[906]: conn peer=[2001:db8:1::4]:55032 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=10682 tx=879 ms=479676435lb: must succeed: curl -sf localhost:9901/clusters6436lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6437lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 3.27 seconds)6438lb: must succeed: curl -sf localhost:9901/clusters6439lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6440worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6441worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6442(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 20.47 seconds)6443subtest: queue gauges show a burst while every build blocks6444lb: must succeed: curl -sf localhost:9901/clusters6445lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6446lb: must succeed: curl -sf localhost:9901/clusters6447lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6448worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6449worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6450client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]'6451client # [ 180.219659] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]".6452client # Running as unit: burst.service; invocation ID: 504eee636abe44679d1408a801346ca56453client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.09 seconds)6454lb: must succeed: curl -sf localhost:9901/clusters6455lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6456lb: must succeed: curl -sf localhost:9901/clusters6457lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6458worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6459client # [ 180.421810] nix[1562]: don't know how to build these paths:6460client # [ 180.423004] nix[1562]: /nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv6461worker1 # [ 180.382316] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:394426462client # [ 180.424107] nix[1562]: /nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv6463client # [ 180.425171] nix[1562]: /nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv6464worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6465client # [ 180.426721] nix[1562]: /nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv6466worker1 # [ 180.397564] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:23Z level=debug event=want client=5 drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv cached=06467worker1 # [ 180.402621] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:23Z level=debug event=assigned drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv worker=192.168.1.3:50051 clients=16468worker1 # [ 180.407481] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:23Z level=debug event=want client=5 drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv cached=06469worker1 # [ 180.411389] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:23Z level=debug event=assigned drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv worker=192.168.1.4:50051 clients=16470worker1 # [ 180.415721] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:23Z level=debug event=want client=5 drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv cached=06471worker1 # [ 180.419608] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:23Z level=debug event=want client=5 drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv cached=06472worker1 # [ 180.443052] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426473worker2 # [ 180.443535] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372546474worker1 # [ 180.458868] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426475worker2 # [ 180.458853] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)6476client # [ 180.510494] nix[1562]: copying 1 paths to 'lb:50051'...6477worker1 # [ 180.473488] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426478client # [ 180.516110] nix[1562]: copying path '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' to 'lb:50051'...6479worker1 # [ 180.489192] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6480worker2 # [ 180.483080] nix-grpc-daemon[1837]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5)6481worker2 # [ 180.570114] nix-grpc-daemon[1837]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 2/5)6482worker1 # [ 180.647117] nix-daemon[834]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)6483worker1 # [ 180.667116] nix-daemon[834]: reaped child process 1897, status = succeeded6484lb # [ 180.772975] niks3-server[1100]: 2026/09/22 22:25:24 INFO Received uploads request method=POST path=/api/pending_closures6485worker1 # [ 180.681294] nix-grpc-daemon[1714]: time=2026-09-22T22:25:24.261Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6486worker1 # [ 180.682816] nix-grpc-daemon[1714]: time=2026-09-22T22:25:24.261Z level=INFO msg="Uploading d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv (416B)"6487lb # [ 180.802063] niks3-server[1100]: 2026/09/22 22:25:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6488worker1 # [ 180.711142] nix-grpc-daemon[1714]: time=2026-09-22T22:25:24.291Z level=INFO msg="Uploading 1 narinfos"6489lb # [ 180.817702] niks3-server[1100]: 2026/09/22 22:25:24 INFO Signed narinfos id=62 count=16490lb # [ 180.824673] niks3-server[1100]: 2026/09/22 22:25:24 INFO Registered completed upload object_key=nar/06ismykzsix0w29371dm1hbzzf3ljf9jn7dyh8skp5wqfkkw0vlk.nar.zst6491lb # [ 180.834416] niks3-server[1100]: 2026/09/22 22:25:24 INFO Registered completed upload object_key=d4rrlfallgfbcpmjnsn604l2mgff4hgx.ls6492worker1 # [ 180.743592] nix-grpc-daemon[1714]: time=2026-09-22T22:25:24.323Z level=INFO msg="Upload complete. (239ms)"6493lb # [ 180.846452] niks3-server[1100]: 2026/09/22 22:25:24 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6494worker1 # [ 180.752365] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=4166495lb # [ 180.857929] niks3-server[1100]: 2026/09/22 22:25:24 INFO Completed upload id=626496lb # [ 180.861096] niks3-server[1100]: 2026/09/22 22:25:24 INFO Registered completed upload object_key=d4rrlfallgfbcpmjnsn604l2mgff4hgx.narinfo6497worker2 # [ 180.755426] nix-grpc-daemon[1837]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 3/5)6498worker1 # [ 180.768325] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426499worker1 # [ 180.776680] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6500worker1 # [ 180.782233] nix-daemon[834]: reaped child process 1892, status = succeeded6501worker1 # [ 180.795231] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6502client # [ 180.832911] nix[1562]: building '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' on lb:50051...6503worker2 # [ 180.923145] nix-grpc-daemon[1837]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 757 ms (attempt 4/5)6504lb: must succeed: curl -sf localhost:9901/clusters6505lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6506lb: must succeed: curl -sf localhost:9901/clusters6507lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6508worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6509worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6510worker2 # [ 181.684937] nix-grpc-daemon[1837]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6511worker2 # [ 181.687725] nix-grpc-daemon[1837]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6512worker2 # [ 181.704742] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:372546513worker2 # [ 181.719390] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:372546514client # [ 181.765108] nix[1562]: copying 1 paths to 'lb:50051'...6515client # [ 181.769872] nix[1562]: copying path '/nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv' to 'lb:50051'...6516worker2 # [ 181.733042] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)6517worker2 # [ 181.761481] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:25Z level=info event=niks3_push_started pid=19026518worker2 # [ 181.899166] nix-grpc-daemon[1902]: time=2026-09-22T22:25:25.461Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""6519worker2 # [ 182.006291] nix-daemon[856]: accepted connection from pid 1915, user nix-grpc-daemon (trusted)6520worker2 # [ 182.025981] nix-daemon[856]: reaped child process 1918, status = succeeded6521lb # [ 182.131451] niks3-server[1100]: 2026/09/22 22:25:25 INFO Received uploads request method=POST path=/api/pending_closures6522worker2 # [ 182.035550] nix-grpc-daemon[1902]: time=2026-09-22T22:25:25.597Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6523worker2 # [ 182.039379] nix-grpc-daemon[1902]: time=2026-09-22T22:25:25.597Z level=INFO msg="Uploading dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv (416B)"6524lb # [ 182.172437] niks3-server[1100]: 2026/09/22 22:25:25 INFO Registered completed upload object_key=dspy0axfmddglppg9zj9blmxlzhfs40x.ls6525worker2 # [ 182.077251] nix-grpc-daemon[1902]: time=2026-09-22T22:25:25.639Z level=INFO msg="Uploading 1 narinfos"6526lb # [ 182.186428] niks3-server[1100]: 2026/09/22 22:25:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6527lb # [ 182.194548] niks3-server[1100]: 2026/09/22 22:25:25 INFO Signed narinfos id=63 count=16528lb # [ 182.204385] niks3-server[1100]: 2026/09/22 22:25:25 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6529worker2 # [ 182.105024] nix-grpc-daemon[1902]: time=2026-09-22T22:25:25.668Z level=INFO msg="Upload complete. (202ms)"6530lb # [ 182.216259] niks3-server[1100]: 2026/09/22 22:25:25 INFO Completed upload id=636531worker2 # [ 182.112123] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37254 duration_s=0 paths=1 nar_bytes_in=4166532lb # [ 182.219926] niks3-server[1100]: 2026/09/22 22:25:25 INFO Registered completed upload object_key=nar/06mdwsnf16qmfi86y8r33asi4vcrp5z7kdxqki87psgfpgvvpdki.nar.zst6533lb # [ 182.225723] niks3-server[1100]: 2026/09/22 22:25:25 INFO Registered completed upload object_key=dspy0axfmddglppg9zj9blmxlzhfs40x.narinfo6534worker2 # [ 182.125492] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372546535worker2 # [ 182.130757] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)6536worker2 # [ 182.134975] nix-daemon[856]: reaped child process 1900, status = succeeded6537worker2 # [ 182.145072] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)6538client # [ 182.187234] nix[1562]: building '/nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv' on lb:50051...6539worker1 # [ 183.088917] nix-daemon[834]: reaped child process 1901, status = succeeded6540worker1 # [ 183.186562] nix-daemon[834]: accepted connection from pid 1929, user nix-grpc-daemon (trusted)6541worker1 # [ 183.205510] nix-daemon[834]: reaped child process 1932, status = succeeded6542lb # [ 183.313487] niks3-server[1100]: 2026/09/22 22:25:26 INFO Received uploads request method=POST path=/api/pending_closures6543worker1 # [ 183.228493] nix-grpc-daemon[1714]: time=2026-09-22T22:25:26.807Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6544worker1 # [ 183.230519] nix-grpc-daemon[1714]: time=2026-09-22T22:25:26.807Z level=INFO msg="Uploading k6zivhvzgmlyxfmy64fzd759bxlhf9b5-slow-q0 (120B)"6545lb # [ 183.361783] niks3-server[1100]: 2026/09/22 22:25:26 INFO Registered completed upload object_key=log/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv6546lb # [ 183.376494] niks3-server[1100]: 2026/09/22 22:25:26 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst6547worker1 # [ 183.281709] nix-grpc-daemon[1714]: time=2026-09-22T22:25:26.861Z level=INFO msg="Uploading 1 narinfos"6548lb # [ 183.386977] niks3-server[1100]: 2026/09/22 22:25:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6549lb # [ 183.398077] niks3-server[1100]: 2026/09/22 22:25:26 INFO Signed narinfos id=64 count=16550lb # [ 183.403397] niks3-server[1100]: 2026/09/22 22:25:26 INFO Registered completed upload object_key=k6zivhvzgmlyxfmy64fzd759bxlhf9b5.ls6551worker1 # [ 183.301131] nix-grpc-daemon[1714]: time=2026-09-22T22:25:26.881Z level=INFO msg="Upload complete. (287ms)"6552lb # [ 183.406979] niks3-server[1100]: 2026/09/22 22:25:26 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6553lb # [ 183.416115] niks3-server[1100]: 2026/09/22 22:25:26 INFO Completed upload id=646554lb # [ 183.419320] niks3-server[1100]: 2026/09/22 22:25:26 INFO Registered completed upload object_key=k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo6555worker1 # [ 183.315024] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=2 drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv assign_id=7 outputs=16556worker1 # [ 183.336352] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:26Z level=debug event=assigned drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv worker=192.168.1.3:50051 clients=16557worker1 # [ 183.343911] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426558worker1 # [ 183.350232] nix-daemon[834]: reaped child process 1899, status = succeeded6559worker1 # [ 183.353625] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426560client # [ 183.405362] nix[1562]: copying 1 paths to 'lb:50051'...6561worker1 # [ 183.366406] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426562client # [ 183.408614] nix[1562]: copying path '/nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv' to 'lb:50051'...6563worker1 # [ 183.382813] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6564worker1 # [ 183.530473] nix-daemon[834]: accepted connection from pid 1936, user nix-grpc-daemon (trusted)6565worker1 # [ 183.551848] nix-daemon[834]: reaped child process 1939, status = succeeded6566lb # [ 183.651607] niks3-server[1100]: 2026/09/22 22:25:27 INFO Received uploads request method=POST path=/api/pending_closures6567worker1 # [ 183.558807] nix-grpc-daemon[1714]: time=2026-09-22T22:25:27.138Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6568worker1 # [ 183.560586] nix-grpc-daemon[1714]: time=2026-09-22T22:25:27.138Z level=INFO msg="Uploading jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv (416B)"6569lb # [ 183.682753] niks3-server[1100]: 2026/09/22 22:25:27 INFO Registered completed upload object_key=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.ls6570worker1 # [ 183.594787] nix-grpc-daemon[1714]: time=2026-09-22T22:25:27.174Z level=INFO msg="Uploading 1 narinfos"6571lb # [ 183.696462] niks3-server[1100]: 2026/09/22 22:25:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6572lb # [ 183.708340] niks3-server[1100]: 2026/09/22 22:25:27 INFO Signed narinfos id=65 count=16573lb # [ 183.711372] niks3-server[1100]: 2026/09/22 22:25:27 INFO Registered completed upload object_key=nar/1fyfjzlx8vymsfmdv5cv8ymgjkr18fwm737qvys29plwwiwmyvwr.nar.zst6574worker1 # [ 183.627227] nix-grpc-daemon[1714]: time=2026-09-22T22:25:27.207Z level=INFO msg="Upload complete. (230ms)"6575lb # [ 183.729631] niks3-server[1100]: 2026/09/22 22:25:27 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6576lb # [ 183.736828] niks3-server[1100]: 2026/09/22 22:25:27 INFO Completed upload id=656577worker1 # [ 183.636392] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=4166578lb # [ 183.740435] niks3-server[1100]: 2026/09/22 22:25:27 INFO Registered completed upload object_key=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.narinfo6579worker1 # [ 183.648764] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426580worker1 # [ 183.660418] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6581worker1 # [ 183.665637] nix-daemon[834]: reaped child process 1934, status = succeeded6582client # [ 183.714923] nix[1562]: building '/nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv' on lb:50051...6583worker1 # [ 183.679568] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6584worker2 # [ 184.176877] nix-daemon[856]: reaped child process 1922, status = succeeded6585worker2 # [ 184.283931] nix-daemon[856]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6586worker2 # [ 184.304003] nix-daemon[856]: reaped child process 1950, status = succeeded6587lb # [ 184.417198] niks3-server[1100]: 2026/09/22 22:25:27 INFO Received uploads request method=POST path=/api/pending_closures6588worker2 # [ 184.323144] nix-grpc-daemon[1902]: time=2026-09-22T22:25:27.883Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6589worker2 # [ 184.325868] nix-grpc-daemon[1902]: time=2026-09-22T22:25:27.884Z level=INFO msg="Uploading y3qkgrgq2zzpgvi2rf5chq94i627wkdb-slow-q3 (120B)"6590lb # [ 184.462138] niks3-server[1100]: 2026/09/22 22:25:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6591worker2 # [ 184.363343] nix-grpc-daemon[1902]: time=2026-09-22T22:25:27.925Z level=INFO msg="Uploading 1 narinfos"6592lb # [ 184.481453] niks3-server[1100]: 2026/09/22 22:25:28 INFO Signed narinfos id=66 count=16593lb # [ 184.490724] niks3-server[1100]: 2026/09/22 22:25:28 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst6594worker2 # [ 184.399490] nix-grpc-daemon[1902]: time=2026-09-22T22:25:27.962Z level=INFO msg="Upload complete. (242ms)"6595lb # [ 184.505719] niks3-server[1100]: 2026/09/22 22:25:28 INFO Registered completed upload object_key=log/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv6596lb # [ 184.515800] niks3-server[1100]: 2026/09/22 22:25:28 INFO Registered completed upload object_key=y3qkgrgq2zzpgvi2rf5chq94i627wkdb.ls6597worker1 # [ 184.414434] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:27Z level=debug event=assigned drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv worker=192.168.1.4:50051 clients=16598lb # [ 184.520611] niks3-server[1100]: 2026/09/22 22:25:28 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6599lb # [ 184.524547] niks3-server[1100]: 2026/09/22 22:25:28 INFO Completed upload id=666600lb # [ 184.527280] niks3-server[1100]: 2026/09/22 22:25:28 INFO Registered completed upload object_key=y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo6601worker2 # [ 184.409340] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37254 duration_s=2 drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv assign_id=8 outputs=16602worker2 # [ 184.431428] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372546603worker2 # [ 184.436749] nix-daemon[856]: reaped child process 1920, status = succeeded6604worker2 # [ 184.440990] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:372546605worker2 # [ 184.449352] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:372546606client # [ 184.493696] nix[1562]: copying 1 paths to 'lb:50051'...6607client # [ 184.493949] nix[1562]: copying path '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' to 'lb:50051'...6608worker2 # [ 184.465454] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)6609worker2 # [ 184.604987] nix-daemon[856]: accepted connection from pid 1954, user nix-grpc-daemon (trusted)6610worker2 # [ 184.625488] nix-daemon[856]: reaped child process 1957, status = succeeded6611lb # [ 184.729956] niks3-server[1100]: 2026/09/22 22:25:28 INFO Received uploads request method=POST path=/api/pending_closures6612worker2 # [ 184.632842] nix-grpc-daemon[1902]: time=2026-09-22T22:25:28.195Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6613worker2 # [ 184.634389] nix-grpc-daemon[1902]: time=2026-09-22T22:25:28.195Z level=INFO msg="Uploading pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv (416B)"6614lb # [ 184.758758] niks3-server[1100]: 2026/09/22 22:25:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6615worker2 # [ 184.659632] nix-grpc-daemon[1902]: time=2026-09-22T22:25:28.222Z level=INFO msg="Uploading 1 narinfos"6616lb # [ 184.773259] niks3-server[1100]: 2026/09/22 22:25:28 INFO Signed narinfos id=67 count=16617lb # [ 184.781073] niks3-server[1100]: 2026/09/22 22:25:28 INFO Registered completed upload object_key=nar/1k21jrz411xc9gkca2pnr9mrjq1s3bg3zhsam3nnv4j066dgzgm7.nar.zst6618lb # [ 184.789792] niks3-server[1100]: 2026/09/22 22:25:28 INFO Registered completed upload object_key=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.ls6619worker2 # [ 184.695762] nix-grpc-daemon[1902]: time=2026-09-22T22:25:28.257Z level=INFO msg="Upload complete. (216ms)"6620lb # [ 184.797806] niks3-server[1100]: 2026/09/22 22:25:28 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6621worker2 # [ 184.698658] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37254 duration_s=0 paths=1 nar_bytes_in=4166622lb # [ 184.808324] niks3-server[1100]: 2026/09/22 22:25:28 INFO Completed upload id=676623lb # [ 184.810712] niks3-server[1100]: 2026/09/22 22:25:28 INFO Registered completed upload object_key=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.narinfo6624worker2 # [ 184.712338] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372546625worker2 # [ 184.721129] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)6626worker2 # [ 184.725537] nix-daemon[856]: reaped child process 1952, status = succeeded6627client # [ 184.777597] nix[1562]: building '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' on lb:50051...6628worker2 # [ 184.737253] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)6629worker1 # [ 185.319303] nix-daemon[834]: reaped child process 1943, status = succeeded6630worker1 # [ 185.425698] nix-daemon[834]: accepted connection from pid 1968, user nix-grpc-daemon (trusted)6631worker1 # [ 185.442169] nix-daemon[834]: reaped child process 1971, status = succeeded6632lb # [ 185.551973] niks3-server[1100]: 2026/09/22 22:25:29 INFO Received uploads request method=POST path=/api/pending_closures6633worker1 # [ 185.460388] nix-grpc-daemon[1714]: time=2026-09-22T22:25:29.039Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6634worker1 # [ 185.461856] nix-grpc-daemon[1714]: time=2026-09-22T22:25:29.039Z level=INFO msg="Uploading gjyi8j90pk5flrsqqdhj6h132pcb7n33-slow-q2 (120B)"6635lb # [ 185.605243] niks3-server[1100]: 2026/09/22 22:25:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6636worker1 # [ 185.512552] nix-grpc-daemon[1714]: time=2026-09-22T22:25:29.092Z level=INFO msg="Uploading 1 narinfos"6637lb # [ 185.618651] niks3-server[1100]: 2026/09/22 22:25:29 INFO Registered completed upload object_key=gjyi8j90pk5flrsqqdhj6h132pcb7n33.ls6638lb # [ 185.626556] niks3-server[1100]: 2026/09/22 22:25:29 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst6639lb # [ 185.637250] niks3-server[1100]: 2026/09/22 22:25:29 INFO Signed narinfos id=68 count=16640lb # [ 185.639379] niks3-server[1100]: 2026/09/22 22:25:29 INFO Registered completed upload object_key=log/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv6641worker1 # [ 185.534119] nix-grpc-daemon[1714]: time=2026-09-22T22:25:29.114Z level=INFO msg="Upload complete. (244ms)"6642lb # [ 185.644532] niks3-server[1100]: 2026/09/22 22:25:29 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6643lb # [ 185.647751] niks3-server[1100]: 2026/09/22 22:25:29 INFO Completed upload id=686644lb # [ 185.649634] niks3-server[1100]: 2026/09/22 22:25:29 INFO Registered completed upload object_key=gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo6645worker1 # [ 185.545161] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv assign_id=9 outputs=16646worker1 # [ 185.560193] nix-daemon[834]: reaped child process 1941, status = succeeded6647worker2 # [ 186.564153] nix-daemon[856]: reaped child process 1961, status = succeeded6648worker2 # [ 186.671030] nix-daemon[856]: accepted connection from pid 1986, user nix-grpc-daemon (trusted)6649worker2 # [ 186.690193] nix-daemon[856]: reaped child process 1989, status = succeeded6650lb # [ 186.802532] niks3-server[1100]: 2026/09/22 22:25:30 INFO Received uploads request method=POST path=/api/pending_closures6651worker2 # [ 186.707924] nix-grpc-daemon[1902]: time=2026-09-22T22:25:30.270Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6652worker2 # [ 186.709567] nix-grpc-daemon[1902]: time=2026-09-22T22:25:30.270Z level=INFO msg="Uploading l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx-slow-q1 (120B)"6653lb # [ 186.842787] niks3-server[1100]: 2026/09/22 22:25:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6654worker2 # [ 186.746549] nix-grpc-daemon[1902]: time=2026-09-22T22:25:30.309Z level=INFO msg="Uploading 1 narinfos"6655lb # [ 186.855628] niks3-server[1100]: 2026/09/22 22:25:30 INFO Signed narinfos id=69 count=16656lb # [ 186.864810] niks3-server[1100]: 2026/09/22 22:25:30 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst6657lb # [ 186.876125] niks3-server[1100]: 2026/09/22 22:25:30 INFO Registered completed upload object_key=l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.ls6658worker2 # [ 186.770182] nix-grpc-daemon[1902]: time=2026-09-22T22:25:30.333Z level=INFO msg="Upload complete. (223ms)"6659lb # [ 186.879095] niks3-server[1100]: 2026/09/22 22:25:30 INFO Registered completed upload object_key=log/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv6660lb # [ 186.887035] niks3-server[1100]: 2026/09/22 22:25:30 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6661lb # [ 186.891831] niks3-server[1100]: 2026/09/22 22:25:30 INFO Completed upload id=696662lb # [ 186.894572] niks3-server[1100]: 2026/09/22 22:25:30 INFO Registered completed upload object_key=l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo6663worker2 # [ 186.780945] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37254 duration_s=2 drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv assign_id=10 outputs=16664worker2 # [ 186.796844] nix-daemon[856]: reaped child process 1959, status = succeeded6665client # [ 186.863242] systemd[1]: burst.service: Deactivated successfully.6666client # [ 186.868256] systemd[1]: burst.service: Consumed 232ms CPU time over 6.644s wall clock time, 57.6M memory peak, 14.2K incoming IP traffic, 19.3K outgoing IP traffic.6667client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }6668client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.07 seconds)6669lb: must succeed: curl -sf localhost:9901/clusters6670lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6671lb: must succeed: curl -sf localhost:9901/clusters6672lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6673worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6674worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6675(finished: subtest: queue gauges show a burst while every build blocks, in 8.05 seconds)6676subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6677client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16678worker1 # [ 188.209515] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:394426679worker1 # [ 188.217509] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426680worker1 # [ 188.257553] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:31Z level=debug event=want client=6 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=06681worker1 # [ 188.264796] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:31Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=16682worker1 # [ 188.271145] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:31Z level=debug event=want client=6 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=06683worker1 # [ 188.276447] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:31Z level=debug event=want client=6 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=06684worker1 # [ 188.302149] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426685worker1 # [ 188.317283] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426686worker1 # [ 188.330179] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426687worker1 # [ 188.337882] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6688worker1 # [ 188.460987] nix-daemon[834]: accepted connection from pid 1988, user nix-grpc-daemon (trusted)6689worker1 # [ 188.477797] nix-daemon[834]: reaped child process 1991, status = succeeded6690lb # [ 188.587954] niks3-server[1100]: 2026/09/22 22:25:32 INFO Received uploads request method=POST path=/api/pending_closures6691worker1 # [ 188.494746] nix-grpc-daemon[1714]: time=2026-09-22T22:25:32.074Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6692worker1 # [ 188.496305] nix-grpc-daemon[1714]: time=2026-09-22T22:25:32.074Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"6693lb # [ 188.614033] niks3-server[1100]: 2026/09/22 22:25:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign6694worker1 # [ 188.518634] nix-grpc-daemon[1714]: time=2026-09-22T22:25:32.098Z level=INFO msg="Uploading 1 narinfos"6695lb # [ 188.622862] niks3-server[1100]: 2026/09/22 22:25:32 INFO Signed narinfos id=70 count=16696lb # [ 188.625876] niks3-server[1100]: 2026/09/22 22:25:32 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst6697lb # [ 188.636739] niks3-server[1100]: 2026/09/22 22:25:32 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete6698lb # [ 188.641238] niks3-server[1100]: 2026/09/22 22:25:32 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls6699lb # [ 188.645592] niks3-server[1100]: 2026/09/22 22:25:32 INFO Completed upload id=706700worker1 # [ 188.543891] nix-grpc-daemon[1714]: time=2026-09-22T22:25:32.124Z level=INFO msg="Upload complete. (197ms)"6701lb # [ 188.648590] niks3-server[1100]: 2026/09/22 22:25:32 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo6702worker1 # [ 188.553102] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=5126703worker1 # [ 188.560421] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426704worker1 # [ 188.571532] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6705worker1 # [ 188.573722] nix-daemon[834]: reaped child process 1986, status = succeeded6706worker1 # [ 188.584839] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6707worker1 # [ 189.420965] nix-daemon[834]: reaped child process 1995, status = succeeded6708worker1 # [ 189.525409] nix-daemon[834]: accepted connection from pid 2011, user nix-grpc-daemon (trusted)6709worker1 # [ 189.544513] nix-daemon[834]: reaped child process 2014, status = succeeded6710lb # [ 189.653275] niks3-server[1100]: 2026/09/22 22:25:33 INFO Received uploads request method=POST path=/api/pending_closures6711worker1 # [ 189.561617] nix-grpc-daemon[1714]: time=2026-09-22T22:25:33.140Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6712worker1 # [ 189.563066] nix-grpc-daemon[1714]: time=2026-09-22T22:25:33.140Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"6713lb # [ 189.692104] niks3-server[1100]: 2026/09/22 22:25:33 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls6714lb # [ 189.705129] niks3-server[1100]: 2026/09/22 22:25:33 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv6715worker1 # [ 189.610511] nix-grpc-daemon[1714]: time=2026-09-22T22:25:33.190Z level=INFO msg="Uploading 1 narinfos"6716lb # [ 189.718203] niks3-server[1100]: 2026/09/22 22:25:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign6717lb # [ 189.725355] niks3-server[1100]: 2026/09/22 22:25:33 INFO Signed narinfos id=71 count=16718lb # [ 189.727361] niks3-server[1100]: 2026/09/22 22:25:33 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6719lb # [ 189.736687] niks3-server[1100]: 2026/09/22 22:25:33 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete6720lb # [ 189.741702] envoy[906]: conn peer=[2001:db8:1::1]:51704 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9731 tx=5294 ms=64236721worker1 # [ 189.638378] nix-grpc-daemon[1714]: time=2026-09-22T22:25:33.218Z level=INFO msg="Upload complete. (243ms)"6722lb # [ 189.744460] niks3-server[1100]: 2026/09/22 22:25:33 INFO Completed upload id=716723lb # [ 189.746497] niks3-server[1100]: 2026/09/22 22:25:33 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo6724worker1 # [ 189.652865] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=11 outputs=16725worker1 # [ 189.668376] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:33Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=16726worker1 # [ 189.675144] nix-daemon[834]: reaped child process 1993, status = succeeded6727worker1 # [ 189.695771] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426728worker1 # [ 189.706278] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:33Z level=debug event=want client=6 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=06729worker1 # [ 189.718391] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426730worker1 # [ 189.732753] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426731worker1 # [ 189.745691] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6732worker1 # [ 189.890977] nix-daemon[834]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)6733worker1 # [ 189.909692] nix-daemon[834]: reaped child process 2023, status = succeeded6734lb # [ 190.014545] niks3-server[1100]: 2026/09/22 22:25:33 INFO Received uploads request method=POST path=/api/pending_closures6735worker1 # [ 189.917919] nix-grpc-daemon[1714]: time=2026-09-22T22:25:33.498Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6736worker1 # [ 189.919387] nix-grpc-daemon[1714]: time=2026-09-22T22:25:33.498Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"6737lb # [ 190.030638] niks3-server[1100]: 2026/09/22 22:25:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign6738worker1 # [ 189.932408] nix-grpc-daemon[1714]: time=2026-09-22T22:25:33.512Z level=INFO msg="Uploading 1 narinfos"6739lb # [ 190.038516] niks3-server[1100]: 2026/09/22 22:25:33 INFO Signed narinfos id=72 count=16740lb # [ 190.042052] niks3-server[1100]: 2026/09/22 22:25:33 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst6741lb # [ 190.049883] niks3-server[1100]: 2026/09/22 22:25:33 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls6742worker1 # [ 189.950908] nix-grpc-daemon[1714]: time=2026-09-22T22:25:33.531Z level=INFO msg="Upload complete. (191ms)"6743lb # [ 190.053209] niks3-server[1100]: 2026/09/22 22:25:33 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete6744lb # [ 190.056675] niks3-server[1100]: 2026/09/22 22:25:33 INFO Completed upload id=726745worker1 # [ 189.956260] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=5126746lb # [ 190.061891] niks3-server[1100]: 2026/09/22 22:25:33 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo6747worker1 # [ 189.966474] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426748worker1 # [ 189.974343] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6749worker1 # [ 189.976667] nix-daemon[834]: reaped child process 2018, status = succeeded6750worker1 # [ 189.986883] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6751worker1 # [ 190.816220] nix-daemon[834]: reaped child process 2027, status = succeeded6752worker1 # [ 190.909529] nix-daemon[834]: accepted connection from pid 2043, user nix-grpc-daemon (trusted)6753worker1 # [ 190.928796] nix-daemon[834]: reaped child process 2046, status = succeeded6754lb # [ 191.035935] niks3-server[1100]: 2026/09/22 22:25:34 INFO Received uploads request method=POST path=/api/pending_closures6755worker1 # [ 190.944380] nix-grpc-daemon[1714]: time=2026-09-22T22:25:34.523Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6756worker1 # [ 190.945824] nix-grpc-daemon[1714]: time=2026-09-22T22:25:34.523Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"6757lb # [ 191.086689] niks3-server[1100]: 2026/09/22 22:25:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign6758worker1 # [ 190.996657] nix-grpc-daemon[1714]: time=2026-09-22T22:25:34.576Z level=INFO msg="Uploading 1 narinfos"6759lb # [ 191.100785] niks3-server[1100]: 2026/09/22 22:25:34 INFO Signed narinfos id=73 count=16760lb # [ 191.103490] niks3-server[1100]: 2026/09/22 22:25:34 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6761lb # [ 191.117587] niks3-server[1100]: 2026/09/22 22:25:34 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls6762lb # [ 191.127937] niks3-server[1100]: 2026/09/22 22:25:34 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv6763worker1 # [ 191.032183] nix-grpc-daemon[1714]: time=2026-09-22T22:25:34.612Z level=INFO msg="Upload complete. (237ms)"6764lb # [ 191.135986] niks3-server[1100]: 2026/09/22 22:25:34 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete6765lb # [ 191.140230] niks3-server[1100]: 2026/09/22 22:25:34 INFO Completed upload id=736766lb # [ 191.144486] niks3-server[1100]: 2026/09/22 22:25:34 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo6767worker1 # [ 191.045262] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=12 outputs=16768worker1 # [ 191.068334] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:34Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=16769worker1 # [ 191.076991] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426770worker1 # [ 191.080917] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:34Z level=debug event=want client=6 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=06771worker1 # [ 191.084983] nix-daemon[834]: reaped child process 2025, status = succeeded6772worker1 # [ 191.098335] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426773worker1 # [ 191.111806] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426774worker1 # [ 191.123686] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6775worker1 # [ 191.267659] nix-daemon[834]: accepted connection from pid 2052, user nix-grpc-daemon (trusted)6776worker1 # [ 191.284714] nix-daemon[834]: reaped child process 2055, status = succeeded6777lb # [ 191.392816] niks3-server[1100]: 2026/09/22 22:25:34 INFO Received uploads request method=POST path=/api/pending_closures6778worker1 # [ 191.299743] nix-grpc-daemon[1714]: time=2026-09-22T22:25:34.879Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6779worker1 # [ 191.301390] nix-grpc-daemon[1714]: time=2026-09-22T22:25:34.879Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"6780lb # [ 191.421831] niks3-server[1100]: 2026/09/22 22:25:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign6781worker1 # [ 191.326365] nix-grpc-daemon[1714]: time=2026-09-22T22:25:34.906Z level=INFO msg="Uploading 1 narinfos"6782lb # [ 191.436705] niks3-server[1100]: 2026/09/22 22:25:34 INFO Signed narinfos id=74 count=16783lb # [ 191.439510] niks3-server[1100]: 2026/09/22 22:25:35 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst6784worker1 # [ 191.352977] nix-grpc-daemon[1714]: time=2026-09-22T22:25:34.933Z level=INFO msg="Upload complete. (215ms)"6785lb # [ 191.457948] niks3-server[1100]: 2026/09/22 22:25:35 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls6786lb # [ 191.461876] niks3-server[1100]: 2026/09/22 22:25:35 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete6787worker1 # [ 191.360323] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=5126788lb # [ 191.465949] niks3-server[1100]: 2026/09/22 22:25:35 INFO Completed upload id=746789lb # [ 191.467708] niks3-server[1100]: 2026/09/22 22:25:35 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo6790worker1 # [ 191.375319] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426791worker1 # [ 191.384196] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6792worker1 # [ 191.387118] nix-daemon[834]: reaped child process 2050, status = succeeded6793worker1 # [ 191.400679] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6794worker1 # [ 192.267713] nix-daemon[834]: reaped child process 2059, status = succeeded6795worker1 # [ 192.392369] nix-daemon[834]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)6796worker1 # [ 192.410478] nix-daemon[834]: reaped child process 2078, status = succeeded6797lb # [ 192.520790] niks3-server[1100]: 2026/09/22 22:25:36 INFO Received uploads request method=POST path=/api/pending_closures6798worker1 # [ 192.429118] nix-grpc-daemon[1714]: time=2026-09-22T22:25:36.008Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6799worker1 # [ 192.430681] nix-grpc-daemon[1714]: time=2026-09-22T22:25:36.008Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"6800worker1 # [ 192.468608] nix-grpc-daemon[1714]: time=2026-09-22T22:25:36.048Z level=INFO msg="Uploading 1 narinfos"6801lb # [ 192.560748] niks3-server[1100]: 2026/09/22 22:25:36 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls6802lb # [ 192.573577] niks3-server[1100]: 2026/09/22 22:25:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign6803lb # [ 192.586052] niks3-server[1100]: 2026/09/22 22:25:36 INFO Signed narinfos id=75 count=16804lb # [ 192.593486] niks3-server[1100]: 2026/09/22 22:25:36 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6805worker1 # [ 192.504201] nix-grpc-daemon[1714]: time=2026-09-22T22:25:36.084Z level=INFO msg="Upload complete. (294ms)"6806lb # [ 192.606595] niks3-server[1100]: 2026/09/22 22:25:36 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv6807lb # [ 192.611507] niks3-server[1100]: 2026/09/22 22:25:36 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete6808worker1 # [ 192.510125] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=13 outputs=16809lb # [ 192.616288] niks3-server[1100]: 2026/09/22 22:25:36 INFO Completed upload id=756810lb # [ 192.619158] niks3-server[1100]: 2026/09/22 22:25:36 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo6811worker1 # [ 192.523201] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:36Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=16812worker1 # [ 192.526409] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426813worker1 # [ 192.530305] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:36Z level=debug event=want client=6 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=06814worker1 # [ 192.533858] nix-daemon[834]: reaped child process 2057, status = succeeded6815worker1 # [ 192.558379] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426816worker1 # [ 192.570025] nix-grpc-daemon[1714]: time=2026-09-22T22:25:36.150Z level=INFO msg="All 1 paths already cached"6817worker1 # [ 192.575837] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426818worker1 # [ 192.590025] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6819worker1 # [ 192.717937] nix-daemon[834]: accepted connection from pid 2084, user nix-grpc-daemon (trusted)6820worker1 # [ 192.735822] nix-daemon[834]: reaped child process 2087, status = succeeded6821lb # [ 192.845282] niks3-server[1100]: 2026/09/22 22:25:36 INFO Received uploads request method=POST path=/api/pending_closures6822worker1 # [ 192.751973] nix-grpc-daemon[1714]: time=2026-09-22T22:25:36.331Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6823worker1 # [ 192.753719] nix-grpc-daemon[1714]: time=2026-09-22T22:25:36.331Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6824lb # [ 192.875135] niks3-server[1100]: 2026/09/22 22:25:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign6825worker1 # [ 192.779179] nix-grpc-daemon[1714]: time=2026-09-22T22:25:36.359Z level=INFO msg="Uploading 1 narinfos"6826lb # [ 192.889921] niks3-server[1100]: 2026/09/22 22:25:36 INFO Signed narinfos id=76 count=16827lb # [ 192.897069] niks3-server[1100]: 2026/09/22 22:25:36 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6828lb # [ 192.907713] niks3-server[1100]: 2026/09/22 22:25:36 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6829lb # [ 192.912470] niks3-server[1100]: 2026/09/22 22:25:36 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete6830worker1 # [ 192.815776] nix-grpc-daemon[1714]: time=2026-09-22T22:25:36.396Z level=INFO msg="Upload complete. (217ms)"6831lb # [ 192.919379] niks3-server[1100]: 2026/09/22 22:25:36 INFO Completed upload id=766832lb # [ 192.925662] niks3-server[1100]: 2026/09/22 22:25:36 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6833worker1 # [ 192.824337] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=6246834worker1 # [ 192.838788] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426835worker1 # [ 192.845492] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6836worker1 # [ 192.850289] nix-daemon[834]: reaped child process 2082, status = succeeded6837worker1 # [ 192.861674] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6838worker1 # [ 193.695494] nix-daemon[834]: reaped child process 2091, status = succeeded6839worker1 # [ 193.809811] nix-daemon[834]: accepted connection from pid 2107, user nix-grpc-daemon (trusted)6840worker1 # [ 193.828876] nix-daemon[834]: reaped child process 2110, status = succeeded6841lb # [ 193.935818] niks3-server[1100]: 2026/09/22 22:25:37 INFO Received uploads request method=POST path=/api/pending_closures6842worker1 # [ 193.843215] nix-grpc-daemon[1714]: time=2026-09-22T22:25:37.423Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6843worker1 # [ 193.846661] nix-grpc-daemon[1714]: time=2026-09-22T22:25:37.425Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6844lb # [ 193.977698] niks3-server[1100]: 2026/09/22 22:25:37 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6845worker1 # [ 193.886529] nix-grpc-daemon[1714]: time=2026-09-22T22:25:37.466Z level=INFO msg="Uploading 1 narinfos"6846lb # [ 193.991995] niks3-server[1100]: 2026/09/22 22:25:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign6847lb # [ 194.001390] niks3-server[1100]: 2026/09/22 22:25:37 INFO Signed narinfos id=77 count=16848lb # [ 194.003865] niks3-server[1100]: 2026/09/22 22:25:37 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6849worker1 # [ 193.912329] nix-grpc-daemon[1714]: time=2026-09-22T22:25:37.492Z level=INFO msg="Upload complete. (242ms)"6850lb # [ 194.016840] niks3-server[1100]: 2026/09/22 22:25:37 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6851lb # [ 194.019537] niks3-server[1100]: 2026/09/22 22:25:37 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete6852lb # [ 194.024393] niks3-server[1100]: 2026/09/22 22:25:37 INFO Completed upload id=776853lb # [ 194.026772] niks3-server[1100]: 2026/09/22 22:25:37 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6854worker1 # [ 193.926011] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=14 outputs=16855worker1 # [ 193.944440] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:37Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16856worker1 # [ 193.950812] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426857worker1 # [ 193.956742] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:37Z level=debug event=want client=6 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06858worker1 # [ 193.962562] nix-daemon[834]: reaped child process 2089, status = succeeded6859worker1 # [ 193.966097] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426860worker1 # [ 193.971332] nix-grpc-daemon[1714]: time=2026-09-22T22:25:37.550Z level=INFO msg="All 1 paths already cached"6861worker1 # [ 193.975270] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426862worker1 # [ 193.990019] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6863worker1 # [ 194.112199] nix-daemon[834]: accepted connection from pid 2116, user nix-grpc-daemon (trusted)6864worker1 # [ 194.131627] nix-daemon[834]: reaped child process 2119, status = succeeded6865lb # [ 194.236564] niks3-server[1100]: 2026/09/22 22:25:37 INFO Received uploads request method=POST path=/api/pending_closures6866worker1 # [ 194.143860] nix-grpc-daemon[1714]: time=2026-09-22T22:25:37.723Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6867worker1 # [ 194.145538] nix-grpc-daemon[1714]: time=2026-09-22T22:25:37.723Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6868lb # [ 194.269671] niks3-server[1100]: 2026/09/22 22:25:37 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6869worker1 # [ 194.176739] nix-grpc-daemon[1714]: time=2026-09-22T22:25:37.756Z level=INFO msg="Uploading 1 narinfos"6870lb # [ 194.280974] niks3-server[1100]: 2026/09/22 22:25:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign6871lb # [ 194.290707] niks3-server[1100]: 2026/09/22 22:25:37 INFO Signed narinfos id=78 count=16872lb # [ 194.300287] niks3-server[1100]: 2026/09/22 22:25:37 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete6873worker1 # [ 194.205679] nix-grpc-daemon[1714]: time=2026-09-22T22:25:37.785Z level=INFO msg="Upload complete. (210ms)"6874lb # [ 194.308456] niks3-server[1100]: 2026/09/22 22:25:37 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6875lb # [ 194.312421] niks3-server[1100]: 2026/09/22 22:25:37 INFO Completed upload id=786876lb # [ 194.316120] niks3-server[1100]: 2026/09/22 22:25:37 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6877worker1 # [ 194.214951] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=6246878worker1 # [ 194.229185] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426879worker1 # [ 194.236287] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6880worker1 # [ 194.240739] nix-daemon[834]: reaped child process 2114, status = succeeded6881worker1 # [ 194.252204] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6882worker1 # [ 194.914227] nix-daemon[834]: reaped child process 2123, status = succeeded6883worker1 # [ 195.040403] nix-daemon[834]: accepted connection from pid 2139, user nix-grpc-daemon (trusted)6884worker1 # [ 195.059620] nix-daemon[834]: reaped child process 2142, status = succeeded6885lb # [ 195.169440] niks3-server[1100]: 2026/09/22 22:25:38 INFO Received uploads request method=POST path=/api/pending_closures6886worker1 # [ 195.079891] nix-grpc-daemon[1714]: time=2026-09-22T22:25:38.658Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6887worker1 # [ 195.081587] nix-grpc-daemon[1714]: time=2026-09-22T22:25:38.659Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6888lb # [ 195.205936] niks3-server[1100]: 2026/09/22 22:25:38 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6889worker1 # [ 195.110936] nix-grpc-daemon[1714]: time=2026-09-22T22:25:38.691Z level=INFO msg="Uploading 1 narinfos"6890lb # [ 195.213747] niks3-server[1100]: 2026/09/22 22:25:38 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6891lb # [ 195.221043] niks3-server[1100]: 2026/09/22 22:25:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign6892lb # [ 195.223432] niks3-server[1100]: 2026/09/22 22:25:38 INFO Signed narinfos id=79 count=16893lb # [ 195.228931] niks3-server[1100]: 2026/09/22 22:25:38 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6894lb # [ 195.236039] niks3-server[1100]: 2026/09/22 22:25:38 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete6895lb # [ 195.240149] niks3-server[1100]: 2026/09/22 22:25:38 INFO Completed upload id=796896worker1 # [ 195.138185] nix-grpc-daemon[1714]: time=2026-09-22T22:25:38.718Z level=INFO msg="Upload complete. (276ms)"6897lb # [ 195.244281] niks3-server[1100]: 2026/09/22 22:25:38 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6898worker1 # [ 195.153395] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=15 outputs=16899worker1 # [ 195.168725] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:38Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16900worker1 # [ 195.175433] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426901worker1 # [ 195.179296] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:38Z level=debug event=want client=6 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06902worker1 # [ 195.183619] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426903worker1 # [ 195.187837] nix-daemon[834]: reaped child process 2121, status = succeeded6904worker1 # [ 195.189795] nix-grpc-daemon[1714]: time=2026-09-22T22:25:38.767Z level=INFO msg="All 1 paths already cached"6905worker1 # [ 195.192869] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426906worker1 # [ 195.205378] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6907worker1 # [ 195.325228] nix-daemon[834]: accepted connection from pid 2148, user nix-grpc-daemon (trusted)6908worker1 # [ 195.341406] nix-daemon[834]: reaped child process 2151, status = succeeded6909lb # [ 195.449513] niks3-server[1100]: 2026/09/22 22:25:39 INFO Received uploads request method=POST path=/api/pending_closures6910worker1 # [ 195.356403] nix-grpc-daemon[1714]: time=2026-09-22T22:25:38.936Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6911worker1 # [ 195.357869] nix-grpc-daemon[1714]: time=2026-09-22T22:25:38.936Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6912lb # [ 195.478511] niks3-server[1100]: 2026/09/22 22:25:39 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6913lb # [ 195.490164] niks3-server[1100]: 2026/09/22 22:25:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign6914worker1 # [ 195.394437] nix-grpc-daemon[1714]: time=2026-09-22T22:25:38.974Z level=INFO msg="Uploading 1 narinfos"6915lb # [ 195.502551] niks3-server[1100]: 2026/09/22 22:25:39 INFO Signed narinfos id=80 count=16916worker1 # [ 195.415706] nix-grpc-daemon[1714]: time=2026-09-22T22:25:38.996Z level=INFO msg="Upload complete. (206ms)"6917lb # [ 195.510751] niks3-server[1100]: 2026/09/22 22:25:39 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6918lb # [ 195.523084] niks3-server[1100]: 2026/09/22 22:25:39 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete6919worker1 # [ 195.424278] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=6246920lb # [ 195.528831] niks3-server[1100]: 2026/09/22 22:25:39 INFO Completed upload id=806921lb # [ 195.531301] niks3-server[1100]: 2026/09/22 22:25:39 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6922worker1 # [ 195.435711] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426923worker1 # [ 195.444987] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6924worker1 # [ 195.447824] nix-daemon[834]: reaped child process 2146, status = succeeded6925worker1 # [ 195.458894] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6926worker1 # [ 196.311300] nix-daemon[834]: reaped child process 2155, status = succeeded6927worker1 # [ 196.422231] nix-daemon[834]: accepted connection from pid 2171, user nix-grpc-daemon (trusted)6928worker1 # [ 196.439479] nix-daemon[834]: reaped child process 2174, status = succeeded6929lb # [ 196.547757] niks3-server[1100]: 2026/09/22 22:25:40 INFO Received uploads request method=POST path=/api/pending_closures6930worker1 # [ 196.456393] nix-grpc-daemon[1714]: time=2026-09-22T22:25:40.035Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6931worker1 # [ 196.457846] nix-grpc-daemon[1714]: time=2026-09-22T22:25:40.035Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6932lb # [ 196.592266] niks3-server[1100]: 2026/09/22 22:25:40 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6933worker1 # [ 196.500087] nix-grpc-daemon[1714]: time=2026-09-22T22:25:40.080Z level=INFO msg="Uploading 1 narinfos"6934lb # [ 196.603165] niks3-server[1100]: 2026/09/22 22:25:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign6935lb # [ 196.615085] niks3-server[1100]: 2026/09/22 22:25:40 INFO Signed narinfos id=81 count=16936lb # [ 196.620532] niks3-server[1100]: 2026/09/22 22:25:40 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6937lb # [ 196.623809] niks3-server[1100]: 2026/09/22 22:25:40 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6938lb # [ 196.636155] niks3-server[1100]: 2026/09/22 22:25:40 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete6939lb # [ 196.638796] niks3-server[1100]: 2026/09/22 22:25:40 INFO Completed upload id=816940worker1 # [ 196.534937] nix-grpc-daemon[1714]: time=2026-09-22T22:25:40.114Z level=INFO msg="Upload complete. (263ms)"6941lb # [ 196.640556] niks3-server[1100]: 2026/09/22 22:25:40 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6942worker1 # [ 196.550393] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=16 outputs=16943worker1 # [ 196.572368] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:40Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16944worker1 # [ 196.580681] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426945worker1 # [ 196.586932] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:40Z level=debug event=want client=6 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06946worker1 # [ 196.600407] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426947worker1 # [ 196.603832] nix-daemon[834]: reaped child process 2153, status = succeeded6948worker1 # [ 196.609364] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6949worker1 # [ 196.611441] nix-grpc-daemon[1714]: time=2026-09-22T22:25:40.165Z level=INFO msg="All 2 paths already cached"6950worker1 # [ 196.617254] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426951worker1 # [ 196.738676] nix-daemon[834]: accepted connection from pid 2180, user nix-grpc-daemon (trusted)6952worker1 # [ 196.758211] nix-daemon[834]: reaped child process 2183, status = succeeded6953lb # [ 196.859120] niks3-server[1100]: 2026/09/22 22:25:40 INFO Received uploads request method=POST path=/api/pending_closures6954worker1 # [ 196.765816] nix-grpc-daemon[1714]: time=2026-09-22T22:25:40.345Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6955worker1 # [ 196.767305] nix-grpc-daemon[1714]: time=2026-09-22T22:25:40.345Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6956lb # [ 196.887675] niks3-server[1100]: 2026/09/22 22:25:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign6957worker1 # [ 196.791618] nix-grpc-daemon[1714]: time=2026-09-22T22:25:40.371Z level=INFO msg="Uploading 1 narinfos"6958lb # [ 196.902312] niks3-server[1100]: 2026/09/22 22:25:40 INFO Signed narinfos id=82 count=16959lb # [ 196.910270] niks3-server[1100]: 2026/09/22 22:25:40 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6960lb # [ 196.923713] niks3-server[1100]: 2026/09/22 22:25:40 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6961worker1 # [ 196.827560] nix-grpc-daemon[1714]: time=2026-09-22T22:25:40.407Z level=INFO msg="Upload complete. (210ms)"6962lb # [ 196.932392] niks3-server[1100]: 2026/09/22 22:25:40 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete6963worker1 # [ 196.836282] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=7526964lb # [ 196.937950] niks3-server[1100]: 2026/09/22 22:25:40 INFO Completed upload id=826965lb # [ 196.942773] niks3-server[1100]: 2026/09/22 22:25:40 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6966worker1 # [ 196.847692] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426967worker1 # [ 196.853854] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6968worker1 # [ 196.858656] nix-daemon[834]: reaped child process 2178, status = succeeded6969worker1 # [ 196.870769] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6970worker1 # [ 197.944375] nix-daemon[834]: reaped child process 2187, status = succeeded6971worker1 # [ 198.049018] nix-daemon[834]: accepted connection from pid 2203, user nix-grpc-daemon (trusted)6972worker1 # [ 198.067129] nix-daemon[834]: reaped child process 2206, status = succeeded6973lb # [ 198.173859] niks3-server[1100]: 2026/09/22 22:25:41 INFO Received uploads request method=POST path=/api/pending_closures6974worker1 # [ 198.083174] nix-grpc-daemon[1714]: time=2026-09-22T22:25:41.662Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6975worker1 # [ 198.084819] nix-grpc-daemon[1714]: time=2026-09-22T22:25:41.662Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6976lb # [ 198.211778] niks3-server[1100]: 2026/09/22 22:25:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign6977worker1 # [ 198.118871] nix-grpc-daemon[1714]: time=2026-09-22T22:25:41.699Z level=INFO msg="Uploading 1 narinfos"6978lb # [ 198.226804] niks3-server[1100]: 2026/09/22 22:25:41 INFO Signed narinfos id=83 count=16979lb # [ 198.234320] niks3-server[1100]: 2026/09/22 22:25:41 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6980lb # [ 198.243432] niks3-server[1100]: 2026/09/22 22:25:41 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6981lb # [ 198.250635] niks3-server[1100]: 2026/09/22 22:25:41 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6982worker1 # [ 198.154643] nix-grpc-daemon[1714]: time=2026-09-22T22:25:41.735Z level=INFO msg="Upload complete. (274ms)"6983lb # [ 198.257178] niks3-server[1100]: 2026/09/22 22:25:41 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete6984lb # [ 198.261339] niks3-server[1100]: 2026/09/22 22:25:41 INFO Completed upload id=836985lb # [ 198.264637] niks3-server[1100]: 2026/09/22 22:25:41 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6986worker1 # [ 198.165052] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=17 outputs=16987worker1 # [ 198.183375] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:41Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16988worker1 # [ 198.188626] nix-daemon[834]: reaped child process 2185, status = succeeded6989worker1 # [ 198.210299] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394426990worker1 # [ 198.222465] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394426991worker1 # [ 198.234015] nix-grpc-daemon[1714]: time=2026-09-22T22:25:41.814Z level=INFO msg="All 2 paths already cached"6992worker1 # [ 198.242167] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394426993worker1 # [ 198.252453] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6994worker1 # [ 198.387007] nix-daemon[834]: accepted connection from pid 2210, user nix-grpc-daemon (trusted)6995worker1 # [ 198.407639] nix-daemon[834]: reaped child process 2213, status = succeeded6996lb # [ 198.513067] niks3-server[1100]: 2026/09/22 22:25:42 INFO Received uploads request method=POST path=/api/pending_closures6997worker1 # [ 198.419831] nix-grpc-daemon[1714]: time=2026-09-22T22:25:41.999Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6998worker1 # [ 198.421507] nix-grpc-daemon[1714]: time=2026-09-22T22:25:41.999Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6999lb # [ 198.541690] niks3-server[1100]: 2026/09/22 22:25:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign7000worker1 # [ 198.446233] nix-grpc-daemon[1714]: time=2026-09-22T22:25:42.026Z level=INFO msg="Uploading 1 narinfos"7001lb # [ 198.554733] niks3-server[1100]: 2026/09/22 22:25:42 INFO Signed narinfos id=84 count=17002lb # [ 198.565214] niks3-server[1100]: 2026/09/22 22:25:42 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls7003lb # [ 198.574480] niks3-server[1100]: 2026/09/22 22:25:42 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst7004worker1 # [ 198.487616] nix-grpc-daemon[1714]: time=2026-09-22T22:25:42.067Z level=INFO msg="Upload complete. (223ms)"7005lb # [ 198.591906] niks3-server[1100]: 2026/09/22 22:25:42 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete7006lb # [ 198.597912] niks3-server[1100]: 2026/09/22 22:25:42 INFO Completed upload id=847007lb # [ 198.602242] niks3-server[1100]: 2026/09/22 22:25:42 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo7008worker1 # [ 198.496325] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=7527009worker1 # [ 198.510375] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394427010worker1 # [ 198.517105] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)7011worker1 # [ 198.522511] nix-daemon[834]: reaped child process 2208, status = succeeded7012worker1 # [ 198.533096] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)7013worker1 # [ 199.757872] nix-daemon[834]: reaped child process 2217, status = succeeded7014worker1 # [ 199.854562] nix-daemon[834]: accepted connection from pid 2233, user nix-grpc-daemon (trusted)7015worker1 # [ 199.869794] nix-daemon[834]: reaped child process 2236, status = succeeded7016lb # [ 199.979887] niks3-server[1100]: 2026/09/22 22:25:43 INFO Received uploads request method=POST path=/api/pending_closures7017worker1 # [ 199.888367] nix-grpc-daemon[1714]: time=2026-09-22T22:25:43.467Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7018worker1 # [ 199.889816] nix-grpc-daemon[1714]: time=2026-09-22T22:25:43.467Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"7019worker1 # [ 199.926879] nix-grpc-daemon[1714]: time=2026-09-22T22:25:43.507Z level=INFO msg="Uploading 1 narinfos"7020lb # [ 200.021259] niks3-server[1100]: 2026/09/22 22:25:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign7021lb # [ 200.032214] niks3-server[1100]: 2026/09/22 22:25:43 INFO Signed narinfos id=85 count=17022lb # [ 200.042342] niks3-server[1100]: 2026/09/22 22:25:43 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv7023lb # [ 200.052929] niks3-server[1100]: 2026/09/22 22:25:43 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst7024lb # [ 200.058885] niks3-server[1100]: 2026/09/22 22:25:43 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls7025worker1 # [ 199.963954] nix-grpc-daemon[1714]: time=2026-09-22T22:25:43.544Z level=INFO msg="Upload complete. (218ms)"7026lb # [ 200.066710] niks3-server[1100]: 2026/09/22 22:25:43 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete7027lb # [ 200.070231] niks3-server[1100]: 2026/09/22 22:25:43 INFO Completed upload id=857028lb # [ 200.074334] niks3-server[1100]: 2026/09/22 22:25:43 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo7029worker1 # [ 199.976792] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=18 outputs=17030worker1 # [ 199.990462] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:43Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=17031worker1 # [ 199.995070] nix-daemon[834]: reaped child process 2215, status = succeeded7032worker1 # [ 200.018029] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394427033worker1 # [ 200.029514] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:394427034worker1 # [ 200.038535] nix-grpc-daemon[1714]: time=2026-09-22T22:25:43.618Z level=INFO msg="All 2 paths already cached"7035worker1 # [ 200.044480] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:394427036worker1 # [ 200.050685] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)7037worker1 # [ 200.171774] nix-daemon[834]: accepted connection from pid 2240, user nix-grpc-daemon (trusted)7038worker1 # [ 200.187689] nix-daemon[834]: reaped child process 2243, status = succeeded7039lb # [ 200.297466] niks3-server[1100]: 2026/09/22 22:25:43 INFO Received uploads request method=POST path=/api/pending_closures7040worker1 # [ 200.204768] nix-grpc-daemon[1714]: time=2026-09-22T22:25:43.784Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7041worker1 # [ 200.206225] nix-grpc-daemon[1714]: time=2026-09-22T22:25:43.784Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"7042lb # [ 200.327781] niks3-server[1100]: 2026/09/22 22:25:43 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls7043worker1 # [ 200.235792] nix-grpc-daemon[1714]: time=2026-09-22T22:25:43.816Z level=INFO msg="Uploading 1 narinfos"7044lb # [ 200.341229] niks3-server[1100]: 2026/09/22 22:25:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/86/sign7045lb # [ 200.352089] niks3-server[1100]: 2026/09/22 22:25:43 INFO Signed narinfos id=86 count=17046lb # [ 200.360949] niks3-server[1100]: 2026/09/22 22:25:43 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst7047worker1 # [ 200.264663] nix-grpc-daemon[1714]: time=2026-09-22T22:25:43.845Z level=INFO msg="Upload complete. (206ms)"7048lb # [ 200.369945] niks3-server[1100]: 2026/09/22 22:25:43 INFO Received complete upload request method=POST path=/api/pending_closures/86/complete7049lb # [ 200.374400] niks3-server[1100]: 2026/09/22 22:25:43 INFO Completed upload id=867050worker1 # [ 200.272205] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=0 paths=1 nar_bytes_in=7527051lb # [ 200.377484] niks3-server[1100]: 2026/09/22 22:25:43 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo7052worker1 # [ 200.282006] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:394427053worker1 # [ 200.287077] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)7054worker1 # [ 200.291535] nix-daemon[834]: reaped child process 2238, status = succeeded7055worker1 # [ 200.301083] nix-daemon[834]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)7056worker1 # [ 201.396247] nix-daemon[834]: reaped child process 2247, status = succeeded7057worker1 # [ 201.485419] nix-daemon[834]: accepted connection from pid 2263, user nix-grpc-daemon (trusted)7058worker1 # [ 201.502025] nix-daemon[834]: reaped child process 2266, status = succeeded7059lb # [ 201.611966] niks3-server[1100]: 2026/09/22 22:25:45 INFO Received uploads request method=POST path=/api/pending_closures7060worker1 # [ 201.521464] nix-grpc-daemon[1714]: time=2026-09-22T22:25:45.100Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7061worker1 # [ 201.523047] nix-grpc-daemon[1714]: time=2026-09-22T22:25:45.100Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"7062lb # [ 201.648534] niks3-server[1100]: 2026/09/22 22:25:45 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv7063lb # [ 201.664217] niks3-server[1100]: 2026/09/22 22:25:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/87/sign7064worker1 # [ 201.568317] nix-grpc-daemon[1714]: time=2026-09-22T22:25:45.148Z level=INFO msg="Uploading 1 narinfos"7065lb # [ 201.675233] niks3-server[1100]: 2026/09/22 22:25:45 INFO Signed narinfos id=87 count=17066lb # [ 201.680201] niks3-server[1100]: 2026/09/22 22:25:45 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst7067lb # [ 201.690149] niks3-server[1100]: 2026/09/22 22:25:45 INFO Received complete upload request method=POST path=/api/pending_closures/87/complete7068lb # [ 201.697046] niks3-server[1100]: 2026/09/22 22:25:45 INFO Completed upload id=877069worker1 # [ 201.594252] nix-grpc-daemon[1714]: time=2026-09-22T22:25:45.174Z level=INFO msg="Upload complete. (282ms)"7070lb # [ 201.699637] niks3-server[1100]: 2026/09/22 22:25:45 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls7071lb # [ 201.704158] niks3-server[1100]: 2026/09/22 22:25:45 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo7072worker1 # [ 201.607378] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39442 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=19 outputs=17073worker1 # [ 201.626045] nix-daemon[834]: reaped child process 2245, status = succeeded7074client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 13.68 seconds)7075worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7076worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)7077client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]'7078client # [ 201.840961] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features "[\"gpu\"]".7079client # Running as unit: gpu.service; invocation ID: ffdac92dd31d4d9691d778c03b93335a7080client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.08 seconds)7081lb: must succeed: curl -sf localhost:9901/clusters7082lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)7083lb: must succeed: curl -sf localhost:9901/clusters7084lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7085worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7086client # [ 202.028958] nix[1635]: don't know how to build these paths:7087client # [ 202.029956] nix[1635]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv7088worker1 # [ 201.988725] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:394427089worker2 # [ 201.993266] nix-grpc-daemon[1837]: ts=2026-09-22T22:25:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:372547090worker1 # [ 202.025353] nix-grpc-daemon[1637]: ts=2026-09-22T22:25:45Z level=debug event=want client=7 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=07091client # [ 202.065033] nix[1635]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}, waiting up to 30s for a worker7092worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)7093lb: must succeed: curl -sf localhost:9901/clusters7094lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)7095lb: must succeed: curl -sf localhost:9901/clusters7096lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7097worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7098worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)7099client: waiting for success: systemctl show -p Result gpu | grep -q exit-code7100lb # [ 209.734410] envoy[906]: conn peer=[2001:db8:1::1]:59946 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27093 tx=12299 ms=134167101client # [ 232.070650] nix[1635]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}7102client # [ 232.086611] nix[1635]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed7103client # [ 232.141870] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE7104client # [ 232.146605] systemd[1]: gpu.service: Failed with result 'exit-code'.7105client # [ 232.148756] systemd[1]: gpu.service: Consumed 184ms CPU time over 30.305s wall clock time, 37.4M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic.7106client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.03 seconds)7107client: must succeed: journalctl -u gpu -o cat7108client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)7109lb: must succeed: curl -sf localhost:9901/clusters7110lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)7111lb: must succeed: curl -sf localhost:9901/clusters7112lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7113worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7114worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)7115(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 44.47 seconds)7116subtest: low disk drains a worker and builds go to the other7117worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill7118worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.16 seconds)7119worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'7120worker1 # [ 234.163419] nix-grpc-daemon[1637]: ts=2026-09-22T22:26:17Z level=info event=unhealthy reason=min_free7121worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds)7122client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&27123client # don't know how to build these paths:7124client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7125worker1 # [ 234.952476] nix-grpc-daemon[1637]: ts=2026-09-22T22:26:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:394427126worker2 # [ 234.957354] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:372547127worker1 # [ 234.988964] nix-grpc-daemon[1637]: ts=2026-09-22T22:26:18Z level=debug event=want client=8 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=07128worker1 # [ 234.995525] nix-grpc-daemon[1637]: ts=2026-09-22T22:26:18Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=17129worker2 # [ 235.030863] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372547130worker2 # [ 235.046699] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:372547131client # copying 1 paths to 'lb:50051'...7132client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...7133worker2 # [ 235.063529] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:372547134worker2 # [ 235.079034] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)7135worker2 # [ 235.239908] nix-daemon[856]: accepted connection from pid 1997, user nix-grpc-daemon (trusted)7136worker2 # [ 235.257541] nix-daemon[856]: reaped child process 2000, status = succeeded7137lb # [ 235.373436] niks3-server[1100]: 2026/09/22 22:26:18 INFO Received uploads request method=POST path=/api/pending_closures7138worker2 # [ 235.284739] nix-grpc-daemon[1902]: time=2026-09-22T22:26:18.846Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7139worker2 # [ 235.286400] nix-grpc-daemon[1902]: time=2026-09-22T22:26:18.846Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"7140lb # [ 235.410678] niks3-server[1100]: 2026/09/22 22:26:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/88/sign7141worker2 # [ 235.310189] nix-grpc-daemon[1902]: time=2026-09-22T22:26:18.873Z level=INFO msg="Uploading 1 narinfos"7142lb # [ 235.418003] niks3-server[1100]: 2026/09/22 22:26:18 INFO Signed narinfos id=88 count=17143lb # [ 235.431489] niks3-server[1100]: 2026/09/22 22:26:18 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst7144lb # [ 235.442428] niks3-server[1100]: 2026/09/22 22:26:19 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls7145worker2 # [ 235.341019] nix-grpc-daemon[1902]: time=2026-09-22T22:26:18.904Z level=INFO msg="Upload complete. (244ms)"7146lb # [ 235.448271] niks3-server[1100]: 2026/09/22 22:26:19 INFO Received complete upload request method=POST path=/api/pending_closures/88/complete7147lb # [ 235.455707] niks3-server[1100]: 2026/09/22 22:26:19 INFO Completed upload id=887148lb # [ 235.458197] niks3-server[1100]: 2026/09/22 22:26:19 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo7149worker2 # [ 235.352617] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37254 duration_s=0 paths=1 nar_bytes_in=5127150worker2 # [ 235.367601] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372547151worker2 # [ 235.373495] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)7152worker2 # [ 235.378571] nix-daemon[856]: reaped child process 1995, status = succeeded7153client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...7154client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7155worker2 # [ 235.391581] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)7156client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds7157client # farm-a> LOG-farm-a-drain7158worker2 # [ 237.059805] nix-daemon[856]: reaped child process 2004, status = succeeded7159worker2 # [ 237.176800] nix-daemon[856]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7160worker2 # [ 237.196159] nix-daemon[856]: reaped child process 2023, status = succeeded7161lb # [ 237.306161] niks3-server[1100]: 2026/09/22 22:26:20 INFO Received uploads request method=POST path=/api/pending_closures7162worker2 # [ 237.211379] nix-grpc-daemon[1902]: time=2026-09-22T22:26:20.772Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7163worker2 # [ 237.213406] nix-grpc-daemon[1902]: time=2026-09-22T22:26:20.772Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"7164lb # [ 237.337768] niks3-server[1100]: 2026/09/22 22:26:20 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7165lb # [ 237.357020] niks3-server[1100]: 2026/09/22 22:26:20 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls7166worker2 # [ 237.260285] nix-grpc-daemon[1902]: time=2026-09-22T22:26:20.823Z level=INFO msg="Uploading 1 narinfos"7167lb # [ 237.367584] niks3-server[1100]: 2026/09/22 22:26:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/89/sign7168lb # [ 237.378177] niks3-server[1100]: 2026/09/22 22:26:20 INFO Signed narinfos id=89 count=17169lb # [ 237.383978] niks3-server[1100]: 2026/09/22 22:26:20 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst7170worker2 # [ 237.290722] nix-grpc-daemon[1902]: time=2026-09-22T22:26:20.853Z level=INFO msg="Upload complete. (288ms)"7171lb # [ 237.397532] niks3-server[1100]: 2026/09/22 22:26:20 INFO Received complete upload request method=POST path=/api/pending_closures/89/complete7172lb # [ 237.402593] niks3-server[1100]: 2026/09/22 22:26:20 INFO Completed upload id=897173lb # [ 237.407045] niks3-server[1100]: 2026/09/22 22:26:20 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo7174worker1 # [ 237.317377] nix-grpc-daemon[1637]: ts=2026-09-22T22:26:20Z level=debug event=want client=8 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=07175worker2 # [ 237.305203] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37254 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=20 outputs=17176worker1 # [ 237.325047] nix-grpc-daemon[1637]: ts=2026-09-22T22:26:20Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=17177worker2 # [ 237.324570] nix-daemon[856]: reaped child process 2002, status = succeeded7178worker2 # [ 237.366807] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372547179worker2 # [ 237.382102] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:372547180worker2 # [ 237.396436] nix-grpc-daemon[1902]: time=2026-09-22T22:26:20.959Z level=INFO msg="All 1 paths already cached"7181client # copying 1 paths to 'lb:50051'...7182client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...7183worker2 # [ 237.408101] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:372547184worker2 # [ 237.421722] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)7185worker2 # [ 237.577391] nix-daemon[856]: accepted connection from pid 2027, user nix-grpc-daemon (trusted)7186worker2 # [ 237.595541] nix-daemon[856]: reaped child process 2030, status = succeeded7187lb # [ 237.708537] niks3-server[1100]: 2026/09/22 22:26:21 INFO Received uploads request method=POST path=/api/pending_closures7188worker2 # [ 237.612969] nix-grpc-daemon[1902]: time=2026-09-22T22:26:21.175Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7189worker2 # [ 237.615083] nix-grpc-daemon[1902]: time=2026-09-22T22:26:21.175Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"7190worker2 # [ 237.633222] nix-grpc-daemon[1902]: time=2026-09-22T22:26:21.196Z level=INFO msg="Uploading 1 narinfos"7191lb # [ 237.739051] niks3-server[1100]: 2026/09/22 22:26:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/90/sign7192lb # [ 237.753476] niks3-server[1100]: 2026/09/22 22:26:21 INFO Signed narinfos id=90 count=17193lb # [ 237.762276] niks3-server[1100]: 2026/09/22 22:26:21 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls7194worker2 # [ 237.672366] nix-grpc-daemon[1902]: time=2026-09-22T22:26:21.235Z level=INFO msg="Upload complete. (234ms)"7195lb # [ 237.771000] niks3-server[1100]: 2026/09/22 22:26:21 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst7196worker2 # [ 237.684182] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37254 duration_s=0 paths=1 nar_bytes_in=6327197lb # [ 237.785613] niks3-server[1100]: 2026/09/22 22:26:21 INFO Received complete upload request method=POST path=/api/pending_closures/90/complete7198lb # [ 237.797702] niks3-server[1100]: 2026/09/22 22:26:21 INFO Completed upload id=907199lb # [ 237.800784] niks3-server[1100]: 2026/09/22 22:26:21 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo7200worker2 # [ 237.699459] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372547201worker2 # [ 237.706828] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)7202worker2 # [ 237.711944] nix-daemon[856]: reaped child process 2025, status = succeeded7203client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...7204client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7205worker2 # [ 237.727327] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)7206client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds7207client # farm-b> LOG-farm-b-drain7208worker2 # [ 238.996769] nix-daemon[856]: reaped child process 2034, status = succeeded7209worker2 # [ 239.056428] nix-daemon[856]: accepted connection from pid 2050, user nix-grpc-daemon (trusted)7210worker2 # [ 239.074877] nix-daemon[856]: reaped child process 2053, status = succeeded7211lb # [ 239.185232] niks3-server[1100]: 2026/09/22 22:26:22 INFO Received uploads request method=POST path=/api/pending_closures7212worker2 # [ 239.090778] nix-grpc-daemon[1902]: time=2026-09-22T22:26:22.651Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7213worker2 # [ 239.092986] nix-grpc-daemon[1902]: time=2026-09-22T22:26:22.651Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"7214lb # [ 239.228813] niks3-server[1100]: 2026/09/22 22:26:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/91/sign7215worker2 # [ 239.130889] nix-grpc-daemon[1902]: time=2026-09-22T22:26:22.693Z level=INFO msg="Uploading 1 narinfos"7216lb # [ 239.242512] niks3-server[1100]: 2026/09/22 22:26:22 INFO Signed narinfos id=91 count=17217lb # [ 239.250781] niks3-server[1100]: 2026/09/22 22:26:22 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst7218lb # [ 239.262827] niks3-server[1100]: 2026/09/22 22:26:22 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls7219worker2 # [ 239.163131] nix-grpc-daemon[1902]: time=2026-09-22T22:26:22.726Z level=INFO msg="Upload complete. (224ms)"7220lb # [ 239.271767] niks3-server[1100]: 2026/09/22 22:26:22 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7221lb # [ 239.277463] niks3-server[1100]: 2026/09/22 22:26:22 INFO Received complete upload request method=POST path=/api/pending_closures/91/complete7222lb # [ 239.282312] niks3-server[1100]: 2026/09/22 22:26:22 INFO Completed upload id=917223worker2 # [ 239.173019] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37254 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=21 outputs=17224lb # [ 239.285109] niks3-server[1100]: 2026/09/22 22:26:22 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo7225worker2 # [ 239.191352] nix-daemon[856]: reaped child process 2032, status = succeeded7226worker1 # [ 239.191948] nix-grpc-daemon[1637]: ts=2026-09-22T22:26:22Z level=debug event=want client=8 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=07227worker1 # [ 239.192728] nix-grpc-daemon[1637]: ts=2026-09-22T22:26:22Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=17228worker2 # [ 239.234318] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372547229worker2 # [ 239.250413] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:372547230worker2 # [ 239.264746] nix-grpc-daemon[1902]: time=2026-09-22T22:26:22.827Z level=INFO msg="All 2 paths already cached"7231client # copying 1 paths to 'lb:50051'...7232worker2 # [ 239.275154] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:372547233client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...7234worker2 # [ 239.287774] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)7235worker2 # [ 239.434549] nix-daemon[856]: accepted connection from pid 2057, user nix-grpc-daemon (trusted)7236worker2 # [ 239.453583] nix-daemon[856]: reaped child process 2060, status = succeeded7237lb # [ 239.563874] niks3-server[1100]: 2026/09/22 22:26:23 INFO Received uploads request method=POST path=/api/pending_closures7238worker2 # [ 239.467403] nix-grpc-daemon[1902]: time=2026-09-22T22:26:23.030Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7239worker2 # [ 239.469266] nix-grpc-daemon[1902]: time=2026-09-22T22:26:23.030Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"7240worker2 # [ 239.499254] nix-grpc-daemon[1902]: time=2026-09-22T22:26:23.062Z level=INFO msg="Uploading 1 narinfos"7241lb # [ 239.595182] niks3-server[1100]: 2026/09/22 22:26:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/92/sign7242lb # [ 239.611850] niks3-server[1100]: 2026/09/22 22:26:23 INFO Signed narinfos id=92 count=17243lb # [ 239.620224] niks3-server[1100]: 2026/09/22 22:26:23 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls7244lb # [ 239.633612] niks3-server[1100]: 2026/09/22 22:26:23 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst7245worker2 # [ 239.535400] nix-grpc-daemon[1902]: time=2026-09-22T22:26:23.098Z level=INFO msg="Upload complete. (231ms)"7246lb # [ 239.643634] niks3-server[1100]: 2026/09/22 22:26:23 INFO Received complete upload request method=POST path=/api/pending_closures/92/complete7247lb # [ 239.649792] niks3-server[1100]: 2026/09/22 22:26:23 INFO Completed upload id=927248lb # [ 239.654253] niks3-server[1100]: 2026/09/22 22:26:23 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo7249worker2 # [ 239.548512] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37254 duration_s=0 paths=1 nar_bytes_in=7607250worker2 # [ 239.561079] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372547251worker2 # [ 239.570421] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)7252worker2 # [ 239.576344] nix-daemon[856]: reaped child process 2055, status = succeeded7253client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...7254worker2 # [ 239.588880] nix-daemon[856]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)7255client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7256lb # [ 239.744561] envoy[906]: conn peer=[2001:db8:1::1]:59924 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=579 ms=300757257client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds7258client # farm-top> LOG-farm-top-drain7259worker2 # [ 240.868451] nix-daemon[856]: reaped child process 2064, status = succeeded7260worker2 # [ 240.960982] nix-daemon[856]: accepted connection from pid 2080, user nix-grpc-daemon (trusted)7261worker2 # [ 240.978257] nix-daemon[856]: reaped child process 2083, status = succeeded7262lb # [ 241.093246] niks3-server[1100]: 2026/09/22 22:26:24 INFO Received uploads request method=POST path=/api/pending_closures7263worker2 # [ 241.000446] nix-grpc-daemon[1902]: time=2026-09-22T22:26:24.559Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7264worker2 # [ 241.002206] nix-grpc-daemon[1902]: time=2026-09-22T22:26:24.559Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"7265lb # [ 241.138149] niks3-server[1100]: 2026/09/22 22:26:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/93/sign7266worker2 # [ 241.044289] nix-grpc-daemon[1902]: time=2026-09-22T22:26:24.607Z level=INFO msg="Uploading 1 narinfos"7267lb # [ 241.155629] niks3-server[1100]: 2026/09/22 22:26:24 INFO Signed narinfos id=93 count=17268lb # [ 241.162703] niks3-server[1100]: 2026/09/22 22:26:24 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls7269lb # [ 241.170467] niks3-server[1100]: 2026/09/22 22:26:24 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7270worker2 # [ 241.072442] nix-grpc-daemon[1902]: time=2026-09-22T22:26:24.635Z level=INFO msg="Upload complete. (273ms)"7271lb # [ 241.180062] niks3-server[1100]: 2026/09/22 22:26:24 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst7272lb # [ 241.183874] niks3-server[1100]: 2026/09/22 22:26:24 INFO Received complete upload request method=POST path=/api/pending_closures/93/complete7273lb # [ 241.188992] niks3-server[1100]: 2026/09/22 22:26:24 INFO Completed upload id=937274lb # [ 241.192084] niks3-server[1100]: 2026/09/22 22:26:24 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo7275worker2 # [ 241.088272] nix-grpc-daemon[1837]: ts=2026-09-22T22:26:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37254 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=22 outputs=17276worker2 # [ 241.103104] nix-daemon[856]: reaped child process 2062, status = succeeded7277client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2, in 6.41 seconds)7278client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath7279client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath, in 0.18 seconds)7280worker1: must succeed: rm /nix/.rw-store/fill7281worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)7282worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7283worker1 # [ 242.168456] nix-grpc-daemon[1637]: ts=2026-09-22T22:26:25Z level=info event=healthy reason=min_free7284worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)7285(finished: subtest: low disk drains a worker and builds go to the other, in 10.20 seconds)7286(finished: run the VM test script, in 243.61 seconds)7287test script finished in 243.86s7288cleanup7289kill QemuMachine (pid 49)7290client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7291client # [2026-09-22T22:26:26Z INFO virtiofsd] Client disconnected, shutting down7292client # [2026-09-22T22:26:26Z INFO virtiofsd] Client disconnected, shutting down7293client # [2026-09-22T22:26:26Z INFO virtiofsd] Client disconnected, shutting down7294kill QemuMachine (pid 50)7295lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7296lb # [2026-09-22T22:26:27Z INFO virtiofsd] Client disconnected, shutting down7297lb # [2026-09-22T22:26:27Z INFO virtiofsd] Client disconnected, shutting down7298lb # [2026-09-22T22:26:27Z INFO virtiofsd] Client disconnected, shutting down7299kill QemuMachine (pid 51)7300worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7301worker1 # [2026-09-22T22:26:27Z INFO virtiofsd] Client disconnected, shutting down7302worker1 # [2026-09-22T22:26:27Z INFO virtiofsd] Client disconnected, shutting down7303worker1 # [2026-09-22T22:26:27Z INFO virtiofsd] Client disconnected, shutting down7304kill QemuMachine (pid 52)7305worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7306worker2 # [2026-09-22T22:26:27Z INFO virtiofsd] Client disconnected, shutting down7307worker2 # [2026-09-22T22:26:27Z INFO virtiofsd] Client disconnected, shutting down7308worker2 # [2026-09-22T22:26:27Z INFO virtiofsd] Client disconnected, shutting down7309(finished: cleanup, in 1.18 seconds)7310additionally exposed symbols:7311 client, lb, worker1, worker2,7312 vlan1,7313 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh