vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #308
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker1 # Formatting '/build/vm-state-worker1/tmp.ARmSj7t1Jz', fmt=raw size=107374182414worker1 # mke2fs 1.47.4 (6-Mar-2025)15worker1 # Discarding device blocks: 0/262144 done16worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes17worker1 # Filesystem UUID: afe99b84-a84f-42bc-9ddd-909458e9ae3218worker1 # Superblock backups stored on blocks:19worker1 # 32768, 98304, 163840, 22937620worker1 # 21worker1 # Allocating group tables: 0/8 done22worker1 # Writing inode tables: 0/8 done23worker1 # Creating journal (8192 blocks): done24worker1 # Writing superblocks and filesystem accounting information: 0/8 done25worker1 # 26worker1 # Virtualisation disk image created.27worker1: QEMU running (pid 53)28client: QEMU running (pid 47)29client # Disk image does not exist, creating the virtualisation disk image...30client # Formatting '/build/vm-state-client/tmp.6QCu5G3TkZ', fmt=raw size=107374182431client # mke2fs 1.47.4 (6-Mar-2025)32client # Discarding device blocks: 0/262144 done33client # Creating filesystem with 262144 4k blocks and 65536 inodes34client # Filesystem UUID: f96b7ead-f234-47b7-b7fb-9d2cc885e30f35client # Superblock backups stored on blocks:36client # 32768, 98304, 163840, 22937637client # 38client # Allocating group tables: 0/8 done39client # Writing inode tables: 0/8 done40client # Creating journal (8192 blocks): done41client # Writing superblocks and filesystem accounting information: 0/8 done42client # 43client # Virtualisation disk image created.44worker2 # Disk image does not exist, creating the virtualisation disk image...45worker2 # Formatting '/build/vm-state-worker2/tmp.G45nRj1lIf', fmt=raw size=107374182446worker2 # mke2fs 1.47.4 (6-Mar-2025)47worker2 # Discarding device blocks: 0/262144 done48worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes49worker2 # Filesystem UUID: 9061be1e-fb1b-4754-893c-0822efb635be50worker2 # Superblock backups stored on blocks:51worker2 # 32768, 98304, 163840, 22937652worker2 # 53worker2 # Allocating group tables: 0/8 done54worker2 # Writing inode tables: 0/8 done55worker2 # Creating journal (8192 blocks): done56worker2 # Writing superblocks and filesystem accounting information: 0/8 done57worker2 # 58worker2 # Virtualisation disk image created.59worker2: QEMU running (pid 54)60worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]61worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202662worker2 # [ 0.000000] KASLR enabled63worker2 # [ 0.000000] random: crng init done64worker2 # [ 0.000000] Machine model: linux,dummy-virt65worker2 # [ 0.000000] efi: UEFI not found.66worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT67worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]68worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]69worker2 # [ 0.000000] Zone ranges:70worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]71worker2 # [ 0.000000] DMA32 empty72worker2 # [ 0.000000] Normal empty73worker2 # [ 0.000000] Device empty74worker2 # [ 0.000000] Movable zone start for each node75worker2 # [ 0.000000] Early memory node ranges76worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]77worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]78worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000079worker2 # [ 0.000000] psci: probing for conduit method from DT.80worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.81worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs82worker2 # [ 0.000000] psci: Trusted OS migration not required83worker2 # [ 0.000000] psci: SMC Calling Convention v1.184worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)85worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u31129686worker2 # [ 0.000000] Detected PIPT I-cache on CPU087worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)88worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface89worker2 # [ 0.000000] CPU features: detected: Spectre-v490worker2 # [ 0.000000] CPU features: detected: Spectre-BHB91worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3892worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2393worker2 # [ 0.000000] alternatives: applying boot alternatives94worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/yk0x9y998qpkbl391cyn802x68ppiqhr-nixos-system-worker2-test/init regInfo=/nix/store/3ijkfcgsn4icm37g1z5bajfh5yln2vbw-closure-info/registration console=ttyAMA0,115200n8 console=tty095worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/3ijkfcgsn4icm37g1z5bajfh5yln2vbw-closure-info/registration", will be passed to user space.96worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes97worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)98worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)99worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB100worker2 # [ 0.000000] software IO TLB: area num 1.101worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB102worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)103worker2 # [ 0.000000] Fallback order for Node 0: 0104worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216105worker2 # [ 0.000000] Policy zone: DMA106worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off107worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1108worker2 # [ 0.000000] allocated 3145728 bytes of page_ext109worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages110worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups111worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.112worker2 # [ 0.000000] rcu: RCU event tracing is enabled.113worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.114worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.115worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.116worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.117worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.118worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1119worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.120worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.121worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.122worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0123worker2 # [ 0.000000] GICv3: 256 SPIs implemented124worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented125worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq126worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI127worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0128worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000129worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]130worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)131worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)132worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000133worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000134worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.135worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns136worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).137worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns138worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns139worker2 # [ 0.000049] arm-pv: using stolen time PV140worker2 # [ 0.000839] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)141worker2 # [ 0.001074] Console: colour dummy device 80x25142worker2 # [ 0.001083] printk: legacy console [tty0] enabled143worker2 # [ 0.001292] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)144worker2 # [ 0.001299] pid_max: default: 32768 minimum: 301145worker2 # [ 0.001385] LSM: initializing lsm=capability,landlock,yama,bpf,ima146worker2 # [ 0.001652] landlock: Up and running.147worker2 # [ 0.001655] Yama: becoming mindful.148worker2 # [ 0.002615] LSM support for eBPF active149worker2 # [ 0.002818] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)150worker2 # [ 0.002852] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)151worker2 # [ 0.004233] cacheinfo: Unable to detect cache hierarchy for CPU 0152worker2 # [ 0.005507] rcu: Hierarchical SRCU implementation.153worker2 # [ 0.005514] rcu: Max phase no-delay instances is 1000.154worker2 # [ 0.006940] fsl-mc MSI: its@8080000 domain created155worker2 # [ 0.007058] EFI services will not be available.156worker2 # [ 0.007141] smp: Bringing up secondary CPUs ...157worker2 # [ 0.007152] smp: Brought up 1 node, 1 CPU158worker2 # [ 0.007155] SMP: Total of 1 processors activated.159worker2 # [ 0.007161] CPU: All CPU(s) started at EL1160worker2 # [ 0.007174] CPU features: detected: Branch Target Identification161worker2 # [ 0.007179] CPU features: detected: ARMv8.4 Translation Table Level162worker2 # [ 0.007182] CPU features: detected: Instruction cache invalidation not required for I/D coherence163worker2 # [ 0.007185] CPU features: detected: Data cache clean to the PoU not required for I/D coherence164worker2 # [ 0.007189] CPU features: detected: Common not Private translations165worker2 # [ 0.007192] CPU features: detected: CRC32 instructions166worker2 # [ 0.007195] CPU features: detected: Data cache clean to Point of Deep Persistence167worker2 # [ 0.007205] CPU features: detected: Data cache clean to Point of Persistence168worker2 # [ 0.007209] CPU features: detected: Data independent timing control (DIT)169worker2 # [ 0.007212] CPU features: detected: E0PD170worker2 # [ 0.007214] CPU features: detected: Enhanced Counter Virtualization171worker2 # [ 0.007217] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)172worker2 # [ 0.007221] CPU features: detected: Enhanced Virtualization Traps173worker2 # [ 0.007224] CPU features: detected: Fine Grained Traps174worker2 # [ 0.007228] CPU features: detected: Generic authentication (architected QARMA5 algorithm)175worker2 # [ 0.007233] CPU features: detected: RCpc load-acquire (LDAPR)176worker2 # [ 0.007236] CPU features: detected: LSE atomic instructions177worker2 # [ 0.007240] CPU features: detected: Privileged Access Never178worker2 # [ 0.007242] CPU features: detected: PMUv3179worker2 # [ 0.007245] CPU features: detected: RAS Extension Support180worker2 # [ 0.007248] CPU features: detected: RASv1p1 Extension Support181worker2 # [ 0.007250] CPU features: detected: Random Number Generator182worker2 # [ 0.007253] CPU features: detected: Speculation barrier (SB)183worker2 # [ 0.007256] CPU features: detected: Stage-2 Force Write-Back184worker2 # [ 0.007259] CPU features: detected: TLB range maintenance instructions185worker2 # [ 0.007264] CPU features: detected: Speculative Store Bypassing Safe (SSBS)186worker2 # [ 0.007320] alternatives: applying system-wide alternatives187worker2 # [ 0.011354] CPU features: detected: BBM Level 2 without TLB conflict abort188worker2 # [ 0.011661] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)189worker2 # [ 0.013110] devtmpfs: initialized190worker2 # [ 0.015188] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)191worker2 # [ 0.015213] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).192worker2 # [ 0.015465] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL193worker2 # [ 0.015478] 0 pages in range for non-PLT usage194worker2 # [ 0.015479] 508288 pages in range for PLT usage195worker2 # [ 0.015600] pinctrl core: initialized pinctrl subsystem196worker2 # [ 0.016567] DMI not present or invalid.197worker2 # [ 0.024888] NET: Registered PF_NETLINK/PF_ROUTE protocol family198worker2 # [ 0.028010] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations199worker2 # [ 0.028232] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations200worker2 # [ 0.028462] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations201worker2 # [ 0.028503] audit: initializing netlink subsys (disabled)202worker2 # [ 0.029337] thermal_sys: Registered thermal governor 'fair_share'203worker2 # [ 0.029340] thermal_sys: Registered thermal governor 'bang_bang'204worker2 # [ 0.029345] thermal_sys: Registered thermal governor 'step_wise'205worker2 # [ 0.029350] thermal_sys: Registered thermal governor 'user_space'206worker2 # [ 0.029353] thermal_sys: Registered thermal governor 'power_allocator'207worker2 # [ 0.029388] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1208worker2 # [ 0.029400] cpuidle: using governor ladder209worker2 # [ 0.029406] cpuidle: using governor menu210worker2 # [ 0.029631] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.211worker2 # [ 0.029655] ASID allocator initialised with 65536 entries212worker2 # [ 0.031108] Serial: AMBA PL011 UART driver213worker2 # [ 0.036776] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1214worker2 # [ 0.036946] printk: console [ttyAMA0] enabled215worker2 # [ 0.180958] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages216worker2 # [ 0.180983] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page217worker2 # [ 0.180989] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages218worker2 # [ 0.180993] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page219worker2 # [ 0.180997] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages220worker2 # [ 0.181001] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page221worker2 # [ 0.181006] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages222worker2 # [ 0.181010] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page223worker2 # [ 0.188921] fbcon: Taking over console224worker2 # [ 0.188942] ACPI: Interpreter disabled.225worker2 # [ 0.197386] iommu: Default domain type: Translated226worker2 # [ 0.197400] iommu: DMA domain TLB invalidation policy: strict mode227worker2 # [ 0.199126] SCSI subsystem initialized228worker2 # [ 0.199833] usbcore: registered new interface driver usbfs229worker2 # [ 0.199921] usbcore: registered new interface driver hub230worker2 # [ 0.199946] usbcore: registered new device driver usb231worker2 # [ 0.200274] pps_core: LinuxPPS API ver. 1 registered232worker2 # [ 0.200285] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>233worker2 # [ 0.200295] PTP clock support registered234worker2 # [ 0.200362] EDAC MC: Ver: 3.0.0235worker2 # [ 0.204820] scmi_core: SCMI protocol bus registered236worker2 # [ 0.205840] FPGA manager framework237worker2 # [ 0.206873] vgaarb: loaded238worker2 # [ 0.207532] clocksource: Switched to clocksource arch_sys_counter239worker2 # [ 0.210266] VFS: Disk quotas dquot_6.6.0240worker2 # [ 0.210307] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)241worker2 # [ 0.214151] netfs: FS-Cache loaded242worker2 # [ 0.214300] pnp: PnP ACPI: disabled243worker2 # [ 0.218662] NET: Registered PF_INET protocol family244worker2 # [ 0.218979] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)245worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]246worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026247worker1 # [ 0.000000] KASLR enabled248worker1 # [ 0.000000] random: crng init done249worker1 # [ 0.000000] Machine model: linux,dummy-virt250worker1 # [ 0.000000] efi: UEFI not found.251worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT252worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]253worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]254worker1 # [ 0.000000] Zone ranges:255worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]256worker1 # [ 0.000000] DMA32 empty257worker1 # [ 0.000000] Normal empty258worker1 # [ 0.000000] Device empty259worker1 # [ 0.000000] Movable zone start for each node260worker1 # [ 0.000000] Early memory node ranges261worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]262worker2 # [ 0.255214] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)263worker2 # [ 0.255287] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)264worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]265worker2 # [ 0.255327] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)266worker2 # [ 0.255427] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)267worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000268worker1 # [ 0.000000] psci: probing for conduit method from DT.269worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.270worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs271worker1 # [ 0.000000] psci: Trusted OS migration not required272worker2 # [ 0.259987] TCP: Hash tables configured (established 16384 bind 16384)273worker2 # [ 0.260126] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)274worker2 # [ 0.260178] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)275worker2 # [ 0.260218] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)276worker2 # [ 0.260363] NET: Registered PF_UNIX/PF_LOCAL protocol family277worker2 # [ 0.260394] NET: Registered PF_XDP protocol family278worker2 # [ 0.260417] PCI: CLS 0 bytes, default 64279worker2 # [ 0.260691] Trying to unpack rootfs image as initramfs...280worker2 # [ 0.273612] kvm [1]: HYP mode not available281worker1 # [ 0.000000] psci: SMC Calling Convention v1.1282worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)283worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296284worker1 # [ 0.000000] Detected PIPT I-cache on CPU0285client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]286client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026287client # [ 0.000000] KASLR enabled288client # [ 0.000000] random: crng init done289client # [ 0.000000] Machine model: linux,dummy-virt290client # [ 0.000000] efi: UEFI not found.291client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT292client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]293client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]294client # [ 0.000000] Zone ranges:295client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]296client # [ 0.000000] DMA32 empty297client # [ 0.000000] Normal empty298client # [ 0.000000] Device empty299client # [ 0.000000] Movable zone start for each node300worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)301client # [ 0.000000] Early memory node ranges302client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]303client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]304client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000305client # [ 0.000000] psci: probing for conduit method from DT.306client # [ 0.000000] psci: PSCIv1.3 detected in firmware.307client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs308client # [ 0.000000] psci: Trusted OS migration not required309worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface310client # [ 0.000000] psci: SMC Calling Convention v1.1311worker1 # [ 0.000000] CPU features: detected: Spectre-v4312worker1 # [ 0.000000] CPU features: detected: Spectre-BHB313client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)314worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38315worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23316worker1 # [ 0.000000] alternatives: applying boot alternatives317client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296318client # [ 0.000000] Detected PIPT I-cache on CPU0319client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)320client # [ 0.000000] CPU features: detected: GICv3 CPU interface321client # [ 0.000000] CPU features: detected: Spectre-v4322client # [ 0.000000] CPU features: detected: Spectre-BHB323client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38324client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23325client # [ 0.000000] alternatives: applying boot alternatives326worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/70rxx88c5basbl4d7k22gf0jfai2y3l4-nixos-system-worker1-test/init regInfo=/nix/store/jjhqasp72vrymip3khybkq0mpf4rhq6r-closure-info/registration console=ttyAMA0,115200n8 console=tty0327worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/jjhqasp72vrymip3khybkq0mpf4rhq6r-closure-info/registration", will be passed to user space.328worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes329client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b3zzhwnbvp6q0xs4x7kdpn6lczkhjzhc-nixos-system-client-test/init regInfo=/nix/store/6raqz6mfpjbgnmcsyvxg42x0ipi2kxbd-closure-info/registration console=ttyAMA0,115200n8 console=tty0330worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)331client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/6raqz6mfpjbgnmcsyvxg42x0ipi2kxbd-closure-info/registration", will be passed to user space.332worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)333client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes334worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB335worker1 # [ 0.000000] software IO TLB: area num 1.336worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB337client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)338client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)339worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)340worker1 # [ 0.000000] Fallback order for Node 0: 0341worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216342client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB343client # [ 0.000000] software IO TLB: area num 1.344client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB345worker1 # [ 0.000000] Policy zone: DMA346worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off347worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1348worker1 # [ 0.000000] allocated 3145728 bytes of page_ext349client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)350client # [ 0.000000] Fallback order for Node 0: 0351client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216352worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages353worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups354worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.355worker1 # [ 0.000000] rcu: RCU event tracing is enabled.356worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.357worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.358worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.359worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.360worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.361worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1362worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.363worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.364client # [ 0.000000] Policy zone: DMA365client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off366client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1367client # [ 0.000000] allocated 3145728 bytes of page_ext368client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages369client # [ 0.000000] ftrace: allocated 294 pages with 4 groups370client # [ 0.000000] rcu: Hierarchical RCU implementation.371client # [ 0.000000] rcu: RCU event tracing is enabled.372client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.373client # [ 0.000000] Trampoline variant of Tasks RCU enabled.374client # [ 0.000000] Rude variant of Tasks RCU enabled.375client # [ 0.000000] Tracing variant of Tasks RCU enabled.376client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.377client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1378client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.379client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.380client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.381client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0382client # [ 0.000000] GICv3: 256 SPIs implemented383client # [ 0.000000] GICv3: 0 Extended SPIs implemented384client # [ 0.000000] Root IRQ handler: gic_handle_irq385client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI386client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0387client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000388client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]389client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)390client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)391client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000392client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000393client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.394client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns395worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.396client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).397client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns398client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns399client # [ 0.000041] arm-pv: using stolen time PV400client # [ 0.000793] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)401client # [ 0.001016] Console: colour dummy device 80x25402client # [ 0.001025] printk: legacy console [tty0] enabled403client # [ 0.001261] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)404worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0405worker1 # [ 0.000000] GICv3: 256 SPIs implemented406worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented407worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq408client # [ 0.001269] pid_max: default: 32768 minimum: 301409client # [ 0.001344] LSM: initializing lsm=capability,landlock,yama,bpf,ima410client # [ 0.001498] landlock: Up and running.411client # [ 0.001503] Yama: becoming mindful.412client # [ 0.002146] LSM support for eBPF active413worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI414worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0415worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000416worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]417worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)418worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)419worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000420worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000421worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.422worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns423worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).424worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns425worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns426worker1 # [ 0.000050] arm-pv: using stolen time PV427client # [ 0.002302] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)428client # [ 0.002340] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)429client # [ 0.003732] cacheinfo: Unable to detect cache hierarchy for CPU 0430client # [ 0.004554] rcu: Hierarchical SRCU implementation.431client # [ 0.004558] rcu: Max phase no-delay instances is 1000.432client # [ 0.005839] fsl-mc MSI: its@8080000 domain created433worker1 # [ 0.001730] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)434worker1 # [ 0.001971] Console: colour dummy device 80x25435worker1 # [ 0.001980] printk: legacy console [tty0] enabled436client # [ 0.005938] EFI services will not be available.437client # [ 0.006036] smp: Bringing up secondary CPUs ...438worker1 # [ 0.002220] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)439worker1 # [ 0.002226] pid_max: default: 32768 minimum: 301440client # [ 0.006046] smp: Brought up 1 node, 1 CPU441worker1 # [ 0.002310] LSM: initializing lsm=capability,landlock,yama,bpf,ima442worker1 # [ 0.003490] landlock: Up and running.443worker1 # [ 0.003496] Yama: becoming mindful.444worker1 # [ 0.005044] LSM support for eBPF active445client # [ 0.006049] SMP: Total of 1 processors activated.446worker1 # [ 0.005995] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)447client # [ 0.006055] CPU: All CPU(s) started at EL1448worker1 # [ 0.006603] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)449client # [ 0.006078] CPU features: detected: Branch Target Identification450worker1 # [ 0.008043] cacheinfo: Unable to detect cache hierarchy for CPU 0451worker1 # [ 0.008938] rcu: Hierarchical SRCU implementation.452worker1 # [ 0.008945] rcu: Max phase no-delay instances is 1000.453client # [ 0.006082] CPU features: detected: ARMv8.4 Translation Table Level454worker1 # [ 0.011262] fsl-mc MSI: its@8080000 domain created455worker1 # [ 0.011368] EFI services will not be available.456worker1 # [ 0.011507] smp: Bringing up secondary CPUs ...457client # [ 0.006085] CPU features: detected: Instruction cache invalidation not required for I/D coherence458worker1 # [ 0.011523] smp: Brought up 1 node, 1 CPU459client # [ 0.006089] CPU features: detected: Data cache clean to the PoU not required for I/D coherence460worker1 # [ 0.011526] SMP: Total of 1 processors activated.461client # [ 0.006093] CPU features: detected: Common not Private translations462worker1 # [ 0.011531] CPU: All CPU(s) started at EL1463client # [ 0.006096] CPU features: detected: CRC32 instructions464worker1 # [ 0.011546] CPU features: detected: Branch Target Identification465client # [ 0.006099] CPU features: detected: Data cache clean to Point of Deep Persistence466worker1 # [ 0.011552] CPU features: detected: ARMv8.4 Translation Table Level467client # [ 0.006103] CPU features: detected: Data cache clean to Point of Persistence468client # [ 0.006106] CPU features: detected: Data independent timing control (DIT)469worker1 # [ 0.011555] CPU features: detected: Instruction cache invalidation not required for I/D coherence470client # [ 0.006109] CPU features: detected: E0PD471worker1 # [ 0.011559] CPU features: detected: Data cache clean to the PoU not required for I/D coherence472worker1 # [ 0.011562] CPU features: detected: Common not Private translations473client # [ 0.006112] CPU features: detected: Enhanced Counter Virtualization474worker1 # [ 0.011566] CPU features: detected: CRC32 instructions475worker1 # [ 0.011568] CPU features: detected: Data cache clean to Point of Deep Persistence476client # [ 0.006115] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)477worker1 # [ 0.011572] CPU features: detected: Data cache clean to Point of Persistence478worker1 # [ 0.011576] CPU features: detected: Data independent timing control (DIT)479client # [ 0.006119] CPU features: detected: Enhanced Virtualization Traps480worker1 # [ 0.011579] CPU features: detected: E0PD481worker1 # [ 0.011581] CPU features: detected: Enhanced Counter Virtualization482client # [ 0.006122] CPU features: detected: Fine Grained Traps483worker1 # [ 0.011584] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)484worker1 # [ 0.011588] CPU features: detected: Enhanced Virtualization Traps485client # [ 0.006125] CPU features: detected: Generic authentication (architected QARMA5 algorithm)486worker1 # [ 0.011591] CPU features: detected: Fine Grained Traps487worker1 # [ 0.011594] CPU features: detected: Generic authentication (architected QARMA5 algorithm)488client # [ 0.006131] CPU features: detected: RCpc load-acquire (LDAPR)489worker1 # [ 0.011601] CPU features: detected: RCpc load-acquire (LDAPR)490worker1 # [ 0.011604] CPU features: detected: LSE atomic instructions491worker1 # [ 0.011607] CPU features: detected: Privileged Access Never492worker1 # [ 0.011610] CPU features: detected: PMUv3493worker1 # [ 0.011612] CPU features: detected: RAS Extension Support494worker1 # [ 0.011615] CPU features: detected: RASv1p1 Extension Support495client # [ 0.006134] CPU features: detected: LSE atomic instructions496client # [ 0.006137] CPU features: detected: Privileged Access Never497client # [ 0.006139] CPU features: detected: PMUv3498client # [ 0.006142] CPU features: detected: RAS Extension Support499client # [ 0.006145] CPU features: detected: RASv1p1 Extension Support500client # [ 0.006148] CPU features: detected: Random Number Generator501client # [ 0.006150] CPU features: detected: Speculation barrier (SB)502client # [ 0.006153] CPU features: detected: Stage-2 Force Write-Back503client # [ 0.006156] CPU features: detected: TLB range maintenance instructions504client # [ 0.006161] CPU features: detected: Speculative Store Bypassing Safe (SSBS)505client # [ 0.006206] alternatives: applying system-wide alternatives506client # [ 0.101912] CPU features: detected: BBM Level 2 without TLB conflict abort507worker1 # [ 0.011618] CPU features: detected: Random Number Generator508worker1 # [ 0.011620] CPU features: detected: Speculation barrier (SB)509client # [ 0.102226] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)510worker1 # [ 0.011623] CPU features: detected: Stage-2 Force Write-Back511worker1 # [ 0.011626] CPU features: detected: TLB range maintenance instructions512worker1 # [ 0.011631] CPU features: detected: Speculative Store Bypassing Safe (SSBS)513worker1 # [ 0.011698] alternatives: applying system-wide alternatives514worker1 # [ 0.067980] CPU features: detected: BBM Level 2 without TLB conflict abort515worker1 # [ 0.068308] Memory: 1406740K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)516worker1 # [ 0.069813] devtmpfs: initialized517worker1 # [ 0.071778] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)518worker1 # [ 0.071804] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).519worker1 # [ 0.072212] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL520worker1 # [ 0.072218] 0 pages in range for non-PLT usage521worker1 # [ 0.072219] 508288 pages in range for PLT usage522worker1 # [ 0.072340] pinctrl core: initialized pinctrl subsystem523worker1 # [ 0.073252] DMI not present or invalid.524worker1 # [ 0.076977] NET: Registered PF_NETLINK/PF_ROUTE protocol family525worker1 # [ 0.079497] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations526worker1 # [ 0.079701] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations527worker1 # [ 0.079938] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations528worker1 # [ 0.079971] audit: initializing netlink subsys (disabled)529worker1 # [ 0.080731] thermal_sys: Registered thermal governor 'fair_share'530worker1 # [ 0.080734] thermal_sys: Registered thermal governor 'bang_bang'531worker1 # [ 0.080739] thermal_sys: Registered thermal governor 'step_wise'532worker1 # [ 0.080746] thermal_sys: Registered thermal governor 'user_space'533worker1 # [ 0.080748] thermal_sys: Registered thermal governor 'power_allocator'534worker1 # [ 0.080782] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1535worker1 # [ 0.080794] cpuidle: using governor ladder536worker1 # [ 0.080800] cpuidle: using governor menu537worker1 # [ 0.082019] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.538worker1 # [ 0.082049] ASID allocator initialised with 65536 entries539worker1 # [ 0.083542] Serial: AMBA PL011 UART driver540worker1 # [ 0.129623] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1541worker1 # [ 0.129921] printk: console [ttyAMA0] enabled542client # [ 0.102891] devtmpfs: initialized543client # [ 0.106193] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)544client # [ 0.108473] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).545client # [ 0.108711] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL546client # [ 0.108717] 0 pages in range for non-PLT usage547client # [ 0.108718] 508288 pages in range for PLT usage548client # [ 0.108916] pinctrl core: initialized pinctrl subsystem549client # [ 0.109796] DMI not present or invalid.550client # [ 0.116474] NET: Registered PF_NETLINK/PF_ROUTE protocol family551worker1 # [ 0.367530] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages552worker1 # [ 0.367560] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page553worker1 # [ 0.367565] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages554worker1 # [ 0.367569] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page555worker1 # [ 0.367574] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages556worker1 # [ 0.367578] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page557client # [ 0.119540] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations558client # [ 0.119746] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations559client # [ 0.119976] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations560client # [ 0.120019] audit: initializing netlink subsys (disabled)561client # [ 0.120720] thermal_sys: Registered thermal governor 'fair_share'562client # [ 0.120723] thermal_sys: Registered thermal governor 'bang_bang'563client # [ 0.120727] thermal_sys: Registered thermal governor 'step_wise'564client # [ 0.120732] thermal_sys: Registered thermal governor 'user_space'565client # [ 0.120735] thermal_sys: Registered thermal governor 'power_allocator'566client # [ 0.120774] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1567client # [ 0.120786] cpuidle: using governor ladder568client # [ 0.120791] cpuidle: using governor menu569client # [ 0.121011] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.570client # [ 0.121031] ASID allocator initialised with 65536 entries571client # [ 0.122504] Serial: AMBA PL011 UART driver572client # [ 0.128329] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1573client # [ 0.128508] printk: console [ttyAMA0] enabled574worker1 # [ 0.367583] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages575worker1 # [ 0.367587] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page576client # [ 0.313883] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages577client # [ 0.313916] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page578client # [ 0.313923] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages579client # [ 0.313927] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page580client # [ 0.313932] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages581client # [ 0.313936] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page582client # [ 0.313941] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages583client # [ 0.313945] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page584client # [ 0.330297] fbcon: Taking over console585client # [ 0.330336] ACPI: Interpreter disabled.586client # [ 0.344959] iommu: Default domain type: Translated587client # [ 0.344992] iommu: DMA domain TLB invalidation policy: strict mode588worker1 # [ 0.420404] fbcon: Taking over console589worker1 # [ 0.420440] ACPI: Interpreter disabled.590worker1 # [ 0.427952] iommu: Default domain type: Translated591client # [ 0.347211] SCSI subsystem initialized592client # [ 0.348839] usbcore: registered new interface driver usbfs593worker1 # [ 0.427968] iommu: DMA domain TLB invalidation policy: strict mode594client # [ 0.348882] usbcore: registered new interface driver hub595client # [ 0.348905] usbcore: registered new device driver usb596client # [ 0.349250] pps_core: LinuxPPS API ver. 1 registered597worker1 # [ 0.434921] SCSI subsystem initialized598worker1 # [ 0.435644] usbcore: registered new interface driver usbfs599client # [ 0.349257] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>600client # [ 0.349269] PTP clock support registered601client # [ 0.349310] EDAC MC: Ver: 3.0.0602worker1 # [ 0.435690] usbcore: registered new interface driver hub603client # [ 0.358918] scmi_core: SCMI protocol bus registered604client # [ 0.363115] FPGA manager framework605client # [ 0.365887] vgaarb: loaded606client # [ 0.366756] clocksource: Switched to clocksource arch_sys_counter607client # [ 0.368516] VFS: Disk quotas dquot_6.6.0608client # [ 0.368571] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)609client # [ 0.372889] netfs: FS-Cache loaded610client # [ 0.373051] pnp: PnP ACPI: disabled611worker1 # [ 0.435721] usbcore: registered new device driver usb612worker1 # [ 0.436053] pps_core: LinuxPPS API ver. 1 registered613worker1 # [ 0.436061] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>614worker1 # [ 0.436071] PTP clock support registered615worker1 # [ 0.436131] EDAC MC: Ver: 3.0.0616worker1 # [ 0.449517] scmi_core: SCMI protocol bus registered617worker1 # [ 0.450924] FPGA manager framework618worker1 # [ 0.452181] vgaarb: loaded619worker1 # [ 0.452864] clocksource: Switched to clocksource arch_sys_counter620worker1 # [ 0.459844] VFS: Disk quotas dquot_6.6.0621worker1 # [ 0.459905] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)622worker1 # [ 0.465820] netfs: FS-Cache loaded623worker1 # [ 0.465968] pnp: PnP ACPI: disabled624client # [ 0.378844] NET: Registered PF_INET protocol family625client # [ 0.379166] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)626worker2 # [ 0.588898] Initialise system trusted keyrings627worker1 # [ 0.475147] NET: Registered PF_INET protocol family628worker1 # [ 0.475461] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)629worker2 # [ 0.590031] workingset: timestamp_bits=42 max_order=19 bucket_order=0630client # [ 0.416288] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)631client # [ 0.416370] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)632client # [ 0.416410] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)633client # [ 0.416518] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)634client # [ 0.416665] TCP: Hash tables configured (established 16384 bind 16384)635client # [ 0.416791] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)636client # [ 0.416837] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)637client # [ 0.416897] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)638client # [ 0.417025] NET: Registered PF_UNIX/PF_LOCAL protocol family639client # [ 0.417053] NET: Registered PF_XDP protocol family640client # [ 0.417074] PCI: CLS 0 bytes, default 64641client # [ 0.417365] Trying to unpack rootfs image as initramfs...642client # [ 0.440844] kvm [1]: HYP mode not available643worker2 # [ 0.640538] squashfs: version 4.0 (2009/01/31) Phillip Lougher644worker2 # [ 0.641465] 9p: Installing v9fs 9p2000 file system support645worker1 # [ 0.557422] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)646worker2 # [ 0.677257] Key type asymmetric registered647worker1 # [ 0.557493] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)648worker1 # [ 0.557535] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)649worker1 # [ 0.557632] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)650worker2 # [ 0.677300] Asymmetric key parser 'x509' registered651worker1 # [ 0.557775] TCP: Hash tables configured (established 16384 bind 16384)652worker1 # [ 0.557881] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)653worker2 # [ 0.677420] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)654worker1 # [ 0.557922] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)655worker2 # [ 0.679552] io scheduler mq-deadline registered656worker1 # [ 0.557961] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)657worker2 # [ 0.679564] io scheduler kyber registered658worker1 # [ 0.558080] NET: Registered PF_UNIX/PF_LOCAL protocol family659worker2 # [ 0.699843] pl061_gpio 9030000.pl061: PL061 GPIO chip registered660worker1 # [ 0.558110] NET: Registered PF_XDP protocol family661worker2 # [ 0.702952] ledtrig-cpu: registered to indicate activity on CPUs662worker2 # [ 0.703451] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:663worker1 # [ 0.558131] PCI: CLS 0 bytes, default 64664worker2 # [ 0.703473] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000665worker1 # [ 0.558395] Trying to unpack rootfs image as initramfs...666worker2 # [ 0.703487] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000667worker2 # [ 0.703495] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000668worker1 # [ 0.599483] kvm [1]: HYP mode not available669worker2 # [ 0.703523] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits670worker2 # [ 0.733910] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]671worker2 # [ 0.747664] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00672worker2 # [ 0.747706] pci_bus 0000:00: root bus resource [bus 00-ff]673worker2 # [ 0.747715] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]674worker2 # [ 0.747721] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]675worker2 # [ 0.747727] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]676worker2 # [ 0.747825] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint677worker2 # [ 0.748365] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint678worker2 # [ 0.748552] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]679worker2 # [ 0.748570] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]680worker2 # [ 0.748600] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]681worker2 # [ 0.748624] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]682worker2 # [ 0.749081] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint683worker2 # [ 0.749265] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]684worker2 # [ 0.749282] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]685worker2 # [ 0.749312] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]686worker2 # [ 0.749766] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint687worker2 # [ 0.749947] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]688worker2 # [ 0.749963] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]689worker2 # [ 0.749993] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]690worker2 # [ 0.750436] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint691worker2 # [ 0.750617] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]692worker2 # [ 0.750633] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]693worker2 # [ 0.750665] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]694worker2 # [ 0.751135] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint695worker2 # [ 0.751315] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]696worker2 # [ 0.751331] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]697worker2 # [ 0.751361] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]698worker2 # [ 0.751891] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint699worker2 # [ 0.752075] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]700worker2 # [ 0.752091] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]701worker2 # [ 0.752120] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]702worker2 # [ 0.752572] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint703worker2 # [ 0.752775] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]704worker2 # [ 0.752791] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]705worker2 # [ 0.752820] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]706worker2 # [ 0.752837] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]707worker2 # [ 0.753293] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint708worker2 # [ 0.753482] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]709worker2 # [ 0.753513] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]710worker2 # [ 0.753965] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint711worker2 # [ 0.754151] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]712worker2 # [ 0.754181] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]713worker2 # [ 0.754565] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint714worker2 # [ 0.754743] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]715worker2 # [ 0.754996] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint716worker2 # [ 0.755241] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]717worker2 # [ 0.755258] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]718worker2 # [ 0.755288] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]719worker2 # [ 0.865297] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint720worker2 # [ 0.865568] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]721worker2 # [ 0.865602] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]722worker2 # [ 0.865641] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]723worker2 # [ 0.866307] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned724worker2 # [ 0.866322] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned725worker2 # [ 0.866328] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned726worker2 # [ 0.866379] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned727worker2 # [ 0.866429] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned728worker2 # [ 0.866479] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned729worker2 # [ 0.866530] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned730worker2 # [ 0.866581] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned731worker2 # [ 0.866633] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned732worker2 # [ 0.866685] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned733worker2 # [ 0.866736] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned734worker2 # [ 0.866786] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned735worker2 # [ 0.866956] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned736worker2 # [ 0.867010] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned737worker2 # [ 0.867034] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned738worker2 # [ 0.867058] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned739worker2 # [ 0.867083] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned740worker2 # [ 0.867111] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned741worker2 # [ 0.867135] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned742worker2 # [ 0.867160] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned743worker2 # [ 0.867187] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned744worker2 # [ 0.867212] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned745worker2 # [ 0.867235] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned746worker2 # [ 0.867262] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned747worker2 # [ 0.867289] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned748worker2 # [ 0.867313] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned749worker2 # [ 0.867336] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned750worker2 # [ 0.867359] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned751worker2 # [ 0.867382] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned752worker2 # [ 0.867405] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned753worker2 # [ 0.867428] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned754worker2 # [ 0.867451] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned755worker2 # [ 0.867474] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned756worker2 # [ 0.867497] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned757worker2 # [ 0.867530] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]758worker2 # [ 0.983677] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]759worker2 # [ 0.983689] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]760worker2 # [ 0.984967] pci 0000:00:0a.0: enabling device (0000 -> 0002)761client # [ 0.807784] Initialise system trusted keyrings762client # [ 0.808595] workingset: timestamp_bits=42 max_order=19 bucket_order=0763client # [ 0.812698] squashfs: version 4.0 (2009/01/31) Phillip Lougher764worker2 # [ 1.009792] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)765client # [ 0.815839] 9p: Installing v9fs 9p2000 file system support766worker2 # [ 1.023405] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)767worker2 # [ 1.033076] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)768client # [ 0.844137] Key type asymmetric registered769worker2 # [ 1.037033] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)770worker2 # [ 1.039383] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)771client # [ 0.844172] Asymmetric key parser 'x509' registered772client # [ 0.844268] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)773client # [ 0.853858] io scheduler mq-deadline registered774client # [ 0.853881] io scheduler kyber registered775worker2 # [ 1.057168] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)776client # [ 0.866937] pl061_gpio 9030000.pl061: PL061 GPIO chip registered777worker2 # [ 1.059334] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)778client # [ 0.868743] ledtrig-cpu: registered to indicate activity on CPUs779client # [ 0.869192] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:780worker2 # [ 1.067278] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)781client # [ 0.869213] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000782client # [ 0.869226] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000783client # [ 0.869234] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000784client # [ 0.869263] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits785client # [ 0.869297] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]786client # [ 0.869381] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00787client # [ 0.869391] pci_bus 0000:00: root bus resource [bus 00-ff]788client # [ 0.869397] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]789client # [ 0.869403] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]790client # [ 0.869408] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]791client # [ 0.869472] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint792client # [ 0.869922] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint793client # [ 0.870111] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]794client # [ 0.870127] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]795client # [ 0.870156] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]796worker2 # [ 1.072285] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)797client # [ 0.870172] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]798worker2 # [ 1.074232] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)799client # [ 0.870693] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint800client # [ 0.870922] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]801client # [ 0.870939] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]802client # [ 0.870968] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]803client # [ 0.871431] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint804client # [ 0.871615] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]805client # [ 0.871632] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]806client # [ 0.871663] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]807client # [ 0.872233] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint808client # [ 0.872418] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]809client # [ 0.872434] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]810client # [ 0.872467] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]811client # [ 0.873353] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint812client # [ 0.873535] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]813client # [ 0.873551] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]814client # [ 0.873584] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]815client # [ 0.874034] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint816client # [ 0.874215] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]817client # [ 0.874231] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]818client # [ 0.874261] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]819client # [ 0.874748] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint820worker2 # [ 1.097333] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)821client # [ 0.915404] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]822client # [ 0.915441] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]823client # [ 0.915471] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]824client # [ 0.915488] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]825client # [ 0.916231] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint826client # [ 0.916436] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]827worker2 # [ 1.119025] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled828client # [ 0.916467] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]829client # [ 0.917070] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint830client # [ 0.917269] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]831client # [ 0.917301] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]832client # [ 0.917738] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint833worker2 # [ 1.123034] msm_serial: driver initialized834client # [ 0.917923] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]835client # [ 0.918192] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint836client # [ 0.918461] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]837worker2 # [ 1.123216] SuperH (H)SCI(F) driver initialized838worker2 # [ 1.123290] STM32 USART driver initialized839client # [ 0.918488] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]840client # [ 0.918520] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]841client # [ 0.934501] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint842client # [ 0.934726] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]843client # [ 0.934744] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]844worker1 # [ 1.030952] Initialise system trusted keyrings845worker1 # [ 1.031763] workingset: timestamp_bits=42 max_order=19 bucket_order=0846client # [ 0.971154] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]847client # [ 0.971959] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned848client # [ 0.971974] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned849client # [ 0.971980] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned850client # [ 0.972038] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned851client # [ 0.972088] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned852client # [ 0.972138] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned853client # [ 0.972186] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned854client # [ 0.972233] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned855client # [ 0.972282] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned856client # [ 0.972330] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned857client # [ 0.972378] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned858client # [ 0.972427] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned859client # [ 0.972528] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned860client # [ 0.972576] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned861client # [ 0.972598] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned862client # [ 0.972619] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned863client # [ 0.972642] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned864client # [ 0.972667] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned865client # [ 0.972690] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned866client # [ 0.972712] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned867client # [ 0.972734] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned868client # [ 0.972756] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned869client # [ 0.972779] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned870client # [ 0.972803] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned871worker1 # [ 1.091462] squashfs: version 4.0 (2009/01/31) Phillip Lougher872client # [ 0.972826] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned873worker1 # [ 1.091697] 9p: Installing v9fs 9p2000 file system support874client # [ 0.972848] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned875client # [ 0.972869] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned876client # [ 0.972891] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned877client # [ 0.972912] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned878client # [ 0.972933] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned879client # [ 0.972955] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned880client # [ 0.972976] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned881client # [ 0.972998] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned882client # [ 0.973020] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned883client # [ 0.973050] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]884client # [ 0.973060] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]885client # [ 0.973065] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]886client # [ 0.974228] pci 0000:00:0a.0: enabling device (0000 -> 0002)887worker1 # [ 1.132049] Key type asymmetric registered888worker1 # [ 1.132090] Asymmetric key parser 'x509' registered889worker1 # [ 1.132232] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)890worker1 # [ 1.134565] io scheduler mq-deadline registered891worker1 # [ 1.134588] io scheduler kyber registered892worker1 # [ 1.142312] pl061_gpio 9030000.pl061: PL061 GPIO chip registered893client # [ 1.069649] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)894worker1 # [ 1.144002] ledtrig-cpu: registered to indicate activity on CPUs895client # [ 1.082365] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)896worker1 # [ 1.180403] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:897worker1 # [ 1.180466] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000898worker1 # [ 1.180481] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000899worker1 # [ 1.180490] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000900worker1 # [ 1.180674] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits901worker1 # [ 1.180716] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]902worker1 # [ 1.180836] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00903worker1 # [ 1.180851] pci_bus 0000:00: root bus resource [bus 00-ff]904client # [ 1.105755] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)905worker1 # [ 1.180857] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]906client # [ 1.109330] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)907worker1 # [ 1.196696] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]908worker1 # [ 1.196707] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]909worker1 # [ 1.196803] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint910worker1 # [ 1.200035] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint911worker1 # [ 1.200233] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]912worker1 # [ 1.200251] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]913worker1 # [ 1.200280] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]914worker1 # [ 1.200297] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]915worker1 # [ 1.200855] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint916client # [ 1.117864] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)917client # [ 1.127035] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)918worker1 # [ 1.213222] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]919worker1 # [ 1.213263] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]920worker1 # [ 1.213293] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]921worker1 # [ 1.213984] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint922worker1 # [ 1.214185] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]923worker1 # [ 1.214206] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]924worker1 # [ 1.214236] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]925client # [ 1.138851] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)926worker1 # [ 1.214713] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint927worker1 # [ 1.214899] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]928worker1 # [ 1.214915] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]929worker1 # [ 1.214948] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]930worker1 # [ 1.215420] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint931worker1 # [ 1.215610] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]932client # [ 1.152356] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)933worker1 # [ 1.215627] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]934worker1 # [ 1.215657] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]935worker1 # [ 1.216639] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint936worker1 # [ 1.216831] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]937worker1 # [ 1.216848] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]938worker1 # [ 1.216905] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]939worker1 # [ 1.217385] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint940worker1 # [ 1.217591] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]941worker1 # [ 1.217608] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]942worker1 # [ 1.217640] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]943client # [ 1.169630] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)944worker1 # [ 1.217657] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]945worker1 # [ 1.218232] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint946worker1 # [ 1.218425] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]947worker1 # [ 1.218456] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]948worker1 # [ 1.218946] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint949worker1 # [ 1.219141] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]950worker1 # [ 1.219171] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]951worker1 # [ 1.219577] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint952worker1 # [ 1.219759] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]953worker1 # [ 1.220013] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint954worker2 # [ 1.384511] loop: module loaded955worker1 # [ 1.220267] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]956worker1 # [ 1.220285] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]957worker1 # [ 1.220314] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]958worker1 # [ 1.220794] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint959client # [ 1.188329] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)960worker2 # [ 1.384793] virtio_blk virtio5: 1/0/0 default/read/poll queues961worker2 # [ 1.385825] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)962worker1 # [ 1.285133] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]963worker1 # [ 1.285179] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]964worker1 # [ 1.285209] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]965worker1 # [ 1.285985] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned966worker1 # [ 1.286000] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned967worker1 # [ 1.286006] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned968worker2 # [ 1.400684] megasas: 07.734.00.00-rc1969worker1 # [ 1.286058] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned970worker2 # [ 1.403171] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]971worker1 # [ 1.286110] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned972worker1 # [ 1.286162] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned973worker1 # [ 1.286213] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned974worker1 # [ 1.286263] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned975worker1 # [ 1.286316] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned976worker1 # [ 1.286368] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned977worker1 # [ 1.286417] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned978worker1 # [ 1.286470] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned979worker1 # [ 1.286581] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned980worker1 # [ 1.286629] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned981worker1 # [ 1.286651] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned982worker1 # [ 1.286674] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned983worker2 # [ 1.425653] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000984worker1 # [ 1.286696] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned985worker2 # [ 1.425730] Intel/Sharp Extended Query Table at 0x0031986worker1 # [ 1.286722] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned987client # [ 1.227086] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)988worker1 # [ 1.286746] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned989worker1 # [ 1.286768] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned990worker1 # [ 1.286793] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned991worker1 # [ 1.286816] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned992worker1 # [ 1.286838] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned993worker1 # [ 1.286863] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned994worker1 # [ 1.286886] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned995worker2 # [ 1.444974] Using buffer write method996worker2 # [ 1.445621] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]997worker1 # [ 1.286908] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned998worker1 # [ 1.286932] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned999worker1 # [ 1.286954] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1000worker1 # [ 1.286976] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1001worker1 # [ 1.286998] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1002worker1 # [ 1.287058] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1003worker1 # [ 1.287081] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1004worker1 # [ 1.287106] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1005worker1 # [ 1.287128] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1006worker1 # [ 1.287161] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1007worker1 # [ 1.287172] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1008worker1 # [ 1.287177] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1009worker1 # [ 1.353589] pci 0000:00:0a.0: enabling device (0000 -> 0002)1010worker1 # [ 1.376424] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1011worker2 # [ 1.465217] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001012worker2 # [ 1.465289] Intel/Sharp Extended Query Table at 0x00311013worker2 # [ 1.467227] Using buffer write method1014client # [ 1.303869] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1015worker1 # [ 1.386638] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1016client # [ 1.307066] msm_serial: driver initialized1017client # [ 1.307215] SuperH (H)SCI(F) driver initialized1018client # [ 1.307272] STM32 USART driver initialized1019worker1 # [ 1.398201] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1020worker1 # [ 1.403269] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1021lb: QEMU running (pid 48)1022lb # Disk image does not exist, creating the virtualisation disk image...1023worker2 # [ 1.527619] Concatenating MTD devices:1024worker1 # [ 1.409176] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1025worker1 # [ 1.412603] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1026lb # Formatting '/build/vm-state-lb/tmp.eGhUH95DUh', fmt=raw size=10737418241027worker2 # [ 1.527656] (0): "0.flash"1028client # [ 1.330811] loop: module loaded1029client # [ 1.331033] virtio_blk virtio5: 1/0/0 default/read/poll queues1030lb # mke2fs 1.47.4 (6-Mar-2025)1031worker1 # [ 1.426569] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1032(finished: start all VMs, in 3.33 seconds)1033client: waiting for unit network-addresses-eth1.service1034lb # Discarding device blocks: 0/262144 done1035worker2 # [ 1.527662] (1): "0.flash"1036client: waiting for the VM to finish booting1037client # [ 1.331855] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1038lb # Creating filesystem with 262144 4k blocks and 65536 inodes1039worker2 # [ 1.527665] into device "0.flash"1040client # [ 1.339715] megasas: 07.734.00.00-rc11041client # [ 1.340606] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1042client # [ 1.344600] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001043lb # Filesystem UUID: 39fe108e-184d-4c80-bbf8-1693bb195e211044lb # Superblock backups stored on blocks:1045lb # 32768, 98304, 163840, 2293761046lb # 1047lb # Allocating group tables: 0/8 done1048lb # Writing inode tables: 0/8 done1049lb # Creating journal (8192 blocks): done1050lb # Writing superblocks and filesystem accounting information: 0/8 done1051lb # 1052lb # Virtualisation disk image created.1053client # [ 1.344647] Intel/Sharp Extended Query Table at 0x00311054client # [ 1.358145] Using buffer write method1055worker1 # [ 1.442888] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1056client # [ 1.358300] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1057worker1 # [ 1.456293] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1058client # [ 1.372046] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001059client # [ 1.372121] Intel/Sharp Extended Query Table at 0x00311060worker1 # [ 1.461754] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1061worker1 # [ 1.474775] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1062client # [ 1.408513] Using buffer write method1063client # [ 1.408584] Concatenating MTD devices:1064client # [ 1.408589] (0): "0.flash"1065client # [ 1.408594] (1): "0.flash"1066client # [ 1.408597] into device "0.flash"1067worker1 # [ 1.497885] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1068worker1 # [ 1.499955] msm_serial: driver initialized1069worker1 # [ 1.500127] SuperH (H)SCI(F) driver initialized1070worker1 # [ 1.500185] STM32 USART driver initialized1071worker1 # [ 1.587174] loop: module loaded1072worker1 # [ 1.587436] virtio_blk virtio5: 1/0/0 default/read/poll queues1073worker1 # [ 1.600911] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1074worker1 # [ 1.615178] megasas: 07.734.00.00-rc11075worker1 # [ 1.616038] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1076worker1 # [ 1.620549] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001077worker1 # [ 1.620602] Intel/Sharp Extended Query Table at 0x00311078worker1 # [ 1.631269] Using buffer write method1079worker1 # [ 1.631426] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1080worker1 # [ 1.642400] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001081worker1 # [ 1.642510] Intel/Sharp Extended Query Table at 0x00311082worker2 # [ 1.759955] Freeing initrd memory: 26148K1083worker2 # [ 1.767259] tun: Universal TUN/TAP device driver, 1.61084worker1 # [ 1.659104] Using buffer write method1085worker1 # [ 1.659184] Concatenating MTD devices:1086worker1 # [ 1.659188] (0): "0.flash"1087worker1 # [ 1.659193] (1): "0.flash"1088worker1 # [ 1.659197] into device "0.flash"1089worker2 # [ 1.773365] thunder_xcv, ver 1.01090worker2 # [ 1.773423] thunder_bgx, ver 1.01091worker2 # [ 1.773449] nicpf, ver 1.01092worker2 # [ 1.774097] e1000: Intel(R) PRO/1000 Network Driver1093worker2 # [ 1.774106] e1000: Copyright (c) 1999-2006 Intel Corporation.1094worker2 # [ 1.774133] e1000e: Intel(R) PRO/1000 Network Driver1095worker2 # [ 1.774140] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1096worker2 # [ 1.774176] igb: Intel(R) Gigabit Ethernet Network Driver1097worker2 # [ 1.774182] igb: Copyright (c) 2007-2014 Intel Corporation.1098worker2 # [ 1.774207] igbvf: Intel(R) Gigabit Virtual Function Network Driver1099worker2 # [ 1.774215] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1100worker2 # [ 1.774364] sky2: driver version 1.301101worker2 # [ 1.785285] usbcore: registered new interface driver usb-storage1102worker2 # [ 1.785404] usbcore: registered new interface driver usbserial_generic1103worker2 # [ 1.785423] usbserial: USB Serial support registered for generic1104worker2 # [ 1.786078] hv_vmbus: registering driver hyperv_keyboard1105worker2 # [ 1.787527] ehci-pci 0000:00:0a.0: EHCI Host Controller1106worker2 # [ 1.787598] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11107worker2 # [ 1.787826] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001108worker2 # [ 1.795380] rtc-pl031 9010000.pl031: registered as rtc01109worker2 # [ 1.795429] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:21:20 UTC (1789906880)1110worker2 # [ 1.799471] i2c_dev: i2c /dev entries driver1111worker2 # [ 1.799585] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001112worker2 # [ 1.800068] hub 1-0:1.0: USB hub found1113worker2 # [ 1.800092] hub 1-0:1.0: 6 ports detected1114worker2 # [ 1.817709] sdhci: Secure Digital Host Controller Interface driver1115worker2 # [ 1.817738] sdhci: Copyright(c) Pierre Ossman1116worker2 # [ 1.818028] Synopsys Designware Multimedia Card Interface Driver1117worker2 # [ 1.818409] sdhci-pltfm: SDHCI platform and OF driver helper1118worker2 # [ 1.829566] hid: raw HID events driver (C) Jiri Kosina1119worker2 # [ 1.829910] usbcore: registered new interface driver usbhid1120worker2 # [ 1.829918] usbhid: USB HID core driver1121worker2 # [ 1.834038] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1122worker2 # [ 1.835931] drop_monitor: Initializing network drop monitor service1123worker2 # [ 1.836216] NET: Registered PF_INET6 protocol family1124worker2 # [ 1.841059] Segment Routing with IPv61125worker2 # [ 1.841088] In-situ OAM (IOAM) with IPv61126worker2 # [ 1.841127] NET: Registered PF_PACKET protocol family1127worker2 # [ 1.843574] 9pnet: Installing 9P2000 support1128worker2 # [ 1.847504] Key type dns_resolver registered1129worker2 # [ 1.855737] registered taskstats version 11130worker2 # [ 1.855999] Loading compiled-in X.509 certificates1131worker2 # [ 1.865814] Demotion targets for Node 0: null1132worker2 # [ 1.866000] Key type .fscrypt registered1133worker2 # [ 1.866008] Key type fscrypt-provisioning registered1134worker2 # [ 1.866126] ima: No TPM chip found, activating TPM-bypass!1135worker2 # [ 1.866148] ima: Allocated hash algorithm: sha11136worker2 # [ 1.866179] ima: No architecture policies found1137worker2 # [ 1.872195] input: gpio-keys as /devices/platform/gpio-keys/input/input01138worker2 # [ 1.897315] clk: Disabling unused clocks1139worker2 # [ 1.897358] PM: genpd: Disabling unused power domains1140worker2 # [ 1.904035] Freeing unused kernel memory: 4736K1141worker2 # [ 1.904287] Run /init as init process1142worker2 # [ 1.922834] systemd[1]: Successfully made /usr/ read-only.1143worker2 # [ 2.051676] usb 1-1: new high-speed USB device number 2 using ehci-pci1144lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]1145lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 20261146lb # [ 0.000000] KASLR enabled1147lb # [ 0.000000] random: crng init done1148lb # [ 0.000000] Machine model: linux,dummy-virt1149lb # [ 0.000000] efi: UEFI not found.1150lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT1151lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]1152lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]1153lb # [ 0.000000] Zone ranges:1154lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]1155lb # [ 0.000000] DMA32 empty1156lb # [ 0.000000] Normal empty1157lb # [ 0.000000] Device empty1158lb # [ 0.000000] Movable zone start for each node1159lb # [ 0.000000] Early memory node ranges1160lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]1161lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]1162lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c4000001163lb # [ 0.000000] psci: probing for conduit method from DT.1164lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.1165lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs1166lb # [ 0.000000] psci: Trusted OS migration not required1167lb # [ 0.000000] psci: SMC Calling Convention v1.11168lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)1169lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u3112961170lb # [ 0.000000] Detected PIPT I-cache on CPU01171lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)1172lb # [ 0.000000] CPU features: detected: GICv3 CPU interface1173lb # [ 0.000000] CPU features: detected: Spectre-v41174lb # [ 0.000000] CPU features: detected: Spectre-BHB1175lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_381176lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_231177lb # [ 0.000000] alternatives: applying boot alternatives1178lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty01179lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space.1180lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes1181lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)1182lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)1183lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB1184lb # [ 0.000000] software IO TLB: area num 1.1185lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB1186lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)1187lb # [ 0.000000] Fallback order for Node 0: 01188lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 3932161189lb # [ 0.000000] Policy zone: DMA1190lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off1191lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=11192lb # [ 0.000000] allocated 3145728 bytes of page_ext1193lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages1194lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups1195lb # [ 0.000000] rcu: Hierarchical RCU implementation.1196lb # [ 0.000000] rcu: RCU event tracing is enabled.1197lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.1198lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.1199lb # [ 0.000000] Rude variant of Tasks RCU enabled.1200lb # [ 0.000000] Tracing variant of Tasks RCU enabled.1201lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.1202lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=11203lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.1204lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.1205lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.1206lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 01207lb # [ 0.000000] GICv3: 256 SPIs implemented1208lb # [ 0.000000] GICv3: 0 Extended SPIs implemented1209lb # [ 0.000000] Root IRQ handler: gic_handle_irq1210lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI1211lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=01212lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a00001213lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]1214lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)1215lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)1216lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a000001217lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a100001218lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.1219lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns1220lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).1221lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns1222lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns1223client # [ 1.931483] Freeing initrd memory: 26160K1224client # [ 1.940160] tun: Universal TUN/TAP device driver, 1.61225client # [ 1.947091] thunder_xcv, ver 1.01226client # [ 1.947141] thunder_bgx, ver 1.01227client # [ 1.947164] nicpf, ver 1.01228lb # [ 0.000037] arm-pv: using stolen time PV1229client # [ 1.947754] e1000: Intel(R) PRO/1000 Network Driver1230lb # [ 0.000632] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)1231lb # [ 0.000841] Console: colour dummy device 80x251232client # [ 1.947762] e1000: Copyright (c) 1999-2006 Intel Corporation.1233lb # [ 0.000850] printk: legacy console [tty0] enabled1234client # [ 1.947787] e1000e: Intel(R) PRO/1000 Network Driver1235lb # [ 0.001054] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)1236client # [ 1.947796] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1237lb # [ 0.001061] pid_max: default: 32768 minimum: 3011238lb # [ 0.001142] LSM: initializing lsm=capability,landlock,yama,bpf,ima1239client # [ 1.947825] igb: Intel(R) Gigabit Ethernet Network Driver1240client # [ 1.947831] igb: Copyright (c) 2007-2014 Intel Corporation.1241client # [ 1.947854] igbvf: Intel(R) Gigabit Virtual Function Network Driver1242client # [ 1.947860] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1243client # [ 1.948003] sky2: driver version 1.301244lb # [ 0.001309] landlock: Up and running.1245client # [ 1.949685] usbcore: registered new interface driver usb-storage1246client # [ 1.949779] usbcore: registered new interface driver usbserial_generic1247lb # [ 0.001313] Yama: becoming mindful.1248lb # [ 0.001965] LSM support for eBPF active1249lb # [ 0.002132] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)1250client # [ 1.949793] usbserial: USB Serial support registered for generic1251lb # [ 0.002166] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)1252lb # [ 0.003475] cacheinfo: Unable to detect cache hierarchy for CPU 01253client # [ 1.950404] hv_vmbus: registering driver hyperv_keyboard1254lb # [ 0.004292] rcu: Hierarchical SRCU implementation.1255lb # [ 0.004298] rcu: Max phase no-delay instances is 1000.1256lb # [ 0.006339] fsl-mc MSI: its@8080000 domain created1257client # [ 1.951510] ehci-pci 0000:00:0a.0: EHCI Host Controller1258lb # [ 0.006443] EFI services will not be available.1259lb # [ 0.006544] smp: Bringing up secondary CPUs ...1260lb # [ 0.006555] smp: Brought up 1 node, 1 CPU1261lb # [ 0.006559] SMP: Total of 1 processors activated.1262lb # [ 0.006565] CPU: All CPU(s) started at EL11263client # [ 1.951541] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11264lb # [ 0.006606] CPU features: detected: Branch Target Identification1265lb # [ 0.006611] CPU features: detected: ARMv8.4 Translation Table Level1266lb # [ 0.006615] CPU features: detected: Instruction cache invalidation not required for I/D coherence1267client # [ 1.951770] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001268lb # [ 0.006618] CPU features: detected: Data cache clean to the PoU not required for I/D coherence1269lb # [ 0.006622] CPU features: detected: Common not Private translations1270lb # [ 0.006625] CPU features: detected: CRC32 instructions1271lb # [ 0.006628] CPU features: detected: Data cache clean to Point of Deep Persistence1272lb # [ 0.006632] CPU features: detected: Data cache clean to Point of Persistence1273client # [ 1.975477] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001274client # [ 1.977934] hub 1-0:1.0: USB hub found1275lb # [ 0.006635] CPU features: detected: Data independent timing control (DIT)1276lb # [ 0.006638] CPU features: detected: E0PD1277lb # [ 0.006641] CPU features: detected: Enhanced Counter Virtualization1278client # [ 1.978421] hub 1-0:1.0: 6 ports detected1279lb # [ 0.006644] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)1280lb # [ 0.006648] CPU features: detected: Enhanced Virtualization Traps1281lb # [ 0.006651] CPU features: detected: Fine Grained Traps1282lb # [ 0.006654] CPU features: detected: Generic authentication (architected QARMA5 algorithm)1283lb # [ 0.006662] CPU features: detected: RCpc load-acquire (LDAPR)1284lb # [ 0.006665] CPU features: detected: LSE atomic instructions1285lb # [ 0.006668] CPU features: detected: Privileged Access Never1286lb # [ 0.006670] CPU features: detected: PMUv31287lb # [ 0.006673] CPU features: detected: RAS Extension Support1288lb # [ 0.006676] CPU features: detected: RASv1p1 Extension Support1289lb # [ 0.006678] CPU features: detected: Random Number Generator1290lb # [ 0.006681] CPU features: detected: Speculation barrier (SB)1291lb # [ 0.006684] CPU features: detected: Stage-2 Force Write-Back1292lb # [ 0.006687] CPU features: detected: TLB range maintenance instructions1293lb # [ 0.006691] CPU features: detected: Speculative Store Bypassing Safe (SSBS)1294lb # [ 0.006733] alternatives: applying system-wide alternatives1295lb # [ 0.010122] CPU features: detected: BBM Level 2 without TLB conflict abort1296client # [ 1.991029] rtc-pl031 9010000.pl031: registered as rtc01297lb # [ 0.010367] Memory: 1406600K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)1298lb # [ 0.010958] devtmpfs: initialized1299client # [ 1.991287] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:21:21 UTC (1789906881)1300lb # [ 0.012925] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)1301client # [ 1.991818] i2c_dev: i2c /dev entries driver1302lb # [ 0.012956] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).1303lb # [ 0.013205] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL1304lb # [ 0.013217] 0 pages in range for non-PLT usage1305lb # [ 0.013218] 508288 pages in range for PLT usage1306lb # [ 0.013356] pinctrl core: initialized pinctrl subsystem1307lb # [ 0.014260] DMI not present or invalid.1308lb # [ 0.017891] NET: Registered PF_NETLINK/PF_ROUTE protocol family1309lb # [ 0.021290] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations1310lb # [ 0.021515] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations1311lb # [ 0.021730] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations1312lb # [ 0.021768] audit: initializing netlink subsys (disabled)1313lb # [ 0.022199] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=11314lb # [ 0.022444] thermal_sys: Registered thermal governor 'fair_share'1315lb # [ 0.022446] thermal_sys: Registered thermal governor 'bang_bang'1316lb # [ 0.022453] thermal_sys: Registered thermal governor 'step_wise'1317client # [ 2.002837] sdhci: Secure Digital Host Controller Interface driver1318lb # [ 0.022456] thermal_sys: Registered thermal governor 'user_space'1319lb # [ 0.022458] thermal_sys: Registered thermal governor 'power_allocator'1320lb # [ 0.022508] cpuidle: using governor ladder1321worker2 # [ 2.208723] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11322lb # [ 0.022516] cpuidle: using governor menu1323lb # [ 0.022743] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.1324lb # [ 0.022763] ASID allocator initialised with 65536 entries1325lb # [ 0.024039] Serial: AMBA PL011 UART driver1326lb # [ 0.029825] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev11327lb # [ 0.030019] printk: console [ttyAMA0] enabled1328client # [ 2.002862] sdhci: Copyright(c) Pierre Ossman1329client # [ 2.003135] Synopsys Designware Multimedia Card Interface Driver1330client # [ 2.003514] sdhci-pltfm: SDHCI platform and OF driver helper1331client # [ 2.007083] hid: raw HID events driver (C) Jiri Kosina1332client # [ 2.007408] usbcore: registered new interface driver usbhid1333client # [ 2.007415] usbhid: USB HID core driver1334client # [ 2.019358] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1335client # [ 2.021126] drop_monitor: Initializing network drop monitor service1336client # [ 2.021920] NET: Registered PF_INET6 protocol family1337client # [ 2.026588] Segment Routing with IPv61338lb # [ 0.187032] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1339lb # [ 0.187062] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page1340client # [ 2.026617] In-situ OAM (IOAM) with IPv61341lb # [ 0.187067] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages1342lb # [ 0.187072] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page1343lb # [ 0.187076] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1344client # [ 2.026654] NET: Registered PF_PACKET protocol family1345lb # [ 0.187081] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page1346lb # [ 0.187085] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages1347lb # [ 0.187089] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page1348client # [ 2.032920] 9pnet: Installing 9P2000 support1349lb # [ 0.195093] fbcon: Taking over console1350lb # [ 0.195121] ACPI: Interpreter disabled.1351client # [ 2.038245] Key type dns_resolver registered1352lb # [ 0.203532] iommu: Default domain type: Translated1353lb # [ 0.203549] iommu: DMA domain TLB invalidation policy: strict mode1354lb # [ 0.205355] SCSI subsystem initialized1355lb # [ 0.206102] usbcore: registered new interface driver usbfs1356lb # [ 0.206137] usbcore: registered new interface driver hub1357lb # [ 0.206157] usbcore: registered new device driver usb1358lb # [ 0.206495] pps_core: LinuxPPS API ver. 1 registered1359lb # [ 0.206501] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>1360lb # [ 0.206511] PTP clock support registered1361lb # [ 0.206595] EDAC MC: Ver: 3.0.01362lb # [ 0.211431] scmi_core: SCMI protocol bus registered1363lb # [ 0.212536] FPGA manager framework1364lb # [ 0.213535] vgaarb: loaded1365client # [ 2.052312] registered taskstats version 11366lb # [ 0.215544] clocksource: Switched to clocksource arch_sys_counter1367lb # [ 0.216241] VFS: Disk quotas dquot_6.6.01368client # [ 2.052556] Loading compiled-in X.509 certificates1369lb # [ 0.216278] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1370lb # [ 0.218908] netfs: FS-Cache loaded1371lb # [ 0.219054] pnp: PnP ACPI: disabled1372client # [ 2.064813] Demotion targets for Node 0: null1373client # [ 2.064987] Key type .fscrypt registered1374client # [ 2.064995] Key type fscrypt-provisioning registered1375client # [ 2.065112] ima: No TPM chip found, activating TPM-bypass!1376client # [ 2.065133] ima: Allocated hash algorithm: sha11377client # [ 2.065160] ima: No architecture policies found1378lb # [ 0.227562] NET: Registered PF_INET protocol family1379client # [ 2.069752] input: gpio-keys as /devices/platform/gpio-keys/input/input01380worker2 # [ 2.260499] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1381lb # [ 0.227979] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1382worker2 # [ 2.265716] systemd[1]: Detected virtualization qemu.1383worker2 # [ 2.266713] systemd[1]: Detected architecture arm64.1384worker2 # [ 2.267388] systemd[1]: Running in initrd.1385worker2 # [ 2.270357] systemd[1]: Initializing machine ID from random generator.1386worker2 # [ 2.274623] systemd[1]: Hostname set to <worker2>.1387worker1 # [ 2.167711] Freeing initrd memory: 26148K1388worker1 # [ 2.175088] tun: Universal TUN/TAP device driver, 1.61389client # [ 2.093715] clk: Disabling unused clocks1390client # [ 2.093776] PM: genpd: Disabling unused power domains1391worker1 # [ 2.180136] thunder_xcv, ver 1.01392worker2 # [ 2.288418] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01393worker1 # [ 2.180203] thunder_bgx, ver 1.01394worker1 # [ 2.180227] nicpf, ver 1.01395worker1 # [ 2.180831] e1000: Intel(R) PRO/1000 Network Driver1396client # [ 2.099695] Freeing unused kernel memory: 4736K1397client # [ 2.099917] Run /init as init process1398worker1 # [ 2.180841] e1000: Copyright (c) 1999-2006 Intel Corporation.1399worker1 # [ 2.184605] e1000e: Intel(R) PRO/1000 Network Driver1400worker1 # [ 2.184631] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1401worker1 # [ 2.184687] igb: Intel(R) Gigabit Ethernet Network Driver1402worker1 # [ 2.184696] igb: Copyright (c) 2007-2014 Intel Corporation.1403worker1 # [ 2.184724] igbvf: Intel(R) Gigabit Virtual Function Network Driver1404worker1 # [ 2.184730] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1405worker1 # [ 2.189264] sky2: driver version 1.301406worker1 # [ 2.191031] usbcore: registered new interface driver usb-storage1407worker1 # [ 2.191205] usbcore: registered new interface driver usbserial_generic1408worker1 # [ 2.191225] usbserial: USB Serial support registered for generic1409lb # [ 0.263478] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1410lb # [ 0.263545] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1411lb # [ 0.263581] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1412lb # [ 0.263683] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1413lb # [ 0.263826] TCP: Hash tables configured (established 16384 bind 16384)1414lb # [ 0.263931] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1415lb # [ 0.263973] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1416worker1 # [ 2.191855] hv_vmbus: registering driver hyperv_keyboard1417client # [ 2.117623] systemd[1]: Successfully made /usr/ read-only.1418worker1 # [ 2.193799] ehci-pci 0000:00:0a.0: EHCI Host Controller1419worker1 # [ 2.193854] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11420lb # [ 0.264012] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1421lb # [ 0.264124] NET: Registered PF_UNIX/PF_LOCAL protocol family1422lb # [ 0.264192] NET: Registered PF_XDP protocol family1423lb # [ 0.264213] PCI: CLS 0 bytes, default 641424lb # [ 0.264525] Trying to unpack rootfs image as initramfs...1425worker1 # [ 2.194133] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001426worker1 # [ 2.205119] rtc-pl031 9010000.pl031: registered as rtc01427worker1 # [ 2.205184] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:21:21 UTC (1789906881)1428worker1 # [ 2.205774] i2c_dev: i2c /dev entries driver1429worker1 # [ 2.209918] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001430worker1 # [ 2.211530] hub 1-0:1.0: USB hub found1431worker1 # [ 2.212318] hub 1-0:1.0: 6 ports detected1432lb # [ 0.280906] kvm [1]: HYP mode not available1433worker1 # [ 2.217075] sdhci: Secure Digital Host Controller Interface driver1434worker1 # [ 2.217098] sdhci: Copyright(c) Pierre Ossman1435worker1 # [ 2.217373] Synopsys Designware Multimedia Card Interface Driver1436worker1 # [ 2.217757] sdhci-pltfm: SDHCI platform and OF driver helper1437worker1 # [ 2.219981] hid: raw HID events driver (C) Jiri Kosina1438worker1 # [ 2.220323] usbcore: registered new interface driver usbhid1439worker1 # [ 2.220331] usbhid: USB HID core driver1440worker1 # [ 2.230031] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1441worker1 # [ 2.232547] drop_monitor: Initializing network drop monitor service1442worker1 # [ 2.236151] NET: Registered PF_INET6 protocol family1443worker1 # [ 2.238068] Segment Routing with IPv61444worker1 # [ 2.238229] In-situ OAM (IOAM) with IPv61445worker1 # [ 2.238331] NET: Registered PF_PACKET protocol family1446worker1 # [ 2.241362] 9pnet: Installing 9P2000 support1447worker1 # [ 2.244329] Key type dns_resolver registered1448worker1 # [ 2.253927] registered taskstats version 11449worker1 # [ 2.254143] Loading compiled-in X.509 certificates1450worker1 # [ 2.265717] Demotion targets for Node 0: null1451worker1 # [ 2.266048] Key type .fscrypt registered1452worker1 # [ 2.266093] Key type fscrypt-provisioning registered1453worker1 # [ 2.266225] ima: No TPM chip found, activating TPM-bypass!1454worker1 # [ 2.266246] ima: Allocated hash algorithm: sha11455worker1 # [ 2.266281] ima: No architecture policies found1456worker1 # [ 2.272761] input: gpio-keys as /devices/platform/gpio-keys/input/input01457worker1 # [ 2.296124] clk: Disabling unused clocks1458worker1 # [ 2.296179] PM: genpd: Disabling unused power domains1459worker1 # [ 2.302347] Freeing unused kernel memory: 4736K1460worker1 # [ 2.302651] Run /init as init process1461client # [ 2.238877] usb 1-1: new high-speed USB device number 2 using ehci-pci1462worker1 # [ 2.327334] systemd[1]: Successfully made /usr/ read-only.1463worker2 # [ 2.463190] usb 1-2: new high-speed USB device number 3 using ehci-pci1464worker1 # [ 2.461028] usb 1-1: new high-speed USB device number 2 using ehci-pci1465client # [ 2.392046] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11466lb # [ 0.563136] Initialise system trusted keyrings1467lb # [ 0.563941] workingset: timestamp_bits=42 max_order=19 bucket_order=01468lb # [ 0.565508] squashfs: version 4.0 (2009/01/31) Phillip Lougher1469lb # [ 0.566320] 9p: Installing v9fs 9p2000 file system support1470worker2 # [ 2.619581] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21471worker2 # [ 2.621608] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01472lb # [ 0.594513] Key type asymmetric registered1473lb # [ 0.594549] Asymmetric key parser 'x509' registered1474lb # [ 0.594667] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1475lb # [ 0.596779] io scheduler mq-deadline registered1476lb # [ 0.596792] io scheduler kyber registered1477lb # [ 0.610838] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1478lb # [ 0.611634] ledtrig-cpu: registered to indicate activity on CPUs1479lb # [ 0.612068] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1480client # [ 2.455120] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1481client # [ 2.461078] systemd[1]: Detected virtualization qemu.1482client # [ 2.461803] systemd[1]: Detected architecture arm64.1483lb # [ 0.612089] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001484lb # [ 0.612102] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001485client # [ 2.462524] systemd[1]: Running in initrd.1486lb # [ 0.612110] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001487lb # [ 0.612148] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1488client # [ 2.464291] systemd[1]: Initializing machine ID from random generator.1489lb # [ 0.612177] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1490lb # [ 0.612267] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001491lb # [ 0.612277] pci_bus 0000:00: root bus resource [bus 00-ff]1492client # [ 2.465978] systemd[1]: Hostname set to <client>.1493lb # [ 0.612283] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1494lb # [ 0.612289] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1495lb # [ 0.612294] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1496lb # [ 0.612370] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1497lb # [ 0.612838] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1498lb # [ 0.613026] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1499lb # [ 0.613043] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1500client # [ 2.469489] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01501lb # [ 0.613072] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1502lb # [ 0.613089] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1503lb # [ 0.613559] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1504lb # [ 0.613742] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1505lb # [ 0.613759] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1506lb # [ 0.613789] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1507lb # [ 0.614414] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1508lb # [ 0.614610] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1509lb # [ 0.614626] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1510lb # [ 0.614655] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1511lb # [ 0.615125] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1512lb # [ 0.615312] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1513lb # [ 0.615328] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1514lb # [ 0.615361] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1515lb # [ 0.615842] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1516lb # [ 0.616032] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1517lb # [ 0.616049] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1518lb # [ 0.616081] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1519lb # [ 0.616535] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1520lb # [ 0.616720] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1521lb # [ 0.616738] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1522lb # [ 0.616771] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1523lb # [ 0.617226] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1524lb # [ 0.617408] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1525lb # [ 0.617430] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1526lb # [ 0.617459] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1527lb # [ 0.617476] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1528lb # [ 0.617958] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1529lb # [ 0.618148] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1530lb # [ 0.618179] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1531lb # [ 0.662858] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1532lb # [ 0.663082] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1533lb # [ 0.663114] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1534lb # [ 0.663529] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1535lb # [ 0.663712] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1536lb # [ 0.663966] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1537lb # [ 0.664263] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1538lb # [ 0.664283] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1539lb # [ 0.664312] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1540lb # [ 0.664783] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1541lb # [ 0.664974] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1542lb # [ 0.664990] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1543lb # [ 0.665019] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1544lb # [ 0.665626] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1545lb # [ 0.665638] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1546lb # [ 0.665644] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1547lb # [ 0.665687] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1548lb # [ 0.665734] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1549lb # [ 0.665782] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1550lb # [ 0.665829] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1551lb # [ 0.665876] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1552lb # [ 0.665925] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1553worker2 # [ 2.703351] systemd[1]: bpf-restrict-fs: LSM BPF program attached1554lb # [ 0.665972] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1555lb # [ 0.666019] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1556lb # [ 0.666065] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1557lb # [ 0.666146] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1558lb # [ 0.666192] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1559lb # [ 0.666214] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1560lb # [ 0.666235] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1561lb # [ 0.666257] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1562lb # [ 0.666282] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1563lb # [ 0.666303] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1564lb # [ 0.698886] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1565lb # [ 0.698941] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1566lb # [ 0.698966] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1567lb # [ 0.698990] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1568lb # [ 0.699015] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1569lb # [ 0.699041] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1570lb # [ 0.699063] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1571worker1 # [ 2.627619] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11572lb # [ 0.699085] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1573lb # [ 0.699107] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1574lb # [ 0.699128] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1575lb # [ 0.699151] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1576lb # [ 0.699173] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1577lb # [ 0.699195] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1578lb # [ 0.699220] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1579lb # [ 0.699244] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1580lb # [ 0.699279] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1581lb # [ 0.699288] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1582lb # [ 0.699294] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1583lb # [ 0.700495] pci 0000:00:0a.0: enabling device (0000 -> 0002)1584worker2 # [ 2.769596] systemd[1]: Queued start job for default target Initrd Default Target.1585lb # [ 0.741999] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1586worker1 # [ 2.662309] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1587worker2 # [ 2.777732] systemd[1]: Created slice Slice /system/modprobe.1588worker1 # [ 2.667780] systemd[1]: Detected virtualization qemu.1589worker2 # [ 2.778729] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1590worker1 # [ 2.668848] systemd[1]: Detected architecture arm64.1591worker2 # [ 2.780579] systemd[1]: Expecting device /dev/disk/by-label/nixos...1592worker1 # [ 2.670161] systemd[1]: Running in initrd.1593worker2 # [ 2.781814] systemd[1]: Reached target Path Units.1594worker2 # [ 2.782414] systemd[1]: Reached target Slice Units.1595worker1 # [ 2.671566] systemd[1]: Initializing machine ID from random generator.1596worker2 # [ 2.783017] systemd[1]: Reached target Swaps.1597worker1 # [ 2.672908] systemd[1]: Hostname set to <worker1>.1598worker2 # [ 2.783990] systemd[1]: Reached target Timer Units.1599worker2 # [ 2.785176] systemd[1]: Listening on D-Bus System Message Bus Socket.1600worker2 # [ 2.786578] systemd[1]: Listening on Journal Socket (/dev/log).1601worker2 # [ 2.787904] systemd[1]: Listening on Journal Sockets.1602lb # [ 0.751991] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1603worker2 # [ 2.789057] systemd[1]: Listening on udev Control Socket.1604worker2 # [ 2.790166] systemd[1]: Listening on udev Kernel Socket.1605worker2 # [ 2.791157] systemd[1]: Reached target Socket Units.1606client # [ 2.598918] usb 1-2: new high-speed USB device number 3 using ehci-pci1607lb # [ 0.763123] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1608lb # [ 0.765542] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1609lb # [ 0.769532] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1610lb # [ 0.775795] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1611lb # [ 0.778300] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1612lb # [ 0.788976] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1613lb # [ 0.792401] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1614worker1 # [ 2.717207] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01615lb # [ 0.798604] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1616lb # [ 0.809925] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1617lb # [ 0.823799] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1618lb # [ 0.844001] msm_serial: driver initialized1619lb # [ 0.844195] SuperH (H)SCI(F) driver initialized1620worker2 # [ 2.878852] systemd[1]: Starting Create List of Static Device Nodes...1621lb # [ 0.844276] STM32 USART driver initialized1622lb # [ 0.901739] loop: module loaded1623lb # [ 0.901945] virtio_blk virtio5: 1/0/0 default/read/poll queues1624client # [ 2.746346] systemd[1]: bpf-restrict-fs: LSM BPF program attached1625worker1 # [ 2.837584] usb 1-2: new high-speed USB device number 3 using ehci-pci1626client # [ 2.762270] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21627client # [ 2.765175] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01628lb # [ 0.903846] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1629worker2 # [ 3.021242] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1630worker2 # [ 3.023706] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1631worker2 # [ 3.035880] systemd[1]: Mounting Kernel Configuration File System...1632client # [ 2.848577] systemd[1]: Queued start job for default target Initrd Default Target.1633worker2 # [ 3.048963] systemd[1]: Starting Journal Service...1634client # [ 2.857448] systemd[1]: Created slice Slice /system/modprobe.1635client # [ 2.858639] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1636client # [ 2.859810] systemd[1]: Expecting device /dev/disk/by-label/nixos...1637client # [ 2.860602] systemd[1]: Reached target Path Units.1638client # [ 2.861479] systemd[1]: Reached target Slice Units.1639client # [ 2.862147] systemd[1]: Reached target Swaps.1640client # [ 2.862734] systemd[1]: Reached target Timer Units.1641client # [ 2.863926] systemd[1]: Listening on D-Bus System Message Bus Socket.1642client # [ 2.864911] systemd[1]: Listening on Journal Socket (/dev/log).1643client # [ 2.866032] systemd[1]: Listening on Journal Sockets.1644lb # [ 1.023255] megasas: 07.734.00.00-rc11645client # [ 2.867623] systemd[1]: Listening on udev Control Socket.1646lb # [ 1.024210] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1647client # [ 2.868620] systemd[1]: Listening on udev Kernel Socket.1648client # [ 2.869414] systemd[1]: Reached target Socket Units.1649client # [ 2.891428] systemd[1]: Starting Create List of Static Device Nodes...1650lb # [ 1.047225] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001651worker1 # [ 3.002329] systemd[1]: bpf-restrict-fs: LSM BPF program attached1652worker1 # [ 3.007853] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21653worker1 # [ 3.011510] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01654client # [ 2.937688] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1655client # [ 2.939002] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1656lb # [ 1.047285] Intel/Sharp Extended Query Table at 0x00311657lb # [ 1.049348] Using buffer write method1658lb # [ 1.049505] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1659lb # [ 1.051663] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001660lb # [ 1.051716] Intel/Sharp Extended Query Table at 0x00311661lb # [ 1.053552] Using buffer write method1662lb # [ 1.053599] Concatenating MTD devices:1663lb # [ 1.053603] (0): "0.flash"1664lb # [ 1.053608] (1): "0.flash"1665lb # [ 1.053611] into device "0.flash"1666client # [ 2.949814] systemd[1]: Mounting Kernel Configuration File System...1667worker2 # [ 3.136515] systemd[1]: Starting Load Kernel Modules...1668worker2 # [ 3.136726] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1669client # [ 2.999363] systemd[1]: Starting Journal Service...1670client # [ 3.027113] systemd[1]: Starting Load Kernel Modules...1671client # [ 3.027307] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1672worker1 # [ 3.113261] systemd[1]: Queued start job for default target Initrd Default Target.1673client # [ 3.034845] systemd[1]: Starting Coldplug All udev Devices...1674client # [ 3.037625] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1675worker1 # [ 3.124463] systemd[1]: Created slice Slice /system/modprobe.1676worker1 # [ 3.125974] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1677worker1 # [ 3.127209] systemd[1]: Expecting device /dev/disk/by-label/nixos...1678worker1 # [ 3.128272] systemd[1]: Reached target Path Units.1679worker1 # [ 3.129013] systemd[1]: Reached target Slice Units.1680worker1 # [ 3.129659] systemd[1]: Reached target Swaps.1681worker1 # [ 3.130258] systemd[1]: Reached target Timer Units.1682worker1 # [ 3.131184] systemd[1]: Listening on D-Bus System Message Bus Socket.1683worker1 # [ 3.132176] systemd[1]: Listening on Journal Socket (/dev/log).1684worker1 # [ 3.133190] systemd[1]: Listening on Journal Sockets.1685worker1 # [ 3.134162] systemd[1]: Listening on udev Control Socket.1686worker1 # [ 3.136017] systemd[1]: Listening on udev Kernel Socket.1687worker1 # [ 3.136819] systemd[1]: Reached target Socket Units.1688client # [ 3.055525] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1689worker1 # [ 3.158584] systemd[1]: Starting Create List of Static Device Nodes...1690worker2 # [ 3.248814] systemd[1]: Starting Coldplug All udev Devices...1691worker1 # [ 3.169172] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1692worker1 # [ 3.169314] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1693client # [ 3.087326] systemd[1]: Finished Create List of Static Device Nodes.1694client # [ 3.087922] systemd[1]: Mounted Kernel Configuration File System.1695client # [ 3.092448] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1696worker1 # [ 3.177321] systemd[1]: Mounting Kernel Configuration File System...1697worker2 # [ 3.301144] systemd-journald[73]: Collecting audit messages is disabled.1698client # [ 3.109172] systemd-journald[73]: Collecting audit messages is disabled.1699client # [ 3.117029] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1700worker1 # [ 3.202495] systemd[1]: Starting Journal Service...1701worker1 # [ 3.213244] systemd[1]: Starting Load Kernel Modules...1702worker2 # [ 3.323718] systemd[1]: Finished Create List of Static Device Nodes.1703worker2 # [ 3.326186] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1704worker1 # [ 3.217147] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1705worker2 # [ 3.336110] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1706worker2 # [ 3.336496] systemd[1]: Mounted Kernel Configuration File System.1707worker2 # [ 3.344111] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1708client # [ 3.143362] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1709worker2 # [ 3.354018] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1710client # [ 3.175341] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01711client # [ 3.176249] [drm] features: -virgl +edid -resource_blob -host_visible1712client # [ 3.176263] [drm] features: -context_init1713client # [ 3.177102] [drm] number of scanouts: 11714client # [ 3.177124] [drm] number of cap sets: 01715client # [ 3.187992] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1716worker2 # [ 3.375688] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1717worker2 # [ 3.382840] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01718worker2 # [ 3.383094] [drm] features: -virgl +edid -resource_blob -host_visible1719worker2 # [ 3.383108] [drm] features: -context_init1720client # [ 3.199619] systemd[1]: Starting Create Static Device Nodes in /dev...1721worker2 # [ 3.415037] [drm] number of scanouts: 11722worker2 # [ 3.415084] [drm] number of cap sets: 01723worker2 # [ 3.416853] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1724worker2 # [ 3.416873] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01725worker2 # [ 3.426176] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1726client # [ 3.247214] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1727client # [ 3.247247] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01728worker2 # [ 3.463722] systemd[1]: Starting Create Static Device Nodes in /dev...1729worker2 # [ 3.479987] Console: switching to colour frame buffer device 160x501730worker2 # [ 3.486006] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1731worker1 # [ 3.353817] systemd[1]: Starting Coldplug All udev Devices...1732worker1 # [ 3.380379] systemd[1]: Finished Create List of Static Device Nodes.1733worker1 # [ 3.381735] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1734worker1 # [ 3.382240] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1735worker1 # [ 3.384676] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1736worker1 # [ 3.390389] systemd[1]: Mounted Kernel Configuration File System.1737client # [ 3.287210] Console: switching to colour frame buffer device 160x501738client # [ 3.316706] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1739worker2 # [ 3.520547] systemd[1]: Finished Load Kernel Modules.1740worker2 # [ 3.522429] systemd[1]: Starting Apply Kernel Variables...1741client # [ 3.169984] systemd-modules-load[74]: Inserted module 'dm_mod'1742client # [ 3.186812] systemd-modules-load[74]: Module 'virtio_balloon' is built in1743client # [ 3.188700] systemd-modules-load[74]: Module 'virtio_console' is built in1744client # [ 3.190367] systemd-modules-load[74]: Inserted module 'virtio_gpu'1745client # [ 3.191749] systemd-modules-load[74]: Module 'virtio_rng' is built in1746client # [ 3.356183] systemd[1]: Started Journal Service.1747worker2 # [ 3.552141] systemd[1]: Finished Create Static Device Nodes in /dev.1748client # [ 3.200732] systemd[1]: Finished Load Kernel Modules.1749worker2 # [ 3.552706] systemd[1]: Reached target Preparation for Local File Systems.1750worker2 # [ 3.552747] systemd[1]: Reached target Local File Systems.1751lb # [ 1.529617] Freeing initrd memory: 26140K1752worker2 # [ 3.564070] systemd[1]: Starting Rule-based Manager for Device Events and Files...1753lb # [ 1.536375] tun: Universal TUN/TAP device driver, 1.61754worker2 # [ 3.541625] systemd-modules-load[74]: Inserted module 'dm_mod'1755lb # [ 1.541278] thunder_xcv, ver 1.01756lb # [ 1.541339] thunder_bgx, ver 1.01757lb # [ 1.541362] nicpf, ver 1.01758lb # [ 1.541992] e1000: Intel(R) PRO/1000 Network Driver1759lb # [ 1.542001] e1000: Copyright (c) 1999-2006 Intel Corporation.1760lb # [ 1.542028] e1000e: Intel(R) PRO/1000 Network Driver1761lb # [ 1.542036] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1762lb # [ 1.542068] igb: Intel(R) Gigabit Ethernet Network Driver1763lb # [ 1.542075] igb: Copyright (c) 2007-2014 Intel Corporation.1764lb # [ 1.542098] igbvf: Intel(R) Gigabit Virtual Function Network Driver1765lb # [ 1.542104] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1766lb # [ 1.542247] sky2: driver version 1.301767client # [ 3.225652] systemd[1]: Starting Apply Kernel Variables...1768lb # [ 1.551215] usbcore: registered new interface driver usb-storage1769lb # [ 1.551345] usbcore: registered new interface driver usbserial_generic1770lb # [ 1.551363] usbserial: USB Serial support registered for generic1771worker2 # [ 3.554324] systemd-modules-load[74]: Module 'virtio_balloon' is built in1772lb # [ 1.552015] hv_vmbus: registering driver hyperv_keyboard1773worker2 # [ 3.583915] systemd[1]: Started Journal Service.1774lb # [ 1.556419] ehci-pci 0000:00:0a.0: EHCI Host Controller1775lb # [ 1.556458] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11776lb # [ 1.556725] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001777worker2 # [ 3.559967] systemd-modules-load[74]: Module 'virtio_console' is built in1778lb # [ 1.559342] rtc-pl031 9010000.pl031: registered as rtc01779lb # [ 1.559381] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:21:22 UTC (1789906882)1780lb # [ 1.559808] i2c_dev: i2c /dev entries driver1781worker2 # [ 3.564748] systemd-modules-load[74]: Inserted module 'virtio_gpu'1782lb # [ 1.565157] sdhci: Secure Digital Host Controller Interface driver1783lb # [ 1.565176] sdhci: Copyright(c) Pierre Ossman1784lb # [ 1.565504] Synopsys Designware Multimedia Card Interface Driver1785lb # [ 1.565977] sdhci-pltfm: SDHCI platform and OF driver helper1786lb # [ 1.566392] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001787worker2 # [ 3.572565] systemd-modules-load[74]: Module 'virtio_rng' is built in1788client # [ 3.248449] systemd[1]: Finished Create Static Device Nodes in /dev.1789worker2 # [ 3.576639] systemd[1]: Starting Create System Files and Directories...1790client # [ 3.252870] systemd[1]: Reached target Preparation for Local File Systems.1791client # [ 3.254479] systemd[1]: Reached target Local File Systems.1792lb # [ 1.579731] hub 1-0:1.0: USB hub found1793lb # [ 1.579772] hub 1-0:1.0: 6 ports detected1794worker2 # [ 3.582640] systemd[1]: Finished Apply Kernel Variables.1795lb # [ 1.581346] hid: raw HID events driver (C) Jiri Kosina1796lb # [ 1.581636] usbcore: registered new interface driver usbhid1797lb # [ 1.581643] usbhid: USB HID core driver1798lb # [ 1.584736] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1799lb # [ 1.588135] drop_monitor: Initializing network drop monitor service1800client # [ 3.266025] systemd[1]: Starting Create System Files and Directories...1801lb # [ 1.588395] NET: Registered PF_INET6 protocol family1802lb # [ 1.591267] Segment Routing with IPv61803lb # [ 1.591288] In-situ OAM (IOAM) with IPv61804lb # [ 1.591326] NET: Registered PF_PACKET protocol family1805lb # [ 1.593581] 9pnet: Installing 9P2000 support1806lb # [ 1.596833] Key type dns_resolver registered1807lb # [ 1.604232] registered taskstats version 11808lb # [ 1.604452] Loading compiled-in X.509 certificates1809client # [ 3.292984] systemd[1]: Starting Rule-based Manager for Device Events and Files...1810lb # [ 1.614416] Demotion targets for Node 0: null1811lb # [ 1.614656] Key type .fscrypt registered1812lb # [ 1.614668] Key type fscrypt-provisioning registered1813lb # [ 1.614787] ima: No TPM chip found, activating TPM-bypass!1814client # [ 3.297121] systemd[1]: Finished Apply Kernel Variables.1815lb # [ 1.614819] ima: Allocated hash algorithm: sha11816lb # [ 1.614866] ima: No architecture policies found1817lb # [ 1.622384] input: gpio-keys as /devices/platform/gpio-keys/input/input01818worker1 # [ 3.529275] systemd-journald[73]: Collecting audit messages is disabled.1819worker1 # [ 3.541619] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1820worker1 # [ 3.543559] systemd[1]: Starting Create Static Device Nodes in /dev...1821lb # [ 1.645348] clk: Disabling unused clocks1822lb # [ 1.645390] PM: genpd: Disabling unused power domains1823lb # [ 1.651347] Freeing unused kernel memory: 4736K1824lb # [ 1.651606] Run /init as init process1825lb # [ 1.668872] systemd[1]: Successfully made /usr/ read-only.1826worker1 # [ 3.636662] systemd[1]: Started Journal Service.1827worker1 # [ 3.440619] systemd[1]: Finished Create Static Device Nodes in /dev.1828worker1 # [ 3.442405] systemd[1]: Reached target Preparation for Local File Systems.1829worker1 # [ 3.443819] systemd[1]: Reached target Local File Systems.1830worker1 # [ 3.448282] systemd[1]: Starting Create System Files and Directories...1831worker1 # [ 3.489729] systemd[1]: Starting Rule-based Manager for Device Events and Files...1832lb # [ 1.865547] usb 1-1: new high-speed USB device number 2 using ehci-pci1833worker1 # [ 3.809642] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1834worker1 # [ 3.813092] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1835worker1 # [ 3.561610] systemd[1]: Finished Create System Files and Directories.1836worker1 # [ 3.722557] systemd-modules-load[74]: Inserted module 'dm_mod'1837worker1 # [ 3.724740] systemd-modules-load[74]: Module 'virtio_balloon' is built in1838worker1 # [ 3.726228] systemd-modules-load[74]: Module 'virtio_console' is built in1839worker1 # [ 3.748577] systemd-udevd[85]: Using default interface naming scheme 'v261'.1840lb # [ 2.019724] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1841lb # [ 2.019774] systemd[1]: Detected virtualization qemu.1842lb # [ 2.019838] systemd[1]: Detected architecture arm64.1843lb # [ 2.019862] systemd[1]: Running in initrd.1844lb # [ 2.021137] systemd[1]: Initializing machine ID from random generator.1845worker1 # [ 3.989586] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01846worker1 # [ 3.989837] [drm] features: -virgl +edid -resource_blob -host_visible1847worker1 # [ 3.989856] [drm] features: -context_init1848worker1 # [ 3.990629] [drm] number of scanouts: 11849worker1 # [ 3.990650] [drm] number of cap sets: 01850worker1 # [ 4.004194] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1851worker1 # [ 4.004230] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01852worker1 # [ 3.812542] systemd[1]: Started Rule-based Manager for Device Events and Files.1853worker2 # [ 4.119975] systemd[1]: Finished Create System Files and Directories.1854worker1 # [ 4.037722] Console: switching to colour frame buffer device 160x501855lb # [ 2.116927] systemd[1]: Hostname set to <lb>.1856worker1 # [ 4.064960] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1857worker1 # [ 3.850374] systemd-modules-load[74]: Inserted module 'virtio_gpu'1858worker1 # [ 3.851975] systemd-modules-load[74]: Module 'virtio_rng' is built in1859worker1 # [ 3.922946] systemd[1]: Finished Load Kernel Modules.1860worker1 # [ 3.929245] systemd[1]: Starting Apply Kernel Variables...1861worker2 # [ 4.241195] systemd-udevd[80]: Using default interface naming scheme 'v261'.1862worker2 # [ 4.278108] systemd[1]: Started Rule-based Manager for Device Events and Files.1863lb # [ 2.355867] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11864client # [ 4.084286] systemd-udevd[88]: Using default interface naming scheme 'v261'.1865client # [ 4.240582] systemd[1]: Finished Create System Files and Directories.1866worker1 # [ 4.278478] systemd[1]: Finished Apply Kernel Variables.1867lb # [ 2.594731] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01868client # [ 4.274958] systemd[1]: Started Rule-based Manager for Device Events and Files.1869worker1 # [ 4.326388] systemd[1]: Starting Virtual Console Setup...1870client # [ 4.373085] systemd[1]: Starting Virtual Console Setup...1871lb # [ 2.714762] usb 1-2: new high-speed USB device number 3 using ehci-pci1872lb # [ 2.764814] systemd[1]: bpf-restrict-fs: LSM BPF program attached1873client # [ 4.440670] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1874client # [ 4.454345] systemd[1]: Finished Virtual Console Setup.1875lb # [ 2.858257] systemd[1]: Queued start job for default target Initrd Default Target.1876lb # [ 2.913135] systemd[1]: Created slice Slice /system/modprobe.1877lb # [ 2.914878] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1878lb # [ 2.916725] systemd[1]: Expecting device /dev/disk/by-label/nixos...1879lb # [ 2.916779] systemd[1]: Reached target Path Units.1880lb # [ 2.916802] systemd[1]: Reached target Slice Units.1881lb # [ 2.916823] systemd[1]: Reached target Swaps.1882lb # [ 2.916843] systemd[1]: Reached target Timer Units.1883lb # [ 2.917062] systemd[1]: Listening on D-Bus System Message Bus Socket.1884lb # [ 2.917304] systemd[1]: Listening on Journal Socket (/dev/log).1885lb # [ 2.917487] systemd[1]: Listening on Journal Sockets.1886lb # [ 2.917602] systemd[1]: Listening on udev Control Socket.1887lb # [ 2.917704] systemd[1]: Listening on udev Kernel Socket.1888lb # [ 2.917728] systemd[1]: Reached target Socket Units.1889lb # [ 2.931092] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21890worker2 # [ 4.937195] systemd[1]: Starting Virtual Console Setup...1891lb # [ 2.931300] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01892lb # [ 2.938830] systemd[1]: Starting Create List of Static Device Nodes...1893lb # [ 2.950676] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1894lb # [ 2.950815] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1895lb # [ 2.958700] systemd[1]: Mounting Kernel Configuration File System...1896worker1 # [ 4.690639] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones.1897worker1 # [ 4.695331] systemd[1]: Finished Virtual Console Setup.1898lb # [ 3.063699] systemd[1]: Starting Journal Service...1899lb # [ 3.128035] systemd[1]: Starting Load Kernel Modules...1900lb # [ 3.142749] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1901lb # [ 3.153852] systemd[1]: Starting Coldplug All udev Devices...1902lb # [ 3.171261] systemd[1]: Finished Create List of Static Device Nodes.1903lb # [ 3.173894] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1904worker2 # [ 5.180663] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1905lb # [ 3.227511] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1906lb # [ 3.228056] systemd[1]: Mounted Kernel Configuration File System.1907worker2 # [ 5.237369] systemd[1]: Finished Virtual Console Setup.1908lb # [ 3.230589] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1909lb # [ 3.287330] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1910lb # [ 3.299053] systemd[1]: Starting Create Static Device Nodes in /dev...1911lb # [ 3.313606] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1912lb # [ 3.330768] systemd-journald[73]: Collecting audit messages is disabled.1913lb # [ 3.335546] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1914lb # [ 3.353859] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01915lb # [ 3.354144] [drm] features: -virgl +edid -resource_blob -host_visible1916lb # [ 3.354156] [drm] features: -context_init1917lb # [ 3.368343] [drm] number of scanouts: 11918lb # [ 3.368386] [drm] number of cap sets: 01919lb # [ 3.379246] systemd[1]: Finished Create Static Device Nodes in /dev.1920lb # [ 3.379506] systemd[1]: Reached target Preparation for Local File Systems.1921lb # [ 3.379535] systemd[1]: Reached target Local File Systems.1922lb # [ 3.384970] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1923lb # [ 3.384996] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01924lb # [ 3.393589] systemd[1]: Starting Rule-based Manager for Device Events and Files...1925lb # [ 3.422879] Console: switching to colour frame buffer device 160x501926lb # [ 3.424184] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1927lb # [ 3.479073] systemd[1]: Finished Load Kernel Modules.1928lb # [ 3.511901] systemd[1]: Starting Apply Kernel Variables...1929lb # [ 3.611409] systemd[1]: Finished Apply Kernel Variables.1930lb # [ 3.814781] systemd[1]: Started Rule-based Manager for Device Events and Files.1931lb # [ 3.861130] systemd[1]: Started Journal Service.1932lb # [ 3.828659] systemd-modules-load[74]: Inserted module 'dm_mod'1933lb # [ 3.832937] systemd-modules-load[74]: Module 'virtio_balloon' is built in1934lb # [ 3.839757] systemd-modules-load[74]: Module 'virtio_console' is built in1935lb # [ 3.846230] systemd-modules-load[74]: Inserted module 'virtio_gpu'1936worker1 # [ 5.594953] systemd[1]: Finished Coldplug All udev Devices.1937lb # [ 3.852440] systemd-modules-load[74]: Module 'virtio_rng' is built in1938worker1 # [ 5.597305] systemd[1]: Reached target System Initialization.1939worker1 # [ 5.598787] systemd[1]: Reached target Basic System.1940lb # [ 3.856970] systemd-udevd[80]: Using default interface naming scheme 'v261'.1941lb # [ 3.869736] systemd[1]: Starting Create System Files and Directories...1942worker2 # [ 5.954240] systemd[1]: Finished Coldplug All udev Devices.1943lb # [ 3.909927] systemd[1]: Finished Create System Files and Directories.1944worker2 # [ 5.955915] systemd[1]: Reached target System Initialization.1945worker2 # [ 5.957441] systemd[1]: Reached target Basic System.1946lb # [ 3.921935] systemd[1]: Starting Virtual Console Setup...1947client # [ 5.710033] systemd[1]: Finished Coldplug All udev Devices.1948client # [ 5.711559] systemd[1]: Reached target System Initialization.1949client # [ 5.712911] systemd[1]: Reached target Basic System.1950lb # [ 4.009567] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1951worker2 # [ 6.055911] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1952lb # [ 4.014760] systemd[1]: Finished Virtual Console Setup.1953worker1 # [ 5.764282] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1954worker1 # [ 5.771912] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1955client # [ 5.768764] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1956worker1 # [ 5.798056] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1957worker2 # [ 6.101181] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958client # [ 5.780761] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1959worker2 # [ 6.108337] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1960client # [ 5.799904] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1961worker1 # [ 5.869717] systemd[1]: Found device /dev/disk/by-label/nixos.1962worker1 # [ 5.876160] systemd[1]: Reached target Initrd Root Device.1963worker1 # [ 5.881287] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1964worker2 # [ 6.223910] systemd[1]: Found device /dev/disk/by-label/nixos.1965worker2 # [ 6.228945] systemd[1]: Reached target Initrd Root Device.1966worker2 # [ 6.233863] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1967client # [ 5.925893] systemd[1]: Found device /dev/disk/by-label/nixos.1968worker1 # [ 5.950911] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1969client # [ 5.929633] systemd[1]: Reached target Initrd Root Device.1970client # [ 5.931825] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1971worker1 # [ 5.964367] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1972worker1 # [ 5.968322] systemd[1]: Mounting /sysroot...1973worker2 # [ 6.289843] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1974worker2 # [ 6.299067] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1975worker2 # [ 6.302831] systemd[1]: Mounting /sysroot...1976worker1 # [ 6.236726] EXT4-fs (vda): mounted filesystem afe99b84-a84f-42bc-9ddd-909458e9ae32 r/w with ordered data mode. Quota mode: none.1977worker1 # [ 6.027528] systemd[1]: Mounted /sysroot.1978worker1 # [ 6.030796] systemd[1]: Reached target Initrd Root File System.1979client # [ 6.006980] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1980worker1 # [ 6.036365] systemd[1]: Starting Mountpoints Configured in the Real Root...1981client # [ 6.016269] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1982client # [ 6.020142] systemd[1]: Mounting /sysroot...1983worker2 # [ 6.384319] EXT4-fs (vda): mounted filesystem 9061be1e-fb1b-4754-893c-0822efb635be r/w with ordered data mode. Quota mode: none.1984worker2 # [ 6.361436] systemd[1]: Mounted /sysroot.1985worker2 # [ 6.365983] systemd[1]: Reached target Initrd Root File System.1986worker1 # [ 6.070640] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1987worker2 # [ 6.371344] systemd[1]: Starting Mountpoints Configured in the Real Root...1988worker1 # [ 6.075831] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1989worker1 # [ 6.083630] systemd[1]: Reloading...1990client # [ 6.235343] EXT4-fs (vda): mounted filesystem f96b7ead-f234-47b7-b7fb-9d2cc885e30f r/w with ordered data mode. Quota mode: none.1991worker2 # [ 6.403530] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1992client # [ 6.081403] systemd[1]: Mounted /sysroot.1993client # [ 6.082628] systemd[1]: Reached target Initrd Root File System.1994client # [ 6.086419] systemd[1]: Starting Mountpoints Configured in the Real Root...1995worker2 # [ 6.410438] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1996worker2 # [ 6.415777] systemd[1]: Reloading...1997client # [ 6.123501] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1998client # [ 6.129300] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1999client # [ 6.132910] systemd[1]: Reloading...2000worker1 # [ 6.340200] systemd[1]: Reloading finished in 257 ms.
loading 1,391 hidden lines…
3392worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3393lb # [ 19.748542] dhcpcd[652]: eth0: soliciting a DHCP lease3394lb # [ 19.753000] dhcpcd[652]: eth0: offered 10.0.2.15 from 10.0.2.23395lb # [ 19.760370] dhcpcd[652]: eth0: probing address 10.0.2.15/243396lb # [ 19.772815] postgresql-pre-start[687]: selecting default time zone ... UTC3397lb # [ 19.779219] postgresql-pre-start[687]: creating configuration files ... ok3398worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3399worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3400worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3401lb: waiting for unit niks3.service3402lb # [ 20.160818] dhcpcd[652]: eth0: soliciting an IPv6 router3403lb # [ 20.161765] dhcpcd[652]: eth0: Router Advertisement from fe80::23404lb # [ 20.162645] dhcpcd[652]: eth0: adding address fec0::5054:ff:fe12:3456/643405lb # [ 20.163591] dhcpcd[652]: eth0: adding route to fec0::/643406lb # [ 20.172335] dhcpcd[652]: eth0: adding default route via fe80::23407lb # [ 20.422259] postgresql-pre-start[687]: running bootstrap script ... ok3408lb # [ 22.220320] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3409lb # [ 22.225952] systemd[1]: Stopped Virtual Console Setup.3410lb # [ 22.226881] systemd[1]: Stopping Virtual Console Setup...3411lb # [ 22.244984] systemd[1]: Starting Virtual Console Setup...3412lb # [ 22.359484] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3413lb # [ 22.369396] systemd[1]: Stopped Virtual Console Setup.3414lb # [ 22.391137] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3415lb # [ 22.405205] systemd[1]: Starting Virtual Console Setup...3416lb # [ 22.417252] postgresql-pre-start[687]: performing post-bootstrap initialization ... ok3417lb # [ 22.613419] systemd-logind[511]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3418worker1 # [ 24.625847] dhcpcd[672]: eth0: leased 10.0.2.15 for 86400 seconds3419worker1 # [ 24.626906] dhcpcd[672]: eth0: adding route to 10.0.2.0/243420worker1 # [ 24.627064] dhcpcd[672]: eth0: adding default route via 10.0.2.23421lb # [ 22.948331] postgresql-pre-start[687]: syncing data to disk ... ok3422lb # [ 22.949393] postgresql-pre-start[687]: initdb: warning: enabling "trust" authentication for local connections3423lb # [ 22.950696] postgresql-pre-start[687]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3424lb # [ 22.957888] postgresql-pre-start[687]: Success. You can now start the database server using:3425lb # [ 22.959379] postgresql-pre-start[687]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3426lb # [ 23.232695] postgres[829]: [829] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3427lb # [ 23.245837] postgres[829]: [829] LOG: listening on IPv6 address "::1", port 54323428lb # [ 23.247012] postgres[829]: [829] LOG: listening on IPv4 address "127.0.0.1", port 54323429lb # [ 23.253244] postgres[829]: [829] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3430lb # [ 23.291576] postgres[838]: [838] LOG: database system was shut down at 2026-09-20 12:21:43 GMT3431lb # [ 23.306289] postgres[829]: [829] LOG: database system is ready to accept connections3432lb # [ 23.311326] systemd-vconsole-setup[819]: Configuration of first virtual console was skipped, ignoring remaining ones.3433lb # [ 23.321254] systemd[1]: Finished Virtual Console Setup.3434lb # [ 23.332894] systemd[1]: Started PostgreSQL Server.3435lb # [ 23.344974] systemd[1]: Starting PostgreSQL Setup Scripts...3436worker1 # [ 25.142886] systemd[1]: Started DHCP Client.3437worker1 # [ 25.155299] systemd[1]: Reached target Multi-User System.3438worker1 # [ 25.157730] systemd[1]: Startup finished in 2.088s (kernel) + 7.732s (initrd) + 15.328s (userspace) = 25.148s.3439lb # [ 23.692482] postgresql-setup-start[850]: CREATE DATABASE3440lb # [ 23.779249] postgresql-setup-start[855]: CREATE ROLE3441lb # [ 23.814536] postgresql-setup-start[857]: ALTER DATABASE3442lb # [ 23.826529] systemd[1]: Finished PostgreSQL Setup Scripts.3443lb # [ 23.830820] systemd[1]: Reached target PostgreSQL.3444worker2 # [ 25.958867] dhcpcd[738]: eth0: leased 10.0.2.15 for 86400 seconds3445worker2 # [ 25.971422] dhcpcd[738]: eth0: adding route to 10.0.2.0/243446worker2 # [ 25.979101] dhcpcd[738]: eth0: adding default route via 10.0.2.23447client # [ 25.924339] dhcpcd[625]: eth0: leased 10.0.2.15 for 86400 seconds3448client # [ 25.927932] dhcpcd[625]: eth0: adding route to 10.0.2.0/243449client # [ 25.930619] dhcpcd[625]: eth0: adding default route via 10.0.2.23450worker2 # [ 26.460592] systemd[1]: Started DHCP Client.3451worker2 # [ 26.464279] systemd[1]: Reached target Multi-User System.3452worker2 # [ 26.465923] systemd[1]: Startup finished in 1.878s (kernel) + 7.959s (initrd) + 16.627s (userspace) = 26.465s.3453client # [ 26.249518] systemd[1]: Started DHCP Client.3454client # [ 26.256891] systemd[1]: Reached target Multi-User System.3455client # [ 26.258562] systemd[1]: Startup finished in 1.943s (kernel) + 7.795s (initrd) + 16.518s (userspace) = 26.258s.3456lb # [ 25.142129] dhcpcd[652]: eth0: leased 10.0.2.15 for 86400 seconds3457lb # [ 25.143336] dhcpcd[652]: eth0: adding route to 10.0.2.0/243458lb # [ 25.144437] dhcpcd[652]: eth0: adding default route via 10.0.2.23459lb # [ 25.373186] systemd[1]: Started DHCP Client.3460lb # [ 25.377077] systemd[1]: Reached target Network is Online.3461lb # [ 25.390383] systemd[1]: Started Envoy reverse proxy.3462lb # [ 25.398123] systemd[1]: Started mock-oidc.service.3463lb # [ 25.556590] mock-oidc-server[935]: Mock OIDC Server running3464lb # [ 25.558473] mock-oidc-server[935]: OIDC Address: 192.168.1.2:80803465lb # [ 25.559385] mock-oidc-server[935]: Issue Address: 0.0.0.0:80813466lb # [ 25.560431] mock-oidc-server[935]: Issuer: http://192.168.1.2:8080/oidc3467lb # [ 25.561836] mock-oidc-server[935]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3468lb # [ 25.563344] mock-oidc-server[935]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3469lb # [ 25.565539] mock-oidc-server[935]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3470lb # [ 26.275885] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3471lb # [ 26.278127] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:469] statically linked extensions:3472lb # [ 26.279595] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3473lb # [ 26.285014] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3474lb # [ 26.287709] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3475lb # [ 26.290691] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3476lb # [ 26.292931] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3477lb # [ 26.295312] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3478lb # [ 26.298955] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3479lb # [ 26.301746] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3480lb # [ 26.305421] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3481lb # [ 26.307959] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3482lb # [ 26.310440] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3483lb # [ 26.336454] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3484lb # [ 26.338323] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3485lb # [ 26.342316] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3486lb # [ 26.345391] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3487lb # [ 26.347789] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3488lb # [ 26.352303] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3489lb # [ 26.355505] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3490lb # [ 26.364292] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3491lb # [ 26.372309] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3492lb # [ 26.374701] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3493lb # [ 26.376766] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3494lb # [ 26.378683] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3495lb # [ 26.380929] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3496lb # [ 26.382948] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3497lb # [ 26.388915] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3498lb # [ 26.392184] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3499lb # [ 26.393981] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3500lb # [ 26.396118] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83501lb # [ 26.398119] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3502lb # [ 26.402307] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3503lb # [ 26.405446] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3504lb # [ 26.407479] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3505lb # [ 26.414059] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3506lb # [ 26.445632] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3507lb # [ 26.448645] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3508lb # [ 26.450928] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3509lb # [ 26.453257] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3510lb # [ 26.456886] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3511lb # [ 26.459982] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3512lb # [ 26.463027] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3513lb # [ 26.466400] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3514lb # [ 26.471254] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3515lb # [ 26.475002] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3516lb # [ 26.477247] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3517lb # [ 26.479212] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3518lb # [ 26.486881] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3519lb # [ 26.489086] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3520lb # [ 26.491441] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3521lb # [ 26.493729] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3522lb # [ 26.497259] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3523lb # [ 26.499532] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3524lb # [ 26.501830] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3525lb # [ 26.506882] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23526lb # [ 26.509603] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3527lb # [ 26.512433] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3528lb # [ 26.514475] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3529lb # [ 26.517131] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3530lb # [ 26.520361] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3531lb # [ 26.523554] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3532lb # [ 26.525568] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3533lb # [ 26.528365] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3534lb # [ 26.530278] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3535lb # [ 26.539384] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3536lb # [ 26.542207] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3537lb # [ 26.549519] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3538lb # [ 26.551406] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13539lb # [ 26.553934] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3540lb # [ 26.555874] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3541lb # [ 26.558101] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3542lb # [ 26.561395] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23543lb # [ 26.563159] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3544lb # [ 26.565234] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3545lb # [ 26.571272] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3546lb # [ 26.575595] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3547lb # [ 26.579216] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3548lb # [ 26.582128] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3549lb # [ 26.586970] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3550lb # [ 26.589732] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3551lb # [ 26.591815] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3552lb # [ 26.594171] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3553lb # [ 26.598034] envoy[934]: [2026-09-20 12:21:47.257][934][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3554lb # [ 26.601102] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3555lb # [ 26.603057] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3556lb # [ 26.606414] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3557lb # [ 26.621295] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3558lb # [ 26.623174] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3559lb # [ 26.628199] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3560lb # [ 26.633370] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3561lb # [ 26.637799] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3562lb # [ 26.647286] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3563lb # [ 26.649700] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3564lb # [ 26.652247] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3565lb # [ 26.655069] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3566lb # [ 26.658285] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3567lb # [ 26.660440] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3568lb # [ 26.662549] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23569lb # [ 26.664832] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3570lb # [ 26.676937] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3571lb # [ 26.678988] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3572lb # [ 26.682010] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3573lb # [ 26.684297] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3574lb # [ 26.687197] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3575lb # [ 26.690264] envoy[934]: [2026-09-20 12:21:47.258][934][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3576lb # [ 26.697381] envoy[934]: [2026-09-20 12:21:47.306][934][info][main] [source/server/server.cc:531] HTTP header map info:3577lb # [ 26.698980] envoy[934]: [2026-09-20 12:21:47.308][934][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3578lb # [ 26.715288] envoy[934]: [2026-09-20 12:21:47.308][934][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3579lb # [ 26.717539] envoy[934]: [2026-09-20 12:21:47.308][934][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3580lb # [ 26.727200] envoy[934]: [2026-09-20 12:21:47.308][934][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3581lb # [ 26.729437] envoy[934]: [2026-09-20 12:21:47.506][934][info][main] [source/server/server.cc:968] runtime: {}3582lb # [ 26.730959] envoy[934]: [2026-09-20 12:21:47.531][934][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3583lb # [ 26.733242] envoy[934]: [2026-09-20 12:21:47.531][934][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013584lb # [ 26.735056] envoy[934]: [2026-09-20 12:21:47.532][934][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013585lb # [ 26.736913] envoy[934]: [2026-09-20 12:21:47.538][934][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3586lb # [ 26.738630] envoy[934]: [2026-09-20 12:21:47.538][934][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3587lb # [ 26.740595] envoy[934]: [2026-09-20 12:21:47.538][934][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3588lb # [ 26.756730] envoy[934]: [2026-09-20 12:21:47.739][934][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3589worker2 # [ 28.806686] systemd[1]: Reached target Network is Online.3590lb # [ 26.767956] envoy[934]: [2026-09-20 12:21:47.750][934][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3591lb # [ 26.771059] envoy[934]: [2026-09-20 12:21:47.753][934][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3592lb # [ 26.774771] envoy[934]: [2026-09-20 12:21:47.753][934][info][main] [source/server/server.cc:1077] starting main dispatch loop3593worker2 # [ 28.820898] systemd[1]: Starting scheduler-token.service...3594worker1 # [ 28.520975] systemd[1]: Starting Nix worker-protocol over gRPC...3595worker2 # [ 28.963753] systemd[1]: scheduler-token.service: Deactivated successfully.3596worker2 # [ 28.973359] systemd[1]: Finished scheduler-token.service.3597worker2 # [ 28.975359] systemd[1]: scheduler-token.service: Consumed 64ms CPU time over 147ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3598worker2 # [ 28.985261] systemd[1]: Starting Nix worker-protocol over gRPC...3599worker1 # [ 28.779099] nix-grpc-daemon[797]: ts=2026-09-20T12:21:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3600worker1 # [ 28.794108] nix-grpc-daemon[797]: ts=2026-09-20T12:21:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3601worker1 # [ 28.796728] nix-grpc-daemon[797]: ts=2026-09-20T12:21:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13602worker1 # [ 28.843853] nix-grpc-daemon[797]: ts=2026-09-20T12:21:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3603worker1 # [ 28.849167] systemd[1]: Started Nix worker-protocol over gRPC.3604worker1 # [ 28.879646] nix-grpc-daemon[797]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3605lb # [ 27.140571] envoy[934]: [2026-09-20 12:21:48.122][934][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3606lb # [ 27.147138] envoy[934]: [2026-09-20 12:21:48.122][934][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3607lb # [ 27.151894] envoy[934]: [2026-09-20 12:21:48.122][934][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3608lb # [ 27.156481] envoy[934]: [2026-09-20 12:21:48.122][934][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3609worker2 # [ 29.243192] nix-grpc-daemon[860]: ts=2026-09-20T12:21:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3610worker2 # [ 29.258313] nix-grpc-daemon[860]: ts=2026-09-20T12:21:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3611worker2 # [ 29.260893] nix-grpc-daemon[860]: ts=2026-09-20T12:21:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13612worker2 # [ 29.315670] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3613worker2 # [ 29.322736] systemd[1]: Started Nix worker-protocol over gRPC.3614worker2 # [ 29.369089] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:500513615worker2 # [ 29.375480] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3616worker1 # [ 29.080843] nix-grpc-daemon[797]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3617worker2 # [ 29.577025] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:500513618worker2 # [ 29.580199] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker1 # [ 29.481249] nix-grpc-daemon[797]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3620worker2 # [ 29.781566] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 29.785900] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3622worker2 # [ 29.987616] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:500513623worker2 # [ 29.993709] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3624worker2 # [ 30.195140] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=scheduler_connected addr=lb:500513625worker2 # [ 30.201054] nix-grpc-daemon[860]: ts=2026-09-20T12:21:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3626worker2 # [ 30.402570] nix-grpc-daemon[860]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:500513627worker2 # [ 30.405167] nix-grpc-daemon[860]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3628worker1 # [ 30.282893] nix-grpc-daemon[797]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:500513629worker1 # [ 30.285241] nix-grpc-daemon[797]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3630worker2 # [ 30.606127] nix-grpc-daemon[860]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:500513631worker2 # [ 30.608465] nix-grpc-daemon[860]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3632worker1 # [ 30.486768] nix-grpc-daemon[797]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:500513633worker1 # [ 30.492483] nix-grpc-daemon[797]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3634worker2 # [ 30.810282] nix-grpc-daemon[860]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:500513635worker2 # [ 30.816224] nix-grpc-daemon[860]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3636worker1 # [ 30.693074] nix-grpc-daemon[797]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:500513637worker1 # [ 30.696216] nix-grpc-daemon[797]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3638worker2 # [ 31.017463] nix-grpc-daemon[860]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:500513639worker2 # [ 31.022885] nix-grpc-daemon[860]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3640worker1 # [ 30.897066] nix-grpc-daemon[797]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:500513641worker1 # [ 30.902446] nix-grpc-daemon[797]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3642worker2 # [ 31.224923] nix-grpc-daemon[860]: ts=2026-09-20T12:21:49Z level=info event=scheduler_connected addr=lb:500513643worker2 # [ 31.230593] nix-grpc-daemon[860]: ts=2026-09-20T12:21:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3644worker1 # [ 31.103293] nix-grpc-daemon[797]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 31.107960] nix-grpc-daemon[797]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3646worker2 # [ 31.433395] nix-grpc-daemon[860]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:500513647worker2 # [ 31.436336] nix-grpc-daemon[860]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3648worker1 # [ 31.311098] nix-grpc-daemon[797]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:500513649worker1 # [ 31.315826] nix-grpc-daemon[797]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3650worker2 # [ 31.634304] nix-grpc-daemon[860]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:500513651worker2 # [ 31.636581] nix-grpc-daemon[860]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3652worker1 # [ 31.512244] nix-grpc-daemon[797]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:500513653worker1 # [ 31.518019] nix-grpc-daemon[797]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3654worker2 # [ 31.838105] nix-grpc-daemon[860]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:500513655worker2 # [ 31.843853] nix-grpc-daemon[860]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3656worker1 # [ 31.718091] nix-grpc-daemon[797]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:500513657worker1 # [ 31.724529] nix-grpc-daemon[797]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3658worker2 # [ 32.044762] nix-grpc-daemon[860]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:500513659worker2 # [ 32.047769] nix-grpc-daemon[860]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3660worker1 # [ 31.925487] nix-grpc-daemon[797]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:500513661worker1 # [ 31.932078] nix-grpc-daemon[797]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3662worker2 # [ 32.248912] nix-grpc-daemon[860]: ts=2026-09-20T12:21:50Z level=info event=scheduler_connected addr=lb:500513663worker2 # [ 32.252405] nix-grpc-daemon[860]: ts=2026-09-20T12:21:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3664worker1 # [ 32.133107] nix-grpc-daemon[797]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:500513665worker1 # [ 32.139118] nix-grpc-daemon[797]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3666worker2 # [ 32.456604] nix-grpc-daemon[860]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:500513667worker2 # [ 32.460886] nix-grpc-daemon[860]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3668worker1 # [ 32.341413] nix-grpc-daemon[797]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:500513669worker1 # [ 32.343496] nix-grpc-daemon[797]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3670worker2 # [ 32.657719] nix-grpc-daemon[860]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:500513671worker2 # [ 32.663552] nix-grpc-daemon[860]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3672worker1 # [ 32.542824] nix-grpc-daemon[797]: ts=2026-09-20T12:21:52Z level=info event=scheduler_connected addr=lb:500513673worker1 # [ 32.549476] nix-grpc-daemon[797]: ts=2026-09-20T12:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3674worker2 # [ 32.864653] nix-grpc-daemon[860]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:500513675worker2 # [ 32.868796] nix-grpc-daemon[860]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3676worker1 # [ 32.750295] nix-grpc-daemon[797]: ts=2026-09-20T12:21:52Z level=info event=scheduler_connected addr=lb:500513677worker1 # [ 32.754573] nix-grpc-daemon[797]: ts=2026-09-20T12:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3678worker2 # [ 33.070113] nix-grpc-daemon[860]: ts=2026-09-20T12:21:51Z level=info event=scheduler_connected addr=lb:500513679worker2 # [ 33.075828] nix-grpc-daemon[860]: ts=2026-09-20T12:21:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3680worker1 # [ 32.955750] nix-grpc-daemon[797]: ts=2026-09-20T12:21:52Z level=info event=scheduler_connected addr=lb:500513681worker1 # [ 32.961838] nix-grpc-daemon[797]: ts=2026-09-20T12:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3682worker2 # [ 33.277520] nix-grpc-daemon[860]: ts=2026-09-20T12:21:52Z level=info event=scheduler_connected addr=lb:500513683worker2 # [ 33.283616] nix-grpc-daemon[860]: ts=2026-09-20T12:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3684worker1 # [ 33.162334] nix-grpc-daemon[797]: ts=2026-09-20T12:21:52Z level=info event=scheduler_connected addr=lb:500513685worker1 # [ 33.164698] nix-grpc-daemon[797]: ts=2026-09-20T12:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3686worker2 # [ 33.485003] nix-grpc-daemon[860]: ts=2026-09-20T12:21:52Z level=info event=scheduler_connected addr=lb:500513687worker2 # [ 33.487347] nix-grpc-daemon[860]: ts=2026-09-20T12:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3688worker1 # [ 33.367343] nix-grpc-daemon[797]: ts=2026-09-20T12:21:52Z level=info event=scheduler_connected addr=lb:500513689worker1 # [ 33.370748] nix-grpc-daemon[797]: ts=2026-09-20T12:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3690worker2 # [ 33.689073] nix-grpc-daemon[860]: ts=2026-09-20T12:21:52Z level=info event=scheduler_connected addr=lb:500513691worker2 # [ 33.694698] nix-grpc-daemon[860]: ts=2026-09-20T12:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3692worker1 # [ 33.568546] nix-grpc-daemon[797]: ts=2026-09-20T12:21:53Z level=info event=scheduler_connected addr=lb:500513693worker1 # [ 33.571210] nix-grpc-daemon[797]: ts=2026-09-20T12:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3694worker2 # [ 33.896151] nix-grpc-daemon[860]: ts=2026-09-20T12:21:52Z level=info event=scheduler_connected addr=lb:500513695worker2 # [ 33.901958] nix-grpc-daemon[860]: ts=2026-09-20T12:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3696worker1 # [ 33.772053] nix-grpc-daemon[797]: ts=2026-09-20T12:21:53Z level=info event=scheduler_connected addr=lb:500513697worker1 # [ 33.775379] nix-grpc-daemon[797]: ts=2026-09-20T12:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3698worker2 # [ 34.103426] nix-grpc-daemon[860]: ts=2026-09-20T12:21:52Z level=info event=scheduler_connected addr=lb:500513699worker2 # [ 34.109347] nix-grpc-daemon[860]: ts=2026-09-20T12:21:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3700worker1 # [ 33.976787] nix-grpc-daemon[797]: ts=2026-09-20T12:21:53Z level=info event=scheduler_connected addr=lb:500513701worker1 # [ 33.982919] nix-grpc-daemon[797]: ts=2026-09-20T12:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3702worker2 # [ 34.310190] nix-grpc-daemon[860]: ts=2026-09-20T12:21:53Z level=info event=scheduler_connected addr=lb:500513703worker2 # [ 34.313577] nix-grpc-daemon[860]: ts=2026-09-20T12:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3704worker1 # [ 34.184149] nix-grpc-daemon[797]: ts=2026-09-20T12:21:53Z level=info event=scheduler_connected addr=lb:500513705worker1 # [ 34.189965] nix-grpc-daemon[797]: ts=2026-09-20T12:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3706worker2 # [ 34.517353] nix-grpc-daemon[860]: ts=2026-09-20T12:21:53Z level=info event=scheduler_connected addr=lb:500513707worker2 # [ 34.521784] nix-grpc-daemon[860]: ts=2026-09-20T12:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3708worker1 # [ 34.391404] nix-grpc-daemon[797]: ts=2026-09-20T12:21:53Z level=info event=scheduler_connected addr=lb:500513709worker1 # [ 34.394373] nix-grpc-daemon[797]: ts=2026-09-20T12:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3710worker2 # [ 34.718044] nix-grpc-daemon[860]: ts=2026-09-20T12:21:53Z level=info event=scheduler_connected addr=lb:500513711worker2 # [ 34.721418] nix-grpc-daemon[860]: ts=2026-09-20T12:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3712worker1 # [ 34.595523] nix-grpc-daemon[797]: ts=2026-09-20T12:21:54Z level=info event=scheduler_connected addr=lb:500513713worker1 # [ 34.599907] nix-grpc-daemon[797]: ts=2026-09-20T12:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3714worker2 # [ 34.924834] nix-grpc-daemon[860]: ts=2026-09-20T12:21:53Z level=info event=scheduler_connected addr=lb:500513715worker2 # [ 34.930480] nix-grpc-daemon[860]: ts=2026-09-20T12:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3716worker1 # [ 34.800682] nix-grpc-daemon[797]: ts=2026-09-20T12:21:54Z level=info event=scheduler_connected addr=lb:500513717worker1 # [ 34.808610] nix-grpc-daemon[797]: ts=2026-09-20T12:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3718worker2 # [ 35.131926] nix-grpc-daemon[860]: ts=2026-09-20T12:21:53Z level=info event=scheduler_connected addr=lb:500513719worker2 # [ 35.137639] nix-grpc-daemon[860]: ts=2026-09-20T12:21:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3720worker1 # [ 35.009860] nix-grpc-daemon[797]: ts=2026-09-20T12:21:54Z level=info event=scheduler_connected addr=lb:500513721worker1 # [ 35.015576] nix-grpc-daemon[797]: ts=2026-09-20T12:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3722worker2 # [ 35.338555] nix-grpc-daemon[860]: ts=2026-09-20T12:21:54Z level=info event=scheduler_connected addr=lb:500513723worker2 # [ 35.341913] nix-grpc-daemon[860]: ts=2026-09-20T12:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3724worker1 # [ 35.216648] nix-grpc-daemon[797]: ts=2026-09-20T12:21:54Z level=info event=scheduler_connected addr=lb:500513725worker1 # [ 35.222093] nix-grpc-daemon[797]: ts=2026-09-20T12:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3726worker2 # [ 35.545388] nix-grpc-daemon[860]: ts=2026-09-20T12:21:54Z level=info event=scheduler_connected addr=lb:500513727worker2 # [ 35.550337] nix-grpc-daemon[860]: ts=2026-09-20T12:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3728worker1 # [ 35.425135] nix-grpc-daemon[797]: ts=2026-09-20T12:21:54Z level=info event=scheduler_connected addr=lb:500513729worker1 # [ 35.430296] nix-grpc-daemon[797]: ts=2026-09-20T12:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3730worker2 # [ 35.751377] nix-grpc-daemon[860]: ts=2026-09-20T12:21:54Z level=info event=scheduler_connected addr=lb:500513731worker2 # [ 35.754760] nix-grpc-daemon[860]: ts=2026-09-20T12:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3732worker1 # [ 35.631211] nix-grpc-daemon[797]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500513733worker1 # [ 35.637310] nix-grpc-daemon[797]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3734worker2 # [ 35.955611] nix-grpc-daemon[860]: ts=2026-09-20T12:21:54Z level=info event=scheduler_connected addr=lb:500513735worker2 # [ 35.957899] nix-grpc-daemon[860]: ts=2026-09-20T12:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3736worker1 # [ 35.838145] nix-grpc-daemon[797]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500513737worker1 # [ 35.843791] nix-grpc-daemon[797]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3738worker2 # [ 36.159198] nix-grpc-daemon[860]: ts=2026-09-20T12:21:54Z level=info event=scheduler_connected addr=lb:500513739worker2 # [ 36.168279] nix-grpc-daemon[860]: ts=2026-09-20T12:21:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3740worker1 # [ 36.044847] nix-grpc-daemon[797]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500513741worker1 # [ 36.050489] nix-grpc-daemon[797]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3742worker2 # [ 36.366466] nix-grpc-daemon[860]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500513743worker2 # [ 36.371658] nix-grpc-daemon[860]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3744worker1 # [ 36.251654] nix-grpc-daemon[797]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500513745worker1 # [ 36.257655] nix-grpc-daemon[797]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3746worker2 # [ 36.574140] nix-grpc-daemon[860]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500513747worker2 # [ 36.576840] nix-grpc-daemon[860]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3748worker1 # [ 36.461105] nix-grpc-daemon[797]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500513749worker1 # [ 36.465984] nix-grpc-daemon[797]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3750worker2 # [ 36.775627] nix-grpc-daemon[860]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500513751worker2 # [ 36.778818] nix-grpc-daemon[860]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3752worker1 # [ 36.661998] nix-grpc-daemon[797]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500513753worker1 # [ 36.667875] nix-grpc-daemon[797]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3754worker2 # [ 36.980670] nix-grpc-daemon[860]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500513755worker2 # [ 36.986565] nix-grpc-daemon[860]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3756worker1 # [ 36.868884] nix-grpc-daemon[797]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500513757worker1 # [ 36.874953] nix-grpc-daemon[797]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3758worker2 # [ 37.188175] nix-grpc-daemon[860]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500513759worker2 # [ 37.194112] nix-grpc-daemon[860]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3760worker1 # [ 37.076097] nix-grpc-daemon[797]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500513761worker1 # [ 37.081897] nix-grpc-daemon[797]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3762worker2 # [ 37.395373] nix-grpc-daemon[860]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500513763worker2 # [ 37.402090] nix-grpc-daemon[860]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3764worker1 # [ 37.283013] nix-grpc-daemon[797]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500513765worker1 # [ 37.289251] nix-grpc-daemon[797]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3766worker2 # [ 37.605715] nix-grpc-daemon[860]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500513767worker2 # [ 37.610341] nix-grpc-daemon[860]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3768worker1 # [ 37.492930] nix-grpc-daemon[797]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500513769worker1 # [ 37.497642] nix-grpc-daemon[797]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3770worker2 # [ 37.806915] nix-grpc-daemon[860]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500513771worker2 # [ 37.813340] nix-grpc-daemon[860]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3772lb # [ 35.821913] rustfs-bucket-start[1034]: mb s3://farm3773lb # [ 35.833944] systemd[1]: Finished rustfs-bucket.service.3774lb # [ 35.848675] systemd[1]: Starting niks3 server...3775worker1 # [ 37.692853] nix-grpc-daemon[797]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500513776worker1 # [ 37.695442] nix-grpc-daemon[797]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3777worker2 # [ 38.014845] nix-grpc-daemon[860]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500513778worker2 # [ 38.021054] nix-grpc-daemon[860]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3779lb # [ 36.081111] postgres[1049]: [1049] ERROR: relation "goose_db_version" does not exist at character 363780lb # [ 36.082579] postgres[1049]: [1049] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3781lb # [ 36.129284] niks3-server[1044]: 2026/09/20 12:21:57 OK 20241026095416_initial_model.sql (27ms)3782lb # [ 36.134216] niks3-server[1044]: 2026/09/20 12:21:57 OK 20251210153512_drop_unused_gin_index.sql (5.34ms)3783lb # [ 36.141830] niks3-server[1044]: 2026/09/20 12:21:57 OK 20251218171726_add_pins.sql (7.66ms)3784lb # [ 36.148796] niks3-server[1044]: 2026/09/20 12:21:57 OK 20260628120000_add_object_size_and_stats.sql (5.21ms)3785worker1 # [ 37.896235] nix-grpc-daemon[797]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500513786worker1 # [ 37.899499] nix-grpc-daemon[797]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3787lb # [ 36.158432] niks3-server[1044]: 2026/09/20 12:21:57 OK 20260905000000_add_claims.sql (7.74ms)3788lb # [ 36.165223] niks3-server[1044]: 2026/09/20 12:21:57 OK 20260920000000_drop_claims.sql (6.44ms)3789lb # [ 36.166695] niks3-server[1044]: 2026/09/20 12:21:57 goose: successfully migrated database to version: 202609200000003790lb # [ 36.173635] niks3-server[1044]: 2026/09/20 12:21:57 OK 1_commit_pending_closure.sql (8.39ms)3791lb # [ 36.177357] niks3-server[1044]: 2026/09/20 12:21:57 OK 2_object_stats_trigger.sql (3.53ms)3792worker2 # [ 38.221904] nix-grpc-daemon[860]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500513793lb # [ 36.180937] niks3-server[1044]: 2026/09/20 12:21:57 goose: up to current file version: 23794worker2 # [ 38.225160] nix-grpc-daemon[860]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3795lb # [ 36.184822] niks3-server[1044]: 2026/09/20 12:21:57 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3796lb # [ 36.256412] niks3-server[1044]: 2026/09/20 12:21:57 INFO Read proxy enabled — serving cache objects from S33797lb # [ 36.262979] niks3-server[1044]: 2026/09/20 12:21:57 INFO Using socket-activated listener address=0.0.0.0:57513798lb # [ 36.268542] niks3-server[1044]: 2026/09/20 12:21:57 INFO systemd watchdog enabled interval=15s3799lb # [ 36.276681] niks3-server[1044]: 2026/09/20 12:21:57 INFO Starting HTTP server address=0.0.0.0:57513800lb # [ 36.278771] systemd[1]: Started niks3 server.3801lb # [ 36.279528] systemd[1]: Reached target Multi-User System.3802lb # [ 36.286343] systemd[1]: Startup finished in 1.614s (kernel) + 6.551s (initrd) + 28.109s (userspace) = 36.275s.3803lb # [ 36.298604] niks3-server[1044]: 2026/09/20 12:21:57 INFO lead: acquired remote=192.168.1.4:535243804worker2 # [ 38.348081] nix-grpc-daemon[860]: ts=2026-09-20T12:21:57Z level=info event=scheduler_take_over3805worker1 # [ 38.100667] nix-grpc-daemon[797]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500513806worker2 # [ 38.405694] nix-grpc-daemon[860]: ts=2026-09-20T12:21:57Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:355703807lb: (finished: waiting for unit niks3.service, in 16.51 seconds)3808worker2 # [ 38.409650] nix-grpc-daemon[860]: ts=2026-09-20T12:21:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03809lb: waiting for TCP port 5751 on localhost3810worker2 # [ 38.426391] nix-grpc-daemon[860]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500513811worker2 # [ 38.443387] nix-grpc-daemon[860]: ts=2026-09-20T12:21:57Z level=info event=oidc_jwks provider=mock keys=13812worker2 # [ 38.445397] nix-grpc-daemon[860]: ts=2026-09-20T12:21:57Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:355703813worker2 # [ 38.447423] nix-grpc-daemon[860]: ts=2026-09-20T12:21:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03814lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3815lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)3816lb: waiting for unit envoy.service3817lb: (finished: waiting for unit envoy.service, in 0.06 seconds)3818lb: waiting for TCP port 50051 on localhost3819lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3820lb # [ 36.546995] envoy[934]: conn peer=[::1]:41746 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33821lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3822worker2 # [ 38.749162] systemd[1]: Starting scheduler-token.service...3823worker2 # [ 38.842325] systemd[1]: scheduler-token.service: Deactivated successfully.3824worker2 # [ 38.844222] systemd[1]: Finished scheduler-token.service.3825worker2 # [ 38.846542] systemd[1]: scheduler-token.service: Consumed 36ms CPU time over 96ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3826lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3827??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3828 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283829lb: must succeed: curl -sf localhost:9901/clusters3830lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3831lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.07 seconds)3832subtest: one node schedules and both builders hold a WorkerSession on it3833lb: must succeed: curl -sf localhost:9901/clusters3834lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3835worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3836worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)3837lb: must succeed: curl -sf localhost:9901/clusters3838lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3839lb: must succeed: curl -sf localhost:9901/clusters3840lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3841worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'3842worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds)3843(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.30 seconds)3844subtest: balancer auth: client cert, bearer token, nothing, unknown CN3845worker1 # [ 39.313008] nix-grpc-daemon[797]: ts=2026-09-20T12:21:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:576763846worker1 # [ 39.327588] systemd[1]: Started Nix Daemon.3847worker1 # [ 39.627016] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)3848worker1 # [ 39.667280] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 1/5)3849worker1 # [ 39.704978] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 2/5)3850worker1 # [ 39.780687] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 3/5)3851worker1 # [ 39.830060] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 356 ms (attempt 4/5)3852worker1 # [ 40.197050] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3853worker2 # [ 40.541304] nix-grpc-daemon[860]: ts=2026-09-20T12:21:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:355823854worker2 # [ 40.558094] systemd[1]: Started Nix Daemon.3855worker2 # [ 40.888406] nix-daemon[929]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3856worker2 # [ 40.916785] nix-grpc-daemon[860]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5)3857worker2 # [ 40.962892] nix-grpc-daemon[860]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 190 ms (attempt 2/5)3858worker2 # [ 41.158350] nix-grpc-daemon[860]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 375 ms (attempt 3/5)3859worker2 # [ 41.543038] nix-grpc-daemon[860]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 4/5)3860worker2 # [ 41.581160] nix-grpc-daemon[860]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3861worker2 # [ 41.596199] nix-grpc-daemon[860]: ts=2026-09-20T12:22:00Z level=debug event=path_info_miss path=b3zzhwnbvp6q0xs4x7kdpn6lczkhjzhc-nixos-system-client-test error="error: path '/nix/store/b3zzhwnbvp6q0xs4x7kdpn6lczkhjzhc-nixos-system-client-test' is required, but there is no substituter that can build it"3862worker1 # [ 41.325544] nix-grpc-daemon[797]: ts=2026-09-20T12:22:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:576763863worker1 # [ 41.345429] nix-grpc-daemon[797]: ts=2026-09-20T12:22:00Z level=debug event=path_info_miss path=b3zzhwnbvp6q0xs4x7kdpn6lczkhjzhc-nixos-system-client-test error="error: path '/nix/store/b3zzhwnbvp6q0xs4x7kdpn6lczkhjzhc-nixos-system-client-test' is required, but there is no substituter that can build it"3864client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3865client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)3866client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3867client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3868worker1 # [ 41.824839] nix-grpc-daemon[797]: ts=2026-09-20T12:22:01Z level=info event=oidc_jwks provider=mock keys=13869worker1 # [ 41.832423] nix-grpc-daemon[797]: ts=2026-09-20T12:22:01Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:576763870worker2 # [ 42.149559] nix-grpc-daemon[860]: ts=2026-09-20T12:22:00Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:355823871worker2 # [ 42.165962] nix-grpc-daemon[860]: ts=2026-09-20T12:22:00Z level=debug event=path_info_miss path=b3zzhwnbvp6q0xs4x7kdpn6lczkhjzhc-nixos-system-client-test error="error: path '/nix/store/b3zzhwnbvp6q0xs4x7kdpn6lczkhjzhc-nixos-system-client-test' is required, but there is no substituter that can build it"3872worker1 # [ 41.873046] nix-grpc-daemon[797]: ts=2026-09-20T12:22:01Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:576763873worker1 # [ 41.887746] nix-grpc-daemon[797]: ts=2026-09-20T12:22:01Z level=debug event=path_info_miss path=b3zzhwnbvp6q0xs4x7kdpn6lczkhjzhc-nixos-system-client-test error="error: path '/nix/store/b3zzhwnbvp6q0xs4x7kdpn6lczkhjzhc-nixos-system-client-test' is required, but there is no substituter that can build it"3874client: must succeed: rm -r /var/lib/nix-grpc-store3875client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.06 seconds)3876worker2 # [ 44.574804] nix-grpc-daemon[860]: ts=2026-09-20T12:22:03Z level=info event=denied method=QueryMissing cn=- role=none3877worker1 # [ 44.587614] nix-grpc-daemon[797]: ts=2026-09-20T12:22:04Z level=info event=denied method=QueryMissing cn=stranger role=none3878(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.70 seconds)3879subtest: DAG build is scheduled across workers and lands in the cache3880client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23881worker1 # [ 44.876517] nix-grpc-daemon[797]: ts=2026-09-20T12:22:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:576763882client # don't know how to build these paths:3883client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3884worker2 # [ 45.190631] nix-grpc-daemon[860]: ts=2026-09-20T12:22:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355823885worker2 # [ 45.236240] nix-grpc-daemon[860]: ts=2026-09-20T12:22:03Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03886worker2 # [ 45.243119] nix-grpc-daemon[860]: ts=2026-09-20T12:22:03Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13887worker1 # [ 44.989236] nix-grpc-daemon[797]: ts=2026-09-20T12:22:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576763888worker1 # [ 45.017646] nix-grpc-daemon[797]: ts=2026-09-20T12:22:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576763889client # copying 1 paths to 'lb:50051'...3890worker1 # [ 45.036793] nix-grpc-daemon[797]: ts=2026-09-20T12:22:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576763891client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3892worker1 # [ 45.073681] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)3893worker1 # [ 45.114940] nix-grpc-daemon[797]: ts=2026-09-20T12:22:04Z level=info event=niks3_push_started pid=8653894worker1 # [ 45.434733] nix-grpc-daemon[865]: time=2026-09-20T12:22:04.948Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""3895worker1 # [ 45.672225] nix-daemon[854]: accepted connection from pid 878, user nix-grpc-daemon (trusted)3896worker1 # [ 45.695646] nix-daemon[854]: reaped child process 881, status = succeeded3897worker1 # [ 45.904155] nix-daemon[854]: accepted connection from pid 883, user nix-grpc-daemon (trusted)3898worker1 # [ 45.925001] nix-daemon[854]: reaped child process 886, status = succeeded3899lb # [ 44.198241] niks3-server[1044]: 2026/09/20 12:22:05 INFO Received uploads request method=POST path=/api/pending_closures3900worker1 # [ 45.978348] nix-grpc-daemon[865]: time=2026-09-20T12:22:05.493Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3901worker1 # [ 45.981833] nix-grpc-daemon[865]: time=2026-09-20T12:22:05.497Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3902lb # [ 44.274866] niks3-server[1044]: 2026/09/20 12:22:05 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3903lb # [ 44.281482] niks3-server[1044]: 2026/09/20 12:22:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3904lb # [ 44.288344] niks3-server[1044]: 2026/09/20 12:22:05 INFO Signed narinfos id=1 count=13905worker1 # [ 46.037379] nix-grpc-daemon[865]: time=2026-09-20T12:22:05.552Z level=INFO msg="Uploading 1 narinfos"3906lb # [ 44.313251] niks3-server[1044]: 2026/09/20 12:22:05 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3907lb # [ 44.329397] niks3-server[1044]: 2026/09/20 12:22:05 INFO Completed upload id=13908worker1 # [ 46.074052] nix-grpc-daemon[865]: time=2026-09-20T12:22:05.589Z level=INFO msg="Upload complete. (630ms)"3909lb # [ 44.347361] niks3-server[1044]: 2026/09/20 12:22:05 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3910worker1 # [ 46.090698] nix-grpc-daemon[797]: ts=2026-09-20T12:22:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=1 paths=1 nar_bytes_in=5043911worker1 # [ 46.105146] nix-grpc-daemon[797]: ts=2026-09-20T12:22:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576763912worker1 # [ 46.109903] nix-grpc-daemon[865]: time=2026-09-20T12:22:05.604Z level=WARN msg="Failed to register uploaded object" key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo error="server returned 404: object is not pending upload\n"3913worker1 # [ 46.122790] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)3914worker1 # [ 46.128268] nix-daemon[854]: reaped child process 863, status = succeeded3915client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3916client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3917worker1 # [ 46.142573] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)3918client # farm-a> LOG-farm-a-t13919worker1 # [ 46.996532] nix-daemon[854]: reaped child process 890, status = succeeded3920worker1 # [ 47.202774] nix-daemon[854]: accepted connection from pid 905, user nix-grpc-daemon (trusted)3921worker1 # [ 47.226981] nix-daemon[854]: reaped child process 908, status = succeeded3922lb # [ 45.497913] niks3-server[1044]: 2026/09/20 12:22:06 INFO Received uploads request method=POST path=/api/pending_closures3923worker1 # [ 47.318717] nix-grpc-daemon[865]: time=2026-09-20T12:22:06.833Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3924worker1 # [ 47.321545] nix-grpc-daemon[865]: time=2026-09-20T12:22:06.836Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3925lb # [ 45.611913] niks3-server[1044]: 2026/09/20 12:22:06 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3926lb # [ 45.625777] niks3-server[1044]: 2026/09/20 12:22:06 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3927lb # [ 45.638055] niks3-server[1044]: 2026/09/20 12:22:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3928worker1 # [ 47.388185] nix-grpc-daemon[865]: time=2026-09-20T12:22:06.903Z level=INFO msg="Uploading 1 narinfos"3929lb # [ 45.645990] niks3-server[1044]: 2026/09/20 12:22:06 INFO Signed narinfos id=2 count=13930lb # [ 45.649262] niks3-server[1044]: 2026/09/20 12:22:06 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3931lb # [ 45.662871] niks3-server[1044]: 2026/09/20 12:22:06 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3932lb # [ 45.685050] niks3-server[1044]: 2026/09/20 12:22:06 INFO Completed upload id=23933worker1 # [ 47.431539] nix-grpc-daemon[865]: time=2026-09-20T12:22:06.946Z level=INFO msg="Upload complete. (476ms)"3934lb # [ 45.695877] niks3-server[1044]: 2026/09/20 12:22:06 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3935worker1 # [ 47.445635] nix-grpc-daemon[797]: ts=2026-09-20T12:22:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13936worker2 # [ 47.755362] nix-grpc-daemon[860]: ts=2026-09-20T12:22:06Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03937worker2 # [ 47.759684] nix-grpc-daemon[860]: ts=2026-09-20T12:22:06Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13938worker1 # [ 47.471284] nix-daemon[854]: reaped child process 888, status = succeeded3939worker1 # [ 47.501945] nix-grpc-daemon[797]: ts=2026-09-20T12:22:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576763940worker1 # [ 47.523934] nix-grpc-daemon[797]: ts=2026-09-20T12:22:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576763941worker1 # [ 47.545706] nix-grpc-daemon[865]: time=2026-09-20T12:22:07.061Z level=INFO msg="All 1 paths already cached"3942client # copying 1 paths to 'lb:50051'...3943worker1 # [ 47.557793] nix-grpc-daemon[797]: ts=2026-09-20T12:22:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576763944client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3945worker1 # [ 47.586584] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)3946worker1 # [ 47.831604] nix-daemon[854]: accepted connection from pid 912, user nix-grpc-daemon (trusted)3947worker1 # [ 47.857388] nix-daemon[854]: reaped child process 915, status = succeeded3948worker1 # [ 48.059596] nix-daemon[854]: accepted connection from pid 917, user nix-grpc-daemon (trusted)3949worker1 # [ 48.081880] nix-daemon[854]: reaped child process 920, status = succeeded3950lb # [ 46.351072] niks3-server[1044]: 2026/09/20 12:22:07 INFO Received uploads request method=POST path=/api/pending_closures3951worker1 # [ 48.114268] nix-grpc-daemon[865]: time=2026-09-20T12:22:07.627Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3952worker1 # [ 48.115917] nix-grpc-daemon[865]: time=2026-09-20T12:22:07.627Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3953lb # [ 46.404192] niks3-server[1044]: 2026/09/20 12:22:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3954worker1 # [ 48.157021] nix-grpc-daemon[865]: time=2026-09-20T12:22:07.672Z level=INFO msg="Uploading 1 narinfos"3955lb # [ 46.417473] niks3-server[1044]: 2026/09/20 12:22:07 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3956lb # [ 46.430067] niks3-server[1044]: 2026/09/20 12:22:07 INFO Signed narinfos id=3 count=13957lb # [ 46.440128] niks3-server[1044]: 2026/09/20 12:22:07 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3958lb # [ 46.452569] niks3-server[1044]: 2026/09/20 12:22:07 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3959worker1 # [ 48.202861] nix-grpc-daemon[865]: time=2026-09-20T12:22:07.718Z level=INFO msg="Upload complete. (594ms)"3960lb # [ 46.458713] niks3-server[1044]: 2026/09/20 12:22:07 INFO Completed upload id=33961lb # [ 46.462156] niks3-server[1044]: 2026/09/20 12:22:07 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3962worker1 # [ 48.208296] nix-grpc-daemon[797]: ts=2026-09-20T12:22:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=0 paths=1 nar_bytes_in=6243963worker1 # [ 48.217859] nix-grpc-daemon[797]: ts=2026-09-20T12:22:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576763964worker1 # [ 48.222182] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)3965worker1 # [ 48.226252] nix-daemon[854]: reaped child process 910, status = succeeded3966client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3967worker1 # [ 48.237677] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)3968client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3969lb # [ 46.760257] envoy[934]: conn peer=[2001:db8:1::1]:52640 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=20963970lb # [ 46.766319] envoy[934]: conn peer=[2001:db8:1::1]:55958 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=883971lb # [ 46.771671] envoy[934]: conn peer=[2001:db8:1::1]:55972 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=173972lb # [ 46.778710] envoy[934]: conn peer=[2001:db8:1::1]:55986 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=183973client # farm-b> LOG-farm-b-t13974worker1 # [ 48.867586] nix-daemon[854]: reaped child process 925, status = succeeded3975worker1 # [ 49.032388] nix-daemon[854]: accepted connection from pid 940, user nix-grpc-daemon (trusted)3976worker1 # [ 49.057192] nix-daemon[854]: reaped child process 943, status = succeeded3977lb # [ 47.327011] niks3-server[1044]: 2026/09/20 12:22:08 INFO Received uploads request method=POST path=/api/pending_closures3978worker1 # [ 49.082424] nix-grpc-daemon[865]: time=2026-09-20T12:22:08.597Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3979worker1 # [ 49.085327] nix-grpc-daemon[865]: time=2026-09-20T12:22:08.599Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3980lb # [ 47.381823] niks3-server[1044]: 2026/09/20 12:22:08 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3981lb # [ 47.395925] niks3-server[1044]: 2026/09/20 12:22:08 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3982lb # [ 47.403506] niks3-server[1044]: 2026/09/20 12:22:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3983worker1 # [ 49.153643] nix-grpc-daemon[865]: time=2026-09-20T12:22:08.668Z level=INFO msg="Uploading 1 narinfos"3984lb # [ 47.415057] niks3-server[1044]: 2026/09/20 12:22:08 INFO Signed narinfos id=4 count=13985lb # [ 47.421629] niks3-server[1044]: 2026/09/20 12:22:08 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3986lb # [ 47.436282] niks3-server[1044]: 2026/09/20 12:22:08 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3987worker1 # [ 49.188432] nix-grpc-daemon[865]: time=2026-09-20T12:22:08.703Z level=INFO msg="Upload complete. (339ms)"3988lb # [ 47.443951] niks3-server[1044]: 2026/09/20 12:22:08 INFO Completed upload id=43989worker1 # [ 49.194397] nix-grpc-daemon[797]: ts=2026-09-20T12:22:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=0 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13990lb # [ 47.449682] niks3-server[1044]: 2026/09/20 12:22:08 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3991worker1 # [ 49.204135] nix-daemon[854]: reaped child process 923, status = succeeded3992worker2 # [ 49.506621] nix-grpc-daemon[860]: ts=2026-09-20T12:22:08Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03993worker2 # [ 49.510448] nix-grpc-daemon[860]: ts=2026-09-20T12:22:08Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13994worker1 # [ 49.253420] nix-grpc-daemon[797]: ts=2026-09-20T12:22:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576763995worker1 # [ 49.269482] nix-grpc-daemon[797]: ts=2026-09-20T12:22:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576763996worker1 # [ 49.286256] nix-grpc-daemon[865]: time=2026-09-20T12:22:08.801Z level=INFO msg="All 2 paths already cached"3997client # copying 1 paths to 'lb:50051'...3998worker1 # [ 49.295496] nix-grpc-daemon[797]: ts=2026-09-20T12:22:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576763999client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4000worker1 # [ 49.312530] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4001worker1 # [ 49.502702] nix-daemon[854]: accepted connection from pid 947, user nix-grpc-daemon (trusted)4002worker1 # [ 49.529676] nix-daemon[854]: reaped child process 950, status = succeeded4003worker1 # [ 49.715470] nix-daemon[854]: accepted connection from pid 952, user nix-grpc-daemon (trusted)4004worker1 # [ 49.736320] nix-daemon[854]: reaped child process 955, status = succeeded4005lb # [ 48.005277] niks3-server[1044]: 2026/09/20 12:22:08 INFO Received uploads request method=POST path=/api/pending_closures4006worker1 # [ 49.766132] nix-grpc-daemon[865]: time=2026-09-20T12:22:09.281Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4007worker1 # [ 49.767777] nix-grpc-daemon[865]: time=2026-09-20T12:22:09.281Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4008lb # [ 48.054683] niks3-server[1044]: 2026/09/20 12:22:09 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4009worker1 # [ 49.811340] nix-grpc-daemon[865]: time=2026-09-20T12:22:09.326Z level=INFO msg="Uploading 1 narinfos"4010lb # [ 48.069596] niks3-server[1044]: 2026/09/20 12:22:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4011lb # [ 48.079794] niks3-server[1044]: 2026/09/20 12:22:09 INFO Signed narinfos id=5 count=14012lb # [ 48.086021] niks3-server[1044]: 2026/09/20 12:22:09 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4013lb # [ 48.094003] niks3-server[1044]: 2026/09/20 12:22:09 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4014worker1 # [ 49.846254] nix-grpc-daemon[865]: time=2026-09-20T12:22:09.361Z level=INFO msg="Upload complete. (524ms)"4015lb # [ 48.104165] niks3-server[1044]: 2026/09/20 12:22:09 INFO Completed upload id=54016lb # [ 48.108259] niks3-server[1044]: 2026/09/20 12:22:09 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4017worker1 # [ 49.856706] nix-grpc-daemon[797]: ts=2026-09-20T12:22:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=0 paths=1 nar_bytes_in=7524018worker1 # [ 49.876773] nix-grpc-daemon[797]: ts=2026-09-20T12:22:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764019worker1 # [ 49.886132] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4020worker1 # [ 49.892487] nix-daemon[854]: reaped child process 945, status = succeeded4021client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4022client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4023worker1 # [ 49.911171] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4024client # farm-top> LOG-farm-top-t14025worker1 # [ 51.538047] nix-daemon[854]: reaped child process 959, status = succeeded4026worker1 # [ 51.706476] nix-daemon[854]: accepted connection from pid 975, user nix-grpc-daemon (trusted)4027worker1 # [ 51.731789] nix-daemon[854]: reaped child process 978, status = succeeded4028lb # [ 50.003241] niks3-server[1044]: 2026/09/20 12:22:10 INFO Received uploads request method=POST path=/api/pending_closures4029worker1 # [ 51.760517] nix-grpc-daemon[865]: time=2026-09-20T12:22:11.273Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4030worker1 # [ 51.762145] nix-grpc-daemon[865]: time=2026-09-20T12:22:11.273Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4031lb # [ 50.053301] niks3-server[1044]: 2026/09/20 12:22:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4032worker1 # [ 51.804796] nix-grpc-daemon[865]: time=2026-09-20T12:22:11.319Z level=INFO msg="Uploading 1 narinfos"4033lb # [ 50.066729] niks3-server[1044]: 2026/09/20 12:22:11 INFO Signed narinfos id=6 count=14034lb # [ 50.092110] niks3-server[1044]: 2026/09/20 12:22:11 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4035lb # [ 50.098968] niks3-server[1044]: 2026/09/20 12:22:11 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4036lb # [ 50.108381] niks3-server[1044]: 2026/09/20 12:22:11 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4037lb # [ 50.118506] niks3-server[1044]: 2026/09/20 12:22:11 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4038worker1 # [ 51.866298] nix-grpc-daemon[865]: time=2026-09-20T12:22:11.381Z level=INFO msg="Upload complete. (338ms)"4039lb # [ 50.122956] niks3-server[1044]: 2026/09/20 12:22:11 INFO Completed upload id=64040worker1 # [ 51.872134] nix-grpc-daemon[797]: ts=2026-09-20T12:22:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14041lb # [ 50.127502] niks3-server[1044]: 2026/09/20 12:22:11 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4042worker1 # [ 51.882411] nix-daemon[854]: reaped child process 957, status = succeeded4043client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.31 seconds)4044client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4045client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.30 seconds)4046client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4047client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4048client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4049client # copying 3 paths...4050client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4051client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4052client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4053client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.70 seconds)4054(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.46 seconds)4055subtest: repeat is answered Cached by the scheduler without building4056worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4057worker1 # finding garbage collector roots...4058worker1 # deleting specified paths...4059worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4060worker1 # deleting unused links...4061worker1 # note: hard linking is currently saving 0.0 KiB4062worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.32 seconds)4063worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4064worker2 # finding garbage collector roots...4065worker2 # deleting specified paths...4066worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4067worker2 # deleting unused links...4068worker2 # note: hard linking is currently saving 0.0 KiB4069worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.36 seconds)4070client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24071worker1 # [ 54.053500] nix-grpc-daemon[797]: ts=2026-09-20T12:22:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:576764072client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4073client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4074worker2 # [ 54.383634] nix-grpc-daemon[860]: ts=2026-09-20T12:22:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355824075worker2 # [ 54.428207] nix-grpc-daemon[860]: ts=2026-09-20T12:22:13Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14076client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.42 seconds)4077client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4078client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.22 seconds)4079lb: must succeed: curl -sf localhost:9901/clusters4080lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4081lb: must succeed: curl -sf localhost:9901/clusters4082lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4083worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4084worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4085(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.65 seconds)4086subtest: inputs already in the cache are not sent to the scheduler4087lb: must succeed: curl -sf localhost:9901/clusters4088lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4089lb: must succeed: curl -sf localhost:9901/clusters4090lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4091worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4092worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4093client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24094worker2 # [ 55.486791] nix-grpc-daemon[860]: ts=2026-09-20T12:22:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:355824095client # don't know how to build these paths:4096client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4097worker1 # [ 55.199495] nix-grpc-daemon[797]: ts=2026-09-20T12:22:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576764098worker1 # [ 55.219549] nix-grpc-daemon[865]: time=2026-09-20T12:22:14.733Z level=INFO msg="All 2 paths already cached"4099worker2 # [ 55.541380] nix-grpc-daemon[860]: ts=2026-09-20T12:22:14Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04100worker2 # [ 55.548400] nix-grpc-daemon[860]: ts=2026-09-20T12:22:14Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14101worker1 # [ 55.291250] nix-grpc-daemon[797]: ts=2026-09-20T12:22:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764102worker1 # [ 55.309417] nix-grpc-daemon[797]: ts=2026-09-20T12:22:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576764103worker1 # [ 55.528894] nix-grpc-daemon[865]: time=2026-09-20T12:22:15.044Z level=INFO msg="All 2 paths already cached"4104client # copying 1 paths to 'lb:50051'...4105client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4106worker1 # [ 55.544161] nix-grpc-daemon[797]: ts=2026-09-20T12:22:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576764107worker1 # [ 55.562982] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4108worker1 # [ 55.796846] nix-daemon[854]: accepted connection from pid 995, user nix-grpc-daemon (trusted)4109worker1 # [ 55.819016] nix-daemon[854]: reaped child process 998, status = succeeded4110worker1 # [ 56.008166] nix-daemon[854]: accepted connection from pid 1000, user nix-grpc-daemon (trusted)4111worker1 # [ 56.027405] nix-daemon[854]: reaped child process 1003, status = succeeded4112lb # [ 54.299513] niks3-server[1044]: 2026/09/20 12:22:15 INFO Received uploads request method=POST path=/api/pending_closures4113worker1 # [ 56.244179] nix-grpc-daemon[865]: time=2026-09-20T12:22:15.758Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4114worker1 # [ 56.251372] nix-grpc-daemon[865]: time=2026-09-20T12:22:15.764Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4115lb # [ 54.537862] niks3-server[1044]: 2026/09/20 12:22:15 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4116worker1 # [ 56.297765] nix-grpc-daemon[865]: time=2026-09-20T12:22:15.812Z level=INFO msg="Uploading 1 narinfos"4117lb # [ 54.555292] niks3-server[1044]: 2026/09/20 12:22:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4118lb # [ 54.568449] niks3-server[1044]: 2026/09/20 12:22:15 INFO Signed narinfos id=7 count=14119lb # [ 54.575312] niks3-server[1044]: 2026/09/20 12:22:15 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4120lb # [ 54.587175] niks3-server[1044]: 2026/09/20 12:22:15 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4121lb # [ 54.647759] niks3-server[1044]: 2026/09/20 12:22:15 INFO Completed upload id=74122worker1 # [ 56.396345] nix-grpc-daemon[865]: time=2026-09-20T12:22:15.911Z level=INFO msg="Upload complete. (809ms)"4123lb # [ 54.654708] niks3-server[1044]: 2026/09/20 12:22:15 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4124worker1 # [ 56.411700] nix-grpc-daemon[797]: ts=2026-09-20T12:22:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=0 paths=1 nar_bytes_in=7524125worker1 # [ 56.433000] nix-grpc-daemon[797]: ts=2026-09-20T12:22:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764126worker1 # [ 56.445656] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4127worker1 # [ 56.454040] nix-daemon[854]: reaped child process 993, status = succeeded4128client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4129client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4130worker1 # [ 56.478670] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4131client # farm-top> LOG-farm-top-t1b4132worker1 # [ 57.514365] nix-daemon[854]: reaped child process 1007, status = succeeded4133worker1 # [ 57.677395] nix-daemon[854]: accepted connection from pid 1022, user nix-grpc-daemon (trusted)4134worker1 # [ 57.702136] nix-daemon[854]: reaped child process 1025, status = succeeded4135lb # [ 55.969038] niks3-server[1044]: 2026/09/20 12:22:16 INFO Received uploads request method=POST path=/api/pending_closures4136worker1 # [ 57.720616] nix-grpc-daemon[865]: time=2026-09-20T12:22:17.233Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4137worker1 # [ 57.722181] nix-grpc-daemon[865]: time=2026-09-20T12:22:17.234Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4138lb # [ 55.996301] niks3-server[1044]: 2026/09/20 12:22:16 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4139lb # [ 56.005976] niks3-server[1044]: 2026/09/20 12:22:16 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4140lb # [ 56.012092] niks3-server[1044]: 2026/09/20 12:22:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4141worker1 # [ 57.759336] nix-grpc-daemon[865]: time=2026-09-20T12:22:17.274Z level=INFO msg="Uploading 1 narinfos"4142lb # [ 56.016514] niks3-server[1044]: 2026/09/20 12:22:16 INFO Signed narinfos id=8 count=14143lb # [ 56.020681] niks3-server[1044]: 2026/09/20 12:22:17 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4144lb # [ 56.029556] niks3-server[1044]: 2026/09/20 12:22:17 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4145lb # [ 56.033502] niks3-server[1044]: 2026/09/20 12:22:17 INFO Completed upload id=84146worker1 # [ 57.777687] nix-grpc-daemon[865]: time=2026-09-20T12:22:17.293Z level=INFO msg="Upload complete. (282ms)"4147lb # [ 56.035378] niks3-server[1044]: 2026/09/20 12:22:17 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4148worker1 # [ 57.785010] nix-grpc-daemon[797]: ts=2026-09-20T12:22:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14149worker1 # [ 57.799190] nix-daemon[854]: reaped child process 1005, status = succeeded4150client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.92 seconds)4151client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4152client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.28 seconds)4153lb: must succeed: curl -sf localhost:9901/clusters4154lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4155lb: must succeed: curl -sf localhost:9901/clusters4156lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4157worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4158worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.08 seconds)4159(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.62 seconds)4160subtest: two clients wanting the same drv build it once4161client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4162client # [ 58.421188] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4163client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.12 seconds)4164client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4165lb # [ 56.762014] envoy[934]: conn peer=[2001:db8:1::1]:55990 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9536 tx=3837 ms=70304166lb # [ 56.767399] envoy[934]: conn peer=[2001:db8:1::1]:55788 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=1024167lb # [ 56.775143] envoy[934]: conn peer=[2001:db8:1::1]:55804 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1728 ms=26164168worker1 # [ 58.712929] nix-grpc-daemon[797]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:576764169client # Running as unit: dedup1.service; invocation ID: 94a3e2dd8c0e4d3bbb0d07907e9cb4a44170client # [ 58.698766] nix[966]: don't know how to build these paths:4171client # [ 58.701753] nix[966]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4172worker2 # [ 59.037769] nix-grpc-daemon[860]: ts=2026-09-20T12:22:17Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04173worker2 # [ 59.044743] nix-grpc-daemon[860]: ts=2026-09-20T12:22:17Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14174worker2 # [ 59.095791] nix-grpc-daemon[860]: ts=2026-09-20T12:22:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355824175worker2 # [ 59.119720] nix-grpc-daemon[860]: ts=2026-09-20T12:22:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355824176client # [ 58.804551] nix[966]: copying 1 paths to 'lb:50051'...4177client # [ 58.809845] nix[966]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4178worker2 # [ 59.133920] nix-grpc-daemon[860]: ts=2026-09-20T12:22:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355824179worker2 # [ 59.153094] nix-daemon[929]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4180worker2 # [ 59.180656] nix-grpc-daemon[860]: ts=2026-09-20T12:22:17Z level=info event=niks3_push_started pid=9804181worker2 # [ 59.474030] nix-grpc-daemon[980]: time=2026-09-20T12:22:18.208Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4182worker2 # [ 59.695258] nix-daemon[929]: accepted connection from pid 993, user nix-grpc-daemon (trusted)4183worker2 # [ 59.724141] nix-daemon[929]: reaped child process 996, status = succeeded4184client # [ 59.567001] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4185client # Running as unit: dedup2.service; invocation ID: 33f857f3250f4560bb75298a90e40c1a4186client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.16 seconds)4187worker2 # [ 59.946581] nix-daemon[929]: accepted connection from pid 998, user nix-grpc-daemon (trusted)4188worker2 # [ 59.969871] nix-daemon[929]: reaped child process 1001, status = succeeded4189lb # [ 57.942683] niks3-server[1044]: 2026/09/20 12:22:18 INFO Received uploads request method=POST path=/api/pending_closures4190worker2 # [ 59.999675] nix-grpc-daemon[980]: time=2026-09-20T12:22:18.735Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4191worker2 # [ 60.004438] nix-grpc-daemon[980]: time=2026-09-20T12:22:18.738Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4192lb # [ 57.994704] niks3-server[1044]: 2026/09/20 12:22:18 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4193lb # [ 58.005945] niks3-server[1044]: 2026/09/20 12:22:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4194worker2 # [ 60.057488] nix-grpc-daemon[980]: time=2026-09-20T12:22:18.792Z level=INFO msg="Uploading 1 narinfos"4195lb # [ 58.016749] niks3-server[1044]: 2026/09/20 12:22:18 INFO Signed narinfos id=9 count=14196lb # [ 58.027854] niks3-server[1044]: 2026/09/20 12:22:19 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4197lb # [ 58.044294] niks3-server[1044]: 2026/09/20 12:22:19 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4198worker2 # [ 60.096783] nix-grpc-daemon[980]: time=2026-09-20T12:22:18.832Z level=INFO msg="Upload complete. (613ms)"4199lb # [ 58.053749] niks3-server[1044]: 2026/09/20 12:22:19 INFO Completed upload id=94200lb # [ 58.059970] niks3-server[1044]: 2026/09/20 12:22:19 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4201worker2 # [ 60.103498] nix-grpc-daemon[860]: ts=2026-09-20T12:22:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=1 nar_bytes_in=4324202worker2 # [ 60.117884] nix-grpc-daemon[860]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355824203worker2 # [ 60.132779] nix-daemon[929]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4204worker2 # [ 60.136098] nix-daemon[929]: reaped child process 978, status = succeeded4205client # [ 59.822215] nix[966]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4206worker2 # [ 60.148806] nix-daemon[929]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4207worker2 # [ 60.264815] nix-grpc-daemon[860]: ts=2026-09-20T12:22:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:355824208client # [ 59.959030] nix[982]: this derivation will be built:4209worker2 # [ 60.290039] nix-grpc-daemon[860]: ts=2026-09-20T12:22:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:355824210client # [ 59.975543] nix[982]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4211worker2 # [ 60.316538] nix-grpc-daemon[860]: ts=2026-09-20T12:22:19Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04212client # [ 60.002796] nix[982]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4213worker2 # [ 60.326139] nix-grpc-daemon[860]: ts=2026-09-20T12:22:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355824214client: must succeed: sleep 24215client: (finished: must succeed: sleep 2, in 2.07 seconds)4216??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4217 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394218client: waiting for success: ! systemctl is-active dedup1 dedup24219??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4220 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394221worker2 # [ 63.814117] nix-daemon[929]: reaped child process 1009, status = succeeded4222worker2 # [ 64.016170] nix-daemon[929]: accepted connection from pid 1036, user nix-grpc-daemon (trusted)4223worker2 # [ 64.037403] nix-daemon[929]: reaped child process 1039, status = succeeded4224lb # [ 62.007350] niks3-server[1044]: 2026/09/20 12:22:22 INFO Received uploads request method=POST path=/api/pending_closures4225worker2 # [ 64.066958] nix-grpc-daemon[980]: time=2026-09-20T12:22:22.800Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4226worker2 # [ 64.069484] nix-grpc-daemon[980]: time=2026-09-20T12:22:22.800Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4227lb # [ 62.078561] niks3-server[1044]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4228worker2 # [ 64.136000] nix-grpc-daemon[980]: time=2026-09-20T12:22:22.869Z level=INFO msg="Uploading 1 narinfos"4229lb # [ 62.089185] niks3-server[1044]: 2026/09/20 12:22:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4230lb # [ 62.098833] niks3-server[1044]: 2026/09/20 12:22:23 INFO Signed narinfos id=10 count=14231lb # [ 62.105236] niks3-server[1044]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4232lb # [ 62.113471] niks3-server[1044]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4233lb # [ 62.120254] niks3-server[1044]: 2026/09/20 12:22:23 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4234lb # [ 62.134088] niks3-server[1044]: 2026/09/20 12:22:23 INFO Completed upload id=104235worker2 # [ 64.178876] nix-grpc-daemon[980]: time=2026-09-20T12:22:22.914Z level=INFO msg="Upload complete. (415ms)"4236lb # [ 62.144890] niks3-server[1044]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4237worker2 # [ 64.190786] nix-grpc-daemon[860]: ts=2026-09-20T12:22:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14238worker2 # [ 64.208511] nix-grpc-daemon[860]: ts=2026-09-20T12:22:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14239worker2 # [ 64.214672] nix-daemon[929]: reaped child process 1007, status = succeeded4240client # [ 63.940869] systemd[1]: dedup2.service: Deactivated successfully.4241client # [ 63.945263] systemd[1]: dedup2.service: Consumed 209ms CPU time over 4.378s wall clock time, 31M memory peak, 7.6K incoming IP traffic, 6.6K outgoing IP traffic.4242client # [ 63.954685] systemd[1]: dedup1.service: Deactivated successfully.4243client # [ 63.957708] systemd[1]: dedup1.service: Consumed 184ms CPU time over 5.531s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4244client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds)4245client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4246client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4247worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4248worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4249worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4250worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4251worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4252worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds)4253worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4254worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds)4255(finished: subtest: two clients wanting the same drv build it once, in 6.44 seconds)4256subtest: build hook: nix-daemon with builders = grpc://lb4257client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4258client # [ 65.030815] systemd[1]: Started Nix Daemon.4259client # [ 65.257148] nix-daemon[1023]: accepted connection from pid 1020, user root (trusted)4260worker1 # [ 65.519995] nix-grpc-daemon[797]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:576764261worker2 # [ 65.827855] nix-grpc-daemon[860]: ts=2026-09-20T12:22:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355824262worker2 # [ 65.852937] nix-grpc-daemon[860]: ts=2026-09-20T12:22:24Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04263worker2 # [ 65.859384] nix-grpc-daemon[860]: ts=2026-09-20T12:22:24Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14264worker1 # [ 65.607725] nix-grpc-daemon[797]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764265worker1 # [ 65.630820] nix-grpc-daemon[797]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576764266worker1 # [ 65.652969] nix-grpc-daemon[797]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576764267worker1 # [ 65.685522] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4268worker1 # [ 65.955857] nix-daemon[854]: accepted connection from pid 1050, user nix-grpc-daemon (trusted)4269worker1 # [ 65.978901] nix-daemon[854]: reaped child process 1053, status = succeeded4270worker1 # [ 66.168855] nix-daemon[854]: accepted connection from pid 1055, user nix-grpc-daemon (trusted)4271worker1 # [ 66.190293] nix-daemon[854]: reaped child process 1058, status = succeeded4272lb # [ 64.459871] niks3-server[1044]: 2026/09/20 12:22:25 INFO Received uploads request method=POST path=/api/pending_closures4273worker1 # [ 66.218342] nix-grpc-daemon[865]: time=2026-09-20T12:22:25.733Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4274worker1 # [ 66.219896] nix-grpc-daemon[865]: time=2026-09-20T12:22:25.733Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4275lb # [ 64.500383] niks3-server[1044]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4276worker1 # [ 66.263263] nix-grpc-daemon[865]: time=2026-09-20T12:22:25.778Z level=INFO msg="Uploading 1 narinfos"4277lb # [ 64.520101] niks3-server[1044]: 2026/09/20 12:22:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4278lb # [ 64.530399] niks3-server[1044]: 2026/09/20 12:22:25 INFO Signed narinfos id=11 count=14279lb # [ 64.537821] niks3-server[1044]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4280lb # [ 64.550569] niks3-server[1044]: 2026/09/20 12:22:25 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4281worker1 # [ 66.301254] nix-grpc-daemon[865]: time=2026-09-20T12:22:25.816Z level=INFO msg="Upload complete. (593ms)"4282lb # [ 64.561286] niks3-server[1044]: 2026/09/20 12:22:25 INFO Completed upload id=114283lb # [ 64.563446] niks3-server[1044]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4284worker1 # [ 66.312457] nix-grpc-daemon[797]: ts=2026-09-20T12:22:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=0 paths=1 nar_bytes_in=5124285worker1 # [ 66.332650] nix-grpc-daemon[797]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764286worker1 # [ 66.342915] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4287worker1 # [ 66.350058] nix-daemon[854]: reaped child process 1048, status = succeeded4288worker1 # [ 66.368913] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4289worker1 # [ 67.815650] nix-daemon[854]: reaped child process 1062, status = succeeded4290worker1 # [ 68.021386] nix-daemon[854]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4291worker1 # [ 68.044443] nix-daemon[854]: reaped child process 1080, status = succeeded4292lb # [ 66.314404] niks3-server[1044]: 2026/09/20 12:22:27 INFO Received uploads request method=POST path=/api/pending_closures4293worker1 # [ 68.072599] nix-grpc-daemon[865]: time=2026-09-20T12:22:27.587Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4294worker1 # [ 68.074187] nix-grpc-daemon[865]: time=2026-09-20T12:22:27.587Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4295lb # [ 66.379796] niks3-server[1044]: 2026/09/20 12:22:27 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4296lb # [ 66.393657] niks3-server[1044]: 2026/09/20 12:22:27 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4297lb # [ 66.403873] niks3-server[1044]: 2026/09/20 12:22:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4298worker1 # [ 68.153807] nix-grpc-daemon[865]: time=2026-09-20T12:22:27.668Z level=INFO msg="Uploading 1 narinfos"4299lb # [ 66.411332] niks3-server[1044]: 2026/09/20 12:22:27 INFO Signed narinfos id=12 count=14300lb # [ 66.417687] niks3-server[1044]: 2026/09/20 12:22:27 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4301lb # [ 66.430581] niks3-server[1044]: 2026/09/20 12:22:27 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4302lb # [ 66.437332] niks3-server[1044]: 2026/09/20 12:22:27 INFO Completed upload id=124303worker1 # [ 68.180849] nix-grpc-daemon[865]: time=2026-09-20T12:22:27.696Z level=INFO msg="Upload complete. (397ms)"4304lb # [ 66.440460] niks3-server[1044]: 2026/09/20 12:22:27 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4305worker1 # [ 68.193617] nix-grpc-daemon[797]: ts=2026-09-20T12:22:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14306worker1 # [ 68.216906] nix-grpc-daemon[797]: ts=2026-09-20T12:22:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:576764307worker1 # [ 68.225733] nix-daemon[854]: reaped child process 1060, status = succeeded4308worker2 # [ 68.543914] nix-grpc-daemon[860]: ts=2026-09-20T12:22:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:355824309worker2 # [ 68.565941] nix-grpc-daemon[860]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4310worker2 # [ 68.595275] nix-grpc-daemon[860]: ts=2026-09-20T12:22:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=1 nar_bytes_out=1284311lb # [ 66.764654] envoy[934]: conn peer=[2001:db8:1::1]:55820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1374 ms=39564312lb # [ 66.770089] envoy[934]: conn peer=[2001:db8:1::1]:55810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1374 ms=52034313lb # [ 66.775234] envoy[934]: conn peer=[2001:db8:1::1]:38274 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3432 tx=1681 ms=28384314lb # [ 66.781273] envoy[934]: conn peer=[2001:db8:1::1]:38278 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=1204315worker2 # [ 68.904964] nix-grpc-daemon[860]: ts=2026-09-20T12:22:27Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:355824316worker1 # [ 68.617347] nix-grpc-daemon[797]: ts=2026-09-20T12:22:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576764317worker1 # [ 68.653282] nix-grpc-daemon[865]: time=2026-09-20T12:22:28.168Z level=INFO msg="All 1 paths already cached"4318worker2 # [ 68.978079] nix-grpc-daemon[860]: ts=2026-09-20T12:22:27Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04319worker2 # [ 68.985236] nix-grpc-daemon[860]: ts=2026-09-20T12:22:27Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14320worker1 # [ 68.690275] nix-grpc-daemon[797]: ts=2026-09-20T12:22:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764321worker1 # [ 68.712213] nix-grpc-daemon[797]: ts=2026-09-20T12:22:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576764322worker1 # [ 68.731273] nix-grpc-daemon[865]: time=2026-09-20T12:22:28.246Z level=INFO msg="All 1 paths already cached"4323worker1 # [ 68.744231] nix-grpc-daemon[797]: ts=2026-09-20T12:22:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576764324worker1 # [ 68.763431] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4325worker1 # [ 69.035421] nix-daemon[854]: accepted connection from pid 1084, user nix-grpc-daemon (trusted)4326worker1 # [ 69.062471] nix-daemon[854]: reaped child process 1087, status = succeeded4327worker1 # [ 69.265828] nix-daemon[854]: accepted connection from pid 1089, user nix-grpc-daemon (trusted)4328worker1 # [ 69.287297] nix-daemon[854]: reaped child process 1092, status = succeeded4329lb # [ 67.556921] niks3-server[1044]: 2026/09/20 12:22:28 INFO Received uploads request method=POST path=/api/pending_closures4330worker1 # [ 69.315353] nix-grpc-daemon[865]: time=2026-09-20T12:22:28.830Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4331worker1 # [ 69.317686] nix-grpc-daemon[865]: time=2026-09-20T12:22:28.832Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4332lb # [ 67.602675] niks3-server[1044]: 2026/09/20 12:22:28 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4333lb # [ 67.624803] niks3-server[1044]: 2026/09/20 12:22:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4334worker1 # [ 69.374741] nix-grpc-daemon[865]: time=2026-09-20T12:22:28.889Z level=INFO msg="Uploading 1 narinfos"4335lb # [ 67.638248] niks3-server[1044]: 2026/09/20 12:22:28 INFO Signed narinfos id=13 count=14336lb # [ 67.643737] niks3-server[1044]: 2026/09/20 12:22:28 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4337lb # [ 67.655853] niks3-server[1044]: 2026/09/20 12:22:28 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4338lb # [ 67.666348] niks3-server[1044]: 2026/09/20 12:22:28 INFO Completed upload id=134339worker1 # [ 69.409073] nix-grpc-daemon[865]: time=2026-09-20T12:22:28.924Z level=INFO msg="Upload complete. (622ms)"4340lb # [ 67.670405] niks3-server[1044]: 2026/09/20 12:22:28 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4341worker1 # [ 69.421444] nix-grpc-daemon[797]: ts=2026-09-20T12:22:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=0 paths=1 nar_bytes_in=6244342worker1 # [ 69.444808] nix-grpc-daemon[797]: ts=2026-09-20T12:22:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764343worker1 # [ 69.455368] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4344worker1 # [ 69.463405] nix-daemon[854]: reaped child process 1082, status = succeeded4345worker1 # [ 69.485683] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4346worker1 # [ 70.345054] nix-daemon[854]: reaped child process 1096, status = succeeded4347worker1 # [ 70.565343] nix-daemon[854]: accepted connection from pid 1111, user nix-grpc-daemon (trusted)4348worker1 # [ 70.586640] nix-daemon[854]: reaped child process 1114, status = succeeded4349lb # [ 68.858840] niks3-server[1044]: 2026/09/20 12:22:29 INFO Received uploads request method=POST path=/api/pending_closures4350worker1 # [ 70.616566] nix-grpc-daemon[865]: time=2026-09-20T12:22:30.130Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4351worker1 # [ 70.618264] nix-grpc-daemon[865]: time=2026-09-20T12:22:30.130Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4352lb # [ 68.910278] niks3-server[1044]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4353lb # [ 68.933705] niks3-server[1044]: 2026/09/20 12:22:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4354worker1 # [ 70.682998] nix-grpc-daemon[865]: time=2026-09-20T12:22:30.198Z level=INFO msg="Uploading 1 narinfos"4355lb # [ 68.944482] niks3-server[1044]: 2026/09/20 12:22:29 INFO Signed narinfos id=14 count=14356lb # [ 68.946579] niks3-server[1044]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4357lb # [ 68.956293] niks3-server[1044]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4358lb # [ 68.962261] niks3-server[1044]: 2026/09/20 12:22:29 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4359lb # [ 68.971312] niks3-server[1044]: 2026/09/20 12:22:29 INFO Completed upload id=144360worker1 # [ 70.715971] nix-grpc-daemon[865]: time=2026-09-20T12:22:30.231Z level=INFO msg="Upload complete. (415ms)"4361lb # [ 68.973797] niks3-server[1044]: 2026/09/20 12:22:29 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4362worker1 # [ 70.724788] nix-grpc-daemon[797]: ts=2026-09-20T12:22:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14363worker1 # [ 70.736155] nix-grpc-daemon[797]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:576764364worker1 # [ 70.738627] nix-daemon[854]: reaped child process 1094, status = succeeded4365worker1 # [ 70.761451] nix-grpc-daemon[797]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:576764366worker1 # [ 70.769255] nix-grpc-daemon[797]: ts=2026-09-20T12:22:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=0 paths=1 nar_bytes_out=1764367worker2 # [ 71.426402] nix-grpc-daemon[860]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:355824368worker2 # [ 71.431655] nix-grpc-daemon[860]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355824369worker2 # [ 71.455571] nix-grpc-daemon[980]: time=2026-09-20T12:22:30.190Z level=INFO msg="All 1 paths already cached"4370worker2 # [ 71.481101] nix-grpc-daemon[860]: ts=2026-09-20T12:22:30Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04371worker2 # [ 71.488887] nix-grpc-daemon[860]: ts=2026-09-20T12:22:30Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14372worker1 # [ 71.193968] nix-grpc-daemon[797]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764373worker1 # [ 71.214263] nix-grpc-daemon[797]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576764374worker1 # [ 71.230821] nix-grpc-daemon[865]: time=2026-09-20T12:22:30.746Z level=INFO msg="All 2 paths already cached"4375worker1 # [ 71.244108] nix-grpc-daemon[797]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576764376worker1 # [ 71.260352] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4377worker1 # [ 71.504214] nix-daemon[854]: accepted connection from pid 1118, user nix-grpc-daemon (trusted)4378worker1 # [ 71.535011] nix-daemon[854]: reaped child process 1121, status = succeeded4379worker1 # [ 71.753904] nix-daemon[854]: accepted connection from pid 1123, user nix-grpc-daemon (trusted)4380worker1 # [ 71.775888] nix-daemon[854]: reaped child process 1126, status = succeeded4381lb # [ 70.049735] niks3-server[1044]: 2026/09/20 12:22:31 INFO Received uploads request method=POST path=/api/pending_closures4382worker1 # [ 71.806378] nix-grpc-daemon[865]: time=2026-09-20T12:22:31.321Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4383worker1 # [ 71.808313] nix-grpc-daemon[865]: time=2026-09-20T12:22:31.321Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4384lb # [ 70.092588] niks3-server[1044]: 2026/09/20 12:22:31 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4385lb # [ 70.108495] niks3-server[1044]: 2026/09/20 12:22:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4386worker1 # [ 71.861696] nix-grpc-daemon[865]: time=2026-09-20T12:22:31.376Z level=INFO msg="Uploading 1 narinfos"4387lb # [ 70.122190] niks3-server[1044]: 2026/09/20 12:22:31 INFO Signed narinfos id=15 count=14388lb # [ 70.127776] niks3-server[1044]: 2026/09/20 12:22:31 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4389lb # [ 70.136241] niks3-server[1044]: 2026/09/20 12:22:31 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4390lb # [ 70.144157] niks3-server[1044]: 2026/09/20 12:22:31 INFO Completed upload id=154391worker1 # [ 71.887787] nix-grpc-daemon[865]: time=2026-09-20T12:22:31.403Z level=INFO msg="Upload complete. (609ms)"4392lb # [ 70.150655] niks3-server[1044]: 2026/09/20 12:22:31 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4393worker1 # [ 71.902127] nix-grpc-daemon[797]: ts=2026-09-20T12:22:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=0 paths=1 nar_bytes_in=7524394worker1 # [ 71.916423] nix-grpc-daemon[797]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764395worker1 # [ 71.926346] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4396worker1 # [ 71.932484] nix-daemon[854]: reaped child process 1116, status = succeeded4397worker1 # [ 71.948503] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4398worker1 # [ 73.405779] nix-daemon[854]: reaped child process 1130, status = succeeded4399worker1 # [ 73.618106] nix-daemon[854]: accepted connection from pid 1145, user nix-grpc-daemon (trusted)4400worker1 # [ 73.645764] nix-daemon[854]: reaped child process 1148, status = succeeded4401lb # [ 71.908777] niks3-server[1044]: 2026/09/20 12:22:32 INFO Received uploads request method=POST path=/api/pending_closures4402worker1 # [ 73.664580] nix-grpc-daemon[865]: time=2026-09-20T12:22:33.176Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4403worker1 # [ 73.666223] nix-grpc-daemon[865]: time=2026-09-20T12:22:33.176Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4404lb # [ 71.972795] niks3-server[1044]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4405worker1 # [ 73.728792] nix-grpc-daemon[865]: time=2026-09-20T12:22:33.243Z level=INFO msg="Uploading 1 narinfos"4406lb # [ 71.984522] niks3-server[1044]: 2026/09/20 12:22:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4407lb # [ 71.989970] niks3-server[1044]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4408lb # [ 71.997330] niks3-server[1044]: 2026/09/20 12:22:32 INFO Signed narinfos id=16 count=14409lb # [ 71.999416] niks3-server[1044]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4410lb # [ 72.011413] niks3-server[1044]: 2026/09/20 12:22:32 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4411lb # [ 72.020706] niks3-server[1044]: 2026/09/20 12:22:33 INFO Completed upload id=164412worker1 # [ 73.764918] nix-grpc-daemon[865]: time=2026-09-20T12:22:33.280Z level=INFO msg="Upload complete. (395ms)"4413lb # [ 72.023296] niks3-server[1044]: 2026/09/20 12:22:33 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4414worker1 # [ 73.777640] nix-grpc-daemon[797]: ts=2026-09-20T12:22:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14415worker2 # [ 74.087614] nix-grpc-daemon[860]: ts=2026-09-20T12:22:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:355824416worker1 # [ 73.802784] nix-daemon[854]: reaped child process 1128, status = succeeded4417worker2 # [ 74.104558] nix-grpc-daemon[860]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4418worker2 # [ 74.129085] nix-grpc-daemon[860]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4419worker2 # [ 74.188181] nix-grpc-daemon[860]: ts=2026-09-20T12:22:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:355824420worker2 # [ 74.195033] nix-grpc-daemon[860]: ts=2026-09-20T12:22:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=1 nar_bytes_out=2324421client # [ 74.015210] nix-daemon[1023]: reaped child process 1025, status = succeeded4422client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 9.26 seconds)4423client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4424client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4425client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4426client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds)4427client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4428client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4429(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 9.41 seconds)4430subtest: an input only one worker has still reaches the builder4431client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4432client # this derivation will be built:4433client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4434client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4435client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.53 seconds)4436client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4437client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.23 seconds)4438worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4439worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.30 seconds)4440worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4441worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds)4442client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24443client # [ 75.509561] nix-daemon[1023]: accepted connection from pid 1105, user root (trusted)4444client # this derivation will be built:4445client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4446worker1 # [ 75.752753] nix-grpc-daemon[797]: ts=2026-09-20T12:22:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:576764447client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4448worker1 # [ 75.759667] nix-grpc-daemon[797]: ts=2026-09-20T12:22:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576764449worker1 # [ 75.981312] nix-daemon[854]: accepted connection from pid 1155, user nix-grpc-daemon (trusted)4450worker1 # [ 76.005352] nix-daemon[854]: reaped child process 1158, status = succeeded4451lb # [ 74.273525] niks3-server[1044]: 2026/09/20 12:22:35 INFO Received uploads request method=POST path=/api/pending_closures4452worker1 # [ 76.024253] nix-grpc-daemon[865]: time=2026-09-20T12:22:35.539Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4453worker1 # [ 76.026286] nix-grpc-daemon[865]: time=2026-09-20T12:22:35.541Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4454lb # [ 74.296974] niks3-server[1044]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4455lb # [ 74.303417] niks3-server[1044]: 2026/09/20 12:22:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4456worker1 # [ 76.052076] nix-grpc-daemon[865]: time=2026-09-20T12:22:35.567Z level=INFO msg="Uploading 1 narinfos"4457lb # [ 74.311387] niks3-server[1044]: 2026/09/20 12:22:35 INFO Signed narinfos id=17 count=14458lb # [ 74.315131] niks3-server[1044]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4459lb # [ 74.321550] niks3-server[1044]: 2026/09/20 12:22:35 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4460lb # [ 74.327181] niks3-server[1044]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4461lb # [ 74.420723] niks3-server[1044]: 2026/09/20 12:22:35 INFO Completed upload id=174462worker1 # [ 76.165076] nix-grpc-daemon[865]: time=2026-09-20T12:22:35.680Z level=INFO msg="Upload complete. (398ms)"4463worker2 # [ 76.497011] nix-grpc-daemon[860]: ts=2026-09-20T12:22:35Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04464worker2 # [ 76.501292] nix-grpc-daemon[860]: ts=2026-09-20T12:22:35Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14465worker2 # [ 76.541241] nix-grpc-daemon[860]: ts=2026-09-20T12:22:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355824466worker2 # [ 76.553219] nix-grpc-daemon[860]: ts=2026-09-20T12:22:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355824467client # copying 2 paths to 'lb:50051'...4468client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4469worker2 # [ 76.572152] nix-grpc-daemon[860]: ts=2026-09-20T12:22:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355824470client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4471worker2 # [ 76.591647] nix-daemon[929]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4472worker2 # [ 76.809760] nix-daemon[929]: accepted connection from pid 1066, user nix-grpc-daemon (trusted)4473worker2 # [ 76.832186] nix-daemon[929]: reaped child process 1069, status = succeeded4474worker2 # [ 77.030245] nix-daemon[929]: accepted connection from pid 1071, user nix-grpc-daemon (trusted)4475worker2 # [ 77.051556] nix-daemon[929]: reaped child process 1074, status = succeeded4476lb # [ 75.019532] niks3-server[1044]: 2026/09/20 12:22:36 INFO Received uploads request method=POST path=/api/pending_closures4477lb # [ 75.032951] niks3-server[1044]: 2026/09/20 12:22:36 INFO Received uploads request method=POST path=/api/pending_closures4478worker2 # [ 77.088510] nix-grpc-daemon[980]: time=2026-09-20T12:22:35.822Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4479worker2 # [ 77.090078] nix-grpc-daemon[980]: time=2026-09-20T12:22:35.823Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4480worker2 # [ 77.091823] nix-grpc-daemon[980]: time=2026-09-20T12:22:35.823Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4481lb # [ 75.070306] niks3-server[1044]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4482lb # [ 75.086496] niks3-server[1044]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4483lb # [ 75.100401] niks3-server[1044]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4484lb # [ 75.110343] niks3-server[1044]: 2026/09/20 12:22:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4485worker2 # [ 77.163366] nix-grpc-daemon[980]: time=2026-09-20T12:22:35.898Z level=INFO msg="Uploading 3 narinfos"4486lb # [ 75.116617] niks3-server[1044]: 2026/09/20 12:22:36 INFO Signed narinfos id=18 count=14487lb # [ 75.122452] niks3-server[1044]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4488lb # [ 75.131066] niks3-server[1044]: 2026/09/20 12:22:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4489lb # [ 75.139246] niks3-server[1044]: 2026/09/20 12:22:36 INFO Signed narinfos id=19 count=24490lb # [ 75.149936] niks3-server[1044]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4491lb # [ 75.156634] niks3-server[1044]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4492lb # [ 75.165686] niks3-server[1044]: 2026/09/20 12:22:36 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4493lb # [ 75.172351] niks3-server[1044]: 2026/09/20 12:22:36 INFO Completed upload id=184494lb # [ 75.174142] niks3-server[1044]: 2026/09/20 12:22:36 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4495lb # [ 75.177562] niks3-server[1044]: 2026/09/20 12:22:36 INFO Completed upload id=194496worker2 # [ 77.221522] nix-grpc-daemon[980]: time=2026-09-20T12:22:35.957Z level=INFO msg="Upload complete. (608ms)"4497lb # [ 75.179750] niks3-server[1044]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4498worker2 # [ 77.233065] nix-grpc-daemon[860]: ts=2026-09-20T12:22:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=2 nar_bytes_in=9844499worker2 # [ 77.247059] nix-grpc-daemon[860]: ts=2026-09-20T12:22:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355824500worker2 # [ 77.254627] nix-daemon[929]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4501worker2 # [ 77.261122] nix-daemon[929]: reaped child process 1064, status = succeeded4502worker2 # [ 77.279015] nix-grpc-daemon[860]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4503client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4504worker2 # [ 77.295714] nix-daemon[929]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4505client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4506worker2 # [ 78.139497] nix-daemon[929]: reaped child process 1079, status = succeeded4507worker2 # [ 78.346867] nix-daemon[929]: accepted connection from pid 1094, user nix-grpc-daemon (trusted)4508worker2 # [ 78.369555] nix-daemon[929]: reaped child process 1097, status = succeeded4509lb # [ 76.339259] niks3-server[1044]: 2026/09/20 12:22:37 INFO Received uploads request method=POST path=/api/pending_closures4510worker2 # [ 78.396789] nix-grpc-daemon[980]: time=2026-09-20T12:22:37.131Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4511lb # [ 76.367914] niks3-server[1044]: 2026/09/20 12:22:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4512worker2 # [ 78.416721] nix-grpc-daemon[980]: time=2026-09-20T12:22:37.152Z level=INFO msg="Uploading 1 narinfos"4513lb # [ 76.372913] niks3-server[1044]: 2026/09/20 12:22:37 INFO Signed narinfos id=20 count=14514lb # [ 76.377693] niks3-server[1044]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4515lb # [ 76.386692] niks3-server[1044]: 2026/09/20 12:22:37 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4516lb # [ 76.404566] niks3-server[1044]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4517lb # [ 76.410219] niks3-server[1044]: 2026/09/20 12:22:37 INFO Completed upload id=204518worker2 # [ 78.454616] nix-grpc-daemon[980]: time=2026-09-20T12:22:37.190Z level=INFO msg="Upload complete. (341ms)"4519lb # [ 76.412935] niks3-server[1044]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4520worker2 # [ 78.462886] nix-grpc-daemon[860]: ts=2026-09-20T12:22:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14521worker2 # [ 78.480611] nix-daemon[929]: reaped child process 1076, status = succeeded4522client # copying 1 paths...4523worker1 # [ 78.212525] nix-grpc-daemon[797]: ts=2026-09-20T12:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:576764524worker1 # [ 78.229633] nix-grpc-daemon[797]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4525client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4526worker1 # [ 78.293047] nix-grpc-daemon[797]: ts=2026-09-20T12:22:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:576764527worker1 # [ 78.299479] nix-grpc-daemon[797]: ts=2026-09-20T12:22:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=0 paths=1 nar_bytes_out=1204528client # [ 78.410457] nix-daemon[1023]: reaped child process 1108, status = succeeded4529client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.17 seconds)4530client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24531lb # [ 76.767212] envoy[934]: conn peer=[2001:db8:1::1]:38290 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3903 tx=1893 ms=22274532lb # [ 76.773153] envoy[934]: conn peer=[2001:db8:1::1]:38306 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=784533lb # [ 76.778274] envoy[934]: conn peer=[2001:db8:1::1]:54056 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=407 ms=794534lb # [ 76.783431] envoy[934]: conn peer=[2001:db8:1::1]:54054 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4329 tx=2216 ms=28354535lb # [ 76.789462] envoy[934]: conn peer=[2001:db8:1::1]:54062 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1878 ms=26114536lb # [ 76.794831] envoy[934]: conn peer=[2001:db8:1::1]:54076 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=784537client # [ 78.688157] nix-daemon[1023]: accepted connection from pid 1126, user root (trusted)4538client # this derivation will be built:4539client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4540worker2 # [ 79.256764] nix-grpc-daemon[860]: ts=2026-09-20T12:22:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:355824541client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4542worker1 # [ 78.970502] nix-grpc-daemon[797]: ts=2026-09-20T12:22:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576764543worker1 # [ 78.984717] nix-grpc-daemon[865]: time=2026-09-20T12:22:38.499Z level=INFO msg="All 1 paths already cached"4544worker2 # [ 79.308440] nix-grpc-daemon[860]: ts=2026-09-20T12:22:38Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04545worker2 # [ 79.316349] nix-grpc-daemon[860]: ts=2026-09-20T12:22:38Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14546worker1 # [ 79.020726] nix-grpc-daemon[797]: ts=2026-09-20T12:22:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764547worker1 # [ 79.042823] nix-grpc-daemon[797]: ts=2026-09-20T12:22:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576764548client # copying 1 paths to 'lb:50051'...4549client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4550worker1 # [ 79.073002] nix-grpc-daemon[797]: ts=2026-09-20T12:22:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576764551worker1 # [ 79.093882] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4552worker1 # [ 79.125366] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5)4553worker1 # [ 79.204535] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 199 ms (attempt 2/5)4554worker1 # [ 79.413272] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 209 ms (attempt 3/5)4555worker1 # [ 79.630548] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 261 ms (attempt 4/5)4556worker1 # [ 79.902745] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4557worker1 # [ 79.916149] nix-grpc-daemon[797]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4558worker1 # [ 80.214017] nix-daemon[854]: accepted connection from pid 1167, user nix-grpc-daemon (trusted)4559worker1 # [ 80.239580] nix-daemon[854]: reaped child process 1170, status = succeeded4560worker1 # [ 80.451782] nix-daemon[854]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)4561worker1 # [ 80.476172] nix-daemon[854]: reaped child process 1175, status = succeeded4562lb # [ 78.747716] niks3-server[1044]: 2026/09/20 12:22:39 INFO Received uploads request method=POST path=/api/pending_closures4563worker1 # [ 80.504358] nix-grpc-daemon[865]: time=2026-09-20T12:22:40.019Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4564worker1 # [ 80.505982] nix-grpc-daemon[865]: time=2026-09-20T12:22:40.019Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4565lb # [ 78.791696] niks3-server[1044]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4566lb # [ 78.808380] niks3-server[1044]: 2026/09/20 12:22:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4567worker1 # [ 80.559216] nix-grpc-daemon[865]: time=2026-09-20T12:22:40.074Z level=INFO msg="Uploading 1 narinfos"4568lb # [ 78.816501] niks3-server[1044]: 2026/09/20 12:22:39 INFO Signed narinfos id=21 count=14569lb # [ 78.824920] niks3-server[1044]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4570lb # [ 78.841376] niks3-server[1044]: 2026/09/20 12:22:39 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4571lb # [ 78.855687] niks3-server[1044]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4572lb # [ 78.861601] niks3-server[1044]: 2026/09/20 12:22:39 INFO Completed upload id=214573worker1 # [ 80.605819] nix-grpc-daemon[865]: time=2026-09-20T12:22:40.121Z level=INFO msg="Upload complete. (645ms)"4574worker1 # [ 80.621970] nix-grpc-daemon[797]: ts=2026-09-20T12:22:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=1 paths=1 nar_bytes_in=5684575worker1 # [ 80.641239] nix-grpc-daemon[797]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576764576worker1 # [ 80.654957] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4577worker1 # [ 80.671826] nix-daemon[854]: reaped child process 1161, status = succeeded4578worker1 # [ 80.681702] nix-daemon[854]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4579client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4580client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4581worker1 # [ 81.730243] nix-daemon[854]: reaped child process 1179, status = succeeded4582worker1 # [ 81.939353] nix-daemon[854]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)4583worker1 # [ 81.964059] nix-daemon[854]: reaped child process 1197, status = succeeded4584lb # [ 80.234359] niks3-server[1044]: 2026/09/20 12:22:41 INFO Received uploads request method=POST path=/api/pending_closures4585worker1 # [ 81.992035] nix-grpc-daemon[865]: time=2026-09-20T12:22:41.505Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4586lb # [ 80.281049] niks3-server[1044]: 2026/09/20 12:22:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4587worker1 # [ 82.042262] nix-grpc-daemon[865]: time=2026-09-20T12:22:41.557Z level=INFO msg="Uploading 1 narinfos"4588lb # [ 80.298363] niks3-server[1044]: 2026/09/20 12:22:41 INFO Signed narinfos id=22 count=14589lb # [ 80.309186] niks3-server[1044]: 2026/09/20 12:22:41 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4590lb # [ 80.318331] niks3-server[1044]: 2026/09/20 12:22:41 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4591lb # [ 80.326867] niks3-server[1044]: 2026/09/20 12:22:41 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4592worker1 # [ 82.077429] nix-grpc-daemon[865]: time=2026-09-20T12:22:41.592Z level=INFO msg="Upload complete. (379ms)"4593lb # [ 80.335156] niks3-server[1044]: 2026/09/20 12:22:41 INFO Completed upload id=224594lb # [ 80.338191] niks3-server[1044]: 2026/09/20 12:22:41 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4595worker1 # [ 82.089528] nix-grpc-daemon[797]: ts=2026-09-20T12:22:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57676 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14596worker1 # [ 82.112467] nix-daemon[854]: reaped child process 1177, status = succeeded4597client # copying 1 paths...4598worker1 # [ 82.140409] nix-grpc-daemon[797]: ts=2026-09-20T12:22:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:576764599client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4600worker2 # [ 82.488457] nix-grpc-daemon[860]: ts=2026-09-20T12:22:41Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:355824601worker2 # [ 82.511164] nix-grpc-daemon[860]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4602worker2 # [ 82.530329] nix-grpc-daemon[860]: ts=2026-09-20T12:22:41Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=1 nar_bytes_out=1204603client # [ 82.378926] nix-daemon[1023]: reaped child process 1129, status = succeeded4604client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.96 seconds)4605client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24606client # [ 82.617428] nix-daemon[1023]: accepted connection from pid 1148, user root (trusted)4607client # this derivation will be built:4608client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4609worker2 # [ 83.159455] nix-grpc-daemon[860]: ts=2026-09-20T12:22:41Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:355824610client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4611worker1 # [ 82.865165] nix-grpc-daemon[797]: ts=2026-09-20T12:22:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576764612worker1 # [ 82.878545] nix-grpc-daemon[865]: time=2026-09-20T12:22:42.394Z level=INFO msg="All 1 paths already cached"4613worker2 # [ 83.199640] nix-grpc-daemon[860]: ts=2026-09-20T12:22:41Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04614worker2 # [ 83.208372] nix-grpc-daemon[860]: ts=2026-09-20T12:22:41Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14615worker2 # [ 83.218491] nix-grpc-daemon[860]: ts=2026-09-20T12:22:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355824616worker2 # [ 83.230986] nix-grpc-daemon[860]: ts=2026-09-20T12:22:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355824617worker2 # [ 83.248727] nix-grpc-daemon[980]: time=2026-09-20T12:22:41.983Z level=INFO msg="All 1 paths already cached"4618client # copying 1 paths to 'lb:50051'...4619client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4620worker2 # [ 83.260837] nix-grpc-daemon[860]: ts=2026-09-20T12:22:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355824621worker2 # [ 83.277795] nix-daemon[929]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4622worker2 # [ 83.500901] nix-daemon[929]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)4623worker2 # [ 83.525886] nix-daemon[929]: reaped child process 1109, status = succeeded4624worker2 # [ 83.707952] nix-daemon[929]: accepted connection from pid 1111, user nix-grpc-daemon (trusted)4625worker2 # [ 83.729633] nix-daemon[929]: reaped child process 1114, status = succeeded4626lb # [ 81.698115] niks3-server[1044]: 2026/09/20 12:22:42 INFO Received uploads request method=POST path=/api/pending_closures4627worker2 # [ 83.753134] nix-grpc-daemon[980]: time=2026-09-20T12:22:42.489Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4628worker2 # [ 83.755391] nix-grpc-daemon[980]: time=2026-09-20T12:22:42.491Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4629lb # [ 81.732004] niks3-server[1044]: 2026/09/20 12:22:42 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4630lb # [ 81.748631] niks3-server[1044]: 2026/09/20 12:22:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4631worker2 # [ 83.799146] nix-grpc-daemon[980]: time=2026-09-20T12:22:42.534Z level=INFO msg="Uploading 1 narinfos"4632lb # [ 81.761280] niks3-server[1044]: 2026/09/20 12:22:42 INFO Signed narinfos id=23 count=14633lb # [ 81.767065] niks3-server[1044]: 2026/09/20 12:22:42 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4634lb # [ 81.775495] niks3-server[1044]: 2026/09/20 12:22:42 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4635lb # [ 81.782069] niks3-server[1044]: 2026/09/20 12:22:42 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4636lb # [ 81.787457] niks3-server[1044]: 2026/09/20 12:22:42 INFO Completed upload id=234637worker2 # [ 83.831977] nix-grpc-daemon[980]: time=2026-09-20T12:22:42.567Z level=INFO msg="Upload complete. (535ms)"4638worker2 # [ 83.845230] nix-grpc-daemon[860]: ts=2026-09-20T12:22:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=1 nar_bytes_in=5684639worker2 # [ 83.860679] nix-grpc-daemon[860]: ts=2026-09-20T12:22:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355824640worker2 # [ 83.867125] nix-daemon[929]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4641worker2 # [ 83.873059] nix-daemon[929]: reaped child process 1104, status = succeeded4642client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4643worker2 # [ 83.888636] nix-daemon[929]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4644client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4645worker2 # [ 84.915163] nix-daemon[929]: reaped child process 1118, status = succeeded4646worker2 # [ 85.081659] nix-daemon[929]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)4647worker2 # [ 85.102986] nix-daemon[929]: reaped child process 1136, status = succeeded4648lb # [ 83.073070] niks3-server[1044]: 2026/09/20 12:22:44 INFO Received uploads request method=POST path=/api/pending_closures4649worker2 # [ 85.128478] nix-grpc-daemon[980]: time=2026-09-20T12:22:43.863Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4650worker2 # [ 85.159656] nix-grpc-daemon[980]: time=2026-09-20T12:22:43.895Z level=INFO msg="Uploading 1 narinfos"4651lb # [ 83.108933] niks3-server[1044]: 2026/09/20 12:22:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4652lb # [ 83.123760] niks3-server[1044]: 2026/09/20 12:22:44 INFO Signed narinfos id=24 count=14653lb # [ 83.130640] niks3-server[1044]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4654lb # [ 83.136419] niks3-server[1044]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4655lb # [ 83.144176] niks3-server[1044]: 2026/09/20 12:22:44 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4656lb # [ 83.152833] niks3-server[1044]: 2026/09/20 12:22:44 INFO Completed upload id=244657worker2 # [ 85.196258] nix-grpc-daemon[980]: time=2026-09-20T12:22:43.932Z level=INFO msg="Upload complete. (296ms)"4658lb # [ 83.156603] niks3-server[1044]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4659worker2 # [ 85.207427] nix-grpc-daemon[860]: ts=2026-09-20T12:22:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14660worker2 # [ 85.222101] nix-daemon[929]: reaped child process 1116, status = succeeded4661client # copying 1 paths...4662worker1 # [ 84.959377] nix-grpc-daemon[797]: ts=2026-09-20T12:22:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:576764663worker1 # [ 84.974248] nix-grpc-daemon[797]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4664client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4665worker2 # [ 85.322770] nix-grpc-daemon[860]: ts=2026-09-20T12:22:44Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:355824666worker2 # [ 85.328758] nix-grpc-daemon[860]: ts=2026-09-20T12:22:44Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35582 duration_s=0 paths=1 nar_bytes_out=1204667client # [ 85.086503] nix-daemon[1023]: reaped child process 1151, status = succeeded4668client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.71 seconds)4669(finished: subtest: an input only one worker has still reaches the builder, in 10.93 seconds)4670subtest: upload whose reference the worker lacks is completed from the cache4671client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4672client # this derivation will be built:4673client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4674client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4675client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.47 seconds)4676client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4677client # this derivation will be built:4678client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4679client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4680client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.45 seconds)4681client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4682client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.22 seconds)4683worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4684worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.26 seconds)4685worker2 # [ 86.911141] systemd[1]: Stopping Nix worker-protocol over gRPC...4686worker2 # [ 87.353717] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=signal_exit4687worker2 # [ 87.607758] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=scheduler_yield4688worker2 # [ 87.618787] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=scheduler_restarting addr=lb:500514689lb # [ 85.576584] niks3-server[1044]: 2026/09/20 12:22:46 INFO lead: released remote=192.168.1.4:535244690worker2 # [ 87.624349] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:355704691worker1 # [ 87.328197] nix-grpc-daemon[797]: ts=2026-09-20T12:22:46Z level=info event=scheduler_restarting addr=lb:500514692worker2 # [ 87.630804] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=worker_gone addr=192.168.1.4:500514693worker2 # [ 87.635267] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:355704694worker2 # [ 87.640087] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=worker_gone addr=192.168.1.3:500514695worker2 # [ 87.820710] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500514696worker1 # [ 87.527865] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500514697worker2 # [ 87.826081] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4698worker1 # [ 87.530299] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4699worker2 # [ 88.027245] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500514700worker2 # [ 88.031017] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4701worker1 # [ 87.731435] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500514702worker1 # [ 87.737172] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4703worker2 # [ 88.232641] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500514704worker1 # [ 87.938334] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500514705worker2 # [ 88.238127] nix-grpc-daemon[860]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4706worker1 # [ 87.943818] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4707lb # [ 86.282697] niks3-server[1044]: 2026/09/20 12:22:47 INFO lead: acquired remote=192.168.1.3:444264708worker1 # [ 88.028392] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_take_over4709worker2 # [ 88.441082] nix-grpc-daemon[860]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500514710worker1 # [ 88.144720] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500514711worker2 # [ 88.446175] nix-grpc-daemon[860]: ts=2026-09-20T12:22:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4712worker1 # [ 88.150216] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4713worker2 # [ 88.614164] nix-grpc-daemon[860]: ts=2026-09-20T12:22:47Z level=info event=scheduler_restarting4714worker1 # [ 88.353307] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500514715worker1 # [ 88.357579] nix-grpc-daemon[797]: ts=2026-09-20T12:22:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4716worker2 # [ 88.670239] nix-grpc-daemon[860]: ts=2026-09-20T12:22:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4717worker2 # [ 88.675740] nix-daemon[929]: reaped child process 931, status = succeeded4718lb # [ 86.765257] envoy[934]: conn peer=[2001:db8:1::1]:54082 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1805 ms=33394719lb # [ 86.770409] envoy[934]: conn peer=[2001:db8:1::1]:53870 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1154720lb # [ 86.775396] envoy[934]: conn peer=[2001:db8:1::1]:53886 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=234721lb # [ 86.781166] envoy[934]: conn peer=[2001:db8:1::1]:53884 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3725 tx=1918 ms=21824722lb # [ 86.786082] envoy[934]: conn peer=[2001:db8:1::4]:47218 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=38313 tx=2102 ms=593004723worker1 # [ 88.553878] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=info event=scheduler_connected addr=lb:500514724worker1 # [ 88.559461] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4725worker1 # [ 88.760665] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=info event=scheduler_connected addr=lb:500514726worker1 # [ 88.766374] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4727worker2 # [ 89.162246] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4728worker2 # [ 89.172961] systemd[1]: Stopped Nix worker-protocol over gRPC.4729worker2 # [ 89.175421] systemd[1]: nix-grpc-daemon.service: Consumed 2.124s CPU time over 1min 174ms wall clock time, 52M memory peak, 53.3K incoming IP traffic, 128K outgoing IP traffic.4730worker2 # [ 89.193971] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4731worker2 # [ 89.195932] systemd[1]: Closed Nix worker-protocol over gRPC.4732worker2 # [ 89.197744] systemd[1]: nix-grpc-daemon.socket: Consumed 876us CPU time over 1min 11.046s wall clock time, 256K memory peak, 73.5K incoming IP traffic, 63.9K outgoing IP traffic.4733lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4734lb: must succeed: curl -sf localhost:9901/clusters4735worker1 # [ 88.967224] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=info event=scheduler_connected addr=lb:500514736worker1 # [ 88.973027] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4737lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4738lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4739client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24740worker1 # [ 89.174126] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=info event=scheduler_connected addr=lb:500514741worker1 # [ 89.195221] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:447004742worker1 # [ 89.200367] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04743worker1 # [ 89.253965] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:576764744worker1 # [ 89.263797] nix-grpc-daemon[797]: ts=2026-09-20T12:22:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:576764745client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4746client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.30 seconds)4747worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4748worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4749worker2 # [ 89.710996] systemd[1]: Listening on Nix worker-protocol over gRPC.4750worker1 # [ 89.467090] systemd[1]: Stopping Nix worker-protocol over gRPC...4751worker1 # [ 89.905372] nix-grpc-daemon[797]: ts=2026-09-20T12:22:49Z level=info event=signal_exit4752worker1 # [ 90.133642] nix-grpc-daemon[797]: ts=2026-09-20T12:22:49Z level=info event=scheduler_yield4753worker1 # [ 90.138868] nix-grpc-daemon[797]: ts=2026-09-20T12:22:49Z level=info event=scheduler_restarting addr=lb:500514754worker1 # [ 90.142538] nix-grpc-daemon[797]: ts=2026-09-20T12:22:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:447004755worker1 # [ 90.144287] nix-grpc-daemon[797]: ts=2026-09-20T12:22:49Z level=info event=worker_gone addr=192.168.1.3:500514756lb # [ 88.405121] niks3-server[1044]: 2026/09/20 12:22:49 INFO lead: released remote=192.168.1.3:444264757worker2 # [ 90.521654] systemd[1]: Starting scheduler-token.service...4758worker2 # [ 90.639868] systemd[1]: scheduler-token.service: Deactivated successfully.4759worker1 # [ 90.341046] nix-grpc-daemon[797]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500514760worker2 # [ 90.648391] systemd[1]: Finished scheduler-token.service.4761worker1 # [ 90.347288] nix-grpc-daemon[797]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4762worker2 # [ 90.650198] systemd[1]: scheduler-token.service: Consumed 63ms CPU time over 125ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4763worker2 # [ 90.659874] systemd[1]: Starting Nix worker-protocol over gRPC...4764worker1 # [ 90.548348] nix-grpc-daemon[797]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500514765worker2 # [ 90.857043] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4766worker1 # [ 90.554079] nix-grpc-daemon[797]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4767worker2 # [ 90.860177] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4768worker2 # [ 90.864405] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14769worker2 # [ 90.873147] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4770worker2 # [ 90.875024] systemd[1]: Started Nix worker-protocol over gRPC.4771worker2 # [ 90.889329] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:49Z level=info event=scheduler_take_over4772lb # [ 88.845284] niks3-server[1044]: 2026/09/20 12:22:49 INFO lead: acquired remote=192.168.1.4:534024773worker2 # [ 90.907430] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500514774worker2 # [ 90.909414] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4775worker1 # [ 90.754824] nix-grpc-daemon[797]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500514776worker1 # [ 90.760697] nix-grpc-daemon[797]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4777worker2 # [ 91.111213] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500514778worker2 # [ 91.117015] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4779worker1 # [ 90.963812] nix-grpc-daemon[797]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500514780worker1 # [ 90.968278] nix-grpc-daemon[797]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4781worker2 # [ 91.318348] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500514782worker2 # [ 91.324136] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4783worker1 # [ 91.135518] nix-grpc-daemon[797]: ts=2026-09-20T12:22:50Z level=info event=scheduler_restarting4784worker1 # [ 91.187641] nix-grpc-daemon[797]: ts=2026-09-20T12:22:50Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4785worker1 # [ 91.202060] nix-daemon[854]: reaped child process 856, status = succeeded4786worker2 # [ 91.525537] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500514787worker2 # [ 91.530956] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4788worker2 # [ 91.732436] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500514789worker2 # [ 91.737874] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4790worker2 # [ 91.940797] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500514791worker2 # [ 91.958658] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:50Z level=info event=oidc_jwks provider=mock keys=14792worker2 # [ 91.963432] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:50Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:583904793worker2 # [ 91.969120] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04794worker1 # [ 92.018386] nix-grpc-daemon[797]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4795worker1 # [ 92.023064] nix-grpc-daemon[797]: E0000 00:00:1789906971.532474 840 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true4796worker1 # [ 92.050675] nix-grpc-daemon[797]: E0000 00:00:1789906971.566114 840 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4797worker1 # [ 92.770116] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4798worker1 # [ 92.774282] systemd[1]: Stopped Nix worker-protocol over gRPC.4799worker1 # [ 92.779913] systemd[1]: nix-grpc-daemon.service: Consumed 4.417s CPU time over 1min 4.251s wall clock time, 59.9M memory peak, 86.8K incoming IP traffic, 155.9K outgoing IP traffic.4800worker1 # [ 92.793925] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4801worker1 # [ 92.795924] systemd[1]: Closed Nix worker-protocol over gRPC.4802worker1 # [ 92.798504] systemd[1]: nix-grpc-daemon.socket: Consumed 964us CPU time over 1min 15.900s wall clock time, 256K memory peak, 83.7K incoming IP traffic, 70.1K outgoing IP traffic.4803lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4804lb: must succeed: curl -sf localhost:9901/clusters4805lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4806lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4807client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24808worker2 # [ 93.459806] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426604809worker2 # [ 93.475642] nix-daemon[929]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)4810worker2 # [ 93.505210] nix-grpc-daemon[1160]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5)4811worker2 # [ 93.602649] nix-grpc-daemon[1160]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 2/5)4812worker2 # [ 93.641495] nix-grpc-daemon[1160]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 3/5)4813worker2 # [ 93.748662] nix-grpc-daemon[1160]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 480 ms (attempt 4/5)4814worker2 # [ 94.238017] nix-grpc-daemon[1160]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4815client # copying 2 paths...4816client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4817client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4818worker2 # [ 94.264820] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:426604819worker2 # [ 94.277123] nix-daemon[929]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)4820worker2 # [ 94.299613] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:53Z level=info event=niks3_push_started pid=12164821worker2 # [ 94.504479] nix-grpc-daemon[1216]: time=2026-09-20T12:22:53.239Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4822worker2 # [ 94.689007] nix-daemon[929]: accepted connection from pid 1229, user nix-grpc-daemon (trusted)4823worker2 # [ 94.709220] nix-daemon[929]: reaped child process 1232, status = succeeded4824lb # [ 92.680384] niks3-server[1044]: 2026/09/20 12:22:53 INFO Received uploads request method=POST path=/api/pending_closures4825lb # [ 92.689997] niks3-server[1044]: 2026/09/20 12:22:53 INFO Received uploads request method=POST path=/api/pending_closures4826worker2 # [ 94.747342] nix-grpc-daemon[1216]: time=2026-09-20T12:22:53.480Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4827worker2 # [ 94.750240] nix-grpc-daemon[1216]: time=2026-09-20T12:22:53.480Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4828worker2 # [ 94.752416] nix-grpc-daemon[1216]: time=2026-09-20T12:22:53.481Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4829lb # [ 92.745183] niks3-server[1044]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4830lb # [ 92.761072] niks3-server[1044]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4831lb # [ 92.770691] niks3-server[1044]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4832lb # [ 92.779368] niks3-server[1044]: 2026/09/20 12:22:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4833lb # [ 92.785826] niks3-server[1044]: 2026/09/20 12:22:53 INFO Signed narinfos id=25 count=14834lb # [ 92.790811] niks3-server[1044]: 2026/09/20 12:22:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4835lb # [ 92.794172] niks3-server[1044]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4836lb # [ 92.803857] niks3-server[1044]: 2026/09/20 12:22:53 INFO Signed narinfos id=26 count=24837worker2 # [ 94.849472] nix-grpc-daemon[1216]: time=2026-09-20T12:22:53.584Z level=INFO msg="Uploading 3 narinfos"4838lb # [ 92.835057] niks3-server[1044]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4839lb # [ 92.846453] niks3-server[1044]: 2026/09/20 12:22:53 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4840lb # [ 92.852193] niks3-server[1044]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4841lb # [ 92.860946] niks3-server[1044]: 2026/09/20 12:22:53 INFO Completed upload id=254842worker2 # [ 94.907360] nix-grpc-daemon[1216]: time=2026-09-20T12:22:53.643Z level=INFO msg="Upload complete. (398ms)"4843lb # [ 92.865121] niks3-server[1044]: 2026/09/20 12:22:53 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4844lb # [ 92.868148] niks3-server[1044]: 2026/09/20 12:22:53 INFO Completed upload id=264845lb # [ 92.874854] niks3-server[1044]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4846worker2 # [ 94.924977] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42660 duration_s=0 paths=2 nar_bytes_in=3124847worker2 # [ 94.939664] nix-daemon[929]: reaped child process 1214, status = succeeded4848client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.76 seconds)4849worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4850worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4851worker1 # [ 94.791088] systemd[1]: Listening on Nix worker-protocol over gRPC.4852worker1 # [ 94.802004] systemd[1]: Starting Nix worker-protocol over gRPC...4853worker1 # [ 95.006362] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4854worker1 # [ 95.009059] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4855worker1 # [ 95.013581] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14856worker1 # [ 95.022348] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4857worker1 # [ 95.031532] systemd[1]: Started Nix worker-protocol over gRPC.4858lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4859lb: must succeed: curl -sf localhost:9901/clusters4860worker1 # [ 95.049394] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:54Z level=info event=scheduler_connected addr=lb:500514861worker2 # [ 95.351521] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:54Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:583904862worker2 # [ 95.354314] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04863lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4864lb: must succeed: curl -sf localhost:9901/clusters4865lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4866lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.19 seconds)4867(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.10 seconds)4868subtest: scheduler down: the other node takes the lock and keeps it4869lb: must succeed: curl -sf localhost:9901/clusters4870lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4871lb: must succeed: curl -sf localhost:9901/clusters4872lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4873lb: must succeed: curl -sf localhost:9901/clusters4874lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4875lb: must succeed: curl -sf localhost:9901/clusters4876lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4877worker2 # [ 96.811542] systemd[1]: Stopping Nix worker-protocol over gRPC...4878worker2 # [ 96.877359] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:55Z level=info event=signal_exit4879worker2 # [ 97.096195] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:55Z level=info event=scheduler_yield4880lb # [ 95.060776] niks3-server[1044]: 2026/09/20 12:22:56 INFO lead: released remote=192.168.1.4:534024881worker1 # [ 96.808394] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:56Z level=info event=scheduler_restarting addr=lb:500514882worker2 # [ 97.111545] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:583904883worker2 # [ 97.119443] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:55Z level=info event=worker_gone addr=192.168.1.3:500514884worker2 # [ 97.123871] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:55Z level=info event=scheduler_restarting addr=lb:500514885worker2 # [ 97.128160] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:583904886worker2 # [ 97.132585] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:55Z level=info event=worker_gone addr=192.168.1.4:500514887worker1 # [ 97.008720] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:56Z level=info event=scheduler_connected addr=lb:500514888worker1 # [ 97.014615] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4889worker2 # [ 97.319426] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:56Z level=info event=scheduler_connected addr=lb:500514890worker2 # [ 97.324508] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4891worker1 # [ 97.215333] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:56Z level=info event=scheduler_connected addr=lb:500514892worker2 # [ 97.521922] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:56Z level=info event=scheduler_connected addr=lb:500514893worker1 # [ 97.221646] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4894worker2 # [ 97.527305] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4895worker1 # [ 97.422759] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:56Z level=info event=scheduler_connected addr=lb:500514896worker2 # [ 97.728799] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:56Z level=info event=scheduler_connected addr=lb:500514897worker1 # [ 97.428441] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4898worker2 # [ 97.734206] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4899worker1 # [ 97.629755] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:57Z level=info event=scheduler_connected addr=lb:500514900worker1 # [ 97.635341] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4901worker2 # [ 97.937080] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:56Z level=info event=scheduler_connected addr=lb:500514902worker2 # [ 97.941399] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4903worker2 # [ 98.101752] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:56Z level=info event=scheduler_restarting4904worker2 # [ 98.135137] nix-daemon[929]: reaped child process 1209, status = succeeded4905worker1 # [ 97.838318] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:57Z level=info event=scheduler_connected addr=lb:500514906worker1 # [ 97.842937] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4907worker2 # [ 98.156819] nix-grpc-daemon[1160]: ts=2026-09-20T12:22:56Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4908worker1 # [ 98.039243] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:57Z level=info event=scheduler_connected addr=lb:500514909worker1 # [ 98.045414] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4910worker1 # [ 98.246457] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:57Z level=info event=scheduler_connected addr=lb:500514911worker1 # [ 98.252421] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4912worker1 # [ 98.453419] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:57Z level=info event=scheduler_connected addr=lb:500514913worker1 # [ 98.459061] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4914lb # [ 96.762507] envoy[934]: conn peer=[2001:db8:1::1]:53898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=304915lb # [ 96.767473] envoy[934]: conn peer=192.168.1.3:56542 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8993 tx=2590 ms=612794916lb # [ 96.772451] envoy[934]: conn peer=[2001:db8:1::1]:60624 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1007 tx=305 ms=14804917lb # [ 96.779826] envoy[934]: conn peer=[2001:db8:1::4]:37740 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7963 tx=535 ms=72434918worker2 # [ 98.914088] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4919worker2 # [ 98.921515] systemd[1]: Stopped Nix worker-protocol over gRPC.4920worker2 # [ 98.927615] systemd[1]: nix-grpc-daemon.service: Consumed 475ms CPU time over 8.252s wall clock time, 31.1M memory peak, 20.2K incoming IP traffic, 30.8K outgoing IP traffic.4921worker2 # [ 98.942964] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4922worker2 # [ 98.948700] systemd[1]: Closed Nix worker-protocol over gRPC.4923worker2 # [ 98.950529] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 9.242s wall clock time, 256K memory peak, 20.1K incoming IP traffic, 15.1K outgoing IP traffic.4924worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4925worker1 # [ 98.660162] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:58Z level=info event=scheduler_connected addr=lb:500514926worker1 # [ 98.665679] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4927worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds)4928worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4929worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4930worker1 # [ 98.867747] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:58Z level=info event=scheduler_connected addr=lb:500514931worker1 # [ 98.872000] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4932worker1 # [ 99.073153] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:58Z level=info event=scheduler_connected addr=lb:500514933worker1 # [ 99.078769] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4934worker1 # [ 99.279812] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:58Z level=info event=scheduler_connected addr=lb:500514935worker1 # [ 99.285527] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4936worker1 # [ 99.486306] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_connected addr=lb:500514937worker1 # [ 99.492111] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4938worker1 # [ 99.693104] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_connected addr=lb:500514939worker1 # [ 99.698810] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4940worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4941worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4942worker1 # [ 99.900395] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_connected addr=lb:500514943worker1 # [ 99.903349] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4944worker1 # [ 100.034150] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_take_over4945lb # [ 98.290839] niks3-server[1044]: 2026/09/20 12:22:59 INFO lead: acquired remote=192.168.1.3:415304946worker1 # [ 100.104498] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_connected addr=lb:500514947worker1 # [ 100.109969] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4948worker1 # [ 100.311017] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_connected addr=lb:500514949worker1 # [ 100.316817] nix-grpc-daemon[1221]: ts=2026-09-20T12:22:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4950worker1 # [ 100.517824] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:00Z level=info event=scheduler_connected addr=lb:500514951worker1 # [ 100.523482] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4952worker1 # [ 100.724564] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:00Z level=info event=scheduler_connected addr=lb:500514953worker1 # [ 100.730139] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4954worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4955worker1 # [ 100.938711] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:00Z level=info event=scheduler_connected addr=lb:500514956worker1 # [ 100.943598] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:00Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:401144957worker1 # [ 100.949567] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:00Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04958worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.11 seconds)4959client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24960worker1 # [ 101.515192] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:401304961worker1 # [ 101.531596] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)4962client # don't know how to build these paths:4963client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4964worker1 # [ 101.558822] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:401304965worker1 # [ 101.577801] nix-grpc-daemon[1221]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5)4966worker1 # [ 101.682667] nix-grpc-daemon[1221]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 2/5)4967worker1 # [ 101.766694] nix-grpc-daemon[1221]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 295 ms (attempt 3/5)4968worker1 # [ 102.070933] nix-grpc-daemon[1221]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 794 ms (attempt 4/5)4969worker1 # [ 102.874130] nix-grpc-daemon[1221]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4970worker1 # [ 102.913559] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:02Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04971worker1 # [ 102.921142] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:02Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14972worker1 # [ 102.961929] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:401304973worker1 # [ 102.980393] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:401304974client # copying 1 paths to 'lb:50051'...4975client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4976worker1 # [ 102.997504] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:401304977worker1 # [ 103.014183] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)4978worker1 # [ 103.044213] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:02Z level=info event=niks3_push_started pid=12944979worker1 # [ 103.268442] nix-grpc-daemon[1294]: time=2026-09-20T12:23:02.783Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""4980worker1 # [ 103.457129] nix-daemon[854]: accepted connection from pid 1307, user nix-grpc-daemon (trusted)4981worker1 # [ 103.482086] nix-daemon[854]: reaped child process 1310, status = succeeded4982worker1 # [ 103.664970] nix-daemon[854]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)4983worker1 # [ 103.685993] nix-daemon[854]: reaped child process 1315, status = succeeded4984lb # [ 101.958487] niks3-server[1044]: 2026/09/20 12:23:02 INFO Received uploads request method=POST path=/api/pending_closures4985worker1 # [ 103.716253] nix-grpc-daemon[1294]: time=2026-09-20T12:23:03.230Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4986worker1 # [ 103.719300] nix-grpc-daemon[1294]: time=2026-09-20T12:23:03.230Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4987lb # [ 102.000831] niks3-server[1044]: 2026/09/20 12:23:02 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4988lb # [ 102.015744] niks3-server[1044]: 2026/09/20 12:23:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4989worker1 # [ 103.767342] nix-grpc-daemon[1294]: time=2026-09-20T12:23:03.282Z level=INFO msg="Uploading 1 narinfos"4990lb # [ 102.029683] niks3-server[1044]: 2026/09/20 12:23:03 INFO Signed narinfos id=27 count=14991lb # [ 102.037506] niks3-server[1044]: 2026/09/20 12:23:03 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4992lb # [ 102.052068] niks3-server[1044]: 2026/09/20 12:23:03 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4993lb # [ 102.062949] niks3-server[1044]: 2026/09/20 12:23:03 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4994lb # [ 102.069792] niks3-server[1044]: 2026/09/20 12:23:03 INFO Completed upload id=274995worker1 # [ 103.814303] nix-grpc-daemon[1294]: time=2026-09-20T12:23:03.329Z level=INFO msg="Upload complete. (541ms)"4996worker1 # [ 103.826785] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40130 duration_s=0 paths=1 nar_bytes_in=5204997worker1 # [ 103.844965] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:401304998worker1 # [ 103.853392] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)4999worker1 # [ 103.863501] nix-daemon[854]: reaped child process 1292, status = succeeded5000client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5001worker1 # [ 103.874507] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5002client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5003client # farm-a> LOG-farm-a-on-standby5004worker1 # [ 105.103761] nix-daemon[854]: reaped child process 1319, status = succeeded5005worker1 # [ 105.275680] nix-daemon[854]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)5006worker1 # [ 105.297448] nix-daemon[854]: reaped child process 1337, status = succeeded5007lb # [ 103.565921] niks3-server[1044]: 2026/09/20 12:23:04 INFO Received uploads request method=POST path=/api/pending_closures5008worker1 # [ 105.324759] nix-grpc-daemon[1294]: time=2026-09-20T12:23:04.839Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5009worker1 # [ 105.330333] nix-grpc-daemon[1294]: time=2026-09-20T12:23:04.842Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5010lb # [ 103.609072] niks3-server[1044]: 2026/09/20 12:23:04 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5011lb # [ 103.627398] niks3-server[1044]: 2026/09/20 12:23:04 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5012lb # [ 103.639243] niks3-server[1044]: 2026/09/20 12:23:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5013worker1 # [ 105.390263] nix-grpc-daemon[1294]: time=2026-09-20T12:23:04.904Z level=INFO msg="Uploading 1 narinfos"5014lb # [ 103.648583] niks3-server[1044]: 2026/09/20 12:23:04 INFO Signed narinfos id=28 count=15015lb # [ 103.650699] niks3-server[1044]: 2026/09/20 12:23:04 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5016lb # [ 103.660546] niks3-server[1044]: 2026/09/20 12:23:04 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5017lb # [ 103.667612] niks3-server[1044]: 2026/09/20 12:23:04 INFO Completed upload id=285018worker1 # [ 105.411939] nix-grpc-daemon[1294]: time=2026-09-20T12:23:04.927Z level=INFO msg="Upload complete. (321ms)"5019lb # [ 103.670854] niks3-server[1044]: 2026/09/20 12:23:04 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5020worker1 # [ 105.434940] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40130 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15021worker1 # [ 105.451114] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:04Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05022worker1 # [ 105.454746] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:04Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15023worker1 # [ 105.458341] nix-daemon[854]: reaped child process 1317, status = succeeded5024worker1 # [ 105.481706] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:401305025worker1 # [ 105.497468] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:401305026worker1 # [ 105.513094] nix-grpc-daemon[1294]: time=2026-09-20T12:23:05.028Z level=INFO msg="All 1 paths already cached"5027client # copying 1 paths to 'lb:50051'...5028client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5029worker1 # [ 105.526175] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:401305030worker1 # [ 105.540874] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5031worker1 # [ 105.747332] nix-daemon[854]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5032worker1 # [ 105.765957] nix-daemon[854]: reaped child process 1346, status = succeeded5033worker1 # [ 105.946550] nix-daemon[854]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5034worker1 # [ 105.966262] nix-daemon[854]: reaped child process 1351, status = succeeded5035lb # [ 104.235117] niks3-server[1044]: 2026/09/20 12:23:05 INFO Received uploads request method=POST path=/api/pending_closures5036worker1 # [ 105.989881] nix-grpc-daemon[1294]: time=2026-09-20T12:23:05.504Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5037worker1 # [ 105.991515] nix-grpc-daemon[1294]: time=2026-09-20T12:23:05.505Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5038lb # [ 104.266621] niks3-server[1044]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5039lb # [ 104.282601] niks3-server[1044]: 2026/09/20 12:23:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5040worker1 # [ 106.033005] nix-grpc-daemon[1294]: time=2026-09-20T12:23:05.548Z level=INFO msg="Uploading 1 narinfos"5041lb # [ 104.296218] niks3-server[1044]: 2026/09/20 12:23:05 INFO Signed narinfos id=29 count=15042lb # [ 104.298775] niks3-server[1044]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5043lb # [ 104.311015] niks3-server[1044]: 2026/09/20 12:23:05 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5044lb # [ 104.317889] niks3-server[1044]: 2026/09/20 12:23:05 INFO Completed upload id=295045lb # [ 104.320973] niks3-server[1044]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5046worker1 # [ 106.062160] nix-grpc-daemon[1294]: time=2026-09-20T12:23:05.577Z level=INFO msg="Upload complete. (504ms)"5047worker1 # [ 106.069808] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40130 duration_s=0 paths=1 nar_bytes_in=6405048worker1 # [ 106.082044] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:401305049worker1 # [ 106.093942] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5050worker1 # [ 106.098883] nix-daemon[854]: reaped child process 1341, status = succeeded5051client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5052client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5053worker1 # [ 106.114358] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5054client # farm-b> LOG-farm-b-on-standby5055worker1 # [ 107.360676] nix-daemon[854]: reaped child process 1355, status = succeeded5056worker1 # [ 107.556191] nix-daemon[854]: accepted connection from pid 1370, user nix-grpc-daemon (trusted)5057worker1 # [ 107.579620] nix-daemon[854]: reaped child process 1373, status = succeeded5058lb # [ 105.851793] niks3-server[1044]: 2026/09/20 12:23:06 INFO Received uploads request method=POST path=/api/pending_closures5059worker1 # [ 107.610217] nix-grpc-daemon[1294]: time=2026-09-20T12:23:07.124Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5060worker1 # [ 107.611862] nix-grpc-daemon[1294]: time=2026-09-20T12:23:07.124Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5061lb # [ 105.893208] niks3-server[1044]: 2026/09/20 12:23:06 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5062lb # [ 105.910217] niks3-server[1044]: 2026/09/20 12:23:06 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5063lb # [ 105.917450] niks3-server[1044]: 2026/09/20 12:23:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5064worker1 # [ 107.666012] nix-grpc-daemon[1294]: time=2026-09-20T12:23:07.181Z level=INFO msg="Uploading 1 narinfos"5065lb # [ 105.926122] niks3-server[1044]: 2026/09/20 12:23:06 INFO Signed narinfos id=30 count=15066lb # [ 105.930782] niks3-server[1044]: 2026/09/20 12:23:06 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5067lb # [ 105.938039] niks3-server[1044]: 2026/09/20 12:23:06 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5068worker1 # [ 107.687545] nix-grpc-daemon[1294]: time=2026-09-20T12:23:07.203Z level=INFO msg="Upload complete. (361ms)"5069lb # [ 105.944358] niks3-server[1044]: 2026/09/20 12:23:06 INFO Completed upload id=305070lb # [ 105.947442] niks3-server[1044]: 2026/09/20 12:23:06 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5071worker1 # [ 107.695895] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40130 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15072worker1 # [ 107.704788] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:07Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05073worker1 # [ 107.707378] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:07Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15074worker1 # [ 107.712286] nix-daemon[854]: reaped child process 1353, status = succeeded5075worker1 # [ 107.752850] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:401305076worker1 # [ 107.766993] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:401305077worker1 # [ 107.780276] nix-grpc-daemon[1294]: time=2026-09-20T12:23:07.295Z level=INFO msg="All 2 paths already cached"5078client # copying 1 paths to 'lb:50051'...5079client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5080worker1 # [ 107.789056] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:401305081worker1 # [ 107.804707] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5082worker1 # [ 108.007038] nix-daemon[854]: accepted connection from pid 1379, user nix-grpc-daemon (trusted)5083worker1 # [ 108.026278] nix-daemon[854]: reaped child process 1382, status = succeeded5084worker1 # [ 108.212867] nix-daemon[854]: accepted connection from pid 1384, user nix-grpc-daemon (trusted)5085worker1 # [ 108.236838] nix-daemon[854]: reaped child process 1387, status = succeeded5086lb # [ 106.504749] niks3-server[1044]: 2026/09/20 12:23:07 INFO Received uploads request method=POST path=/api/pending_closures5087worker1 # [ 108.260164] nix-grpc-daemon[1294]: time=2026-09-20T12:23:07.775Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5088worker1 # [ 108.261781] nix-grpc-daemon[1294]: time=2026-09-20T12:23:07.775Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5089lb # [ 106.538093] niks3-server[1044]: 2026/09/20 12:23:07 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5090lb # [ 106.552516] niks3-server[1044]: 2026/09/20 12:23:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5091worker1 # [ 108.302906] nix-grpc-daemon[1294]: time=2026-09-20T12:23:07.818Z level=INFO msg="Uploading 1 narinfos"5092lb # [ 106.565403] niks3-server[1044]: 2026/09/20 12:23:07 INFO Signed narinfos id=31 count=15093lb # [ 106.571098] niks3-server[1044]: 2026/09/20 12:23:07 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5094lb # [ 106.580379] niks3-server[1044]: 2026/09/20 12:23:07 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5095lb # [ 106.588887] niks3-server[1044]: 2026/09/20 12:23:07 INFO Completed upload id=315096worker1 # [ 108.333116] nix-grpc-daemon[1294]: time=2026-09-20T12:23:07.848Z level=INFO msg="Upload complete. (513ms)"5097lb # [ 106.591929] niks3-server[1044]: 2026/09/20 12:23:07 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5098worker1 # [ 108.344510] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40130 duration_s=0 paths=1 nar_bytes_in=7685099worker1 # [ 108.352438] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:401305100worker1 # [ 108.365755] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5101worker1 # [ 108.370698] nix-daemon[854]: reaped child process 1377, status = succeeded5102client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5103client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5104worker1 # [ 108.384615] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5105client # farm-top> LOG-farm-top-on-standby5106worker1 # [ 109.634778] nix-daemon[854]: reaped child process 1391, status = succeeded5107worker1 # [ 109.822021] nix-daemon[854]: accepted connection from pid 1406, user nix-grpc-daemon (trusted)5108worker1 # [ 109.842325] nix-daemon[854]: reaped child process 1409, status = succeeded5109lb # [ 108.115614] niks3-server[1044]: 2026/09/20 12:23:09 INFO Received uploads request method=POST path=/api/pending_closures5110worker1 # [ 109.871029] nix-grpc-daemon[1294]: time=2026-09-20T12:23:09.384Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5111worker1 # [ 109.873048] nix-grpc-daemon[1294]: time=2026-09-20T12:23:09.384Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5112lb # [ 108.158010] niks3-server[1044]: 2026/09/20 12:23:09 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5113lb # [ 108.167444] niks3-server[1044]: 2026/09/20 12:23:09 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5114lb # [ 108.179922] niks3-server[1044]: 2026/09/20 12:23:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5115worker1 # [ 109.924640] nix-grpc-daemon[1294]: time=2026-09-20T12:23:09.439Z level=INFO msg="Uploading 1 narinfos"5116lb # [ 108.183507] niks3-server[1044]: 2026/09/20 12:23:09 INFO Signed narinfos id=32 count=15117lb # [ 108.193138] niks3-server[1044]: 2026/09/20 12:23:09 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5118lb # [ 108.203374] niks3-server[1044]: 2026/09/20 12:23:09 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5119worker1 # [ 109.952744] nix-grpc-daemon[1294]: time=2026-09-20T12:23:09.468Z level=INFO msg="Upload complete. (356ms)"5120lb # [ 108.210126] niks3-server[1044]: 2026/09/20 12:23:09 INFO Completed upload id=325121worker1 # [ 109.959300] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40130 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15122lb # [ 108.214997] niks3-server[1044]: 2026/09/20 12:23:09 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5123worker1 # [ 109.968273] nix-daemon[854]: reaped child process 1389, status = succeeded5124client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 9.02 seconds)5125client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5126client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5127worker2 # [ 110.646076] systemd[1]: Listening on Nix worker-protocol over gRPC.5128worker2 # [ 110.651753] systemd[1]: Starting scheduler-token.service...5129worker2 # [ 110.741749] systemd[1]: scheduler-token.service: Deactivated successfully.5130worker2 # [ 110.748168] systemd[1]: Finished scheduler-token.service.5131worker2 # [ 110.749498] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 93ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5132worker2 # [ 110.755380] systemd[1]: Starting Nix worker-protocol over gRPC...5133worker2 # [ 110.941656] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:09Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5134worker2 # [ 110.944385] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5135worker2 # [ 110.947593] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15136worker2 # [ 110.956395] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5137worker2 # [ 110.967639] systemd[1]: Started Nix worker-protocol over gRPC.5138lb: must succeed: curl -sf localhost:9901/clusters5139worker2 # [ 110.987971] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:09Z level=info event=scheduler_connected addr=lb:500515140worker1 # [ 110.700203] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:10Z level=info event=oidc_jwks provider=mock keys=15141worker1 # [ 110.706332] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:10Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:401145142worker1 # [ 110.711893] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05143lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5144worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5145worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5146lb: must succeed: curl -sf localhost:9901/clusters5147lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5148lb: must succeed: curl -sf localhost:9901/clusters5149lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5150worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5151worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5152(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.83 seconds)5153subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5154client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5155client # [ 111.101933] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5156client # Running as unit: rs.service; invocation ID: 88617f0455224024a7297177c85906315157client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5158worker1 # [ 111.367584] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:401305159client # [ 111.352216] nix[1252]: don't know how to build these paths:5160client # [ 111.353249] nix[1252]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5161worker1 # [ 111.387860] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:10Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05162worker1 # [ 111.395225] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:10Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15163worker1 # [ 111.432310] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:401305164worker1 # [ 111.448766] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:401305165client # [ 111.440118] nix[1252]: copying 1 paths to 'lb:50051'...5166worker1 # [ 111.464123] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:401305167client # [ 111.442546] nix[1252]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5168worker1 # [ 111.480173] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5169worker1 # [ 111.686235] nix-daemon[854]: accepted connection from pid 1422, user nix-grpc-daemon (trusted)5170worker1 # [ 111.706633] nix-daemon[854]: reaped child process 1425, status = succeeded5171worker1 # [ 111.885987] nix-daemon[854]: accepted connection from pid 1427, user nix-grpc-daemon (trusted)5172worker1 # [ 111.905291] nix-daemon[854]: reaped child process 1430, status = succeeded5173lb # [ 110.176123] niks3-server[1044]: 2026/09/20 12:23:11 INFO Received uploads request method=POST path=/api/pending_closures5174worker1 # [ 111.932962] nix-grpc-daemon[1294]: time=2026-09-20T12:23:11.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5175worker1 # [ 111.934531] nix-grpc-daemon[1294]: time=2026-09-20T12:23:11.447Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5176lb # [ 110.207799] niks3-server[1044]: 2026/09/20 12:23:11 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5177worker1 # [ 111.966716] nix-grpc-daemon[1294]: time=2026-09-20T12:23:11.482Z level=INFO msg="Uploading 1 narinfos"5178lb # [ 110.226637] niks3-server[1044]: 2026/09/20 12:23:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5179lb # [ 110.235826] niks3-server[1044]: 2026/09/20 12:23:11 INFO Signed narinfos id=33 count=15180worker1 # [ 111.990090] nix-grpc-daemon[1294]: time=2026-09-20T12:23:11.505Z level=INFO msg="Upload complete. (492ms)"5181lb # [ 110.240866] niks3-server[1044]: 2026/09/20 12:23:11 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5182lb # [ 110.250758] niks3-server[1044]: 2026/09/20 12:23:11 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5183lb # [ 110.255521] niks3-server[1044]: 2026/09/20 12:23:11 INFO Completed upload id=335184worker1 # [ 112.000279] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40130 duration_s=0 paths=1 nar_bytes_in=4165185lb # [ 110.257812] niks3-server[1044]: 2026/09/20 12:23:11 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5186worker1 # [ 112.008350] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:401305187worker1 # [ 112.019614] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5188worker1 # [ 112.021803] nix-daemon[854]: reaped child process 1420, status = succeeded5189worker1 # [ 112.033359] nix-daemon[854]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)5190client # [ 112.007328] nix[1252]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5191lb: must succeed: curl -sf localhost:9901/clusters5192lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5193lb: must succeed: curl -sf localhost:9901/clusters5194lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5195lb: must succeed: curl -sf localhost:9901/clusters5196lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5197lb: must succeed: curl -sf localhost:9901/clusters5198lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5199worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5200worker2 # [ 114.422797] systemd-journald[279]: Received client request to rotate journal, rotating.5201worker2 # [ 114.546647] systemd-journald[279]: Vacuuming done, freed 0B of archived journals from /var/log/journal/c277c4d7b2744a6abd8bb9b7ad4a92be.5202worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.21 seconds)5203worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5204worker1 # [ 114.296504] systemd[1]: Stopping Nix worker-protocol over gRPC...5205worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5206??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5207 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735208client: must succeed: sleep 5.05209worker1 # [ 115.033314] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:14Z level=info event=draining5210lb # [ 116.765659] envoy[934]: conn peer=[2001:db8:1::1]:48318 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=3885 ms=87285211client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5212worker1 # [ 119.665800] nix-daemon[854]: reaped child process 1434, status = succeeded5213worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5214worker1 # [ 119.835561] nix-daemon[854]: accepted connection from pid 1474, user nix-grpc-daemon (trusted)5215worker1 # [ 119.857947] nix-daemon[854]: reaped child process 1477, status = succeeded5216lb # [ 118.126498] niks3-server[1044]: 2026/09/20 12:23:19 INFO Received uploads request method=POST path=/api/pending_closures5217worker1 # [ 119.884514] nix-grpc-daemon[1294]: time=2026-09-20T12:23:19.397Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5218worker1 # [ 119.886114] nix-grpc-daemon[1294]: time=2026-09-20T12:23:19.397Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5219lb # [ 118.175034] niks3-server[1044]: 2026/09/20 12:23:19 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5220lb # [ 118.190161] niks3-server[1044]: 2026/09/20 12:23:19 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5221lb # [ 118.198946] niks3-server[1044]: 2026/09/20 12:23:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5222worker1 # [ 119.948387] nix-grpc-daemon[1294]: time=2026-09-20T12:23:19.463Z level=INFO msg="Uploading 1 narinfos"5223lb # [ 118.207743] niks3-server[1044]: 2026/09/20 12:23:19 INFO Signed narinfos id=34 count=15224lb # [ 118.213247] niks3-server[1044]: 2026/09/20 12:23:19 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5225lb # [ 118.220650] niks3-server[1044]: 2026/09/20 12:23:19 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5226lb # [ 118.228172] niks3-server[1044]: 2026/09/20 12:23:19 INFO Completed upload id=345227worker1 # [ 119.972456] nix-grpc-daemon[1294]: time=2026-09-20T12:23:19.487Z level=INFO msg="Upload complete. (321ms)"5228lb # [ 118.230820] niks3-server[1044]: 2026/09/20 12:23:19 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5229worker1 # [ 119.989332] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40130 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15230worker1 # [ 120.005453] nix-daemon[854]: reaped child process 1432, status = succeeded5231client # [ 120.005861] systemd[1]: rs.service: Deactivated successfully.5232worker1 # [ 120.034599] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:19Z level=info event=signal_exit5233client # [ 120.010810] systemd[1]: rs.service: Consumed 164ms CPU time over 8.907s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.5234worker1 # [ 120.256301] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:19Z level=info event=scheduler_yield5235lb # [ 118.516278] niks3-server[1044]: 2026/09/20 12:23:19 INFO lead: released remote=192.168.1.3:415305236worker1 # [ 120.266764] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:19Z level=info event=scheduler_restarting addr=lb:500515237worker2 # [ 120.569437] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:19Z level=info event=scheduler_restarting addr=lb:500515238worker1 # [ 120.273131] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:401145239worker1 # [ 120.278004] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:19Z level=info event=worker_gone addr=192.168.1.3:500515240worker1 # [ 120.282217] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:401145241worker1 # [ 120.286810] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:19Z level=info event=worker_gone addr=192.168.1.4:500515242worker1 # [ 120.468150] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:19Z level=info event=scheduler_connected addr=lb:500515243worker2 # [ 120.769436] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:19Z level=info event=scheduler_connected addr=lb:500515244worker2 # [ 120.775965] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5245worker1 # [ 120.476710] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5246worker2 # [ 120.977559] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:19Z level=info event=scheduler_connected addr=lb:500515247worker1 # [ 120.677879] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:20Z level=info event=scheduler_connected addr=lb:500515248lb # [ 118.932239] niks3-server[1044]: 2026/09/20 12:23:19 INFO lead: acquired remote=192.168.1.4:494025249worker2 # [ 120.982708] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:19Z level=info event=scheduler_take_over5250worker1 # [ 120.685408] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5251worker2 # [ 120.987695] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5252worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.13 seconds)5253client: waiting for success: ! systemctl is-active rs5254worker1 # [ 120.886380] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:20Z level=info event=scheduler_connected addr=lb:500515255worker2 # [ 121.189145] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:19Z level=info event=scheduler_connected addr=lb:500515256client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5257client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5258worker2 # [ 121.207248] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:19Z level=info event=oidc_jwks provider=mock keys=15259worker1 # [ 120.911383] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5260worker2 # [ 121.213996] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:19Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:390165261worker2 # [ 121.219542] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05262client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5263client: must fail: journalctl -u rs | grep -q 'reconnecting'5264client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5265lb: must succeed: curl -sf localhost:9901/clusters5266lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5267worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5268worker1 # [ 121.115473] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:20Z level=info event=scheduler_connected addr=lb:500515269worker1 # [ 121.121162] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5270worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5271worker1 # [ 121.263108] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:20Z level=info event=scheduler_restarting5272worker1 # [ 121.300914] nix-daemon[854]: reaped child process 1285, status = succeeded5273worker1 # [ 121.342943] nix-grpc-daemon[1221]: ts=2026-09-20T12:23:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5274worker1 # [ 121.819521] nix-grpc-daemon[1221]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5275worker1 # [ 121.824482] nix-grpc-daemon[1221]: E0000 00:00:1789907001.334819 1264 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5276worker1 # [ 121.840996] nix-grpc-daemon[1221]: E0000 00:00:1789907001.356423 1264 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5277lb: must succeed: curl -sf localhost:9901/clusters5278lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5279worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5280worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5281worker1 # [ 122.891692] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5282worker1 # [ 122.895170] systemd[1]: Stopped Nix worker-protocol over gRPC.5283worker1 # [ 122.903996] systemd[1]: nix-grpc-daemon.service: Consumed 1.929s CPU time over 28.087s wall clock time, 34.4M memory peak, 50K incoming IP traffic, 91.2K outgoing IP traffic.5284worker1 # [ 122.923809] systemd[1]: Starting Nix worker-protocol over gRPC...5285worker1 # [ 123.129822] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:22Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5286worker1 # [ 123.132504] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:22Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5287worker1 # [ 123.136722] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:22Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15288worker1 # [ 123.145468] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:22Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5289worker1 # [ 123.147330] systemd[1]: Started Nix worker-protocol over gRPC.5290worker1 # [ 123.165851] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:22Z level=info event=scheduler_connected addr=lb:500515291worker2 # [ 123.469735] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:22Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:390165292worker2 # [ 123.470029] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:22Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05293lb: must succeed: curl -sf localhost:9901/clusters5294lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5295worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5296worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5297(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.44 seconds)5298subtest: scheduler restart mid-build: build finishes, no double build5299client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5300client # [ 123.541208] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5301client # Running as unit: mid.service; invocation ID: 1f60bf08dfc341a08c7a29f7ef00b6f15302client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5303worker2 # [ 124.107681] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:434205304worker2 # [ 124.123197] nix-daemon[929]: accepted connection from pid 1256, user nix-grpc-daemon (trusted)5305client # [ 123.816944] nix[1288]: don't know how to build these paths:5306client # [ 123.818601] nix[1288]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5307worker2 # [ 124.155772] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:22Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05308worker2 # [ 124.162792] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:22Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15309worker2 # [ 124.209255] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:434205310worker2 # [ 124.226661] nix-grpc-daemon[1256]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)5311worker2 # [ 124.270629] nix-grpc-daemon[1256]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 181 ms (attempt 2/5)5312worker2 # [ 124.459618] nix-grpc-daemon[1256]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 185 ms (attempt 3/5)5313worker2 # [ 124.653692] nix-grpc-daemon[1256]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 748 ms (attempt 4/5)5314worker2 # [ 125.410398] nix-grpc-daemon[1256]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5315worker2 # [ 125.433401] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:434205316client # [ 125.125275] nix[1288]: copying 1 paths to 'lb:50051'...5317worker2 # [ 125.450432] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:434205318client # [ 125.128606] nix[1288]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5319worker2 # [ 125.470248] nix-daemon[929]: accepted connection from pid 1256, user nix-grpc-daemon (trusted)5320worker2 # [ 125.499709] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:24Z level=info event=niks3_push_started pid=13755321worker2 # [ 125.721750] nix-grpc-daemon[1375]: time=2026-09-20T12:23:24.456Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""5322worker2 # [ 125.898735] nix-daemon[929]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5323worker2 # [ 125.918672] nix-daemon[929]: reaped child process 1391, status = succeeded5324worker2 # [ 126.103914] nix-daemon[929]: accepted connection from pid 1393, user nix-grpc-daemon (trusted)5325worker2 # [ 126.122308] nix-daemon[929]: reaped child process 1396, status = succeeded5326lb # [ 124.091428] niks3-server[1044]: 2026/09/20 12:23:25 INFO Received uploads request method=POST path=/api/pending_closures5327worker2 # [ 126.146770] nix-grpc-daemon[1375]: time=2026-09-20T12:23:24.881Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5328worker2 # [ 126.149061] nix-grpc-daemon[1375]: time=2026-09-20T12:23:24.881Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5329lb # [ 124.132957] niks3-server[1044]: 2026/09/20 12:23:25 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5330worker2 # [ 126.193069] nix-grpc-daemon[1375]: time=2026-09-20T12:23:24.928Z level=INFO msg="Uploading 1 narinfos"5331lb # [ 124.148261] niks3-server[1044]: 2026/09/20 12:23:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5332lb # [ 124.159616] niks3-server[1044]: 2026/09/20 12:23:25 INFO Signed narinfos id=35 count=15333lb # [ 124.168737] niks3-server[1044]: 2026/09/20 12:23:25 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5334lb # [ 124.179852] niks3-server[1044]: 2026/09/20 12:23:25 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5335worker2 # [ 126.222835] nix-grpc-daemon[1375]: time=2026-09-20T12:23:24.958Z level=INFO msg="Upload complete. (497ms)"5336lb # [ 124.191243] niks3-server[1044]: 2026/09/20 12:23:25 INFO Completed upload id=355337worker2 # [ 126.233990] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43420 duration_s=0 paths=1 nar_bytes_in=4245338worker2 # [ 126.247579] nix-grpc-daemon[1256]: ts=2026-09-20T12:23:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:434205339worker2 # [ 126.250958] nix-grpc-daemon[1375]: time=2026-09-20T12:23:24.983Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n"5340worker2 # [ 126.261250] nix-daemon[929]: accepted connection from pid 1256, user nix-grpc-daemon (trusted)5341worker2 # [ 126.264679] nix-daemon[929]: reaped child process 1373, status = succeeded5342client # [ 125.949144] nix[1288]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5343worker2 # [ 126.277027] nix-daemon[929]: accepted connection from pid 1256, user nix-grpc-daemon (trusted)5344lb: must succeed: curl -sf localhost:9901/clusters5345lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5346lb: must succeed: curl -sf localhost:9901/clusters5347lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5348worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5349worker2 # [ 127.880626] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1256 (nix-grpc-daemon) on client request.5350worker2 # [ 127.882233] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5351lb # [ 125.842598] niks3-server[1044]: 2026/09/20 12:23:26 INFO lead: released remote=192.168.1.4:494025352client # [ 127.579252] nix[1288]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5353worker1 # [ 127.603851] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5354worker2 # [ 127.912509] systemd[1]: Starting scheduler-token.service...5355client # [ 127.584466] nix[1288]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5356worker2 # [ 127.927797] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5357worker2 # [ 127.931754] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5358worker2 # [ 127.934463] systemd[1]: nix-grpc-daemon.service: Consumed 565ms CPU time over 17.170s wall clock time, 31.5M memory peak, 16.1K incoming IP traffic, 24.5K outgoing IP traffic.5359worker2 # [ 127.949122] nix-daemon[929]: reaped child process 1362, status = succeeded5360worker2 # [ 127.952130] nix-daemon[929]: reaped child process 1398, status = succeeded5361worker2 # [ 127.960687] nix-daemon[1400]: unexpected Nix daemon error: error: interrupted by the user5362worker2 # [ 127.971286] nix-daemon[929]: reaped child process 1400, status = failed with exit code 15363worker2 # [ 128.018328] systemd[1]: scheduler-token.service: Deactivated successfully.5364worker2 # [ 128.019394] systemd[1]: Finished scheduler-token.service.5365worker2 # [ 128.023431] systemd[1]: scheduler-token.service: Consumed 26ms CPU time over 111ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5366worker2 # [ 128.026221] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.5367worker2 # [ 128.029113] systemd[1]: Starting scheduler-token.service...5368worker2 # [ 128.100200] systemd[1]: scheduler-token.service: Deactivated successfully.5369worker2 # [ 128.101992] systemd[1]: Finished scheduler-token.service.5370worker2 # [ 128.104534] systemd[1]: scheduler-token.service: Consumed 25ms CPU time over 73ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5371worker1 # [ 127.804242] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:27Z level=info event=scheduler_connected addr=lb:500515372worker2 # [ 128.109899] systemd[1]: Starting Nix worker-protocol over gRPC...5373worker2 # [ 128.278583] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5374worker2 # [ 128.281068] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5375worker2 # [ 128.285138] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15376worker2 # [ 128.292910] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5377worker2 # [ 128.294650] systemd[1]: Started Nix worker-protocol over gRPC.5378worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.48 seconds)5379client: must succeed: sleep 5.05380worker2 # [ 128.317874] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_take_over5381worker2 # [ 128.322350] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:434385382lb # [ 126.273623] niks3-server[1044]: 2026/09/20 12:23:27 INFO lead: acquired remote=192.168.1.4:476805383worker2 # [ 128.323953] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05384worker2 # [ 128.332667] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_connected addr=lb:500515385worker2 # [ 128.334497] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5386client # [ 128.081005] nix[1288]: scheduler at lb:50051: no healthy upstream, reconnecting5387worker2 # [ 128.536236] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_connected addr=lb:500515388worker2 # [ 128.541441] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5389worker2 # [ 128.742695] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_connected addr=lb:500515390worker2 # [ 128.748311] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5391lb # [ 126.765813] envoy[934]: conn peer=[2001:db8:1::1]:49986 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2936 tx=1308 ms=86305392lb # [ 126.770951] envoy[934]: conn peer=[2001:db8:1::3]:60132 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4565 tx=1405 ms=262865393lb # [ 126.776002] envoy[934]: conn peer=[2001:db8:1::4]:54762 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=3440 tx=404 ms=169215394worker2 # [ 128.949651] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_connected addr=lb:500515395worker2 # [ 128.955239] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5396worker2 # [ 129.156646] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_connected addr=lb:500515397worker2 # [ 129.162150] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5398worker2 # [ 129.364933] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:28Z level=info event=scheduler_connected addr=lb:500515399worker2 # [ 129.380154] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:28Z level=info event=oidc_jwks provider=mock keys=15400worker2 # [ 129.385940] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:28Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:434425401worker2 # [ 129.391353] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05402worker2 # [ 129.415526] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:28Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05403worker2 # [ 129.421809] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:28Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15404worker1 # [ 129.142398] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339725405worker1 # [ 129.158040] nix-daemon[854]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5406worker1 # [ 129.182386] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 1/5)5407worker1 # [ 129.205058] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 2/5)5408worker1 # [ 129.234572] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 384 ms (attempt 3/5)5409worker1 # [ 129.626393] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 602 ms (attempt 4/5)5410worker1 # [ 130.238614] nix-grpc-daemon[1484]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5411worker1 # [ 130.258880] nix-grpc-daemon[1484]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5412worker1 # [ 130.288202] nix-daemon[854]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5413client # [ 130.283052] nix[1288]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5414worker1 # [ 130.308213] nix-daemon[854]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5415client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5416worker1 # [ 133.340375] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:32Z level=info event=niks3_push_started pid=15855417worker1 # [ 133.344772] nix-daemon[854]: reaped child process 1561, status = succeeded5418client: waiting for success: ! systemctl is-active mid5419worker1 # [ 133.533047] nix-grpc-daemon[1585]: time=2026-09-20T12:23:33.047Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5420worker1 # [ 133.708437] nix-daemon[854]: accepted connection from pid 1598, user nix-grpc-daemon (trusted)5421worker1 # [ 133.729561] nix-daemon[854]: reaped child process 1601, status = succeeded5422lb # [ 131.999025] niks3-server[1044]: 2026/09/20 12:23:32 INFO Received uploads request method=POST path=/api/pending_closures5423worker1 # [ 133.754935] nix-grpc-daemon[1585]: time=2026-09-20T12:23:33.268Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5424worker1 # [ 133.757933] nix-grpc-daemon[1585]: time=2026-09-20T12:23:33.268Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5425lb # [ 132.052411] niks3-server[1044]: 2026/09/20 12:23:33 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5426lb # [ 132.065350] niks3-server[1044]: 2026/09/20 12:23:33 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5427lb # [ 132.076609] niks3-server[1044]: 2026/09/20 12:23:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5428lb # [ 132.083174] niks3-server[1044]: 2026/09/20 12:23:33 INFO Signed narinfos id=36 count=15429worker1 # [ 133.827586] nix-grpc-daemon[1585]: time=2026-09-20T12:23:33.341Z level=INFO msg="Uploading 1 narinfos"5430lb # [ 132.089516] niks3-server[1044]: 2026/09/20 12:23:33 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5431lb # [ 132.101756] niks3-server[1044]: 2026/09/20 12:23:33 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5432worker1 # [ 133.851215] nix-grpc-daemon[1585]: time=2026-09-20T12:23:33.366Z level=INFO msg="Upload complete. (314ms)"5433lb # [ 132.109291] niks3-server[1044]: 2026/09/20 12:23:33 INFO Completed upload id=365434worker1 # [ 133.864548] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33972 duration_s=4 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15435worker1 # [ 133.879251] nix-grpc-daemon[1585]: time=2026-09-20T12:23:33.387Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5436worker1 # [ 133.885273] nix-daemon[854]: reaped child process 1559, status = succeeded5437client # [ 133.882357] systemd[1]: mid.service: Deactivated successfully.5438client # [ 133.886871] systemd[1]: mid.service: Consumed 175ms CPU time over 10.346s wall clock time, 39.2M memory peak, 10K incoming IP traffic, 11K outgoing IP traffic.5439client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5440client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5441client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5442(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.11 seconds)5443subtest: interrupting the client stops the build on the worker5444client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5445client # [ 134.613592] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5446client # Running as unit: intr.service; invocation ID: b468d579d8d54afeb2973d83162ee23a5447client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds)5448client # [ 134.834386] nix[1324]: don't know how to build these paths:5449client # [ 134.835572] nix[1324]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5450worker1 # [ 134.855982] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:339725451worker2 # [ 135.177516] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:33Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05452worker2 # [ 135.182977] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:33Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15453worker2 # [ 135.236158] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516425454worker2 # [ 135.250966] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5455worker2 # [ 135.274358] nix-grpc-daemon[1442]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 1/5)5456worker2 # [ 135.381139] nix-grpc-daemon[1442]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 2/5)5457worker2 # [ 135.397001] nix-grpc-daemon[1442]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 3/5)5458worker2 # [ 135.516784] nix-grpc-daemon[1442]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 4/5)5459worker2 # [ 135.656877] nix-grpc-daemon[1442]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5460worker2 # [ 135.680363] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516425461client # [ 135.372282] nix[1324]: copying 1 paths to 'lb:50051'...5462worker2 # [ 135.697055] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516425463client # [ 135.374692] nix[1324]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5464worker2 # [ 135.712757] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5465worker2 # [ 135.744119] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:34Z level=info event=niks3_push_started pid=15145466worker2 # [ 135.955780] nix-grpc-daemon[1514]: time=2026-09-20T12:23:34.691Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""5467worker2 # [ 136.131288] nix-daemon[929]: accepted connection from pid 1527, user nix-grpc-daemon (trusted)5468worker2 # [ 136.150234] nix-daemon[929]: reaped child process 1530, status = succeeded5469worker2 # [ 136.339989] nix-daemon[929]: accepted connection from pid 1532, user nix-grpc-daemon (trusted)5470worker2 # [ 136.360514] nix-daemon[929]: reaped child process 1539, status = succeeded5471lb # [ 134.327992] niks3-server[1044]: 2026/09/20 12:23:35 INFO Received uploads request method=POST path=/api/pending_closures5472worker2 # [ 136.390977] nix-grpc-daemon[1514]: time=2026-09-20T12:23:35.125Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5473worker2 # [ 136.392867] nix-grpc-daemon[1514]: time=2026-09-20T12:23:35.125Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5474lb # [ 134.384284] niks3-server[1044]: 2026/09/20 12:23:35 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5475worker2 # [ 136.440608] nix-grpc-daemon[1514]: time=2026-09-20T12:23:35.175Z level=INFO msg="Uploading 1 narinfos"5476lb # [ 134.399153] niks3-server[1044]: 2026/09/20 12:23:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5477lb # [ 134.409720] niks3-server[1044]: 2026/09/20 12:23:35 INFO Signed narinfos id=37 count=15478worker2 # [ 136.462131] nix-grpc-daemon[1514]: time=2026-09-20T12:23:35.198Z level=INFO msg="Upload complete. (501ms)"5479lb # [ 134.419363] niks3-server[1044]: 2026/09/20 12:23:35 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5480lb # [ 134.424473] niks3-server[1044]: 2026/09/20 12:23:35 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5481lb # [ 134.429604] niks3-server[1044]: 2026/09/20 12:23:35 INFO Completed upload id=375482worker2 # [ 136.474473] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=0 paths=1 nar_bytes_in=4245483lb # [ 134.432243] niks3-server[1044]: 2026/09/20 12:23:35 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5484worker2 # [ 136.487766] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516425485worker2 # [ 136.494637] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5486worker2 # [ 136.500266] nix-daemon[929]: reaped child process 1512, status = succeeded5487client # [ 136.187035] nix[1324]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5488worker2 # [ 136.514425] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5489client: must succeed: systemctl kill -s INT intr5490client # [ 137.164854] systemd[1]: intr.service: Sent signal SIGINT to main process 1324 (nix) on client request.5491client # [ 137.171960] nix[1324]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5492client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds)5493client # [ 137.183456] nix[1324]: error: interrupted by the user5494client # [ 137.215458] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5495worker2 # [ 137.541426] nix-daemon[1543]: unexpected Nix daemon error: error: interrupted by the user5496worker2 # [ 137.544675] nix-daemon[929]: reaped child process 1541, status = succeeded5497client # [ 137.219924] systemd[1]: intr.service: Failed with result 'exit-code'.5498client # [ 137.222656] systemd[1]: intr.service: Consumed 141ms CPU time over 2.604s wall clock time, 39.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5499worker2 # [ 137.551140] nix-daemon[929]: reaped child process 1543, status = failed with exit code 15500(finished: subtest: interrupting the client stops the build on the worker, in 2.73 seconds)5501subtest: a deploy mid-build drains: the build finishes, the new generation takes over5502client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5503client # [ 137.379473] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5504client # Running as unit: sw.service; invocation ID: d43ad5e6148c4b8b80559ce64107e29d5505client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5506client # [ 137.637134] nix[1345]: don't know how to build these paths:5507client # [ 137.638973] nix[1345]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5508worker2 # [ 137.961016] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:516425509worker2 # [ 137.975475] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:36Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05510worker2 # [ 137.981674] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:36Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15511worker1 # [ 137.686464] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339725512worker1 # [ 137.703581] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:339725513client # [ 137.692102] nix[1345]: copying 1 paths to 'lb:50051'...5514client # [ 137.695375] nix[1345]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5515worker1 # [ 137.718664] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:339725516worker1 # [ 137.734165] nix-daemon[854]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5517worker1 # [ 137.948177] nix-daemon[854]: accepted connection from pid 1625, user nix-grpc-daemon (trusted)5518worker1 # [ 137.967695] nix-daemon[854]: reaped child process 1628, status = succeeded5519worker1 # [ 138.145293] nix-daemon[854]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)5520worker1 # [ 138.165207] nix-daemon[854]: reaped child process 1633, status = succeeded5521lb # [ 136.433060] niks3-server[1044]: 2026/09/20 12:23:37 INFO Received uploads request method=POST path=/api/pending_closures5522worker1 # [ 138.187648] nix-grpc-daemon[1585]: time=2026-09-20T12:23:37.702Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5523worker1 # [ 138.189392] nix-grpc-daemon[1585]: time=2026-09-20T12:23:37.702Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5524lb # [ 136.463802] niks3-server[1044]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5525worker1 # [ 138.223385] nix-grpc-daemon[1585]: time=2026-09-20T12:23:37.738Z level=INFO msg="Uploading 1 narinfos"5526lb # [ 136.481448] niks3-server[1044]: 2026/09/20 12:23:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5527lb # [ 136.491146] niks3-server[1044]: 2026/09/20 12:23:37 INFO Signed narinfos id=38 count=15528lb # [ 136.501127] niks3-server[1044]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5529worker1 # [ 138.248860] nix-grpc-daemon[1585]: time=2026-09-20T12:23:37.764Z level=INFO msg="Upload complete. (497ms)"5530lb # [ 136.505763] niks3-server[1044]: 2026/09/20 12:23:37 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5531lb # [ 136.510416] niks3-server[1044]: 2026/09/20 12:23:37 INFO Completed upload id=385532lb # [ 136.513325] niks3-server[1044]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5533worker1 # [ 138.256109] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33972 duration_s=0 paths=1 nar_bytes_in=4165534worker1 # [ 138.269851] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:339725535worker1 # [ 138.276105] nix-daemon[854]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5536worker1 # [ 138.281001] nix-daemon[854]: reaped child process 1623, status = succeeded5537client # [ 138.266287] nix[1345]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5538worker1 # [ 138.294112] nix-daemon[854]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5539lb # [ 136.768246] envoy[934]: conn peer=[2001:db8:1::1]:37840 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4028 tx=1756 ms=100765540lb # [ 136.773376] envoy[934]: conn peer=[2001:db8:1::1]:47286 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=755 ms=23625541worker1: must succeed: systemctl reload nix-grpc-daemon.service5542worker1 # [ 140.121711] systemd[1]: Reloading Nix worker-protocol over gRPC...5543worker1 # [ 140.171925] systemd[1]: Reloaded Nix worker-protocol over gRPC.5544worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5545worker1: must succeed: pgrep -f 'read -t [9]0 x'5546worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5547client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25548worker2 # [ 140.786080] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:516425549client # don't know how to build these paths:5550client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5551worker2 # [ 140.797002] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516425552worker2 # [ 140.829913] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:39Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05553worker2 # [ 140.836751] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:39Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15554worker2 # [ 140.882628] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516425555worker2 # [ 140.899010] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516425556client # copying 1 paths to 'lb:50051'...5557worker2 # [ 140.915628] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516425558client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5559worker2 # [ 140.940357] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5560worker2 # [ 141.142475] nix-daemon[929]: accepted connection from pid 1589, user nix-grpc-daemon (trusted)5561worker2 # [ 141.164189] nix-daemon[929]: reaped child process 1592, status = succeeded5562worker2 # [ 141.340060] nix-daemon[929]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5563worker2 # [ 141.357972] nix-daemon[929]: reaped child process 1597, status = succeeded5564lb # [ 139.330214] niks3-server[1044]: 2026/09/20 12:23:40 INFO Received uploads request method=POST path=/api/pending_closures5565worker2 # [ 141.383485] nix-grpc-daemon[1514]: time=2026-09-20T12:23:40.118Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5566worker2 # [ 141.385105] nix-grpc-daemon[1514]: time=2026-09-20T12:23:40.118Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5567lb # [ 139.360935] niks3-server[1044]: 2026/09/20 12:23:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5568worker2 # [ 141.414639] nix-grpc-daemon[1514]: time=2026-09-20T12:23:40.150Z level=INFO msg="Uploading 1 narinfos"5569lb # [ 139.372575] niks3-server[1044]: 2026/09/20 12:23:40 INFO Signed narinfos id=39 count=15570lb # [ 139.383589] niks3-server[1044]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5571lb # [ 139.391757] niks3-server[1044]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5572lb # [ 139.402754] niks3-server[1044]: 2026/09/20 12:23:40 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5573worker2 # [ 141.446912] nix-grpc-daemon[1514]: time=2026-09-20T12:23:40.182Z level=INFO msg="Upload complete. (489ms)"5574lb # [ 139.408330] niks3-server[1044]: 2026/09/20 12:23:40 INFO Completed upload id=395575lb # [ 139.412345] niks3-server[1044]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5576worker2 # [ 141.457158] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=0 paths=1 nar_bytes_in=5285577worker1 # [ 141.163468] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:40Z level=info event=draining5578worker2 # [ 141.470633] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516425579worker2 # [ 141.476280] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5580worker2 # [ 141.481014] nix-daemon[929]: reaped child process 1587, status = succeeded5581client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5582client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5583worker2 # [ 141.493631] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5584client # farm-a> LOG-farm-a-during-drain5585worker2 # [ 142.522155] nix-daemon[929]: reaped child process 1601, status = succeeded5586worker2 # [ 142.687352] nix-daemon[929]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5587worker2 # [ 142.705716] nix-daemon[929]: reaped child process 1619, status = succeeded5588lb # [ 140.675727] niks3-server[1044]: 2026/09/20 12:23:41 INFO Received uploads request method=POST path=/api/pending_closures5589worker2 # [ 142.732447] nix-grpc-daemon[1514]: time=2026-09-20T12:23:41.466Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5590worker2 # [ 142.733964] nix-grpc-daemon[1514]: time=2026-09-20T12:23:41.466Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5591lb # [ 140.721868] niks3-server[1044]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5592lb # [ 140.732196] niks3-server[1044]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5593lb # [ 140.741708] niks3-server[1044]: 2026/09/20 12:23:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5594worker2 # [ 142.790559] nix-grpc-daemon[1514]: time=2026-09-20T12:23:41.525Z level=INFO msg="Uploading 1 narinfos"5595lb # [ 140.749358] niks3-server[1044]: 2026/09/20 12:23:41 INFO Signed narinfos id=40 count=15596lb # [ 140.751473] niks3-server[1044]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5597lb # [ 140.760630] niks3-server[1044]: 2026/09/20 12:23:41 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5598lb # [ 140.770969] niks3-server[1044]: 2026/09/20 12:23:41 INFO Completed upload id=405599worker2 # [ 142.814892] nix-grpc-daemon[1514]: time=2026-09-20T12:23:41.550Z level=INFO msg="Upload complete. (311ms)"5600lb # [ 140.773738] niks3-server[1044]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5601worker2 # [ 142.827785] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15602worker2 # [ 142.846695] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:41Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05603worker2 # [ 142.850928] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:41Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15604worker2 # [ 142.855198] nix-daemon[929]: reaped child process 1599, status = succeeded5605worker2 # [ 142.890762] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516425606worker2 # [ 142.907608] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516425607worker2 # [ 142.921859] nix-grpc-daemon[1514]: time=2026-09-20T12:23:41.657Z level=INFO msg="All 1 paths already cached"5608client # copying 1 paths to 'lb:50051'...5609worker2 # [ 142.932130] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516425610client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5611worker2 # [ 142.957552] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5612worker2 # [ 143.164038] nix-daemon[929]: accepted connection from pid 1625, user nix-grpc-daemon (trusted)5613worker2 # [ 143.182045] nix-daemon[929]: reaped child process 1628, status = succeeded5614worker2 # [ 143.354019] nix-daemon[929]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)5615worker2 # [ 143.375240] nix-daemon[929]: reaped child process 1633, status = succeeded5616lb # [ 141.341883] niks3-server[1044]: 2026/09/20 12:23:42 INFO Received uploads request method=POST path=/api/pending_closures5617worker2 # [ 143.394785] nix-grpc-daemon[1514]: time=2026-09-20T12:23:42.130Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5618worker2 # [ 143.396999] nix-grpc-daemon[1514]: time=2026-09-20T12:23:42.132Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5619lb # [ 141.370848] niks3-server[1044]: 2026/09/20 12:23:42 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5620worker2 # [ 143.429184] nix-grpc-daemon[1514]: time=2026-09-20T12:23:42.164Z level=INFO msg="Uploading 1 narinfos"5621lb # [ 141.386410] niks3-server[1044]: 2026/09/20 12:23:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5622lb # [ 141.398638] niks3-server[1044]: 2026/09/20 12:23:42 INFO Signed narinfos id=41 count=15623lb # [ 141.403554] niks3-server[1044]: 2026/09/20 12:23:42 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5624worker2 # [ 143.456122] nix-grpc-daemon[1514]: time=2026-09-20T12:23:42.192Z level=INFO msg="Upload complete. (480ms)"5625lb # [ 141.412699] niks3-server[1044]: 2026/09/20 12:23:42 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5626lb # [ 141.418257] niks3-server[1044]: 2026/09/20 12:23:42 INFO Completed upload id=415627worker2 # [ 143.464284] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=0 paths=1 nar_bytes_in=6405628lb # [ 141.422257] niks3-server[1044]: 2026/09/20 12:23:42 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5629worker2 # [ 143.472763] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516425630worker2 # [ 143.484489] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5631worker2 # [ 143.490229] nix-daemon[929]: reaped child process 1623, status = succeeded5632client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5633client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5634worker2 # [ 143.504236] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5635client # farm-b> LOG-farm-b-during-drain5636worker2 # [ 144.551823] nix-daemon[929]: reaped child process 1637, status = succeeded5637worker2 # [ 144.743162] nix-daemon[929]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)5638worker2 # [ 144.761808] nix-daemon[929]: reaped child process 1655, status = succeeded5639lb # [ 142.730006] niks3-server[1044]: 2026/09/20 12:23:43 INFO Received uploads request method=POST path=/api/pending_closures5640worker2 # [ 144.784419] nix-grpc-daemon[1514]: time=2026-09-20T12:23:43.519Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5641worker2 # [ 144.785950] nix-grpc-daemon[1514]: time=2026-09-20T12:23:43.519Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5642lb # [ 142.770035] niks3-server[1044]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5643lb # [ 142.781029] niks3-server[1044]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5644worker2 # [ 144.835082] nix-grpc-daemon[1514]: time=2026-09-20T12:23:43.570Z level=INFO msg="Uploading 1 narinfos"5645lb # [ 142.791855] niks3-server[1044]: 2026/09/20 12:23:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5646lb # [ 142.801286] niks3-server[1044]: 2026/09/20 12:23:43 INFO Signed narinfos id=42 count=15647lb # [ 142.803385] niks3-server[1044]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5648lb # [ 142.810763] niks3-server[1044]: 2026/09/20 12:23:43 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5649lb # [ 142.816807] niks3-server[1044]: 2026/09/20 12:23:43 INFO Completed upload id=425650worker2 # [ 144.861250] nix-grpc-daemon[1514]: time=2026-09-20T12:23:43.597Z level=INFO msg="Upload complete. (346ms)"5651lb # [ 142.819046] niks3-server[1044]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5652worker2 # [ 144.881120] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15653worker2 # [ 144.892344] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:43Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05654worker2 # [ 144.895627] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:43Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15655worker2 # [ 144.901563] nix-daemon[929]: reaped child process 1635, status = succeeded5656worker2 # [ 144.921590] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516425657worker2 # [ 144.943296] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516425658worker2 # [ 144.958648] nix-grpc-daemon[1514]: time=2026-09-20T12:23:43.694Z level=INFO msg="All 2 paths already cached"5659client # copying 1 paths to 'lb:50051'...5660worker2 # [ 144.969716] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516425661client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5662worker2 # [ 144.993485] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5663worker2 # [ 145.204425] nix-daemon[929]: accepted connection from pid 1661, user nix-grpc-daemon (trusted)5664worker2 # [ 145.223696] nix-daemon[929]: reaped child process 1664, status = succeeded5665worker2 # [ 145.405638] nix-daemon[929]: accepted connection from pid 1666, user nix-grpc-daemon (trusted)5666worker2 # [ 145.423776] nix-daemon[929]: reaped child process 1669, status = succeeded5667lb # [ 143.390968] niks3-server[1044]: 2026/09/20 12:23:44 INFO Received uploads request method=POST path=/api/pending_closures5668worker2 # [ 145.445211] nix-grpc-daemon[1514]: time=2026-09-20T12:23:44.180Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5669worker2 # [ 145.446705] nix-grpc-daemon[1514]: time=2026-09-20T12:23:44.180Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5670lb # [ 143.426682] niks3-server[1044]: 2026/09/20 12:23:44 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5671lb # [ 143.448434] niks3-server[1044]: 2026/09/20 12:23:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5672worker2 # [ 145.497622] nix-grpc-daemon[1514]: time=2026-09-20T12:23:44.233Z level=INFO msg="Uploading 1 narinfos"5673lb # [ 143.463908] niks3-server[1044]: 2026/09/20 12:23:44 INFO Signed narinfos id=43 count=15674lb # [ 143.468284] niks3-server[1044]: 2026/09/20 12:23:44 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5675lb # [ 143.478450] niks3-server[1044]: 2026/09/20 12:23:44 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5676lb # [ 143.482957] niks3-server[1044]: 2026/09/20 12:23:44 INFO Completed upload id=435677lb # [ 143.485338] niks3-server[1044]: 2026/09/20 12:23:44 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5678worker2 # [ 145.527333] nix-grpc-daemon[1514]: time=2026-09-20T12:23:44.263Z level=INFO msg="Upload complete. (514ms)"5679worker2 # [ 145.536506] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=0 paths=1 nar_bytes_in=7685680worker2 # [ 145.552509] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516425681worker2 # [ 145.559636] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5682worker2 # [ 145.565260] nix-daemon[929]: reaped child process 1659, status = succeeded5683client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5684worker2 # [ 145.578882] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5685client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5686client # farm-top> LOG-farm-top-during-drain5687worker2 # [ 147.013319] nix-daemon[929]: reaped child process 1673, status = succeeded5688worker2 # [ 147.185178] nix-daemon[929]: accepted connection from pid 1688, user nix-grpc-daemon (trusted)5689worker2 # [ 147.203814] nix-daemon[929]: reaped child process 1691, status = succeeded5690lb # [ 145.173721] niks3-server[1044]: 2026/09/20 12:23:46 INFO Received uploads request method=POST path=/api/pending_closures5691worker2 # [ 147.229688] nix-grpc-daemon[1514]: time=2026-09-20T12:23:45.963Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5692worker2 # [ 147.231510] nix-grpc-daemon[1514]: time=2026-09-20T12:23:45.963Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5693lb # [ 145.213030] niks3-server[1044]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5694lb # [ 145.225232] niks3-server[1044]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5695lb # [ 145.235637] niks3-server[1044]: 2026/09/20 12:23:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5696lb # [ 145.240397] niks3-server[1044]: 2026/09/20 12:23:46 INFO Signed narinfos id=44 count=15697worker2 # [ 147.284831] nix-grpc-daemon[1514]: time=2026-09-20T12:23:46.020Z level=INFO msg="Uploading 1 narinfos"5698lb # [ 145.243903] niks3-server[1044]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5699lb # [ 145.252893] niks3-server[1044]: 2026/09/20 12:23:46 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5700lb # [ 145.261704] niks3-server[1044]: 2026/09/20 12:23:46 INFO Completed upload id=445701worker2 # [ 147.306090] nix-grpc-daemon[1514]: time=2026-09-20T12:23:46.042Z level=INFO msg="Upload complete. (316ms)"5702lb # [ 145.264544] niks3-server[1044]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5703worker2 # [ 147.321041] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15704worker2 # [ 147.334767] nix-daemon[929]: reaped child process 1671, status = succeeded5705client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.83 seconds)5706client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5707client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5708worker1: must succeed: pkill -f 'read -t [9]0 x'5709worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5710client: waiting for success: ! systemctl is-active sw5711worker1 # [ 147.536202] nix-daemon[854]: reaped child process 1637, status = succeeded5712worker1 # [ 147.712801] nix-daemon[854]: accepted connection from pid 1677, user nix-grpc-daemon (trusted)5713worker1 # [ 147.734594] nix-daemon[854]: reaped child process 1680, status = succeeded5714lb # [ 146.001892] niks3-server[1044]: 2026/09/20 12:23:46 INFO Received uploads request method=POST path=/api/pending_closures5715worker1 # [ 147.756965] nix-grpc-daemon[1585]: time=2026-09-20T12:23:47.272Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5716worker1 # [ 147.759499] nix-grpc-daemon[1585]: time=2026-09-20T12:23:47.274Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5717lb # [ 146.041234] niks3-server[1044]: 2026/09/20 12:23:47 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5718lb # [ 146.053801] niks3-server[1044]: 2026/09/20 12:23:47 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5719lb # [ 146.070678] niks3-server[1044]: 2026/09/20 12:23:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5720worker1 # [ 147.822077] nix-grpc-daemon[1585]: time=2026-09-20T12:23:47.336Z level=INFO msg="Uploading 1 narinfos"5721lb # [ 146.083226] niks3-server[1044]: 2026/09/20 12:23:47 INFO Signed narinfos id=45 count=15722lb # [ 146.089047] niks3-server[1044]: 2026/09/20 12:23:47 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5723lb # [ 146.102271] niks3-server[1044]: 2026/09/20 12:23:47 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5724lb # [ 146.108445] niks3-server[1044]: 2026/09/20 12:23:47 INFO Completed upload id=455725worker1 # [ 147.851145] nix-grpc-daemon[1585]: time=2026-09-20T12:23:47.366Z level=INFO msg="Upload complete. (339ms)"5726lb # [ 146.110913] niks3-server[1044]: 2026/09/20 12:23:47 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5727worker1 # [ 147.865278] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33972 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15728worker1 # [ 147.884718] nix-daemon[854]: reaped child process 1635, status = succeeded5729client # [ 147.885390] systemd[1]: sw.service: Deactivated successfully.5730client # [ 147.890103] systemd[1]: sw.service: Consumed 174ms CPU time over 10.509s wall clock time, 37M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5731worker1 # [ 148.165564] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:47Z level=info event=signal_exit5732client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5733client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5734lb # [ 146.769102] envoy[934]: conn peer=[2001:db8:1::1]:47314 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9612 tx=3846 ms=65475735lb # [ 146.774132] envoy[934]: conn peer=[2001:db8:1::1]:47300 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2939 tx=1350 ms=102205736client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5737worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5738worker2 # [ 149.686216] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:434385739worker2 # [ 149.692262] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:48Z level=info event=worker_gone addr=192.168.1.3:500515740worker1 # [ 149.392873] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:48Z level=info event=scheduler_restarting5741worker1 # [ 149.406534] nix-grpc-daemon[1484]: ts=2026-09-20T12:23:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5742worker1 # [ 149.435550] nix-daemon[854]: reaped child process 1553, status = succeeded5743worker1 # [ 149.931745] nix-grpc-daemon[1484]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5744worker1 # [ 149.936515] nix-grpc-daemon[1484]: E0000 00:00:1789907029.447107 1527 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5745worker1 # [ 149.945071] nix-grpc-daemon[1484]: E0000 00:00:1789907029.460504 1527 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5746worker1 # [ 151.206735] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5747worker1 # [ 151.210033] systemd[1]: nix-grpc-daemon.service: Consumed 869ms CPU time over 28.280s wall clock time, 30.8M memory peak, 20.6K incoming IP traffic, 26.8K outgoing IP traffic.5748worker1 # [ 151.232744] systemd[1]: Starting Nix worker-protocol over gRPC...5749worker1 # [ 151.435109] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5750worker1 # [ 151.437667] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5751worker1 # [ 151.441764] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15752worker1 # [ 151.449856] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5753worker1 # [ 151.451664] systemd[1]: Started Nix worker-protocol over gRPC.5754worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.92 seconds)5755lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5756lb: must succeed: curl -sf localhost:9901/clusters5757worker1 # [ 151.475703] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:50Z level=info event=scheduler_connected addr=lb:500515758worker2 # [ 151.781160] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:50Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:434425759worker2 # [ 151.786148] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05760lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5761lb: must succeed: curl -sf localhost:9901/clusters5762lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5763lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5764lb: must succeed: curl -sf localhost:9901/clusters5765lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5766worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5767worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5768(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.44 seconds)5769subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5770client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15771worker1 # [ 153.041324] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:553165772worker1 # [ 153.057126] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5773worker1 # [ 153.078245] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553165774worker1 # [ 153.095493] nix-grpc-daemon[1694]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 1/5)5775worker1 # [ 153.136388] nix-grpc-daemon[1694]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 2/5)5776worker1 # [ 153.227972] nix-grpc-daemon[1694]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 323 ms (attempt 3/5)5777worker1 # [ 153.558771] nix-grpc-daemon[1694]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 4/5)5778worker1 # [ 153.627147] nix-grpc-daemon[1694]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5779worker2 # [ 153.980573] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:52Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05780worker2 # [ 153.980961] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:52Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15781worker2 # [ 153.981086] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:52Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05782worker2 # [ 153.981211] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:52Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05783worker1 # [ 153.725699] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553165784worker1 # [ 153.742352] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553165785worker1 # [ 153.758284] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:553165786worker1 # [ 153.773699] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5787worker1 # [ 154.025534] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:53Z level=info event=niks3_push_started pid=17505788worker1 # [ 154.266939] nix-grpc-daemon[1750]: time=2026-09-20T12:23:53.781Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5789worker1 # [ 154.453491] nix-daemon[854]: accepted connection from pid 1763, user nix-grpc-daemon (trusted)5790worker1 # [ 154.474235] nix-daemon[854]: reaped child process 1766, status = succeeded5791worker1 # [ 154.655738] nix-daemon[854]: accepted connection from pid 1768, user nix-grpc-daemon (trusted)5792worker1 # [ 154.674685] nix-daemon[854]: reaped child process 1771, status = succeeded5793lb # [ 152.944855] niks3-server[1044]: 2026/09/20 12:23:53 INFO Received uploads request method=POST path=/api/pending_closures5794worker1 # [ 154.701799] nix-grpc-daemon[1750]: time=2026-09-20T12:23:54.215Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5795worker1 # [ 154.703459] nix-grpc-daemon[1750]: time=2026-09-20T12:23:54.215Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5796lb # [ 152.982397] niks3-server[1044]: 2026/09/20 12:23:53 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5797lb # [ 152.997209] niks3-server[1044]: 2026/09/20 12:23:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5798worker1 # [ 154.747959] nix-grpc-daemon[1750]: time=2026-09-20T12:23:54.262Z level=INFO msg="Uploading 1 narinfos"5799lb # [ 153.007310] niks3-server[1044]: 2026/09/20 12:23:53 INFO Signed narinfos id=46 count=15800lb # [ 153.017148] niks3-server[1044]: 2026/09/20 12:23:53 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5801lb # [ 153.031495] niks3-server[1044]: 2026/09/20 12:23:54 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5802worker1 # [ 154.780688] nix-grpc-daemon[1750]: time=2026-09-20T12:23:54.296Z level=INFO msg="Upload complete. (509ms)"5803lb # [ 153.037358] niks3-server[1044]: 2026/09/20 12:23:54 INFO Completed upload id=465804lb # [ 153.040741] niks3-server[1044]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5805worker1 # [ 154.793018] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=1 paths=1 nar_bytes_in=5125806worker1 # [ 154.801193] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553165807worker1 # [ 154.812192] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5808worker1 # [ 154.817306] nix-daemon[854]: reaped child process 1748, status = succeeded5809worker1 # [ 154.831176] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5810worker1 # [ 155.661130] nix-daemon[854]: reaped child process 1775, status = succeeded5811worker1 # [ 155.830306] nix-daemon[854]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5812worker1 # [ 155.852306] nix-daemon[854]: reaped child process 1793, status = succeeded5813lb # [ 154.121100] niks3-server[1044]: 2026/09/20 12:23:55 INFO Received uploads request method=POST path=/api/pending_closures5814worker1 # [ 155.877603] nix-grpc-daemon[1750]: time=2026-09-20T12:23:55.392Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5815worker1 # [ 155.882907] nix-grpc-daemon[1750]: time=2026-09-20T12:23:55.394Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5816lb # [ 154.178634] niks3-server[1044]: 2026/09/20 12:23:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5817worker1 # [ 155.931812] nix-grpc-daemon[1750]: time=2026-09-20T12:23:55.446Z level=INFO msg="Uploading 1 narinfos"5818lb # [ 154.195531] niks3-server[1044]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5819lb # [ 154.205750] niks3-server[1044]: 2026/09/20 12:23:55 INFO Signed narinfos id=47 count=15820lb # [ 154.216368] niks3-server[1044]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5821worker1 # [ 155.959721] nix-grpc-daemon[1750]: time=2026-09-20T12:23:55.475Z level=INFO msg="Upload complete. (318ms)"5822lb # [ 154.219265] niks3-server[1044]: 2026/09/20 12:23:55 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5823lb # [ 154.225792] niks3-server[1044]: 2026/09/20 12:23:55 INFO Completed upload id=475824worker1 # [ 155.969664] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15825lb # [ 154.229010] niks3-server[1044]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5826worker2 # [ 156.272415] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:55Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15827lb # [ 154.236351] niks3-server[1044]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5828worker1 # [ 155.990455] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553165829worker2 # [ 156.290218] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:55Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05830worker1 # [ 155.996206] nix-daemon[854]: reaped child process 1773, status = succeeded5831worker1 # [ 155.999473] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553165832worker1 # [ 156.010970] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:553165833worker1 # [ 156.020454] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5834worker1 # [ 156.215721] nix-daemon[854]: accepted connection from pid 1797, user nix-grpc-daemon (trusted)5835worker1 # [ 156.243010] nix-daemon[854]: reaped child process 1800, status = succeeded5836worker1 # [ 156.433703] nix-daemon[854]: accepted connection from pid 1802, user nix-grpc-daemon (trusted)5837worker1 # [ 156.457463] nix-daemon[854]: reaped child process 1805, status = succeeded5838lb # [ 154.723996] niks3-server[1044]: 2026/09/20 12:23:55 INFO Received uploads request method=POST path=/api/pending_closures5839worker1 # [ 156.483124] nix-grpc-daemon[1750]: time=2026-09-20T12:23:55.998Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5840worker1 # [ 156.484812] nix-grpc-daemon[1750]: time=2026-09-20T12:23:55.998Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5841lb # [ 154.765618] niks3-server[1044]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5842worker1 # [ 156.522680] nix-grpc-daemon[1750]: time=2026-09-20T12:23:56.037Z level=INFO msg="Uploading 1 narinfos"5843lb # [ 154.783111] niks3-server[1044]: 2026/09/20 12:23:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5844lb # [ 154.791749] niks3-server[1044]: 2026/09/20 12:23:55 INFO Signed narinfos id=48 count=15845lb # [ 154.795501] niks3-server[1044]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5846lb # [ 154.805194] niks3-server[1044]: 2026/09/20 12:23:55 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5847lb # [ 154.811919] niks3-server[1044]: 2026/09/20 12:23:55 INFO Completed upload id=485848worker1 # [ 156.556414] nix-grpc-daemon[1750]: time=2026-09-20T12:23:56.071Z level=INFO msg="Upload complete. (524ms)"5849lb # [ 154.814805] niks3-server[1044]: 2026/09/20 12:23:55 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5850worker1 # [ 156.567095] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=0 paths=1 nar_bytes_in=5125851worker1 # [ 156.584498] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553165852worker1 # [ 156.591373] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5853worker1 # [ 156.597212] nix-daemon[854]: reaped child process 1795, status = succeeded5854worker1 # [ 156.613059] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5855worker1 # [ 157.435434] nix-daemon[854]: reaped child process 1809, status = succeeded5856worker1 # [ 157.609699] nix-daemon[854]: accepted connection from pid 1824, user nix-grpc-daemon (trusted)5857worker1 # [ 157.631072] nix-daemon[854]: reaped child process 1827, status = succeeded5858lb # [ 155.900668] niks3-server[1044]: 2026/09/20 12:23:56 INFO Received uploads request method=POST path=/api/pending_closures5859worker1 # [ 157.655302] nix-grpc-daemon[1750]: time=2026-09-20T12:23:57.169Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5860worker1 # [ 157.656974] nix-grpc-daemon[1750]: time=2026-09-20T12:23:57.169Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5861worker1 # [ 157.698533] nix-grpc-daemon[1750]: time=2026-09-20T12:23:57.213Z level=INFO msg="Uploading 1 narinfos"5862lb # [ 155.944271] niks3-server[1044]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5863lb # [ 155.959500] niks3-server[1044]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5864lb # [ 155.970608] niks3-server[1044]: 2026/09/20 12:23:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5865lb # [ 155.981663] niks3-server[1044]: 2026/09/20 12:23:56 INFO Signed narinfos id=49 count=15866lb # [ 155.984587] niks3-server[1044]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5867lb # [ 155.988322] niks3-server[1044]: 2026/09/20 12:23:56 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5868lb # [ 155.992808] niks3-server[1044]: 2026/09/20 12:23:56 INFO Completed upload id=495869worker1 # [ 157.736612] nix-grpc-daemon[1750]: time=2026-09-20T12:23:57.252Z level=INFO msg="Upload complete. (313ms)"5870lb # [ 155.995856] niks3-server[1044]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5871worker1 # [ 157.744803] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15872worker2 # [ 158.047316] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:56Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15873worker1 # [ 157.761442] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553165874worker2 # [ 158.061251] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:56Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05875worker1 # [ 157.768781] nix-daemon[854]: reaped child process 1807, status = succeeded5876worker1 # [ 157.776539] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553165877worker1 # [ 157.790563] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:553165878worker1 # [ 157.801898] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5879worker1 # [ 157.994793] nix-daemon[854]: accepted connection from pid 1831, user nix-grpc-daemon (trusted)5880worker1 # [ 158.013956] nix-daemon[854]: reaped child process 1834, status = succeeded5881worker1 # [ 158.191732] nix-daemon[854]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)5882worker1 # [ 158.213021] nix-daemon[854]: reaped child process 1839, status = succeeded5883lb # [ 156.481528] niks3-server[1044]: 2026/09/20 12:23:57 INFO Received uploads request method=POST path=/api/pending_closures5884worker1 # [ 158.236116] nix-grpc-daemon[1750]: time=2026-09-20T12:23:57.751Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5885worker1 # [ 158.237674] nix-grpc-daemon[1750]: time=2026-09-20T12:23:57.751Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5886lb # [ 156.519063] niks3-server[1044]: 2026/09/20 12:23:57 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5887worker1 # [ 158.278326] nix-grpc-daemon[1750]: time=2026-09-20T12:23:57.793Z level=INFO msg="Uploading 1 narinfos"5888lb # [ 156.538411] niks3-server[1044]: 2026/09/20 12:23:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5889lb # [ 156.547964] niks3-server[1044]: 2026/09/20 12:23:57 INFO Signed narinfos id=50 count=15890lb # [ 156.550639] niks3-server[1044]: 2026/09/20 12:23:57 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5891lb # [ 156.561243] niks3-server[1044]: 2026/09/20 12:23:57 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5892worker1 # [ 158.312102] nix-grpc-daemon[1750]: time=2026-09-20T12:23:57.827Z level=INFO msg="Upload complete. (497ms)"5893lb # [ 156.571271] niks3-server[1044]: 2026/09/20 12:23:57 INFO Completed upload id=505894lb # [ 156.574581] niks3-server[1044]: 2026/09/20 12:23:57 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5895worker1 # [ 158.324096] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=0 paths=1 nar_bytes_in=5125896worker1 # [ 158.336256] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553165897worker1 # [ 158.345014] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5898worker1 # [ 158.350727] nix-daemon[854]: reaped child process 1829, status = succeeded5899worker1 # [ 158.366996] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5900lb # [ 156.770908] envoy[934]: conn peer=[2001:db8:1::3]:45004 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=262305901worker1 # [ 159.816875] nix-daemon[854]: reaped child process 1843, status = succeeded5902worker1 # [ 160.001537] nix-daemon[854]: accepted connection from pid 1858, user nix-grpc-daemon (trusted)5903worker1 # [ 160.020868] nix-daemon[854]: reaped child process 1861, status = succeeded5904lb # [ 158.290155] niks3-server[1044]: 2026/09/20 12:23:59 INFO Received uploads request method=POST path=/api/pending_closures5905worker1 # [ 160.046297] nix-grpc-daemon[1750]: time=2026-09-20T12:23:59.560Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5906worker1 # [ 160.047842] nix-grpc-daemon[1750]: time=2026-09-20T12:23:59.560Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5907lb # [ 158.331895] niks3-server[1044]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5908lb # [ 158.342683] niks3-server[1044]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5909lb # [ 158.354412] niks3-server[1044]: 2026/09/20 12:23:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5910worker1 # [ 160.104319] nix-grpc-daemon[1750]: time=2026-09-20T12:23:59.619Z level=INFO msg="Uploading 1 narinfos"5911lb # [ 158.363954] niks3-server[1044]: 2026/09/20 12:23:59 INFO Signed narinfos id=51 count=15912lb # [ 158.366294] niks3-server[1044]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5913lb # [ 158.379142] niks3-server[1044]: 2026/09/20 12:23:59 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5914lb # [ 158.386360] niks3-server[1044]: 2026/09/20 12:23:59 INFO Completed upload id=515915worker1 # [ 160.129190] nix-grpc-daemon[1750]: time=2026-09-20T12:23:59.644Z level=INFO msg="Upload complete. (349ms)"5916lb # [ 158.388788] niks3-server[1044]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5917worker2 # [ 160.442191] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:59Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15918worker1 # [ 160.143899] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15919worker2 # [ 160.452972] nix-grpc-daemon[1442]: ts=2026-09-20T12:23:59Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05920worker1 # [ 160.160553] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553165921worker1 # [ 160.168243] nix-daemon[854]: reaped child process 1841, status = succeeded5922worker1 # [ 160.177138] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553165923worker1 # [ 160.191438] nix-grpc-daemon[1750]: time=2026-09-20T12:23:59.706Z level=INFO msg="All 1 paths already cached"5924worker1 # [ 160.200141] nix-grpc-daemon[1694]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:553165925worker1 # [ 160.214331] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5926worker1 # [ 160.411713] nix-daemon[854]: accepted connection from pid 1865, user nix-grpc-daemon (trusted)5927worker1 # [ 160.431874] nix-daemon[854]: reaped child process 1868, status = succeeded5928worker1 # [ 160.609755] nix-daemon[854]: accepted connection from pid 1870, user nix-grpc-daemon (trusted)5929worker1 # [ 160.628848] nix-daemon[854]: reaped child process 1873, status = succeeded5930lb # [ 158.896756] niks3-server[1044]: 2026/09/20 12:23:59 INFO Received uploads request method=POST path=/api/pending_closures5931worker1 # [ 160.650100] nix-grpc-daemon[1750]: time=2026-09-20T12:24:00.165Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5932worker1 # [ 160.651636] nix-grpc-daemon[1750]: time=2026-09-20T12:24:00.165Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5933lb # [ 158.927385] niks3-server[1044]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5934lb # [ 158.940218] niks3-server[1044]: 2026/09/20 12:23:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5935worker1 # [ 160.690892] nix-grpc-daemon[1750]: time=2026-09-20T12:24:00.206Z level=INFO msg="Uploading 1 narinfos"5936lb # [ 158.951820] niks3-server[1044]: 2026/09/20 12:23:59 INFO Signed narinfos id=52 count=15937lb # [ 158.960445] niks3-server[1044]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5938lb # [ 158.973123] niks3-server[1044]: 2026/09/20 12:23:59 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5939lb # [ 158.978791] niks3-server[1044]: 2026/09/20 12:23:59 INFO Completed upload id=525940worker1 # [ 160.723013] nix-grpc-daemon[1750]: time=2026-09-20T12:24:00.238Z level=INFO msg="Upload complete. (491ms)"5941lb # [ 158.982215] niks3-server[1044]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5942worker1 # [ 160.732298] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=0 paths=1 nar_bytes_in=6245943worker1 # [ 160.740344] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553165944worker1 # [ 160.756277] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5945worker1 # [ 160.759196] nix-daemon[854]: reaped child process 1863, status = succeeded5946worker1 # [ 160.771103] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5947worker1 # [ 162.425301] nix-daemon[854]: reaped child process 1877, status = succeeded5948worker1 # [ 162.611514] nix-daemon[854]: accepted connection from pid 1892, user nix-grpc-daemon (trusted)5949worker1 # [ 162.631708] nix-daemon[854]: reaped child process 1895, status = succeeded5950lb # [ 160.901827] niks3-server[1044]: 2026/09/20 12:24:01 INFO Received uploads request method=POST path=/api/pending_closures5951worker1 # [ 162.655141] nix-grpc-daemon[1750]: time=2026-09-20T12:24:02.170Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5952worker1 # [ 162.660068] nix-grpc-daemon[1750]: time=2026-09-20T12:24:02.172Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5953lb # [ 160.955158] niks3-server[1044]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5954lb # [ 160.967689] niks3-server[1044]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5955lb # [ 160.974722] niks3-server[1044]: 2026/09/20 12:24:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5956worker1 # [ 162.719337] nix-grpc-daemon[1750]: time=2026-09-20T12:24:02.234Z level=INFO msg="Uploading 1 narinfos"5957lb # [ 160.984179] niks3-server[1044]: 2026/09/20 12:24:01 INFO Signed narinfos id=53 count=15958lb # [ 160.986563] niks3-server[1044]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5959lb # [ 160.998941] niks3-server[1044]: 2026/09/20 12:24:01 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5960lb # [ 161.003591] niks3-server[1044]: 2026/09/20 12:24:01 INFO Completed upload id=535961worker1 # [ 162.747801] nix-grpc-daemon[1750]: time=2026-09-20T12:24:02.263Z level=INFO msg="Upload complete. (359ms)"5962lb # [ 161.006281] niks3-server[1044]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5963worker2 # [ 163.060946] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:01Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15964worker1 # [ 162.764243] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=2 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15965worker2 # [ 163.068699] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:01Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05966worker1 # [ 162.781680] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553165967worker1 # [ 162.790082] nix-daemon[854]: reaped child process 1875, status = succeeded5968worker1 # [ 162.799050] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553165969worker1 # [ 162.814637] nix-grpc-daemon[1750]: time=2026-09-20T12:24:02.330Z level=INFO msg="All 1 paths already cached"5970worker1 # [ 162.823796] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:553165971worker1 # [ 162.837791] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5972worker1 # [ 163.043015] nix-daemon[854]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)5973worker1 # [ 163.061967] nix-daemon[854]: reaped child process 1902, status = succeeded5974worker1 # [ 163.243175] nix-daemon[854]: accepted connection from pid 1904, user nix-grpc-daemon (trusted)5975worker1 # [ 163.261776] nix-daemon[854]: reaped child process 1907, status = succeeded5976lb # [ 161.530641] niks3-server[1044]: 2026/09/20 12:24:02 INFO Received uploads request method=POST path=/api/pending_closures5977worker1 # [ 163.283844] nix-grpc-daemon[1750]: time=2026-09-20T12:24:02.799Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5978worker1 # [ 163.285761] nix-grpc-daemon[1750]: time=2026-09-20T12:24:02.799Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5979lb # [ 161.559287] niks3-server[1044]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5980lb # [ 161.569187] niks3-server[1044]: 2026/09/20 12:24:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5981worker1 # [ 163.319011] nix-grpc-daemon[1750]: time=2026-09-20T12:24:02.834Z level=INFO msg="Uploading 1 narinfos"5982lb # [ 161.581155] niks3-server[1044]: 2026/09/20 12:24:02 INFO Signed narinfos id=54 count=15983lb # [ 161.587992] niks3-server[1044]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5984lb # [ 161.595940] niks3-server[1044]: 2026/09/20 12:24:02 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5985lb # [ 161.603111] niks3-server[1044]: 2026/09/20 12:24:02 INFO Completed upload id=545986worker1 # [ 163.347297] nix-grpc-daemon[1750]: time=2026-09-20T12:24:02.862Z level=INFO msg="Upload complete. (493ms)"5987lb # [ 161.606108] niks3-server[1044]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5988worker1 # [ 163.356343] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=0 paths=1 nar_bytes_in=6245989worker1 # [ 163.364816] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553165990worker1 # [ 163.375229] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5991worker1 # [ 163.380303] nix-daemon[854]: reaped child process 1897, status = succeeded5992worker1 # [ 163.391810] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5993worker1 # [ 164.644175] nix-daemon[854]: reaped child process 1911, status = succeeded5994worker1 # [ 164.822993] nix-daemon[854]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)5995worker1 # [ 164.843102] nix-daemon[854]: reaped child process 1929, status = succeeded5996lb # [ 163.117804] niks3-server[1044]: 2026/09/20 12:24:04 INFO Received uploads request method=POST path=/api/pending_closures5997worker1 # [ 164.871507] nix-grpc-daemon[1750]: time=2026-09-20T12:24:04.385Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5998worker1 # [ 164.873499] nix-grpc-daemon[1750]: time=2026-09-20T12:24:04.385Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5999lb # [ 163.152790] niks3-server[1044]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6000lb # [ 163.168165] niks3-server[1044]: 2026/09/20 12:24:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6001worker1 # [ 164.917826] nix-grpc-daemon[1750]: time=2026-09-20T12:24:04.433Z level=INFO msg="Uploading 1 narinfos"6002lb # [ 163.179432] niks3-server[1044]: 2026/09/20 12:24:04 INFO Signed narinfos id=55 count=16003lb # [ 163.184870] niks3-server[1044]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6004lb # [ 163.190134] niks3-server[1044]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6005lb # [ 163.196365] niks3-server[1044]: 2026/09/20 12:24:04 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6006lb # [ 163.200360] niks3-server[1044]: 2026/09/20 12:24:04 INFO Completed upload id=556007worker1 # [ 164.944525] nix-grpc-daemon[1750]: time=2026-09-20T12:24:04.460Z level=INFO msg="Upload complete. (339ms)"6008lb # [ 163.203208] niks3-server[1044]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6009worker2 # [ 165.253367] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:03Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16010worker1 # [ 164.956863] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=16011worker2 # [ 165.266301] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:04Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06012worker1 # [ 164.973897] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553166013worker1 # [ 164.981199] nix-daemon[854]: reaped child process 1909, status = succeeded6014worker1 # [ 164.989328] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553166015worker1 # [ 165.001909] nix-grpc-daemon[1750]: time=2026-09-20T12:24:04.517Z level=INFO msg="All 1 paths already cached"6016worker1 # [ 165.010405] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:553166017worker1 # [ 165.023305] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6018worker1 # [ 165.212707] nix-daemon[854]: accepted connection from pid 1933, user nix-grpc-daemon (trusted)6019worker1 # [ 165.233884] nix-daemon[854]: reaped child process 1936, status = succeeded6020worker1 # [ 165.410659] nix-daemon[854]: accepted connection from pid 1938, user nix-grpc-daemon (trusted)6021worker1 # [ 165.429161] nix-daemon[854]: reaped child process 1941, status = succeeded6022lb # [ 163.696147] niks3-server[1044]: 2026/09/20 12:24:04 INFO Received uploads request method=POST path=/api/pending_closures6023worker1 # [ 165.452486] nix-grpc-daemon[1750]: time=2026-09-20T12:24:04.967Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6024worker1 # [ 165.453988] nix-grpc-daemon[1750]: time=2026-09-20T12:24:04.967Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6025lb # [ 163.730508] niks3-server[1044]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6026worker1 # [ 165.485667] nix-grpc-daemon[1750]: time=2026-09-20T12:24:05.001Z level=INFO msg="Uploading 1 narinfos"6027lb # [ 163.747472] niks3-server[1044]: 2026/09/20 12:24:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6028lb # [ 163.756680] niks3-server[1044]: 2026/09/20 12:24:04 INFO Signed narinfos id=56 count=16029lb # [ 163.763710] niks3-server[1044]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6030worker1 # [ 165.514243] nix-grpc-daemon[1750]: time=2026-09-20T12:24:05.029Z level=INFO msg="Upload complete. (477ms)"6031lb # [ 163.770871] niks3-server[1044]: 2026/09/20 12:24:04 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6032lb # [ 163.776890] niks3-server[1044]: 2026/09/20 12:24:04 INFO Completed upload id=566033worker1 # [ 165.520727] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=0 paths=1 nar_bytes_in=6246034lb # [ 163.780442] niks3-server[1044]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6035worker1 # [ 165.534194] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553166036worker1 # [ 165.541367] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6037worker1 # [ 165.546236] nix-daemon[854]: reaped child process 1931, status = succeeded6038worker1 # [ 165.559798] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6039worker1 # [ 166.401913] nix-daemon[854]: reaped child process 1945, status = succeeded6040worker1 # [ 166.592664] nix-daemon[854]: accepted connection from pid 1960, user nix-grpc-daemon (trusted)6041worker1 # [ 166.611144] nix-daemon[854]: reaped child process 1963, status = succeeded6042lb # [ 164.880675] niks3-server[1044]: 2026/09/20 12:24:05 INFO Received uploads request method=POST path=/api/pending_closures6043worker1 # [ 166.638582] nix-grpc-daemon[1750]: time=2026-09-20T12:24:06.152Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6044worker1 # [ 166.640322] nix-grpc-daemon[1750]: time=2026-09-20T12:24:06.152Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6045worker1 # [ 166.681619] nix-grpc-daemon[1750]: time=2026-09-20T12:24:06.196Z level=INFO msg="Uploading 1 narinfos"6046lb # [ 164.928626] niks3-server[1044]: 2026/09/20 12:24:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6047lb # [ 164.942119] niks3-server[1044]: 2026/09/20 12:24:05 INFO Signed narinfos id=57 count=16048lb # [ 164.951617] niks3-server[1044]: 2026/09/20 12:24:05 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6049lb # [ 164.961615] niks3-server[1044]: 2026/09/20 12:24:05 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6050worker1 # [ 166.719055] nix-grpc-daemon[1750]: time=2026-09-20T12:24:06.234Z level=INFO msg="Upload complete. (349ms)"6051lb # [ 164.973537] niks3-server[1044]: 2026/09/20 12:24:05 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6052lb # [ 164.979685] niks3-server[1044]: 2026/09/20 12:24:05 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6053lb # [ 164.985421] niks3-server[1044]: 2026/09/20 12:24:05 INFO Completed upload id=576054lb # [ 164.988824] niks3-server[1044]: 2026/09/20 12:24:05 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6055worker2 # [ 167.031537] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:05Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16056worker1 # [ 166.730101] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16057worker2 # [ 167.045233] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:05Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06058worker1 # [ 166.752561] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553166059worker1 # [ 166.762998] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553166060worker1 # [ 166.769319] nix-daemon[854]: reaped child process 1943, status = succeeded6061worker1 # [ 166.777094] nix-grpc-daemon[1750]: time=2026-09-20T12:24:06.292Z level=INFO msg="All 2 paths already cached"6062worker1 # [ 166.785041] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:553166063worker1 # [ 166.797505] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6064worker1 # [ 166.986811] nix-daemon[854]: accepted connection from pid 1967, user nix-grpc-daemon (trusted)6065worker1 # [ 167.007223] nix-daemon[854]: reaped child process 1970, status = succeeded6066worker1 # [ 167.180112] nix-daemon[854]: accepted connection from pid 1972, user nix-grpc-daemon (trusted)6067worker1 # [ 167.198972] nix-daemon[854]: reaped child process 1975, status = succeeded6068lb # [ 165.466926] niks3-server[1044]: 2026/09/20 12:24:06 INFO Received uploads request method=POST path=/api/pending_closures6069worker1 # [ 167.220923] nix-grpc-daemon[1750]: time=2026-09-20T12:24:06.736Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6070worker1 # [ 167.222434] nix-grpc-daemon[1750]: time=2026-09-20T12:24:06.736Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6071lb # [ 165.494176] niks3-server[1044]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6072worker1 # [ 167.253105] nix-grpc-daemon[1750]: time=2026-09-20T12:24:06.768Z level=INFO msg="Uploading 1 narinfos"6073lb # [ 165.512611] niks3-server[1044]: 2026/09/20 12:24:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6074lb # [ 165.523351] niks3-server[1044]: 2026/09/20 12:24:06 INFO Signed narinfos id=58 count=16075worker1 # [ 167.276170] nix-grpc-daemon[1750]: time=2026-09-20T12:24:06.791Z level=INFO msg="Upload complete. (464ms)"6076lb # [ 165.532301] niks3-server[1044]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6077lb # [ 165.536753] niks3-server[1044]: 2026/09/20 12:24:06 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6078lb # [ 165.540890] niks3-server[1044]: 2026/09/20 12:24:06 INFO Completed upload id=586079worker1 # [ 167.284120] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=0 paths=1 nar_bytes_in=7526080lb # [ 165.542921] niks3-server[1044]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6081worker1 # [ 167.291057] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553166082worker1 # [ 167.300468] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6083worker1 # [ 167.305564] nix-daemon[854]: reaped child process 1965, status = succeeded6084worker1 # [ 167.316853] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6085worker1 # [ 168.141249] nix-daemon[854]: reaped child process 1979, status = succeeded6086worker1 # [ 168.303139] nix-daemon[854]: accepted connection from pid 1994, user nix-grpc-daemon (trusted)6087worker1 # [ 168.323828] nix-daemon[854]: reaped child process 1997, status = succeeded6088lb # [ 166.593846] niks3-server[1044]: 2026/09/20 12:24:07 INFO Received uploads request method=POST path=/api/pending_closures6089worker1 # [ 168.348401] nix-grpc-daemon[1750]: time=2026-09-20T12:24:07.861Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6090worker1 # [ 168.349892] nix-grpc-daemon[1750]: time=2026-09-20T12:24:07.861Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6091lb # [ 166.630415] niks3-server[1044]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6092lb # [ 166.646523] niks3-server[1044]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6093lb # [ 166.656957] niks3-server[1044]: 2026/09/20 12:24:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6094worker1 # [ 168.406190] nix-grpc-daemon[1750]: time=2026-09-20T12:24:07.921Z level=INFO msg="Uploading 1 narinfos"6095lb # [ 166.665185] niks3-server[1044]: 2026/09/20 12:24:07 INFO Signed narinfos id=59 count=16096lb # [ 166.667712] niks3-server[1044]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6097lb # [ 166.680152] niks3-server[1044]: 2026/09/20 12:24:07 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6098lb # [ 166.685992] niks3-server[1044]: 2026/09/20 12:24:07 INFO Completed upload id=596099worker1 # [ 168.429556] nix-grpc-daemon[1750]: time=2026-09-20T12:24:07.945Z level=INFO msg="Upload complete. (304ms)"6100lb # [ 166.689274] niks3-server[1044]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6101worker2 # [ 168.735256] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:07Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16102worker1 # [ 168.441461] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16103worker1 # [ 168.460815] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553166104worker1 # [ 168.467801] nix-daemon[854]: reaped child process 1977, status = succeeded6105worker1 # [ 168.475638] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553166106worker1 # [ 168.488753] nix-grpc-daemon[1750]: time=2026-09-20T12:24:08.004Z level=INFO msg="All 2 paths already cached"6107worker1 # [ 168.497160] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:553166108worker1 # [ 168.508908] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6109worker1 # [ 168.705521] nix-daemon[854]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)6110worker1 # [ 168.724329] nix-daemon[854]: reaped child process 2004, status = succeeded6111worker1 # [ 168.900413] nix-daemon[854]: accepted connection from pid 2006, user nix-grpc-daemon (trusted)6112worker1 # [ 168.918573] nix-daemon[854]: reaped child process 2009, status = succeeded6113lb # [ 167.186889] niks3-server[1044]: 2026/09/20 12:24:08 INFO Received uploads request method=POST path=/api/pending_closures6114worker1 # [ 168.939774] nix-grpc-daemon[1750]: time=2026-09-20T12:24:08.455Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6115worker1 # [ 168.941506] nix-grpc-daemon[1750]: time=2026-09-20T12:24:08.455Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6116lb # [ 167.219869] niks3-server[1044]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6117worker1 # [ 168.973461] nix-grpc-daemon[1750]: time=2026-09-20T12:24:08.488Z level=INFO msg="Uploading 1 narinfos"6118lb # [ 167.236074] niks3-server[1044]: 2026/09/20 12:24:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6119lb # [ 167.245753] niks3-server[1044]: 2026/09/20 12:24:08 INFO Signed narinfos id=60 count=16120lb # [ 167.249714] niks3-server[1044]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6121worker1 # [ 169.002666] nix-grpc-daemon[1750]: time=2026-09-20T12:24:08.518Z level=INFO msg="Upload complete. (479ms)"6122lb # [ 167.259367] niks3-server[1044]: 2026/09/20 12:24:08 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6123lb # [ 167.264650] niks3-server[1044]: 2026/09/20 12:24:08 INFO Completed upload id=606124lb # [ 167.267860] niks3-server[1044]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6125worker1 # [ 169.012559] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=0 paths=1 nar_bytes_in=7526126worker1 # [ 169.022557] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553166127worker1 # [ 169.029438] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6128worker1 # [ 169.034734] nix-daemon[854]: reaped child process 1999, status = succeeded6129worker1 # [ 169.046117] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6130worker1 # [ 170.497780] nix-daemon[854]: reaped child process 2013, status = succeeded6131worker1 # [ 170.684359] nix-daemon[854]: accepted connection from pid 2028, user nix-grpc-daemon (trusted)6132worker1 # [ 170.705046] nix-daemon[854]: reaped child process 2031, status = succeeded6133lb # [ 168.973845] niks3-server[1044]: 2026/09/20 12:24:09 INFO Received uploads request method=POST path=/api/pending_closures6134worker1 # [ 170.728282] nix-grpc-daemon[1750]: time=2026-09-20T12:24:10.243Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6135worker1 # [ 170.731273] nix-grpc-daemon[1750]: time=2026-09-20T12:24:10.245Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6136lb # [ 169.010603] niks3-server[1044]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6137lb # [ 169.028529] niks3-server[1044]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6138lb # [ 169.042177] niks3-server[1044]: 2026/09/20 12:24:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6139worker1 # [ 170.793537] nix-grpc-daemon[1750]: time=2026-09-20T12:24:10.308Z level=INFO msg="Uploading 1 narinfos"6140lb # [ 169.049200] niks3-server[1044]: 2026/09/20 12:24:10 INFO Signed narinfos id=61 count=16141lb # [ 169.057619] niks3-server[1044]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6142lb # [ 169.068211] niks3-server[1044]: 2026/09/20 12:24:10 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6143lb # [ 169.075725] niks3-server[1044]: 2026/09/20 12:24:10 INFO Completed upload id=616144worker1 # [ 170.819973] nix-grpc-daemon[1750]: time=2026-09-20T12:24:10.335Z level=INFO msg="Upload complete. (356ms)"6145lb # [ 169.079254] niks3-server[1044]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6146worker2 # [ 171.131130] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:09Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16147worker1 # [ 170.833197] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16148worker1 # [ 170.852716] nix-daemon[854]: reaped child process 2011, status = succeeded6149worker1 # [ 170.884197] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553166150worker1 # [ 170.899701] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553166151worker1 # [ 170.913944] nix-grpc-daemon[1750]: time=2026-09-20T12:24:10.429Z level=INFO msg="All 2 paths already cached"6152worker1 # [ 170.923858] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:553166153worker1 # [ 170.938211] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6154worker1 # [ 171.143982] nix-daemon[854]: accepted connection from pid 2035, user nix-grpc-daemon (trusted)6155worker1 # [ 171.164815] nix-daemon[854]: reaped child process 2038, status = succeeded6156worker1 # [ 171.340925] nix-daemon[854]: accepted connection from pid 2040, user nix-grpc-daemon (trusted)6157worker1 # [ 171.359212] nix-daemon[854]: reaped child process 2043, status = succeeded6158lb # [ 169.626259] niks3-server[1044]: 2026/09/20 12:24:10 INFO Received uploads request method=POST path=/api/pending_closures6159worker1 # [ 171.381030] nix-grpc-daemon[1750]: time=2026-09-20T12:24:10.896Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6160worker1 # [ 171.382555] nix-grpc-daemon[1750]: time=2026-09-20T12:24:10.896Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6161lb # [ 169.656272] niks3-server[1044]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6162worker1 # [ 171.413272] nix-grpc-daemon[1750]: time=2026-09-20T12:24:10.928Z level=INFO msg="Uploading 1 narinfos"6163lb # [ 169.673651] niks3-server[1044]: 2026/09/20 12:24:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6164lb # [ 169.683687] niks3-server[1044]: 2026/09/20 12:24:10 INFO Signed narinfos id=62 count=16165worker1 # [ 171.436660] nix-grpc-daemon[1750]: time=2026-09-20T12:24:10.952Z level=INFO msg="Upload complete. (481ms)"6166lb # [ 169.688803] niks3-server[1044]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6167lb # [ 169.698811] niks3-server[1044]: 2026/09/20 12:24:10 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6168worker1 # [ 171.444116] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=0 paths=1 nar_bytes_in=7526169lb # [ 169.703966] niks3-server[1044]: 2026/09/20 12:24:10 INFO Completed upload id=626170lb # [ 169.706447] niks3-server[1044]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6171worker1 # [ 171.452855] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:553166172worker1 # [ 171.464689] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6173worker1 # [ 171.469730] nix-daemon[854]: reaped child process 2033, status = succeeded6174worker1 # [ 171.482766] nix-daemon[854]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6175worker1 # [ 172.316543] nix-daemon[854]: reaped child process 2047, status = succeeded6176worker1 # [ 172.486074] nix-daemon[854]: accepted connection from pid 2062, user nix-grpc-daemon (trusted)6177worker1 # [ 172.506419] nix-daemon[854]: reaped child process 2065, status = succeeded6178lb # [ 170.778320] niks3-server[1044]: 2026/09/20 12:24:11 INFO Received uploads request method=POST path=/api/pending_closures6179worker1 # [ 172.532401] nix-grpc-daemon[1750]: time=2026-09-20T12:24:12.045Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6180worker1 # [ 172.533977] nix-grpc-daemon[1750]: time=2026-09-20T12:24:12.045Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6181lb # [ 170.813994] niks3-server[1044]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6182lb # [ 170.828543] niks3-server[1044]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6183lb # [ 170.841147] niks3-server[1044]: 2026/09/20 12:24:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6184worker1 # [ 172.589686] nix-grpc-daemon[1750]: time=2026-09-20T12:24:12.104Z level=INFO msg="Uploading 1 narinfos"6185lb # [ 170.849057] niks3-server[1044]: 2026/09/20 12:24:11 INFO Signed narinfos id=63 count=16186lb # [ 170.851241] niks3-server[1044]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6187lb # [ 170.859532] niks3-server[1044]: 2026/09/20 12:24:11 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6188lb # [ 170.866602] niks3-server[1044]: 2026/09/20 12:24:11 INFO Completed upload id=636189worker1 # [ 172.610319] nix-grpc-daemon[1750]: time=2026-09-20T12:24:12.125Z level=INFO msg="Upload complete. (318ms)"6190lb # [ 170.869038] niks3-server[1044]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6191worker1 # [ 172.621224] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55316 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16192worker1 # [ 172.640881] nix-daemon[854]: reaped child process 2045, status = succeeded6193client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.92 seconds)6194worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6195worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6196client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16197worker1 # [ 173.022394] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:553166198worker1 # [ 173.030676] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553166199worker2 # [ 173.350321] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:12Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06200lb # [ 176.772301] envoy[934]: conn peer=[2001:db8:1::1]:44580 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27161 tx=10853 ms=196036201client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.32 seconds)6202(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 50.32 seconds)6203subtest: low disk drains a worker and builds go to the other6204worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6205worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.11 seconds)6206worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6207worker1 # [ 204.482846] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:43Z level=info event=unhealthy reason=min_free6208worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6209client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26210worker1 # [ 205.568846] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:553166211client # don't know how to build these paths:6212client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6213worker1 # [ 205.579118] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:553166214worker2 # [ 205.910937] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:44Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06215worker2 # [ 205.911732] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:44Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16216worker2 # [ 205.952938] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516426217worker2 # [ 205.970050] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516426218client # copying 1 paths to 'lb:50051'...6219client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6220worker2 # [ 205.987209] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516426221worker2 # [ 206.003902] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)6222worker2 # [ 206.214591] nix-daemon[929]: accepted connection from pid 1716, user nix-grpc-daemon (trusted)6223worker2 # [ 206.234285] nix-daemon[929]: reaped child process 1719, status = succeeded6224worker2 # [ 206.410819] nix-daemon[929]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6225worker2 # [ 206.429547] nix-daemon[929]: reaped child process 1724, status = succeeded6226lb # [ 204.397411] niks3-server[1044]: 2026/09/20 12:24:45 INFO Received uploads request method=POST path=/api/pending_closures6227worker2 # [ 206.453005] nix-grpc-daemon[1514]: time=2026-09-20T12:24:45.188Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6228worker2 # [ 206.454567] nix-grpc-daemon[1514]: time=2026-09-20T12:24:45.188Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6229lb # [ 204.437248] niks3-server[1044]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6230worker2 # [ 206.495895] nix-grpc-daemon[1514]: time=2026-09-20T12:24:45.231Z level=INFO msg="Uploading 1 narinfos"6231lb # [ 204.452108] niks3-server[1044]: 2026/09/20 12:24:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6232lb # [ 204.460983] niks3-server[1044]: 2026/09/20 12:24:45 INFO Signed narinfos id=64 count=16233lb # [ 204.466830] niks3-server[1044]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6234lb # [ 204.476984] niks3-server[1044]: 2026/09/20 12:24:45 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6235worker2 # [ 206.526254] nix-grpc-daemon[1514]: time=2026-09-20T12:24:45.262Z level=INFO msg="Upload complete. (504ms)"6236lb # [ 204.483779] niks3-server[1044]: 2026/09/20 12:24:45 INFO Completed upload id=646237lb # [ 204.486321] niks3-server[1044]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6238worker2 # [ 206.536393] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=0 paths=1 nar_bytes_in=5126239worker2 # [ 206.551463] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516426240worker2 # [ 206.558686] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)6241worker2 # [ 206.564743] nix-daemon[929]: reaped child process 1714, status = succeeded6242client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6243client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6244worker2 # [ 206.579765] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)6245client # farm-a> LOG-farm-a-drain6246worker2 # [ 207.628560] nix-daemon[929]: reaped child process 1728, status = succeeded6247worker2 # [ 207.808101] nix-daemon[929]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)6248worker2 # [ 207.828121] nix-daemon[929]: reaped child process 1746, status = succeeded6249lb # [ 205.798933] niks3-server[1044]: 2026/09/20 12:24:46 INFO Received uploads request method=POST path=/api/pending_closures6250worker2 # [ 207.856451] nix-grpc-daemon[1514]: time=2026-09-20T12:24:46.589Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6251worker2 # [ 207.858016] nix-grpc-daemon[1514]: time=2026-09-20T12:24:46.589Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6252lb # [ 205.838640] niks3-server[1044]: 2026/09/20 12:24:46 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6253lb # [ 205.852798] niks3-server[1044]: 2026/09/20 12:24:46 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6254worker2 # [ 207.907201] nix-grpc-daemon[1514]: time=2026-09-20T12:24:46.642Z level=INFO msg="Uploading 1 narinfos"6255lb # [ 205.862933] niks3-server[1044]: 2026/09/20 12:24:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6256lb # [ 205.868238] niks3-server[1044]: 2026/09/20 12:24:46 INFO Signed narinfos id=65 count=16257lb # [ 205.877355] niks3-server[1044]: 2026/09/20 12:24:46 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6258lb # [ 205.885946] niks3-server[1044]: 2026/09/20 12:24:46 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6259worker2 # [ 207.933916] nix-grpc-daemon[1514]: time=2026-09-20T12:24:46.669Z level=INFO msg="Upload complete. (343ms)"6260lb # [ 205.892663] niks3-server[1044]: 2026/09/20 12:24:46 INFO Completed upload id=656261lb # [ 205.894541] niks3-server[1044]: 2026/09/20 12:24:46 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6262worker2 # [ 207.950487] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16263worker2 # [ 207.971372] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:46Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06264worker2 # [ 207.975924] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:46Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16265worker2 # [ 207.980782] nix-daemon[929]: reaped child process 1726, status = succeeded6266worker2 # [ 208.008812] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516426267worker2 # [ 208.024141] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516426268worker2 # [ 208.038440] nix-grpc-daemon[1514]: time=2026-09-20T12:24:46.774Z level=INFO msg="All 1 paths already cached"6269client # copying 1 paths to 'lb:50051'...6270client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6271worker2 # [ 208.049009] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516426272worker2 # [ 208.063051] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)6273worker2 # [ 208.257823] nix-daemon[929]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)6274worker2 # [ 208.278510] nix-daemon[929]: reaped child process 1755, status = succeeded6275worker2 # [ 208.451710] nix-daemon[929]: accepted connection from pid 1757, user nix-grpc-daemon (trusted)6276worker2 # [ 208.470085] nix-daemon[929]: reaped child process 1760, status = succeeded6277lb # [ 206.438835] niks3-server[1044]: 2026/09/20 12:24:47 INFO Received uploads request method=POST path=/api/pending_closures6278worker2 # [ 208.492091] nix-grpc-daemon[1514]: time=2026-09-20T12:24:47.227Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6279worker2 # [ 208.493620] nix-grpc-daemon[1514]: time=2026-09-20T12:24:47.227Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6280lb # [ 206.468982] niks3-server[1044]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6281worker2 # [ 208.526478] nix-grpc-daemon[1514]: time=2026-09-20T12:24:47.262Z level=INFO msg="Uploading 1 narinfos"6282lb # [ 206.484236] niks3-server[1044]: 2026/09/20 12:24:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6283lb # [ 206.495143] niks3-server[1044]: 2026/09/20 12:24:47 INFO Signed narinfos id=66 count=16284lb # [ 206.502938] niks3-server[1044]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6285worker2 # [ 208.557661] nix-grpc-daemon[1514]: time=2026-09-20T12:24:47.293Z level=INFO msg="Upload complete. (479ms)"6286lb # [ 206.512121] niks3-server[1044]: 2026/09/20 12:24:47 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6287lb # [ 206.518703] niks3-server[1044]: 2026/09/20 12:24:47 INFO Completed upload id=666288lb # [ 206.522776] niks3-server[1044]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6289worker2 # [ 208.564221] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=0 paths=1 nar_bytes_in=6326290worker2 # [ 208.578440] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516426291worker2 # [ 208.584628] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)6292worker2 # [ 208.589594] nix-daemon[929]: reaped child process 1750, status = succeeded6293client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6294client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6295worker2 # [ 208.603114] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)6296lb # [ 206.771084] envoy[934]: conn peer=[2001:db8:1::1]:47716 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300516297client # farm-b> LOG-farm-b-drain6298worker2 # [ 209.849911] nix-daemon[929]: reaped child process 1764, status = succeeded6299worker2 # [ 210.021828] nix-daemon[929]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)6300worker2 # [ 210.039868] nix-daemon[929]: reaped child process 1782, status = succeeded6301lb # [ 208.008688] niks3-server[1044]: 2026/09/20 12:24:48 INFO Received uploads request method=POST path=/api/pending_closures6302worker2 # [ 210.072528] nix-grpc-daemon[1514]: time=2026-09-20T12:24:48.804Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6303worker2 # [ 210.074620] nix-grpc-daemon[1514]: time=2026-09-20T12:24:48.804Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6304lb # [ 208.058502] niks3-server[1044]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6305lb # [ 208.069885] niks3-server[1044]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6306lb # [ 208.079400] niks3-server[1044]: 2026/09/20 12:24:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6307lb # [ 208.085069] niks3-server[1044]: 2026/09/20 12:24:49 INFO Signed narinfos id=67 count=16308worker2 # [ 210.129807] nix-grpc-daemon[1514]: time=2026-09-20T12:24:48.865Z level=INFO msg="Uploading 1 narinfos"6309lb # [ 208.090731] niks3-server[1044]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6310lb # [ 208.099936] niks3-server[1044]: 2026/09/20 12:24:49 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6311lb # [ 208.105228] niks3-server[1044]: 2026/09/20 12:24:49 INFO Completed upload id=676312worker2 # [ 210.149203] nix-grpc-daemon[1514]: time=2026-09-20T12:24:48.885Z level=INFO msg="Upload complete. (335ms)"6313lb # [ 208.108199] niks3-server[1044]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6314worker2 # [ 210.166964] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16315worker2 # [ 210.184401] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:48Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06316worker2 # [ 210.189958] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:48Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16317worker2 # [ 210.194502] nix-daemon[929]: reaped child process 1762, status = succeeded6318worker2 # [ 210.213017] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516426319worker2 # [ 210.229222] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516426320worker2 # [ 210.243569] nix-grpc-daemon[1514]: time=2026-09-20T12:24:48.979Z level=INFO msg="All 2 paths already cached"6321client # copying 1 paths to 'lb:50051'...6322client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6323worker2 # [ 210.254248] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516426324worker2 # [ 210.268193] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)6325worker2 # [ 210.475896] nix-daemon[929]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)6326worker2 # [ 210.495506] nix-daemon[929]: reaped child process 1791, status = succeeded6327worker2 # [ 210.669712] nix-daemon[929]: accepted connection from pid 1793, user nix-grpc-daemon (trusted)6328worker2 # [ 210.687716] nix-daemon[929]: reaped child process 1796, status = succeeded6329lb # [ 208.654172] niks3-server[1044]: 2026/09/20 12:24:49 INFO Received uploads request method=POST path=/api/pending_closures6330worker2 # [ 210.707698] nix-grpc-daemon[1514]: time=2026-09-20T12:24:49.443Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6331worker2 # [ 210.709404] nix-grpc-daemon[1514]: time=2026-09-20T12:24:49.443Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6332lb # [ 208.680594] niks3-server[1044]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6333worker2 # [ 210.738296] nix-grpc-daemon[1514]: time=2026-09-20T12:24:49.474Z level=INFO msg="Uploading 1 narinfos"6334lb # [ 208.694303] niks3-server[1044]: 2026/09/20 12:24:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6335lb # [ 208.706401] niks3-server[1044]: 2026/09/20 12:24:49 INFO Signed narinfos id=68 count=16336lb # [ 208.712775] niks3-server[1044]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6337lb # [ 208.719672] niks3-server[1044]: 2026/09/20 12:24:49 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6338worker2 # [ 210.769842] nix-grpc-daemon[1514]: time=2026-09-20T12:24:49.505Z level=INFO msg="Upload complete. (484ms)"6339lb # [ 208.726149] niks3-server[1044]: 2026/09/20 12:24:49 INFO Completed upload id=686340lb # [ 208.728740] niks3-server[1044]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6341worker2 # [ 210.776167] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=0 paths=1 nar_bytes_in=7606342worker2 # [ 210.784756] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516426343worker2 # [ 210.794348] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)6344worker2 # [ 210.798883] nix-daemon[929]: reaped child process 1786, status = succeeded6345client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6346client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6347worker2 # [ 210.812386] nix-daemon[929]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)6348client # farm-top> LOG-farm-top-drain6349worker2 # [ 212.235796] nix-daemon[929]: reaped child process 1800, status = succeeded6350worker2 # [ 212.392320] nix-daemon[929]: accepted connection from pid 1815, user nix-grpc-daemon (trusted)6351worker2 # [ 212.411439] nix-daemon[929]: reaped child process 1818, status = succeeded6352lb # [ 210.379602] niks3-server[1044]: 2026/09/20 12:24:51 INFO Received uploads request method=POST path=/api/pending_closures6353worker2 # [ 212.434718] nix-grpc-daemon[1514]: time=2026-09-20T12:24:51.169Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6354worker2 # [ 212.436366] nix-grpc-daemon[1514]: time=2026-09-20T12:24:51.169Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6355lb # [ 210.415328] niks3-server[1044]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6356lb # [ 210.427253] niks3-server[1044]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6357lb # [ 210.440209] niks3-server[1044]: 2026/09/20 12:24:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6358worker2 # [ 212.490313] nix-grpc-daemon[1514]: time=2026-09-20T12:24:51.225Z level=INFO msg="Uploading 1 narinfos"6359lb # [ 210.449609] niks3-server[1044]: 2026/09/20 12:24:51 INFO Signed narinfos id=69 count=16360lb # [ 210.455033] niks3-server[1044]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6361lb # [ 210.462122] niks3-server[1044]: 2026/09/20 12:24:51 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6362lb # [ 210.469305] niks3-server[1044]: 2026/09/20 12:24:51 INFO Completed upload id=696363lb # [ 210.472323] niks3-server[1044]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6364worker2 # [ 212.513011] nix-grpc-daemon[1514]: time=2026-09-20T12:24:51.248Z level=INFO msg="Upload complete. (290ms)"6365worker2 # [ 212.522562] nix-grpc-daemon[1442]: ts=2026-09-20T12:24:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51642 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16366worker2 # [ 212.541225] nix-daemon[929]: reaped child process 1798, status = succeeded6367client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.96 seconds)6368client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6369client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds)6370worker1: must succeed: rm /nix/.rw-store/fill6371worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6372worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6373worker1 # [ 213.492942] nix-grpc-daemon[1694]: ts=2026-09-20T12:24:53Z level=info event=healthy reason=min_free6374worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6375(finished: subtest: low disk drains a worker and builds go to the other, in 10.80 seconds)6376(finished: run the VM test script, in 216.02 seconds)6377test script finished in 216.32s6378cleanup6379kill QemuMachine (pid 47)6380client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6381kill QemuMachine (pid 48)6382lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6383kill QemuMachine (pid 53)6384worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6385kill QemuMachine (pid 54)6386worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6387(finished: cleanup, in 1.23 seconds)6388additionally exposed symbols:6389 client, lb, worker1, worker2,6390 vlan1,6391 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh