nixbot

builds

succeeded vm-test-run-nix-grpc-farm checks.aarch64-linux.farm · build #254 · raw

1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13client # Formatting '/build/vm-state-client/tmp.BBUgbUGdli', fmt=raw size=107374182414client # mke2fs 1.47.4 (6-Mar-2025)15worker1 # Disk image does not exist, creating the virtualisation disk image...16worker2 # Disk image does not exist, creating the virtualisation disk image...17worker1: QEMU running (pid 51)18worker1 # Formatting '/build/vm-state-worker1/tmp.hVIPj3jnFS', fmt=raw size=107374182419lb # Disk image does not exist, creating the virtualisation disk image...20lb: QEMU running (pid 49)21client: QEMU running (pid 50)22worker1 # mke2fs 1.47.4 (6-Mar-2025)23lb # Formatting '/build/vm-state-lb/tmp.iOcRS90K6G', fmt=raw size=107374182424worker2: QEMU running (pid 52)25worker1 # Discarding device blocks: 0/262144 done26lb # mke2fs 1.47.4 (6-Mar-2025)27worker2 # Formatting '/build/vm-state-worker2/tmp.7szSe2IfRH', fmt=raw size=107374182428client # Discarding device blocks: 0/262144 done29(finished: start all VMs, in 0.48 seconds)30worker2 # mke2fs 1.47.4 (6-Mar-2025)31client # Creating filesystem with 262144 4k blocks and 65536 inodes32client: waiting for unit network-addresses-eth1.service33worker2 # Discarding device blocks: 0/262144 done34client # Filesystem UUID: 5ee9d5bc-5edd-4358-a2bb-0c80b07d231a35client: waiting for the VM to finish booting36worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes37client # Superblock backups stored on blocks:38lb # Discarding device blocks: 0/262144 done39worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes40worker2 # Filesystem UUID: 2beda237-e6d3-47f2-9eca-17fbc2e4866f41client # 32768, 98304, 163840, 22937642lb # Creating filesystem with 262144 4k blocks and 65536 inodes43worker1 # Filesystem UUID: 8c240b0b-2896-44a2-ab91-e1cc35788eff44worker2 # Superblock backups stored on blocks:45client # 46lb # Filesystem UUID: 96bdc730-9fb8-49a4-9636-ae238093d00747worker1 # Superblock backups stored on blocks:48worker2 # 32768, 98304, 163840, 22937649client # Allocating group tables: 0/8 done50lb # Superblock backups stored on blocks:51worker1 # 32768, 98304, 163840, 22937652worker2 # 53client # Writing inode tables: 0/8 done54lb # 32768, 98304, 163840, 22937655worker1 # 56worker2 # Allocating group tables: 0/8 done57client # Creating journal (8192 blocks): done58lb # 59worker1 # Allocating group tables: 0/8 done60worker2 # Writing inode tables: 0/8 done61client # Writing superblocks and filesystem accounting information: 0/8 done62lb # Allocating group tables: 0/8 done63worker1 # Writing inode tables: 0/8 done64worker2 # Creating journal (8192 blocks): done65client # 66lb # Writing inode tables: 0/8 done67worker1 # Creating journal (8192 blocks): done68worker2 # Writing superblocks and filesystem accounting information: 0/8 done69client # Virtualisation disk image created.70lb # Creating journal (8192 blocks): done71worker1 # Writing superblocks and filesystem accounting information: 0/8 done72lb # Writing superblocks and filesystem accounting information: 0/8 done73worker1 # 74lb # 75worker1 # Virtualisation disk image created.76lb # Virtualisation disk image created.77worker2 # 78worker2 # Virtualisation disk image created.79worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker2 # [ 0.000000] KASLR enabled82worker2 # [ 0.000000] random: crng init done83worker2 # [ 0.000000] Machine model: linux,dummy-virt84worker2 # [ 0.000000] efi: UEFI not found.85worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker2 # [ 0.000000] Zone ranges:89worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90worker2 # [ 0.000000] DMA32 empty91worker2 # [ 0.000000] Normal empty92worker2 # [ 0.000000] Device empty93worker2 # [ 0.000000] Movable zone start for each node94worker2 # [ 0.000000] Early memory node ranges95worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]99worker2 # [ 0.000000] psci: probing for conduit method from DT.100worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.101worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs102client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026103client # [ 0.000000] KASLR enabled104worker2 # [ 0.000000] psci: Trusted OS migration not required105client # [ 0.000000] random: crng init done106worker2 # [ 0.000000] psci: SMC Calling Convention v1.1107client # [ 0.000000] Machine model: linux,dummy-virt108client # [ 0.000000] efi: UEFI not found.109worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)110client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT111worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296112worker2 # [ 0.000000] Detected PIPT I-cache on CPU0113client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]114client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]115worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)116client # [ 0.000000] Zone ranges:117worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface118client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]119worker2 # [ 0.000000] CPU features: detected: Spectre-v4120client # [ 0.000000] DMA32 empty121client # [ 0.000000] Normal empty122worker2 # [ 0.000000] CPU features: detected: Spectre-BHB123client # [ 0.000000] Device empty124client # [ 0.000000] Movable zone start for each node125worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38126client # [ 0.000000] Early memory node ranges127worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23128client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]129worker2 # [ 0.000000] alternatives: applying boot alternatives130client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]131client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000132client # [ 0.000000] psci: probing for conduit method from DT.133client # [ 0.000000] psci: PSCIv1.3 detected in firmware.134client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs135client # [ 0.000000] psci: Trusted OS migration not required136worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jbmz6j4lv6g7mbr4lfjirkfpl1ip7l3n-nixos-system-worker2-test/init regInfo=/nix/store/f22848wr761m7mhl13dj0mscxryf1720-closure-info/registration console=ttyAMA0,115200n8 console=tty0137client # [ 0.000000] psci: SMC Calling Convention v1.1138client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)139client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296140worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/f22848wr761m7mhl13dj0mscxryf1720-closure-info/registration", will be passed to user space.141client # [ 0.000000] Detected PIPT I-cache on CPU0142worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes143client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)144worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)145client # [ 0.000000] CPU features: detected: GICv3 CPU interface146client # [ 0.000000] CPU features: detected: Spectre-v4147worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)148client # [ 0.000000] CPU features: detected: Spectre-BHB149worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB150client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38151worker2 # [ 0.000000] software IO TLB: area num 1.152client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23153worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB154client # [ 0.000000] alternatives: applying boot alternatives155worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)156worker2 # [ 0.000000] Fallback order for Node 0: 0157worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216158worker2 # [ 0.000000] Policy zone: DMA159worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off160worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1161client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test/init regInfo=/nix/store/fyblb9a3ys5cssd508s2s53prxsdfvcl-closure-info/registration console=ttyAMA0,115200n8 console=tty0162worker2 # [ 0.000000] allocated 3145728 bytes of page_ext163worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages164worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups165worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.166client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/fyblb9a3ys5cssd508s2s53prxsdfvcl-closure-info/registration", will be passed to user space.167worker2 # [ 0.000000] rcu: RCU event tracing is enabled.168client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes169worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.170client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)171worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.172worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.173client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)174worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.175client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB176worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.177client # [ 0.000000] software IO TLB: area num 1.178worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]179worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1180client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB181client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)182worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.183worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026184client # [ 0.000000] Fallback order for Node 0: 0185worker1 # [ 0.000000] KASLR enabled186worker1 # [ 0.000000] random: crng init done187worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.188client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216189worker1 # [ 0.000000] Machine model: linux,dummy-virt190client # [ 0.000000] Policy zone: DMA191worker1 # [ 0.000000] efi: UEFI not found.192worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.193client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off194worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT195worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0196client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1197worker2 # [ 0.000000] GICv3: 256 SPIs implemented198worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]199client # [ 0.000000] allocated 3145728 bytes of page_ext200worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented201lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]202worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]203worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq204client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages205worker1 # [ 0.000000] Zone ranges:206worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI207client # [ 0.000000] ftrace: allocated 294 pages with 4 groups208worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]209client # [ 0.000000] rcu: Hierarchical RCU implementation.210lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026211worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0212worker1 # [ 0.000000] DMA32 empty213lb # [ 0.000000] KASLR enabled214worker1 # [ 0.000000] Normal empty215client # [ 0.000000] rcu: RCU event tracing is enabled.216lb # [ 0.000000] random: crng init done217worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000218worker1 # [ 0.000000] Device empty219worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]220lb # [ 0.000000] Machine model: linux,dummy-virt221client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.222worker1 # [ 0.000000] Movable zone start for each node223lb # [ 0.000000] efi: UEFI not found.224worker1 # [ 0.000000] Early memory node ranges225client # [ 0.000000] Trampoline variant of Tasks RCU enabled.226worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)227worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]228lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT229client # [ 0.000000] Rude variant of Tasks RCU enabled.230client # [ 0.000000] Tracing variant of Tasks RCU enabled.231worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]232lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]233worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)234client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.235worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000236lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]237worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000238lb # [ 0.000000] Zone ranges:239worker1 # [ 0.000000] psci: probing for conduit method from DT.240client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1241worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000242worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.243lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]244lb # [ 0.000000] DMA32 empty245worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs246client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.247lb # [ 0.000000] Normal empty248worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.249lb # [ 0.000000] Device empty250worker1 # [ 0.000000] psci: Trusted OS migration not required251lb # [ 0.000000] Movable zone start for each node252client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.253worker1 # [ 0.000000] psci: SMC Calling Convention v1.1254worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns255lb # [ 0.000000] Early memory node ranges256worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).257lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]258client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.259worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)260client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0261lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]262worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296263client # [ 0.000000] GICv3: 256 SPIs implemented264worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns265worker1 # [ 0.000000] Detected PIPT I-cache on CPU0266lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000267client # [ 0.000000] GICv3: 0 Extended SPIs implemented268lb # [ 0.000000] psci: probing for conduit method from DT.269client # [ 0.000000] Root IRQ handler: gic_handle_irq270worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)271worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns272lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.273worker2 # [ 0.000032] arm-pv: using stolen time PV274client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI275worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface276lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs277client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0278worker1 # [ 0.000000] CPU features: detected: Spectre-v4279lb # [ 0.000000] psci: Trusted OS migration not required280worker2 # [ 0.000655] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)281worker1 # [ 0.000000] CPU features: detected: Spectre-BHB282client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000283lb # [ 0.000000] psci: SMC Calling Convention v1.1284worker2 # [ 0.000815] Console: colour dummy device 80x25285client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]286worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38287worker2 # [ 0.000822] printk: legacy console [tty0] enabled288worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23289lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)290client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)291worker1 # [ 0.000000] alternatives: applying boot alternatives292lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296293worker2 # [ 0.001032] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)294lb # [ 0.000000] Detected PIPT I-cache on CPU0295worker2 # [ 0.001039] pid_max: default: 32768 minimum: 301296client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)297worker2 # [ 0.001106] LSM: initializing lsm=capability,landlock,yama,bpf,ima298lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)299client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000300worker2 # [ 0.001320] landlock: Up and running.301lb # [ 0.000000] CPU features: detected: GICv3 CPU interface302worker2 # [ 0.001322] Yama: becoming mindful.303client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000304lb # [ 0.000000] CPU features: detected: Spectre-v4305worker2 # [ 0.001971] LSM support for eBPF active306lb # [ 0.000000] CPU features: detected: Spectre-BHB307client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.308worker2 # [ 0.002107] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)309worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/26z9h8v6khkq1di9bb6h1yw8hdp2av88-nixos-system-worker1-test/init regInfo=/nix/store/amyj3rgkzzcd5a9995vqyvs20ykgifx0-closure-info/registration console=ttyAMA0,115200n8 console=tty0310lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38311client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns312worker2 # [ 0.002138] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)313lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23314client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).315worker2 # [ 0.003264] cacheinfo: Unable to detect cache hierarchy for CPU 0316lb # [ 0.000000] alternatives: applying boot alternatives317worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/amyj3rgkzzcd5a9995vqyvs20ykgifx0-closure-info/registration", will be passed to user space.318worker2 # [ 0.004024] rcu: Hierarchical SRCU implementation.319worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes320client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns321worker2 # [ 0.004029] rcu: Max phase no-delay instances is 1000.322worker2 # [ 0.005200] fsl-mc MSI: its@8080000 domain created323worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)324client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns325worker2 # [ 0.005287] EFI services will not be available.326client # [ 0.000030] arm-pv: using stolen time PV327worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)328worker2 # [ 0.005356] smp: Bringing up secondary CPUs ...329worker2 # [ 0.005364] smp: Brought up 1 node, 1 CPU330worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB331client # [ 0.000517] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)332lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0333worker2 # [ 0.005367] SMP: Total of 1 processors activated.334worker1 # [ 0.000000] software IO TLB: area num 1.335client # [ 0.000696] Console: colour dummy device 80x25336worker2 # [ 0.005372] CPU: All CPU(s) started at EL1337client # [ 0.000704] printk: legacy console [tty0] enabled338worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB339worker2 # [ 0.005383] CPU features: detected: Branch Target Identification340lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.341worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)342worker2 # [ 0.005387] CPU features: detected: ARMv8.4 Translation Table Level343client # [ 0.000900] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)344lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes345worker1 # [ 0.000000] Fallback order for Node 0: 0346client # [ 0.000907] pid_max: default: 32768 minimum: 301347worker2 # [ 0.005390] CPU features: detected: Instruction cache invalidation not required for I/D coherence348worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216349lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)350client # [ 0.000985] LSM: initializing lsm=capability,landlock,yama,bpf,ima351worker1 # [ 0.000000] Policy zone: DMA352client # [ 0.001149] landlock: Up and running.353worker2 # [ 0.005394] CPU features: detected: Data cache clean to the PoU not required for I/D coherence354lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)355client # [ 0.001152] Yama: becoming mindful.356worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off357client # [ 0.001717] LSM support for eBPF active358worker2 # [ 0.005397] CPU features: detected: Common not Private translations359lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB360worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1361worker2 # [ 0.005401] CPU features: detected: CRC32 instructions362lb # [ 0.000000] software IO TLB: area num 1.363worker1 # [ 0.000000] allocated 3145728 bytes of page_ext364client # [ 0.001857] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)365worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages366worker2 # [ 0.005403] CPU features: detected: Data cache clean to Point of Deep Persistence367lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB368client # [ 0.001895] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)369worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups370lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)371worker2 # [ 0.005407] CPU features: detected: Data cache clean to Point of Persistence372client # [ 0.003064] cacheinfo: Unable to detect cache hierarchy for CPU 0373worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.374lb # [ 0.000000] Fallback order for Node 0: 0375client # [ 0.003778] rcu: Hierarchical SRCU implementation.376worker1 # [ 0.000000] rcu: RCU event tracing is enabled.377worker2 # [ 0.005410] CPU features: detected: Data independent timing control (DIT)378lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216379client # [ 0.003782] rcu: Max phase no-delay instances is 1000.380worker2 # [ 0.005413] CPU features: detected: E0PD381worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.382lb # [ 0.000000] Policy zone: DMA383client # [ 0.004967] fsl-mc MSI: its@8080000 domain created384worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.385worker2 # [ 0.005415] CPU features: detected: Enhanced Counter Virtualization386client # [ 0.005054] EFI services will not be available.387lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off388worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.389client # [ 0.005120] smp: Bringing up secondary CPUs ...390worker2 # [ 0.005418] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)391lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1392worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.393client # [ 0.005129] smp: Brought up 1 node, 1 CPU394lb # [ 0.000000] allocated 3145728 bytes of page_ext395worker2 # [ 0.005421] CPU features: detected: Enhanced Virtualization Traps396client # [ 0.005132] SMP: Total of 1 processors activated.397worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.398worker2 # [ 0.005425] CPU features: detected: Fine Grained Traps399lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages400client # [ 0.005137] CPU: All CPU(s) started at EL1401lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups402worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1403client # [ 0.005148] CPU features: detected: Branch Target Identification404worker2 # [ 0.005428] CPU features: detected: Generic authentication (architected QARMA5 algorithm)405lb # [ 0.000000] rcu: Hierarchical RCU implementation.406client # [ 0.005153] CPU features: detected: ARMv8.4 Translation Table Level407worker2 # [ 0.005432] CPU features: detected: RCpc load-acquire (LDAPR)408lb # [ 0.000000] rcu: RCU event tracing is enabled.409worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.410worker2 # [ 0.005435] CPU features: detected: LSE atomic instructions411lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.412client # [ 0.005156] CPU features: detected: Instruction cache invalidation not required for I/D coherence413worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.414worker2 # [ 0.005438] CPU features: detected: Privileged Access Never415lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.416worker2 # [ 0.005441] CPU features: detected: PMUv3417lb # [ 0.000000] Rude variant of Tasks RCU enabled.418client # [ 0.005160] CPU features: detected: Data cache clean to the PoU not required for I/D coherence419worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.420worker2 # [ 0.005443] CPU features: detected: RAS Extension Support421lb # [ 0.000000] Tracing variant of Tasks RCU enabled.422worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0423client # [ 0.005163] CPU features: detected: Common not Private translations424worker2 # [ 0.005446] CPU features: detected: RASv1p1 Extension Support425worker1 # [ 0.000000] GICv3: 256 SPIs implemented426client # [ 0.005166] CPU features: detected: CRC32 instructions427lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.428worker2 # [ 0.005449] CPU features: detected: Random Number Generator429worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented430client # [ 0.005169] CPU features: detected: Data cache clean to Point of Deep Persistence431lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1432worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq433worker2 # [ 0.005451] CPU features: detected: Speculation barrier (SB)434worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI435client # [ 0.005173] CPU features: detected: Data cache clean to Point of Persistence436worker2 # [ 0.005454] CPU features: detected: Stage-2 Force Write-Back437lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.438worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0439client # [ 0.005176] CPU features: detected: Data independent timing control (DIT)440worker2 # [ 0.005457] CPU features: detected: TLB range maintenance instructions441worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000442lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.443client # [ 0.005179] CPU features: detected: E0PD444worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]445worker2 # [ 0.005462] CPU features: detected: Speculative Store Bypassing Safe (SSBS)446client # [ 0.005182] CPU features: detected: Enhanced Counter Virtualization447lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.448worker2 # [ 0.005500] alternatives: applying system-wide alternatives449worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)450client # [ 0.005185] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)451lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0452worker2 # [ 0.008371] CPU features: detected: BBM Level 2 without TLB conflict abort453lb # [ 0.000000] GICv3: 256 SPIs implemented454client # [ 0.005188] CPU features: detected: Enhanced Virtualization Traps455worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)456lb # [ 0.000000] GICv3: 0 Extended SPIs implemented457client # [ 0.005191] CPU features: detected: Fine Grained Traps458lb # [ 0.000000] Root IRQ handler: gic_handle_irq459worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000460worker2 # [ 0.008531] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)461lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI462client # [ 0.005194] CPU features: detected: Generic authentication (architected QARMA5 algorithm)463worker2 # [ 0.008917] devtmpfs: initialized464worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000465lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0466client # [ 0.005200] CPU features: detected: RCpc load-acquire (LDAPR)467worker2 # [ 0.010751] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)468worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.469lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000470client # [ 0.005203] CPU features: detected: LSE atomic instructions471lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]472worker2 # [ 0.010772] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).473client # [ 0.005206] CPU features: detected: Privileged Access Never474worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns475client # [ 0.005208] CPU features: detected: PMUv3476worker2 # [ 0.010956] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL477lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)478worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).479client # [ 0.005211] CPU features: detected: RAS Extension Support480client # [ 0.005214] CPU features: detected: RASv1p1 Extension Support481lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)482worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns483client # [ 0.005216] CPU features: detected: Random Number Generator484lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000485worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns486client # [ 0.005219] CPU features: detected: Speculation barrier (SB)487lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000488worker1 # [ 0.000028] arm-pv: using stolen time PV489client # [ 0.005222] CPU features: detected: Stage-2 Force Write-Back490lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.491client # [ 0.005225] CPU features: detected: TLB range maintenance instructions492worker1 # [ 0.000399] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)493worker1 # [ 0.000536] Console: colour dummy device 80x25494lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns495client # [ 0.005230] CPU features: detected: Speculative Store Bypassing Safe (SSBS)496worker1 # [ 0.000545] printk: legacy console [tty0] enabled497client # [ 0.005268] alternatives: applying system-wide alternatives498lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).499client # [ 0.008276] CPU features: detected: BBM Level 2 without TLB conflict abort500worker1 # [ 0.000738] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)501lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns502worker1 # [ 0.000745] pid_max: default: 32768 minimum: 301503lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns504worker1 # [ 0.000820] LSM: initializing lsm=capability,landlock,yama,bpf,ima505client # [ 0.008485] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)506lb # [ 0.000028] arm-pv: using stolen time PV507worker1 # [ 0.000949] landlock: Up and running.508client # [ 0.008865] devtmpfs: initialized509worker1 # [ 0.000952] Yama: becoming mindful.510worker2 # [ 0.010961] 0 pages in range for non-PLT usage511worker1 # [ 0.001394] LSM support for eBPF active512client # [ 0.010689] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)513worker2 # [ 0.010962] 508288 pages in range for PLT usage514lb # [ 0.000383] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)515lb # [ 0.000525] Console: colour dummy device 80x25516worker2 # [ 0.011053] pinctrl core: initialized pinctrl subsystem517worker1 # [ 0.001518] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)518client # [ 0.010717] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).519lb # [ 0.000532] printk: legacy console [tty0] enabled520worker2 # [ 0.011801] DMI not present or invalid.521worker1 # [ 0.001551] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)522client # [ 0.010903] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL523worker2 # [ 0.015181] NET: Registered PF_NETLINK/PF_ROUTE protocol family524worker1 # [ 0.002689] cacheinfo: Unable to detect cache hierarchy for CPU 0525lb # [ 0.000718] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)526worker2 # [ 0.017378] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations527worker1 # [ 0.003363] rcu: Hierarchical SRCU implementation.528lb # [ 0.000724] pid_max: default: 32768 minimum: 301529worker1 # [ 0.003366] rcu: Max phase no-delay instances is 1000.530worker2 # [ 0.017553] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations531lb # [ 0.000807] LSM: initializing lsm=capability,landlock,yama,bpf,ima532lb # [ 0.000937] landlock: Up and running.533worker1 # [ 0.004562] fsl-mc MSI: its@8080000 domain created534lb # [ 0.000940] Yama: becoming mindful.535worker2 # [ 0.017750] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations536worker1 # [ 0.004651] EFI services will not be available.537lb # [ 0.001366] LSM support for eBPF active538worker2 # [ 0.017770] audit: initializing netlink subsys (disabled)539worker1 # [ 0.004714] smp: Bringing up secondary CPUs ...540worker1 # [ 0.004721] smp: Brought up 1 node, 1 CPU541lb # [ 0.001479] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)542worker2 # [ 0.018393] thermal_sys: Registered thermal governor 'fair_share'543worker1 # [ 0.004724] SMP: Total of 1 processors activated.544worker2 # [ 0.018395] thermal_sys: Registered thermal governor 'bang_bang'545worker1 # [ 0.004729] CPU: All CPU(s) started at EL1546lb # [ 0.001510] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)547worker2 # [ 0.018399] thermal_sys: Registered thermal governor 'step_wise'548worker1 # [ 0.004740] CPU features: detected: Branch Target Identification549lb # [ 0.002624] cacheinfo: Unable to detect cache hierarchy for CPU 0550worker2 # [ 0.018404] thermal_sys: Registered thermal governor 'user_space'551lb # [ 0.003346] rcu: Hierarchical SRCU implementation.552worker1 # [ 0.004745] CPU features: detected: ARMv8.4 Translation Table Level553lb # [ 0.003350] rcu: Max phase no-delay instances is 1000.554worker2 # [ 0.018407] thermal_sys: Registered thermal governor 'power_allocator'555lb # [ 0.004518] fsl-mc MSI: its@8080000 domain created556worker1 # [ 0.004748] CPU features: detected: Instruction cache invalidation not required for I/D coherence557worker2 # [ 0.018433] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1558lb # [ 0.004612] EFI services will not be available.559worker2 # [ 0.018441] cpuidle: using governor ladder560worker1 # [ 0.004752] CPU features: detected: Data cache clean to the PoU not required for I/D coherence561lb # [ 0.004672] smp: Bringing up secondary CPUs ...562client # [ 0.010908] 0 pages in range for non-PLT usage563worker2 # [ 0.018447] cpuidle: using governor menu564lb # [ 0.004680] smp: Brought up 1 node, 1 CPU565client # [ 0.010909] 508288 pages in range for PLT usage566worker1 # [ 0.004756] CPU features: detected: Common not Private translations567lb # [ 0.004683] SMP: Total of 1 processors activated.568worker2 # [ 0.018649] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.569client # [ 0.011013] pinctrl core: initialized pinctrl subsystem570worker1 # [ 0.004758] CPU features: detected: CRC32 instructions571lb # [ 0.004688] CPU: All CPU(s) started at EL1572client # [ 0.011781] DMI not present or invalid.573worker2 # [ 0.018665] ASID allocator initialised with 65536 entries574worker1 # [ 0.004761] CPU features: detected: Data cache clean to Point of Deep Persistence575lb # [ 0.004697] CPU features: detected: Branch Target Identification576worker2 # [ 0.019899] Serial: AMBA PL011 UART driver577client # [ 0.015268] NET: Registered PF_NETLINK/PF_ROUTE protocol family578lb # [ 0.004702] CPU features: detected: ARMv8.4 Translation Table Level579worker1 # [ 0.004765] CPU features: detected: Data cache clean to Point of Persistence580client # [ 0.017492] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations581worker2 # [ 0.025559] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1582worker1 # [ 0.004768] CPU features: detected: Data independent timing control (DIT)583worker2 # [ 0.025709] printk: console [ttyAMA0] enabled584lb # [ 0.004705] CPU features: detected: Instruction cache invalidation not required for I/D coherence585client # [ 0.017689] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations586worker1 # [ 0.004771] CPU features: detected: E0PD587worker1 # [ 0.004773] CPU features: detected: Enhanced Counter Virtualization588client # [ 0.017892] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations589lb # [ 0.004709] CPU features: detected: Data cache clean to the PoU not required for I/D coherence590worker2 # [ 0.146239] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages591client # [ 0.017913] audit: initializing netlink subsys (disabled)592lb # [ 0.004712] CPU features: detected: Common not Private translations593worker1 # [ 0.004776] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)594worker2 # [ 0.146258] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page595lb # [ 0.004715] CPU features: detected: CRC32 instructions596client # [ 0.018446] thermal_sys: Registered thermal governor 'fair_share'597worker1 # [ 0.004779] CPU features: detected: Enhanced Virtualization Traps598worker2 # [ 0.146264] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages599client # [ 0.018448] thermal_sys: Registered thermal governor 'bang_bang'600worker1 # [ 0.004782] CPU features: detected: Fine Grained Traps601lb # [ 0.004718] CPU features: detected: Data cache clean to Point of Deep Persistence602worker2 # [ 0.146269] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page603client # [ 0.018452] thermal_sys: Registered thermal governor 'step_wise'604lb # [ 0.004722] CPU features: detected: Data cache clean to Point of Persistence605worker1 # [ 0.004786] CPU features: detected: Generic authentication (architected QARMA5 algorithm)606worker2 # [ 0.146273] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages607client # [ 0.018457] thermal_sys: Registered thermal governor 'user_space'608worker1 # [ 0.004790] CPU features: detected: RCpc load-acquire (LDAPR)609lb # [ 0.004725] CPU features: detected: Data independent timing control (DIT)610worker2 # [ 0.146277] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page611client # [ 0.018459] thermal_sys: Registered thermal governor 'power_allocator'612lb # [ 0.004728] CPU features: detected: E0PD613worker1 # [ 0.004793] CPU features: detected: LSE atomic instructions614worker2 # [ 0.146282] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages615lb # [ 0.004730] CPU features: detected: Enhanced Counter Virtualization616worker1 # [ 0.004796] CPU features: detected: Privileged Access Never617client # [ 0.018484] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1618worker1 # [ 0.004798] CPU features: detected: PMUv3619worker2 # [ 0.146286] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page620client # [ 0.018492] cpuidle: using governor ladder621lb # [ 0.004733] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)622client # [ 0.018498] cpuidle: using governor menu623worker1 # [ 0.004801] CPU features: detected: RAS Extension Support624lb # [ 0.004737] CPU features: detected: Enhanced Virtualization Traps625worker1 # [ 0.004804] CPU features: detected: RASv1p1 Extension Support626client # [ 0.018699] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.627lb # [ 0.004740] CPU features: detected: Fine Grained Traps628worker1 # [ 0.004806] CPU features: detected: Random Number Generator629client # [ 0.018714] ASID allocator initialised with 65536 entries630worker2 # [ 0.153550] fbcon: Taking over console631client # [ 0.019923] Serial: AMBA PL011 UART driver632worker1 # [ 0.004809] CPU features: detected: Speculation barrier (SB)633lb # [ 0.004743] CPU features: detected: Generic authentication (architected QARMA5 algorithm)634worker2 # [ 0.153564] ACPI: Interpreter disabled.635worker1 # [ 0.004811] CPU features: detected: Stage-2 Force Write-Back636client # [ 0.025332] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1637worker2 # [ 0.155391] iommu: Default domain type: Translated638lb # [ 0.004747] CPU features: detected: RCpc load-acquire (LDAPR)639client # [ 0.025505] printk: console [ttyAMA0] enabled640worker1 # [ 0.004814] CPU features: detected: TLB range maintenance instructions641lb # [ 0.004750] CPU features: detected: LSE atomic instructions642worker2 # [ 0.155401] iommu: DMA domain TLB invalidation policy: strict mode643lb # [ 0.004753] CPU features: detected: Privileged Access Never644worker1 # [ 0.004818] CPU features: detected: Speculative Store Bypassing Safe (SSBS)645lb # [ 0.004756] CPU features: detected: PMUv3646worker2 # [ 0.157053] SCSI subsystem initialized647client # [ 0.145286] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages648worker1 # [ 0.004854] alternatives: applying system-wide alternatives649lb # [ 0.004758] CPU features: detected: RAS Extension Support650client # [ 0.145304] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page651worker1 # [ 0.007684] CPU features: detected: BBM Level 2 without TLB conflict abort652lb # [ 0.004761] CPU features: detected: RASv1p1 Extension Support653client # [ 0.145310] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages654lb # [ 0.004763] CPU features: detected: Random Number Generator655client # [ 0.145314] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page656lb # [ 0.004766] CPU features: detected: Speculation barrier (SB)657worker1 # [ 0.007831] Memory: 1406564K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)658worker1 # [ 0.008268] devtmpfs: initialized659client # [ 0.145318] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages660lb # [ 0.004768] CPU features: detected: Stage-2 Force Write-Back661worker1 # [ 0.010009] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)662client # [ 0.145322] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page663lb # [ 0.004771] CPU features: detected: TLB range maintenance instructions664client # [ 0.145327] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages665lb # [ 0.004775] CPU features: detected: Speculative Store Bypassing Safe (SSBS)666worker1 # [ 0.010031] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).667client # [ 0.145331] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page668lb # [ 0.004811] alternatives: applying system-wide alternatives669worker1 # [ 0.010198] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL670worker1 # [ 0.010202] 0 pages in range for non-PLT usage671lb # [ 0.007652] CPU features: detected: BBM Level 2 without TLB conflict abort672worker1 # [ 0.010203] 508288 pages in range for PLT usage673worker1 # [ 0.010306] pinctrl core: initialized pinctrl subsystem674client # [ 0.152477] fbcon: Taking over console675worker1 # [ 0.011038] DMI not present or invalid.676worker2 # [ 0.164488] usbcore: registered new interface driver usbfs677client # [ 0.152490] ACPI: Interpreter disabled.678worker1 # [ 0.014171] NET: Registered PF_NETLINK/PF_ROUTE protocol family679lb # [ 0.007806] Memory: 1406540K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)680worker2 # [ 0.164520] usbcore: registered new interface driver hub681client # [ 0.154257] iommu: Default domain type: Translated682lb # [ 0.008198] devtmpfs: initialized683worker1 # [ 0.016344] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations684worker2 # [ 0.164539] usbcore: registered new device driver usb685client # [ 0.154267] iommu: DMA domain TLB invalidation policy: strict mode686lb # [ 0.010142] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)687worker2 # [ 0.164849] pps_core: LinuxPPS API ver. 1 registered688worker1 # [ 0.016509] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations689client # [ 0.155860] SCSI subsystem initialized690lb # [ 0.010164] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).691worker2 # [ 0.164859] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>692worker1 # [ 0.016703] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations693worker2 # [ 0.164870] PTP clock support registered694lb # [ 0.010338] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL695worker2 # [ 0.164910] EDAC MC: Ver: 3.0.0696worker1 # [ 0.016722] audit: initializing netlink subsys (disabled)697lb # [ 0.010342] 0 pages in range for non-PLT usage698worker1 # [ 0.017249] thermal_sys: Registered thermal governor 'fair_share'699lb # [ 0.010343] 508288 pages in range for PLT usage700worker2 # [ 0.169332] scmi_core: SCMI protocol bus registered701worker1 # [ 0.017251] thermal_sys: Registered thermal governor 'bang_bang'702lb # [ 0.010428] pinctrl core: initialized pinctrl subsystem703lb # [ 0.011149] DMI not present or invalid.704worker2 # [ 0.170255] FPGA manager framework705worker1 # [ 0.017254] thermal_sys: Registered thermal governor 'step_wise'706worker2 # [ 0.171197] vgaarb: loaded707lb # [ 0.014196] NET: Registered PF_NETLINK/PF_ROUTE protocol family708worker1 # [ 0.017260] thermal_sys: Registered thermal governor 'user_space'709lb # [ 0.016478] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations710worker1 # [ 0.017262] thermal_sys: Registered thermal governor 'power_allocator'711worker2 # [ 0.171818] clocksource: Switched to clocksource arch_sys_counter712lb # [ 0.016665] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations713worker2 # [ 0.172395] VFS: Disk quotas dquot_6.6.0714worker1 # [ 0.017284] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1715worker1 # [ 0.017293] cpuidle: using governor ladder716lb # [ 0.016857] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations717worker2 # [ 0.172421] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)718worker1 # [ 0.017299] cpuidle: using governor menu719lb # [ 0.016877] audit: initializing netlink subsys (disabled)720worker2 # [ 0.174681] netfs: FS-Cache loaded721worker1 # [ 0.017496] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.722worker2 # [ 0.174796] pnp: PnP ACPI: disabled723lb # [ 0.017478] thermal_sys: Registered thermal governor 'fair_share'724client # [ 0.163345] usbcore: registered new interface driver usbfs725worker1 # [ 0.017512] ASID allocator initialised with 65536 entries726lb # [ 0.017480] thermal_sys: Registered thermal governor 'bang_bang'727worker1 # [ 0.018683] Serial: AMBA PL011 UART driver728client # [ 0.163376] usbcore: registered new interface driver hub729lb # [ 0.017484] thermal_sys: Registered thermal governor 'step_wise'730client # [ 0.163394] usbcore: registered new device driver usb731worker1 # [ 0.023697] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1732client # [ 0.163650] pps_core: LinuxPPS API ver. 1 registered733lb # [ 0.017489] thermal_sys: Registered thermal governor 'user_space'734worker1 # [ 0.023849] printk: console [ttyAMA0] enabled735lb # [ 0.017491] thermal_sys: Registered thermal governor 'power_allocator'736client # [ 0.163655] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>737client # [ 0.163665] PTP clock support registered738lb # [ 0.017514] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1739client # [ 0.163718] EDAC MC: Ver: 3.0.0740lb # [ 0.017524] cpuidle: using governor ladder741lb # [ 0.017529] cpuidle: using governor menu742client # [ 0.168271] scmi_core: SCMI protocol bus registered743lb # [ 0.017711] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.744client # [ 0.169276] FPGA manager framework745lb # [ 0.017724] ASID allocator initialised with 65536 entries746client # [ 0.170284] vgaarb: loaded747lb # [ 0.018840] Serial: AMBA PL011 UART driver748lb # [ 0.023941] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1749client # [ 0.170906] clocksource: Switched to clocksource arch_sys_counter750lb # [ 0.024055] printk: console [ttyAMA0] enabled751client # [ 0.171475] VFS: Disk quotas dquot_6.6.0752worker2 # [ 0.180505] NET: Registered PF_INET protocol family753client # [ 0.171500] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)754worker2 # [ 0.180772] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)755client # [ 0.173820] netfs: FS-Cache loaded756worker1 # [ 0.140131] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages757client # [ 0.173926] pnp: PnP ACPI: disabled758worker1 # [ 0.140148] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page759worker1 # [ 0.140154] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages760worker1 # [ 0.140158] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page761worker1 # [ 0.140163] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages762worker1 # [ 0.140167] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page763worker1 # [ 0.140172] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages764lb # [ 0.139764] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages765worker1 # [ 0.140176] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page766lb # [ 0.139781] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page767lb # [ 0.139786] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages768lb # [ 0.139791] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page769worker1 # [ 0.147531] fbcon: Taking over console770lb # [ 0.139795] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages771worker1 # [ 0.147544] ACPI: Interpreter disabled.772lb # [ 0.139799] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page773client # [ 0.179579] NET: Registered PF_INET protocol family774lb # [ 0.139803] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages775client # [ 0.179833] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)776lb # [ 0.139807] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page777lb # [ 0.147116] fbcon: Taking over console778lb # [ 0.147130] ACPI: Interpreter disabled.779worker1 # [ 0.156304] iommu: Default domain type: Translated780worker1 # [ 0.156314] iommu: DMA domain TLB invalidation policy: strict mode781worker1 # [ 0.156664] SCSI subsystem initialized782worker1 # [ 0.158579] usbcore: registered new interface driver usbfs783worker1 # [ 0.158610] usbcore: registered new interface driver hub784worker1 # [ 0.158634] usbcore: registered new device driver usb785worker1 # [ 0.158896] pps_core: LinuxPPS API ver. 1 registered786lb # [ 0.156090] iommu: Default domain type: Translated787worker1 # [ 0.158902] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>788lb # [ 0.156101] iommu: DMA domain TLB invalidation policy: strict mode789worker1 # [ 0.158912] PTP clock support registered790lb # [ 0.156440] SCSI subsystem initialized791worker1 # [ 0.158965] EDAC MC: Ver: 3.0.0792worker1 # [ 0.163482] scmi_core: SCMI protocol bus registered793lb # [ 0.158392] usbcore: registered new interface driver usbfs794lb # [ 0.158424] usbcore: registered new interface driver hub795worker1 # [ 0.164446] FPGA manager framework796worker1 # [ 0.165345] vgaarb: loaded797lb # [ 0.158441] usbcore: registered new device driver usb798lb # [ 0.158708] pps_core: LinuxPPS API ver. 1 registered799worker1 # [ 0.165966] clocksource: Switched to clocksource arch_sys_counter800lb # [ 0.158714] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>801lb # [ 0.158724] PTP clock support registered802lb # [ 0.158771] EDAC MC: Ver: 3.0.0803lb # [ 0.163328] scmi_core: SCMI protocol bus registered804worker1 # [ 0.169523] VFS: Disk quotas dquot_6.6.0805lb # [ 0.164304] FPGA manager framework806lb # [ 0.165229] vgaarb: loaded807worker1 # [ 0.169558] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)808lb # [ 0.165849] clocksource: Switched to clocksource arch_sys_counter809worker2 # [ 0.209389] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)810worker2 # [ 0.209428] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)811worker1 # [ 0.173156] netfs: FS-Cache loaded812worker2 # [ 0.209453] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)813worker1 # [ 0.173283] pnp: PnP ACPI: disabled814worker2 # [ 0.209524] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)815lb # [ 0.169717] VFS: Disk quotas dquot_6.6.0816worker2 # [ 0.209669] TCP: Hash tables configured (established 16384 bind 16384)817lb # [ 0.169752] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)818worker2 # [ 0.209745] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)819worker2 # [ 0.209780] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)820worker2 # [ 0.209816] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)821worker1 # [ 0.177126] NET: Registered PF_INET protocol family822worker2 # [ 0.209917] NET: Registered PF_UNIX/PF_LOCAL protocol family823lb # [ 0.173281] netfs: FS-Cache loaded824worker2 # [ 0.209974] NET: Registered PF_XDP protocol family825worker1 # [ 0.177390] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)826lb # [ 0.173396] pnp: PnP ACPI: disabled827worker2 # [ 0.209991] PCI: CLS 0 bytes, default 64828worker2 # [ 0.210215] Trying to unpack rootfs image as initramfs...829client # [ 0.208471] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)830lb # [ 0.177160] NET: Registered PF_INET protocol family831client # [ 0.208513] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)832lb # [ 0.177428] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)833client # [ 0.208541] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)834client # [ 0.208611] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)835client # [ 0.208752] TCP: Hash tables configured (established 16384 bind 16384)836client # [ 0.208828] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)837worker2 # [ 0.225361] kvm [1]: HYP mode not available838client # [ 0.208862] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839client # [ 0.208898] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840client # [ 0.208993] NET: Registered PF_UNIX/PF_LOCAL protocol family841client # [ 0.209015] NET: Registered PF_XDP protocol family842client # [ 0.209031] PCI: CLS 0 bytes, default 64843client # [ 0.209261] Trying to unpack rootfs image as initramfs...844client # [ 0.224583] kvm [1]: HYP mode not available845worker1 # [ 0.206829] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846worker1 # [ 0.206877] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847worker1 # [ 0.206906] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848worker1 # [ 0.206982] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849worker1 # [ 0.207125] TCP: Hash tables configured (established 16384 bind 16384)850worker1 # [ 0.207206] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)851lb # [ 0.206459] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)852worker1 # [ 0.207242] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)853lb # [ 0.206504] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)854worker1 # [ 0.207277] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)855worker1 # [ 0.207362] NET: Registered PF_UNIX/PF_LOCAL protocol family856lb # [ 0.206532] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)857worker1 # [ 0.207390] NET: Registered PF_XDP protocol family858lb # [ 0.206603] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)859worker1 # [ 0.207407] PCI: CLS 0 bytes, default 64860worker1 # [ 0.207636] Trying to unpack rootfs image as initramfs...861lb # [ 0.206747] TCP: Hash tables configured (established 16384 bind 16384)862lb # [ 0.206828] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)863lb # [ 0.206863] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)864lb # [ 0.206899] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)865lb # [ 0.207040] NET: Registered PF_UNIX/PF_LOCAL protocol family866lb # [ 0.207110] NET: Registered PF_XDP protocol family867lb # [ 0.207129] PCI: CLS 0 bytes, default 64868lb # [ 0.207366] Trying to unpack rootfs image as initramfs...869worker1 # [ 0.223580] kvm [1]: HYP mode not available870lb # [ 0.223463] kvm [1]: HYP mode not available871worker2 # [ 0.316362] Initialise system trusted keyrings872worker2 # [ 0.317123] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker2 # [ 0.318334] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker2 # [ 0.319080] 9p: Installing v9fs 9p2000 file system support875client # [ 0.315456] Initialise system trusted keyrings876client # [ 0.316173] workingset: timestamp_bits=42 max_order=19 bucket_order=0877client # [ 0.317458] squashfs: version 4.0 (2009/01/31) Phillip Lougher878client # [ 0.318209] 9p: Installing v9fs 9p2000 file system support879worker2 # [ 0.339630] Key type asymmetric registered880worker2 # [ 0.339652] Asymmetric key parser 'x509' registered881worker2 # [ 0.339718] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)882worker2 # [ 0.347870] io scheduler mq-deadline registered883worker2 # [ 0.347887] io scheduler kyber registered884client # [ 0.338784] Key type asymmetric registered885client # [ 0.338805] Asymmetric key parser 'x509' registered886client # [ 0.338867] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)887client # [ 0.346965] io scheduler mq-deadline registered888client # [ 0.346984] io scheduler kyber registered889worker1 # [ 0.314535] Initialise system trusted keyrings890worker1 # [ 0.315257] workingset: timestamp_bits=42 max_order=19 bucket_order=0891worker1 # [ 0.316546] squashfs: version 4.0 (2009/01/31) Phillip Lougher892worker1 # [ 0.317313] 9p: Installing v9fs 9p2000 file system support893lb # [ 0.314409] Initialise system trusted keyrings894lb # [ 0.315150] workingset: timestamp_bits=42 max_order=19 bucket_order=0895lb # [ 0.316437] squashfs: version 4.0 (2009/01/31) Phillip Lougher896client # [ 0.355046] pl061_gpio 9030000.pl061: PL061 GPIO chip registered897lb # [ 0.317196] 9p: Installing v9fs 9p2000 file system support898worker2 # [ 0.359947] pl061_gpio 9030000.pl061: PL061 GPIO chip registered899worker2 # [ 0.360579] ledtrig-cpu: registered to indicate activity on CPUs900worker2 # [ 0.360957] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:901worker2 # [ 0.360974] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000902client # [ 0.356381] ledtrig-cpu: registered to indicate activity on CPUs903client # [ 0.356758] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:904worker2 # [ 0.361000] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000905client # [ 0.356774] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000906worker2 # [ 0.361009] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000907client # [ 0.356787] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000908worker2 # [ 0.361036] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits909client # [ 0.356796] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000910worker2 # [ 0.361060] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]911client # [ 0.356816] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits912worker2 # [ 0.361132] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00913worker2 # [ 0.361141] pci_bus 0000:00: root bus resource [bus 00-ff]914client # [ 0.356840] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]915worker2 # [ 0.361147] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]916client # [ 0.356911] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00917worker2 # [ 0.361152] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]918client # [ 0.356921] pci_bus 0000:00: root bus resource [bus 00-ff]919worker2 # [ 0.361157] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]920client # [ 0.356927] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]921worker2 # [ 0.361224] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint922client # [ 0.356932] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]923client # [ 0.356937] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]924worker2 # [ 0.361659] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint925worker2 # [ 0.361844] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]926client # [ 0.356991] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint927worker2 # [ 0.361861] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]928client # [ 0.357434] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint929worker2 # [ 0.361891] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]930client # [ 0.357618] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]931worker2 # [ 0.361907] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]932client # [ 0.357634] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]933worker2 # [ 0.362356] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint934client # [ 0.357663] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]935worker2 # [ 0.362536] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]936client # [ 0.357679] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]937worker2 # [ 0.362552] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]938client # [ 0.358134] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint939worker2 # [ 0.362582] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]940client # [ 0.358315] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]941lb # [ 0.337758] Key type asymmetric registered942worker2 # [ 0.363027] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint943client # [ 0.358331] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]944lb # [ 0.337782] Asymmetric key parser 'x509' registered945worker2 # [ 0.363207] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]946client # [ 0.358360] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]947worker2 # [ 0.363223] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]948client # [ 0.358810] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint949worker2 # [ 0.363252] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]950worker1 # [ 0.346014] Key type asymmetric registered951worker2 # [ 0.363700] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint952worker1 # [ 0.346037] Asymmetric key parser 'x509' registered953worker2 # [ 0.363901] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]954worker1 # [ 0.346107] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)955worker2 # [ 0.363917] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]956worker1 # [ 0.348210] io scheduler mq-deadline registered957worker2 # [ 0.363949] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]958worker1 # [ 0.348221] io scheduler kyber registered959worker2 # [ 0.364416] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint960worker2 # [ 0.364596] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]961worker2 # [ 0.364612] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]962lb # [ 0.345893] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)963worker2 # [ 0.364642] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]964lb # [ 0.346916] io scheduler mq-deadline registered965lb # [ 0.346926] io scheduler kyber registered966worker2 # [ 0.365141] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint967worker2 # [ 0.365323] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]968worker2 # [ 0.365339] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]969worker2 # [ 0.365368] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]970worker2 # [ 0.365816] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint971worker2 # [ 0.365996] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]972worker2 # [ 0.366012] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]973worker2 # [ 0.366041] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]974worker2 # [ 0.366057] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]975worker1 # [ 0.358098] pl061_gpio 9030000.pl061: PL061 GPIO chip registered976worker2 # [ 0.366501] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint977worker2 # [ 0.366688] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]978worker2 # [ 0.366718] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]979client # [ 0.387035] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]980worker1 # [ 0.359445] ledtrig-cpu: registered to indicate activity on CPUs981worker2 # [ 0.367163] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint982client # [ 0.387061] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]983worker2 # [ 0.367350] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]984worker1 # [ 0.359825] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:985client # [ 0.387091] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]986lb # [ 0.357956] pl061_gpio 9030000.pl061: PL061 GPIO chip registered987worker2 # [ 0.367380] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]988worker1 # [ 0.359842] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000989client # [ 0.387576] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint990worker2 # [ 0.367769] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint991client # [ 0.387758] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]992worker1 # [ 0.359854] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000993client # [ 0.387773] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]994worker1 # [ 0.359863] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000995client # [ 0.387805] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]996lb # [ 0.359230] ledtrig-cpu: registered to indicate activity on CPUs997worker1 # [ 0.359882] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits998client # [ 0.388254] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint999client # [ 0.388434] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1000lb # [ 0.359600] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1001worker1 # [ 0.359909] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1002client # [ 0.388450] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1003worker1 # [ 0.359984] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001004lb # [ 0.359617] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001005client # [ 0.388479] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1006worker1 # [ 0.359994] pci_bus 0000:00: root bus resource [bus 00-ff]1007lb # [ 0.359637] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001008client # [ 0.388923] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1009worker1 # [ 0.360000] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1010client # [ 0.389103] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1011lb # [ 0.359645] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001012worker1 # [ 0.360005] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1013client # [ 0.389119] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1014worker1 # [ 0.360010] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1015lb # [ 0.359664] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1016client # [ 0.389148] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1017worker1 # [ 0.360065] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1018lb # [ 0.359687] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1019client # [ 0.389635] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1020lb # [ 0.359758] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001021client # [ 0.389817] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1022worker1 # [ 0.360508] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1023lb # [ 0.359767] pci_bus 0000:00: root bus resource [bus 00-ff]1024worker1 # [ 0.360693] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1025client # [ 0.389833] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1026worker2 # [ 0.415972] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1027worker1 # [ 0.360709] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1028lb # [ 0.359773] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1029client # [ 0.389862] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1030worker1 # [ 0.360739] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1031lb # [ 0.359778] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1032client # [ 0.389877] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1033worker2 # [ 0.416244] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1034worker1 # [ 0.360755] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1035worker2 # [ 0.416492] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1036lb # [ 0.359783] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1037client # [ 0.390330] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1038worker2 # [ 0.416509] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1039worker1 # [ 0.361198] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1040client # [ 0.390514] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1041lb # [ 0.359837] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1042worker2 # [ 0.416538] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1043worker1 # [ 0.361378] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1044client # [ 0.390544] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1045lb # [ 0.360267] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1046worker1 # [ 0.361394] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1047worker2 # [ 0.417024] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1048lb # [ 0.360450] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1049client # [ 0.391002] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1050worker1 # [ 0.361423] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1051worker2 # [ 0.417206] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1052lb # [ 0.360466] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1053client # [ 0.391186] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1054worker2 # [ 0.417223] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1055worker1 # [ 0.361870] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1056lb # [ 0.360495] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1057client # [ 0.391216] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1058worker2 # [ 0.417252] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1059lb # [ 0.360511] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1060client # [ 0.391599] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1061worker1 # [ 0.381288] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1062worker2 # [ 0.417824] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1063lb # [ 0.360961] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1064client # [ 0.391778] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1065worker1 # [ 0.381307] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1066worker2 # [ 0.417835] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1067lb # [ 0.361142] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1068worker1 # [ 0.381336] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1069client # [ 0.392025] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1070lb # [ 0.361158] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1071worker2 # [ 0.417841] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1072client # [ 0.392297] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1073worker1 # [ 0.381792] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1074lb # [ 0.361187] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1075worker2 # [ 0.417885] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1076client # [ 0.392313] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1077lb # [ 0.361631] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1078client # [ 0.392342] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1079worker2 # [ 0.417931] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1080lb # [ 0.361811] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1081client # [ 0.392804] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1082worker2 # [ 0.417977] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1083lb # [ 0.361827] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1084client # [ 0.392983] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1085worker2 # [ 0.418023] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1086client # [ 0.392999] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1087worker2 # [ 0.418069] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1088client # [ 0.393028] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1089worker2 # [ 0.418115] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1090client # [ 0.393600] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1091worker2 # [ 0.418162] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1092client # [ 0.393611] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1093lb # [ 0.382209] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1094client # [ 0.393617] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1095worker2 # [ 0.418209] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1096lb # [ 0.382672] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1097client # [ 0.393661] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1098worker2 # [ 0.418256] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1099lb # [ 0.382854] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1100client # [ 0.393707] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1101worker2 # [ 0.418323] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1102lb # [ 0.382870] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1103worker2 # [ 0.418369] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1104client # [ 0.393753] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1105lb # [ 0.382902] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1106worker2 # [ 0.418390] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1107client # [ 0.393798] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1108lb # [ 0.383361] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1109worker2 # [ 0.418411] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1110lb # [ 0.383540] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1111client # [ 0.393844] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1112worker2 # [ 0.418433] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1113lb # [ 0.383556] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1114client # [ 0.393890] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1115worker2 # [ 0.418457] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1116lb # [ 0.383586] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1117client # [ 0.393936] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1118worker2 # [ 0.418479] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1119worker1 # [ 0.390022] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1120lb # [ 0.384026] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1121worker1 # [ 0.390049] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1122lb # [ 0.384206] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1123worker2 # [ 0.418501] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1124client # [ 0.393982] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1125lb # [ 0.384221] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1126worker1 # [ 0.390082] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1127worker2 # [ 0.418522] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1128client # [ 0.394028] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1129lb # [ 0.384250] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130worker1 # [ 0.390581] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1131worker2 # [ 0.418544] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1132client # [ 0.394093] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1133worker1 # [ 0.390769] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1134worker2 # [ 0.418566] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1135lb # [ 0.384699] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1136client # [ 0.394139] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1137worker1 # [ 0.390786] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1138lb # [ 0.384879] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1139worker2 # [ 0.418589] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1140client # [ 0.394161] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1141lb # [ 0.384895] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1142worker1 # [ 0.390815] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1143worker2 # [ 0.418611] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1144client # [ 0.394182] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1145lb # [ 0.384923] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1146worker1 # [ 0.391259] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1147worker2 # [ 0.418633] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1148client # [ 0.394204] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1149worker1 # [ 0.391444] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1150lb # [ 0.384939] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1151worker2 # [ 0.418654] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1152client # [ 0.394228] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1153worker1 # [ 0.391460] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1154worker2 # [ 0.418675] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1155lb # [ 0.385420] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1156client # [ 0.394250] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1157worker2 # [ 0.418697] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1158worker1 # [ 0.391490] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1159lb # [ 0.385605] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1160client # [ 0.394272] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1161worker2 # [ 0.418718] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1162lb # [ 0.385634] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1163worker1 # [ 0.391972] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1164worker2 # [ 0.418739] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1165client # [ 0.394293] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1166worker1 # [ 0.392165] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1167worker2 # [ 0.418761] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1168client # [ 0.394316] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1169worker1 # [ 0.392181] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1170worker2 # [ 0.418783] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1171worker1 # [ 0.392210] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1172client # [ 0.394338] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1173worker2 # [ 0.418805] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1174worker1 # [ 0.392226] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1175client # [ 0.394361] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1176worker2 # [ 0.418831] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1177client # [ 0.394383] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1178worker1 # [ 0.392677] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1179worker2 # [ 0.418841] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1180client # [ 0.394404] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1181worker1 # [ 0.392868] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1182worker2 # [ 0.418846] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1183client # [ 0.394426] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1184worker1 # [ 0.392897] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1185client # [ 0.394447] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1186worker1 # [ 0.393344] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1187client # [ 0.394469] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1188worker1 # [ 0.393529] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1189client # [ 0.394490] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1190worker2 # [ 0.456775] pci 0000:00:0a.0: enabling device (0000 -> 0002)1191worker1 # [ 0.393558] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1192client # [ 0.394511] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1193client # [ 0.394533] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1194worker1 # [ 0.393941] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1195lb # [ 0.406142] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1196client # [ 0.394555] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1197worker1 # [ 0.394141] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1198lb # [ 0.406340] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1199client # [ 0.394576] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1200worker1 # [ 0.394390] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1201lb # [ 0.406370] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1202client # [ 0.394602] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1203worker1 # [ 0.394657] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1204lb # [ 0.406758] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1205client # [ 0.394612] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1206worker1 # [ 0.394674] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1207lb # [ 0.406937] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1208client # [ 0.394617] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1209worker1 # [ 0.394703] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1210lb # [ 0.407197] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1211worker1 # [ 0.395165] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1212lb # [ 0.407461] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1213worker1 # [ 0.395347] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1214lb # [ 0.407480] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1215worker1 # [ 0.395363] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1216lb # [ 0.407510] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1217worker1 # [ 0.395392] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1218lb # [ 0.407964] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1219worker1 # [ 0.395958] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1220lb # [ 0.408147] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1221worker1 # [ 0.395969] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1222lb # [ 0.408163] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1223worker1 # [ 0.395975] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1224lb # [ 0.408191] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1225lb # [ 0.408748] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1226worker1 # [ 0.396019] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1227lb # [ 0.408759] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1228worker1 # [ 0.396066] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1229lb # [ 0.408764] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1230worker1 # [ 0.396124] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1231client # [ 0.459828] pci 0000:00:0a.0: enabling device (0000 -> 0002)1232lb # [ 0.408808] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1233worker1 # [ 0.396170] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1234lb # [ 0.408854] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1235worker1 # [ 0.396216] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1236lb # [ 0.408900] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1237worker1 # [ 0.396262] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1238lb # [ 0.408947] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1239worker1 # [ 0.396308] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1240lb # [ 0.408994] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1241worker1 # [ 0.396355] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1242lb # [ 0.409041] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1243worker1 # [ 0.396400] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1244lb # [ 0.409088] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1245worker1 # [ 0.396470] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1246worker1 # [ 0.396516] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1247lb # [ 0.409135] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1248worker1 # [ 0.396537] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1249lb # [ 0.409180] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1250worker1 # [ 0.396558] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1251lb # [ 0.409256] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1252worker1 # [ 0.396579] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1253lb # [ 0.409301] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1254worker1 # [ 0.396603] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1255lb # [ 0.409322] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1256worker2 # [ 0.482354] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1257worker1 # [ 0.396624] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1258lb # [ 0.409344] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1259worker1 # [ 0.396646] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1260lb # [ 0.409365] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1261worker1 # [ 0.396667] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1262lb # [ 0.409390] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1263worker1 # [ 0.396689] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1264lb # [ 0.409411] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1265worker1 # [ 0.396711] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1266lb # [ 0.409433] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1267worker1 # [ 0.396733] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1268lb # [ 0.409454] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1269worker1 # [ 0.396755] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1270lb # [ 0.409476] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1271worker1 # [ 0.396776] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1272lb # [ 0.409498] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1273worker1 # [ 0.396797] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1274lb # [ 0.409520] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1275worker1 # [ 0.396819] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1276lb # [ 0.409543] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1277worker1 # [ 0.396840] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1278lb # [ 0.409564] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1279worker1 # [ 0.396861] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1280worker2 # [ 0.488489] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1281lb # [ 0.409585] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1282worker1 # [ 0.396882] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1283lb # [ 0.409606] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1284worker2 # [ 0.490506] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1285worker1 # [ 0.396903] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1286lb # [ 0.409627] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1287worker1 # [ 0.396925] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1288client # [ 0.480018] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1289lb # [ 0.409648] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1290client # [ 0.482111] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1291worker1 # [ 0.396946] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1292lb # [ 0.409669] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1293worker1 # [ 0.396972] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1294lb # [ 0.409691] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1295worker1 # [ 0.396982] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1296lb # [ 0.409714] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1297worker1 # [ 0.396986] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1298lb # [ 0.409736] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1299lb # [ 0.409762] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1300lb # [ 0.409771] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1301lb # [ 0.409776] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1302client # [ 0.493224] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1303worker2 # [ 0.500415] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1304worker1 # [ 0.462228] pci 0000:00:0a.0: enabling device (0000 -> 0002)1305worker2 # [ 0.502365] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1306worker2 # [ 0.504292] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1307lb # [ 0.459031] pci 0000:00:0a.0: enabling device (0000 -> 0002)1308worker2 # [ 0.506317] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1309client # [ 0.499123] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1310client # [ 0.501083] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1311client # [ 0.511086] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1312client # [ 0.513076] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1313worker1 # [ 0.483386] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1314worker1 # [ 0.485385] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1315worker2 # [ 0.524457] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1316lb # [ 0.479498] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1317worker2 # [ 0.526588] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1318lb # [ 0.481527] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1319worker2 # [ 0.528312] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1320worker2 # [ 0.530407] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1321client # [ 0.523126] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1322worker1 # [ 0.496594] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1323client # [ 0.526028] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1324lb # [ 0.492404] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1325client # [ 0.527843] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1326client # [ 0.530241] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1327worker2 # [ 0.548509] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1328worker1 # [ 0.502533] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1329worker2 # [ 0.551041] msm_serial: driver initialized1330lb # [ 0.498737] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1331worker2 # [ 0.551187] SuperH (H)SCI(F) driver initialized1332worker2 # [ 0.551240] STM32 USART driver initialized1333worker1 # [ 0.504658] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1334lb # [ 0.500644] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1335client # [ 0.548118] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1336client # [ 0.550561] msm_serial: driver initialized1337client # [ 0.550692] SuperH (H)SCI(F) driver initialized1338worker1 # [ 0.514486] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1339client # [ 0.550744] STM32 USART driver initialized1340worker1 # [ 0.516523] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1341lb # [ 0.510859] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1342lb # [ 0.513017] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1343lb # [ 0.524538] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1344worker1 # [ 0.526521] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1345lb # [ 0.527468] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1346worker1 # [ 0.529595] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1347lb # [ 0.529233] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1348worker1 # [ 0.531388] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1349worker1 # [ 0.533570] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1350worker2 # [ 0.582643] loop: module loaded1351worker2 # [ 0.582818] virtio_blk virtio5: 1/0/0 default/read/poll queues1352worker2 # [ 0.583502] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1353lb # [ 0.539423] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1354worker2 # [ 0.588390] megasas: 07.734.00.00-rc11355worker2 # [ 0.589156] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1356worker2 # [ 0.591363] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001357worker2 # [ 0.591417] Intel/Sharp Extended Query Table at 0x00311358client # [ 0.581793] loop: module loaded1359client # [ 0.581962] virtio_blk virtio5: 1/0/0 default/read/poll queues1360client # [ 0.582667] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1361worker1 # [ 0.551145] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1362worker1 # [ 0.553694] msm_serial: driver initialized1363worker1 # [ 0.553853] SuperH (H)SCI(F) driver initialized1364worker1 # [ 0.553906] STM32 USART driver initialized1365lb # [ 0.551034] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1366client # [ 0.587455] megasas: 07.734.00.00-rc11367client # [ 0.588152] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1368lb # [ 0.553564] msm_serial: driver initialized1369worker2 # [ 0.600811] Using buffer write method1370lb # [ 0.553708] SuperH (H)SCI(F) driver initialized1371lb # [ 0.553762] STM32 USART driver initialized1372worker2 # [ 0.600889] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1373worker2 # [ 0.611857] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001374worker2 # [ 0.611882] Intel/Sharp Extended Query Table at 0x00311375client # [ 0.598948] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001376worker2 # [ 0.613365] Using buffer write method1377client # [ 0.598990] Intel/Sharp Extended Query Table at 0x00311378worker2 # [ 0.613392] Concatenating MTD devices:1379client # [ 0.600629] Using buffer write method1380worker2 # [ 0.613396] (0): "0.flash"1381worker2 # [ 0.613400] (1): "0.flash"1382worker2 # [ 0.613403] into device "0.flash"1383client # [ 0.600692] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1384client # [ 0.611534] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001385client # [ 0.611563] Intel/Sharp Extended Query Table at 0x00311386client # [ 0.612943] Using buffer write method1387client # [ 0.612971] Concatenating MTD devices:1388client # [ 0.612975] (0): "0.flash"1389client # [ 0.612979] (1): "0.flash"1390client # [ 0.612982] into device "0.flash"1391worker1 # [ 0.584865] loop: module loaded1392worker1 # [ 0.585031] virtio_blk virtio5: 1/0/0 default/read/poll queues1393worker1 # [ 0.585957] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1394lb # [ 0.584554] loop: module loaded1395lb # [ 0.584735] virtio_blk virtio5: 1/0/0 default/read/poll queues1396lb # [ 0.585427] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1397lb # [ 0.590420] megasas: 07.734.00.00-rc11398lb # [ 0.591231] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1399lb # [ 0.593057] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001400lb # [ 0.593112] Intel/Sharp Extended Query Table at 0x00311401worker1 # [ 0.598569] megasas: 07.734.00.00-rc11402worker1 # [ 0.599268] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1403worker1 # [ 0.601372] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001404worker1 # [ 0.601396] Intel/Sharp Extended Query Table at 0x00311405worker1 # [ 0.602943] Using buffer write method1406worker1 # [ 0.603001] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1407lb # [ 0.602957] Using buffer write method1408lb # [ 0.603041] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1409worker1 # [ 0.604627] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001410worker1 # [ 0.604667] Intel/Sharp Extended Query Table at 0x00311411lb # [ 0.604537] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001412lb # [ 0.604576] Intel/Sharp Extended Query Table at 0x00311413lb # [ 0.617906] Using buffer write method1414worker1 # [ 0.622034] Using buffer write method1415lb # [ 0.617931] Concatenating MTD devices:1416worker1 # [ 0.622062] Concatenating MTD devices:1417lb # [ 0.617935] (0): "0.flash"1418worker1 # [ 0.622066] (0): "0.flash"1419lb # [ 0.617939] (1): "0.flash"1420worker1 # [ 0.622070] (1): "0.flash"1421lb # [ 0.617943] into device "0.flash"1422worker1 # [ 0.622073] into device "0.flash"1423worker2 # [ 0.843497] Freeing initrd memory: 26148K1424worker2 # [ 0.849435] tun: Universal TUN/TAP device driver, 1.61425client # [ 0.840991] Freeing initrd memory: 26160K1426worker2 # [ 0.853139] thunder_xcv, ver 1.01427worker2 # [ 0.853184] thunder_bgx, ver 1.01428worker2 # [ 0.853207] nicpf, ver 1.01429worker2 # [ 0.853760] e1000: Intel(R) PRO/1000 Network Driver1430worker2 # [ 0.853768] e1000: Copyright (c) 1999-2006 Intel Corporation.1431worker2 # [ 0.853792] e1000e: Intel(R) PRO/1000 Network Driver1432worker2 # [ 0.853800] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1433worker2 # [ 0.853829] igb: Intel(R) Gigabit Ethernet Network Driver1434worker2 # [ 0.853834] igb: Copyright (c) 2007-2014 Intel Corporation.1435worker2 # [ 0.853858] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436client # [ 0.846897] tun: Universal TUN/TAP device driver, 1.61437worker2 # [ 0.853864] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1438client # [ 0.849873] thunder_xcv, ver 1.01439worker2 # [ 0.853995] sky2: driver version 1.301440client # [ 0.849910] thunder_bgx, ver 1.01441client # [ 0.849931] nicpf, ver 1.01442worker2 # [ 0.855573] usbcore: registered new interface driver usb-storage1443client # [ 0.850463] e1000: Intel(R) PRO/1000 Network Driver1444worker2 # [ 0.855671] usbcore: registered new interface driver usbserial_generic1445client # [ 0.850470] e1000: Copyright (c) 1999-2006 Intel Corporation.1446worker2 # [ 0.855686] usbserial: USB Serial support registered for generic1447client # [ 0.850491] e1000e: Intel(R) PRO/1000 Network Driver1448worker2 # [ 0.856539] ehci-pci 0000:00:0a.0: EHCI Host Controller1449client # [ 0.850499] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1450client # [ 0.850527] igb: Intel(R) Gigabit Ethernet Network Driver1451worker2 # [ 0.856565] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11452client # [ 0.850533] igb: Copyright (c) 2007-2014 Intel Corporation.1453worker2 # [ 0.856830] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001454client # [ 0.850555] igbvf: Intel(R) Gigabit Virtual Function Network Driver1455client # [ 0.850561] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1456worker2 # [ 0.868447] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001457client # [ 0.850686] sky2: driver version 1.301458worker2 # [ 0.868810] hub 1-0:1.0: USB hub found1459worker2 # [ 0.868830] hub 1-0:1.0: 6 ports detected1460worker2 # [ 0.871413] hv_vmbus: registering driver hyperv_keyboard1461client # [ 0.860108] usbcore: registered new interface driver usb-storage1462worker2 # [ 0.872914] rtc-pl031 9010000.pl031: registered as rtc01463client # [ 0.860159] usbcore: registered new interface driver usbserial_generic1464worker2 # [ 0.872941] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:40 UTC (1789895080)1465client # [ 0.860173] usbserial: USB Serial support registered for generic1466worker2 # [ 0.873245] i2c_dev: i2c /dev entries driver1467client # [ 0.860741] hv_vmbus: registering driver hyperv_keyboard1468client # [ 0.862044] ehci-pci 0000:00:0a.0: EHCI Host Controller1469client # [ 0.862069] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11470client # [ 0.862267] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001471worker1 # [ 0.832253] Freeing initrd memory: 26148K1472worker2 # [ 0.878180] sdhci: Secure Digital Host Controller Interface driver1473client # [ 0.867655] rtc-pl031 9010000.pl031: registered as rtc01474worker2 # [ 0.878191] sdhci: Copyright(c) Pierre Ossman1475worker2 # [ 0.878457] Synopsys Designware Multimedia Card Interface Driver1476client # [ 0.867684] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:40 UTC (1789895080)1477worker2 # [ 0.878829] sdhci-pltfm: SDHCI platform and OF driver helper1478client # [ 0.868022] i2c_dev: i2c /dev entries driver1479worker1 # [ 0.838346] tun: Universal TUN/TAP device driver, 1.61480client # [ 0.871029] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001481worker2 # [ 0.883163] hid: raw HID events driver (C) Jiri Kosina1482client # [ 0.871384] hub 1-0:1.0: USB hub found1483client # [ 0.871404] hub 1-0:1.0: 6 ports detected1484worker2 # [ 0.883420] usbcore: registered new interface driver usbhid1485lb # [ 0.833281] Freeing initrd memory: 26140K1486worker2 # [ 0.883427] usbhid: USB HID core driver1487worker1 # [ 0.841913] thunder_xcv, ver 1.01488worker1 # [ 0.841956] thunder_bgx, ver 1.01489worker2 # [ 0.886334] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1490lb # [ 0.839184] tun: Universal TUN/TAP device driver, 1.61491worker2 # [ 0.887839] drop_monitor: Initializing network drop monitor service1492worker2 # [ 0.888030] NET: Registered PF_INET6 protocol family1493client # [ 0.875369] sdhci: Secure Digital Host Controller Interface driver1494worker2 # [ 0.890953] Segment Routing with IPv61495client # [ 0.875379] sdhci: Copyright(c) Pierre Ossman1496worker2 # [ 0.890983] In-situ OAM (IOAM) with IPv61497worker1 # [ 0.842846] nicpf, ver 1.01498client # [ 0.875640] Synopsys Designware Multimedia Card Interface Driver1499worker2 # [ 0.891011] NET: Registered PF_PACKET protocol family1500worker1 # [ 0.843408] e1000: Intel(R) PRO/1000 Network Driver1501client # [ 0.875995] sdhci-pltfm: SDHCI platform and OF driver helper1502worker1 # [ 0.843415] e1000: Copyright (c) 1999-2006 Intel Corporation.1503client # [ 0.877646] hid: raw HID events driver (C) Jiri Kosina1504worker1 # [ 0.843439] e1000e: Intel(R) PRO/1000 Network Driver1505client # [ 0.877872] usbcore: registered new interface driver usbhid1506worker1 # [ 0.843448] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1507client # [ 0.877879] usbhid: USB HID core driver1508worker1 # [ 0.843479] igb: Intel(R) Gigabit Ethernet Network Driver1509worker1 # [ 0.843484] igb: Copyright (c) 2007-2014 Intel Corporation.1510worker2 # [ 0.892819] 9pnet: Installing 9P2000 support1511worker1 # [ 0.843507] igbvf: Intel(R) Gigabit Virtual Function Network Driver1512worker2 # [ 0.894951] Key type dns_resolver registered1513lb # [ 0.842869] thunder_xcv, ver 1.01514worker1 # [ 0.843513] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1515lb # [ 0.842911] thunder_bgx, ver 1.01516lb # [ 0.842933] nicpf, ver 1.01517worker1 # [ 0.843651] sky2: driver version 1.301518client # [ 0.883635] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1519lb # [ 0.843510] e1000: Intel(R) PRO/1000 Network Driver1520worker1 # [ 0.845275] usbcore: registered new interface driver usb-storage1521client # [ 0.885122] drop_monitor: Initializing network drop monitor service1522lb # [ 0.843517] e1000: Copyright (c) 1999-2006 Intel Corporation.1523client # [ 0.885275] NET: Registered PF_INET6 protocol family1524worker1 # [ 0.845376] usbcore: registered new interface driver usbserial_generic1525lb # [ 0.843541] e1000e: Intel(R) PRO/1000 Network Driver1526worker1 # [ 0.845390] usbserial: USB Serial support registered for generic1527client # [ 0.888231] Segment Routing with IPv61528lb # [ 0.843548] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1529client # [ 0.888249] In-situ OAM (IOAM) with IPv61530worker1 # [ 0.846679] ehci-pci 0000:00:0a.0: EHCI Host Controller1531lb # [ 0.843578] igb: Intel(R) Gigabit Ethernet Network Driver1532client # [ 0.888282] NET: Registered PF_PACKET protocol family1533worker1 # [ 0.846704] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11534lb # [ 0.843583] igb: Copyright (c) 2007-2014 Intel Corporation.1535worker1 # [ 0.846958] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001536lb # [ 0.843606] igbvf: Intel(R) Gigabit Virtual Function Network Driver1537client # [ 0.889858] 9pnet: Installing 9P2000 support1538lb # [ 0.843612] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1539lb # [ 0.843744] sky2: driver version 1.301540worker1 # [ 0.857613] hv_vmbus: registering driver hyperv_keyboard1541lb # [ 0.845304] usbcore: registered new interface driver usb-storage1542worker2 # [ 0.901832] registered taskstats version 11543worker1 # [ 0.858019] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001544worker2 # [ 0.901990] Loading compiled-in X.509 certificates1545worker1 # [ 0.858321] hub 1-0:1.0: USB hub found1546lb # [ 0.845354] usbcore: registered new interface driver usbserial_generic1547worker1 # [ 0.858340] hub 1-0:1.0: 6 ports detected1548lb # [ 0.845369] usbserial: USB Serial support registered for generic1549lb # [ 0.846546] ehci-pci 0000:00:0a.0: EHCI Host Controller1550client # [ 0.892512] Key type dns_resolver registered1551worker1 # [ 0.861451] rtc-pl031 9010000.pl031: registered as rtc01552lb # [ 0.846570] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11553lb # [ 0.846831] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001554worker1 # [ 0.861478] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:40 UTC (1789895080)1555worker1 # [ 0.861782] i2c_dev: i2c /dev entries driver1556lb # [ 0.858397] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001557lb # [ 0.858756] hub 1-0:1.0: USB hub found1558lb # [ 0.858784] hub 1-0:1.0: 6 ports detected1559worker2 # [ 0.910543] Demotion targets for Node 0: null1560worker2 # [ 0.910650] Key type .fscrypt registered1561lb # [ 0.861003] hv_vmbus: registering driver hyperv_keyboard1562worker2 # [ 0.910656] Key type fscrypt-provisioning registered1563worker2 # [ 0.910747] ima: No TPM chip found, activating TPM-bypass!1564worker2 # [ 0.910766] ima: Allocated hash algorithm: sha11565lb # [ 0.862550] rtc-pl031 9010000.pl031: registered as rtc01566worker2 # [ 0.910787] ima: No architecture policies found1567client # [ 0.898978] registered taskstats version 11568lb # [ 0.862574] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:40 UTC (1789895080)1569worker1 # [ 0.866752] sdhci: Secure Digital Host Controller Interface driver1570client # [ 0.899127] Loading compiled-in X.509 certificates1571worker2 # [ 0.914754] input: gpio-keys as /devices/platform/gpio-keys/input/input01572lb # [ 0.862881] i2c_dev: i2c /dev entries driver1573worker1 # [ 0.866762] sdhci: Copyright(c) Pierre Ossman1574worker1 # [ 0.867033] Synopsys Designware Multimedia Card Interface Driver1575worker1 # [ 0.867410] sdhci-pltfm: SDHCI platform and OF driver helper1576worker1 # [ 0.869159] hid: raw HID events driver (C) Jiri Kosina1577worker1 # [ 0.869401] usbcore: registered new interface driver usbhid1578worker1 # [ 0.869408] usbhid: USB HID core driver1579client # [ 0.907533] Demotion targets for Node 0: null1580lb # [ 0.867715] sdhci: Secure Digital Host Controller Interface driver1581client # [ 0.907631] Key type .fscrypt registered1582lb # [ 0.867725] sdhci: Copyright(c) Pierre Ossman1583client # [ 0.907637] Key type fscrypt-provisioning registered1584lb # [ 0.867987] Synopsys Designware Multimedia Card Interface Driver1585client # [ 0.907725] ima: No TPM chip found, activating TPM-bypass!1586client # [ 0.907744] ima: Allocated hash algorithm: sha11587lb # [ 0.868355] sdhci-pltfm: SDHCI platform and OF driver helper1588worker1 # [ 0.874922] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1589client # [ 0.907764] ima: No architecture policies found1590worker1 # [ 0.876459] drop_monitor: Initializing network drop monitor service1591worker1 # [ 0.876617] NET: Registered PF_INET6 protocol family1592client # [ 0.911931] input: gpio-keys as /devices/platform/gpio-keys/input/input01593lb # [ 0.872679] hid: raw HID events driver (C) Jiri Kosina1594worker1 # [ 0.879543] Segment Routing with IPv61595lb # [ 0.872928] usbcore: registered new interface driver usbhid1596worker1 # [ 0.879561] In-situ OAM (IOAM) with IPv61597lb # [ 0.872934] usbhid: USB HID core driver1598worker1 # [ 0.879588] NET: Registered PF_PACKET protocol family1599worker1 # [ 0.881202] 9pnet: Installing 9P2000 support1600lb # [ 0.875776] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1601lb # [ 0.877278] drop_monitor: Initializing network drop monitor service1602lb # [ 0.877453] NET: Registered PF_INET6 protocol family1603lb # [ 0.880565] Segment Routing with IPv61604worker1 # [ 0.884054] Key type dns_resolver registered1605lb # [ 0.880585] In-situ OAM (IOAM) with IPv61606lb # [ 0.880614] NET: Registered PF_PACKET protocol family1607worker2 # [ 0.932041] clk: Disabling unused clocks1608worker2 # [ 0.932060] PM: genpd: Disabling unused power domains1609lb # [ 0.882454] 9pnet: Installing 9P2000 support1610lb # [ 0.884539] Key type dns_resolver registered1611worker2 # [ 0.936180] Freeing unused kernel memory: 4736K1612worker2 # [ 0.936366] Run /init as init process1613worker1 # [ 0.890647] registered taskstats version 11614worker1 # [ 0.890811] Loading compiled-in X.509 certificates1615client # [ 0.929872] clk: Disabling unused clocks1616client # [ 0.929898] PM: genpd: Disabling unused power domains1617lb # [ 0.891332] registered taskstats version 11618worker1 # [ 0.899180] Demotion targets for Node 0: null1619lb # [ 0.891508] Loading compiled-in X.509 certificates1620worker1 # [ 0.899281] Key type .fscrypt registered1621worker1 # [ 0.899287] Key type fscrypt-provisioning registered1622worker1 # [ 0.899380] ima: No TPM chip found, activating TPM-bypass!1623client # [ 0.934121] Freeing unused kernel memory: 4736K1624client # [ 0.934337] Run /init as init process1625worker1 # [ 0.899399] ima: Allocated hash algorithm: sha11626worker1 # [ 0.899419] ima: No architecture policies found1627worker1 # [ 0.903349] input: gpio-keys as /devices/platform/gpio-keys/input/input01628worker2 # [ 0.950032] systemd[1]: Successfully made /usr/ read-only.1629lb # [ 0.900076] Demotion targets for Node 0: null1630lb # [ 0.900195] Key type .fscrypt registered1631lb # [ 0.900202] Key type fscrypt-provisioning registered1632lb # [ 0.900293] ima: No TPM chip found, activating TPM-bypass!1633lb # [ 0.900312] ima: Allocated hash algorithm: sha11634lb # [ 0.900333] ima: No architecture policies found1635lb # [ 0.904429] input: gpio-keys as /devices/platform/gpio-keys/input/input01636client # [ 0.949109] systemd[1]: Successfully made /usr/ read-only.1637worker1 # [ 0.920903] clk: Disabling unused clocks1638worker1 # [ 0.920923] PM: genpd: Disabling unused power domains1639worker1 # [ 0.925136] Freeing unused kernel memory: 4736K1640worker1 # [ 0.925323] Run /init as init process1641lb # [ 0.922000] clk: Disabling unused clocks1642lb # [ 0.922024] PM: genpd: Disabling unused power domains1643lb # [ 0.926227] Freeing unused kernel memory: 4736K1644lb # [ 0.926416] Run /init as init process1645worker1 # [ 0.940144] systemd[1]: Successfully made /usr/ read-only.1646lb # [ 0.940069] systemd[1]: Successfully made /usr/ read-only.1647worker2 # [ 1.115891] usb 1-1: new high-speed USB device number 2 using ehci-pci1648client # [ 1.118984] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.106041] usb 1-1: new high-speed USB device number 2 using ehci-pci1650lb # [ 1.105920] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker2 # [ 1.270163] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652client # [ 1.271397] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653worker2 # [ 1.284864] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654worker2 # [ 1.296802] systemd[1]: Detected virtualization qemu.1655worker2 # [ 1.298855] systemd[1]: Detected architecture arm64.1656worker2 # [ 1.300946] systemd[1]: Running in initrd.1657worker2 # [ 1.303428] systemd[1]: Initializing machine ID from random generator.1658client # [ 1.284267] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1659worker2 # [ 1.306350] systemd[1]: Hostname set to <worker2>.1660worker1 # [ 1.258238] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661client # [ 1.296262] systemd[1]: Detected virtualization qemu.1662client # [ 1.298299] systemd[1]: Detected architecture arm64.1663client # [ 1.300339] systemd[1]: Running in initrd.1664lb # [ 1.260238] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11665client # [ 1.302799] systemd[1]: Initializing machine ID from random generator.1666client # [ 1.305613] systemd[1]: Hostname set to <client>.1667worker1 # [ 1.274942] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1668worker1 # [ 1.286652] systemd[1]: Detected virtualization qemu.1669worker1 # [ 1.288692] systemd[1]: Detected architecture arm64.1670lb # [ 1.274881] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1671worker1 # [ 1.290570] systemd[1]: Running in initrd.1672lb # [ 1.286521] systemd[1]: Detected virtualization qemu.1673lb # [ 1.288494] systemd[1]: Detected architecture arm64.1674worker1 # [ 1.293013] systemd[1]: Initializing machine ID from random generator.1675lb # [ 1.290453] systemd[1]: Running in initrd.1676worker1 # [ 1.295815] systemd[1]: Hostname set to <worker1>.1677lb # [ 1.292857] systemd[1]: Initializing machine ID from random generator.1678lb # [ 1.295615] systemd[1]: Hostname set to <lb>.1679worker2 # [ 1.356120] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01680client # [ 1.355175] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681lb # [ 1.342118] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682worker1 # [ 1.350209] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker2 # [ 1.479904] usb 1-2: new high-speed USB device number 3 using ehci-pci1684client # [ 1.479005] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker1 # [ 1.470023] usb 1-2: new high-speed USB device number 3 using ehci-pci1686lb # [ 1.465900] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker2 # [ 1.610076] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688client # [ 1.609549] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689worker1 # [ 1.590356] systemd[1]: bpf-restrict-fs: LSM BPF program attached1690worker2 # [ 1.640324] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21691worker2 # [ 1.645380] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01692client # [ 1.635509] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21693client # [ 1.640499] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01694lb # [ 1.612807] systemd[1]: bpf-restrict-fs: LSM BPF program attached1695worker1 # [ 1.622220] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker1 # [ 1.626482] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697lb # [ 1.623339] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21698lb # [ 1.628866] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01699worker2 # [ 1.724769] systemd[1]: Queued start job for default target Initrd Default Target.1700worker2 # [ 1.734085] systemd[1]: Created slice Slice /system/modprobe.1701worker2 # [ 1.735174] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1702worker2 # [ 1.736449] systemd[1]: Expecting device /dev/disk/by-label/nixos...1703client # [ 1.725408] systemd[1]: Queued start job for default target Initrd Default Target.1704worker2 # [ 1.737435] systemd[1]: Reached target Path Units.1705worker2 # [ 1.738183] systemd[1]: Reached target Slice Units.1706worker2 # [ 1.738938] systemd[1]: Reached target Swaps.1707worker2 # [ 1.739622] systemd[1]: Reached target Timer Units.1708worker2 # [ 1.740620] systemd[1]: Listening on D-Bus System Message Bus Socket.1709worker1 # [ 1.696106] systemd[1]: Queued start job for default target Initrd Default Target.1710worker2 # [ 1.741770] systemd[1]: Listening on Journal Socket (/dev/log).1711worker2 # [ 1.742809] systemd[1]: Listening on Journal Sockets.1712worker2 # [ 1.743720] systemd[1]: Listening on udev Control Socket.1713worker2 # [ 1.744722] systemd[1]: Listening on udev Kernel Socket.1714worker2 # [ 1.745611] systemd[1]: Reached target Socket Units.1715worker2 # [ 1.747800] systemd[1]: Starting Create List of Static Device Nodes...1716client # [ 1.737379] systemd[1]: Created slice Slice /system/modprobe.1717worker1 # [ 1.704307] systemd[1]: Created slice Slice /system/modprobe.1718client # [ 1.738605] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1719worker1 # [ 1.705511] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1720client # [ 1.740044] systemd[1]: Expecting device /dev/disk/by-label/nixos...1721client # [ 1.741123] systemd[1]: Reached target Path Units.1722client # [ 1.741965] systemd[1]: Reached target Slice Units.1723worker1 # [ 1.706936] systemd[1]: Expecting device /dev/disk/by-label/nixos...1724client # [ 1.742821] systemd[1]: Reached target Swaps.1725worker1 # [ 1.706975] systemd[1]: Reached target Path Units.1726client # [ 1.743663] systemd[1]: Reached target Timer Units.1727worker1 # [ 1.706995] systemd[1]: Reached target Slice Units.1728worker2 # [ 1.755968] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1729worker1 # [ 1.707014] systemd[1]: Reached target Swaps.1730client # [ 1.744697] systemd[1]: Listening on D-Bus System Message Bus Socket.1731worker1 # [ 1.707034] systemd[1]: Reached target Timer Units.1732client # [ 1.745973] systemd[1]: Listening on Journal Socket (/dev/log).1733worker2 # [ 1.757055] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1734worker1 # [ 1.707211] systemd[1]: Listening on D-Bus System Message Bus Socket.1735client # [ 1.747176] systemd[1]: Listening on Journal Sockets.1736worker1 # [ 1.707377] systemd[1]: Listening on Journal Socket (/dev/log).1737worker1 # [ 1.707519] systemd[1]: Listening on Journal Sockets.1738client # [ 1.748205] systemd[1]: Listening on udev Control Socket.1739worker1 # [ 1.707652] systemd[1]: Listening on udev Control Socket.1740client # [ 1.749253] systemd[1]: Listening on udev Kernel Socket.1741worker1 # [ 1.707775] systemd[1]: Listening on udev Kernel Socket.1742client # [ 1.750195] systemd[1]: Reached target Socket Units.1743worker1 # [ 1.707796] systemd[1]: Reached target Socket Units.1744worker1 # [ 1.718600] systemd[1]: Starting Create List of Static Device Nodes...1745client # [ 1.752641] systemd[1]: Starting Create List of Static Device Nodes...1746worker1 # [ 1.726128] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1747worker2 # [ 1.769129] systemd[1]: Mounting Kernel Configuration File System...1748lb # [ 1.721748] systemd[1]: Queued start job for default target Initrd Default Target.1749worker1 # [ 1.727259] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1750client # [ 1.763086] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1751client # [ 1.764253] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1752worker1 # [ 1.733415] systemd[1]: Mounting Kernel Configuration File System...1753client # [ 1.767657] systemd[1]: Mounting Kernel Configuration File System...1754lb # [ 1.732095] systemd[1]: Created slice Slice /system/modprobe.1755lb # [ 1.733230] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1756lb # [ 1.734539] systemd[1]: Expecting device /dev/disk/by-label/nixos...1757lb # [ 1.735557] systemd[1]: Reached target Path Units.1758lb # [ 1.736332] systemd[1]: Reached target Slice Units.1759lb # [ 1.737124] systemd[1]: Reached target Swaps.1760lb # [ 1.737833] systemd[1]: Reached target Timer Units.1761worker2 # [ 1.788037] systemd[1]: Starting Journal Service...1762lb # [ 1.738867] systemd[1]: Listening on D-Bus System Message Bus Socket.1763lb # [ 1.740031] systemd[1]: Listening on Journal Socket (/dev/log).1764client # [ 1.779384] systemd[1]: Starting Journal Service...1765lb # [ 1.741099] systemd[1]: Listening on Journal Sockets.1766worker2 # [ 1.791986] systemd[1]: Starting Load Kernel Modules...1767lb # [ 1.742078] systemd[1]: Listening on udev Control Socket.1768worker2 # [ 1.792854] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1769lb # [ 1.742194] systemd[1]: Listening on udev Kernel Socket.1770lb # [ 1.742216] systemd[1]: Reached target Socket Units.1771lb # [ 1.745962] systemd[1]: Starting Create List of Static Device Nodes...1772worker1 # [ 1.752473] systemd[1]: Starting Journal Service...1773lb # [ 1.754005] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1774client # [ 1.791859] systemd[1]: Starting Load Kernel Modules...1775client # [ 1.791967] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1776lb # [ 1.755112] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1777worker1 # [ 1.761854] systemd[1]: Starting Load Kernel Modules...1778worker1 # [ 1.761954] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1779lb # [ 1.760977] systemd[1]: Mounting Kernel Configuration File System...1780worker1 # [ 1.771077] systemd[1]: Starting Coldplug All udev Devices...1781worker2 # [ 1.820028] systemd[1]: Starting Coldplug All udev Devices...1782lb # [ 1.774276] systemd[1]: Starting Journal Service...1783client # [ 1.816307] systemd[1]: Starting Coldplug All udev Devices...1784worker2 # [ 1.827964] systemd[1]: Finished Create List of Static Device Nodes.1785client # [ 1.819238] systemd[1]: Finished Create List of Static Device Nodes.1786worker2 # [ 1.828758] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1787worker2 # [ 1.829060] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1788client # [ 1.820960] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1789client # [ 1.823330] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1790lb # [ 1.790235] systemd[1]: Starting Load Kernel Modules...1791lb # [ 1.791169] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1792worker1 # [ 1.796578] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1793worker1 # [ 1.802076] systemd[1]: Finished Create List of Static Device Nodes.1794worker1 # [ 1.803137] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1795client # [ 1.840155] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1796lb # [ 1.802878] systemd[1]: Starting Coldplug All udev Devices...1797worker1 # [ 1.810225] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1798worker2 # [ 1.852474] systemd-journald[73]: Collecting audit messages is disabled.1799worker1 # [ 1.818379] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1800worker2 # [ 1.861230] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1801worker2 # [ 1.861863] systemd[1]: Mounted Kernel Configuration File System.1802client # [ 1.855312] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1803worker2 # [ 1.865613] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1804client # [ 1.856748] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1805worker1 # [ 1.824152] systemd-journald[73]: Collecting audit messages is disabled.1806client # [ 1.859077] systemd[1]: Mounted Kernel Configuration File System.1807worker1 # [ 1.825053] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1808client # [ 1.863976] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01809client # [ 1.864205] [drm] features: -virgl +edid -resource_blob -host_visible1810client # [ 1.864212] [drm] features: -context_init1811client # [ 1.864899] [drm] number of scanouts: 11812worker1 # [ 1.833702] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01813client # [ 1.864915] [drm] number of cap sets: 01814worker1 # [ 1.833960] [drm] features: -virgl +edid -resource_blob -host_visible1815worker1 # [ 1.833969] [drm] features: -context_init1816worker2 # [ 1.878472] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1817worker1 # [ 1.837287] systemd[1]: Mounted Kernel Configuration File System.1818worker2 # [ 1.886980] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01819worker2 # [ 1.887210] [drm] features: -virgl +edid -resource_blob -host_visible1820worker2 # [ 1.887219] [drm] features: -context_init1821lb # [ 1.837994] systemd[1]: Finished Create List of Static Device Nodes.1822lb # [ 1.839158] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1823worker1 # [ 1.846801] [drm] number of scanouts: 11824worker2 # [ 1.890498] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1825worker1 # [ 1.846821] [drm] number of cap sets: 01826client # [ 1.880524] systemd-journald[73]: Collecting audit messages is disabled.1827lb # [ 1.839444] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1828client # [ 1.881964] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1829client # [ 1.887562] systemd[1]: Starting Create Static Device Nodes in /dev...1830worker1 # [ 1.848269] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1831worker1 # [ 1.848285] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01832lb # [ 1.852955] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1833worker2 # [ 1.896168] systemd[1]: Starting Create Static Device Nodes in /dev...1834worker2 # [ 1.904925] [drm] number of scanouts: 11835worker2 # [ 1.904953] [drm] number of cap sets: 01836client # [ 1.891317] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1837lb # [ 1.855111] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1838client # [ 1.891339] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01839lb # [ 1.859147] systemd-journald[73]: Collecting audit messages is disabled.1840worker2 # [ 1.906419] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1841worker2 # [ 1.906435] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01842lb # [ 1.865941] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1843worker1 # [ 1.874486] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1844worker1 # [ 1.876924] systemd[1]: Starting Create Static Device Nodes in /dev...1845lb # [ 1.874751] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01846lb # [ 1.874998] [drm] features: -virgl +edid -resource_blob -host_visible1847lb # [ 1.875007] [drm] features: -context_init1848lb # [ 1.875686] [drm] number of scanouts: 11849lb # [ 1.875703] [drm] number of cap sets: 01850lb # [ 1.879960] systemd[1]: Mounted Kernel Configuration File System.1851client # [ 1.915203] Console: switching to colour frame buffer device 160x501852client # [ 1.921656] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1853worker2 # [ 1.933738] systemd[1]: Finished Create Static Device Nodes in /dev.1854worker2 # [ 1.934049] systemd[1]: Reached target Preparation for Local File Systems.1855worker2 # [ 1.934076] systemd[1]: Reached target Local File Systems.1856worker2 # [ 1.940217] systemd[1]: Starting Rule-based Manager for Device Events and Files...1857worker1 # [ 1.890220] Console: switching to colour frame buffer device 160x501858worker1 # [ 1.896594] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1859lb # [ 1.894434] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1860lb # [ 1.894454] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01861worker2 # [ 1.948077] Console: switching to colour frame buffer device 160x501862worker2 # [ 1.954426] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1863client # [ 1.947578] systemd[1]: Finished Load Kernel Modules.1864client # [ 1.950700] systemd[1]: Starting Apply Kernel Variables...1865worker1 # [ 1.918527] systemd[1]: Finished Load Kernel Modules.1866worker1 # [ 1.921697] systemd[1]: Starting Apply Kernel Variables...1867lb # [ 1.918455] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1868lb # [ 1.920954] systemd[1]: Starting Create Static Device Nodes in /dev...1869client # [ 1.964720] systemd[1]: Finished Create Static Device Nodes in /dev.1870client # [ 1.966977] systemd[1]: Reached target Preparation for Local File Systems.1871worker2 # [ 1.980540] systemd[1]: Finished Load Kernel Modules.1872client # [ 1.969096] systemd[1]: Reached target Local File Systems.1873client # [ 1.979233] systemd[1]: Starting Rule-based Manager for Device Events and Files...1874worker1 # [ 1.946287] systemd[1]: Finished Create Static Device Nodes in /dev.1875worker1 # [ 1.948592] systemd[1]: Reached target Preparation for Local File Systems.1876worker1 # [ 1.948632] systemd[1]: Reached target Local File Systems.1877worker2 # [ 1.992304] systemd[1]: Starting Apply Kernel Variables...1878worker1 # [ 1.954370] systemd[1]: Starting Rule-based Manager for Device Events and Files...1879lb # [ 1.953422] Console: switching to colour frame buffer device 160x501880lb # [ 1.956290] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1881lb # [ 1.962489] systemd[1]: Finished Create Static Device Nodes in /dev.1882lb # [ 1.962680] systemd[1]: Reached target Preparation for Local File Systems.1883lb # [ 1.962715] systemd[1]: Reached target Local File Systems.1884lb # [ 1.967415] systemd[1]: Starting Rule-based Manager for Device Events and Files...1885client # [ 2.007661] systemd[1]: Finished Apply Kernel Variables.1886lb # [ 1.974495] systemd[1]: Finished Load Kernel Modules.1887worker1 # [ 1.982254] systemd[1]: Finished Apply Kernel Variables.1888lb # [ 1.986242] systemd[1]: Starting Apply Kernel Variables...1889worker2 # [ 2.040458] systemd[1]: Finished Apply Kernel Variables.1890worker2 # [ 2.044088] systemd[1]: Started Journal Service.1891worker2 # [ 2.032339] systemd-modules-load[74]: Inserted module 'dm_mod'1892worker2 # [ 2.033546] systemd-modules-load[74]: Module 'virtio_balloon' is built in1893worker1 # [ 2.003502] systemd[1]: Started Journal Service.1894worker1 # [ 1.992610] systemd-modules-load[74]: Inserted module 'dm_mod'1895worker1 # [ 1.993683] systemd-modules-load[74]: Module 'virtio_balloon' is built in1896worker1 # [ 2.000313] systemd-modules-load[74]: Module 'virtio_console' is built in1897worker2 # [ 2.044345] systemd-modules-load[74]: Module 'virtio_console' is built in1898worker2 # [ 2.045455] systemd-modules-load[74]: Inserted module 'virtio_gpu'1899worker2 # [ 2.046434] systemd-modules-load[74]: Module 'virtio_rng' is built in1900worker2 # [ 2.047422] systemd[1]: Starting Create System Files and Directories...1901worker1 # [ 2.006893] systemd-modules-load[74]: Inserted module 'virtio_gpu'1902worker1 # [ 2.007926] systemd-modules-load[74]: Module 'virtio_rng' is built in1903client # [ 2.054007] systemd[1]: Started Journal Service.1904worker2 # [ 2.055439] systemd-udevd[79]: Using default interface naming scheme 'v261'.1905lb # [ 2.022479] systemd[1]: Finished Apply Kernel Variables.1906worker1 # [ 2.016386] systemd[1]: Starting Create System Files and Directories...1907client # [ 2.056279] systemd-modules-load[74]: Inserted module 'dm_mod'1908client # [ 2.057395] systemd-modules-load[74]: Module 'virtio_balloon' is built in1909client # [ 2.058491] systemd-modules-load[74]: Module 'virtio_console' is built in1910client # [ 2.059537] systemd-modules-load[74]: Inserted module 'virtio_gpu'1911worker2 # [ 2.072964] systemd[1]: Finished Create System Files and Directories.1912lb # [ 2.038683] systemd[1]: Started Journal Service.1913client # [ 2.069175] systemd-modules-load[74]: Module 'virtio_rng' is built in1914client # [ 2.070660] systemd-udevd[81]: Using default interface naming scheme 'v261'.1915client # [ 2.071763] systemd[1]: Starting Create System Files and Directories...1916worker1 # [ 2.041556] systemd-udevd[81]: Using default interface naming scheme 'v261'.1917lb # [ 2.027955] systemd-modules-load[74]: Inserted module 'dm_mod'1918lb # [ 2.038309] systemd-modules-load[74]: Module 'virtio_balloon' is built in1919lb # [ 2.039381] systemd-modules-load[74]: Module 'virtio_console' is built in1920worker1 # [ 2.046076] systemd[1]: Finished Create System Files and Directories.1921lb # [ 2.044377] systemd-modules-load[74]: Inserted module 'virtio_gpu'1922worker2 # [ 2.092547] systemd[1]: Started Rule-based Manager for Device Events and Files.1923lb # [ 2.045527] systemd-modules-load[74]: Module 'virtio_rng' is built in1924lb # [ 2.046529] systemd[1]: Starting Create System Files and Directories...1925worker1 # [ 2.073178] systemd[1]: Started Rule-based Manager for Device Events and Files.1926client # [ 2.106025] systemd[1]: Finished Create System Files and Directories.1927client # [ 2.107673] systemd[1]: Started Rule-based Manager for Device Events and Files.1928lb # [ 2.071553] systemd-udevd[80]: Using default interface naming scheme 'v261'.1929lb # [ 2.073659] systemd[1]: Finished Create System Files and Directories.1930worker2 # [ 2.144117] systemd[1]: Starting Virtual Console Setup...1931lb # [ 2.107095] systemd[1]: Started Rule-based Manager for Device Events and Files.1932worker1 # [ 2.126319] systemd[1]: Starting Virtual Console Setup...1933client # [ 2.168216] systemd[1]: Starting Virtual Console Setup...1934worker2 # [ 2.196495] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1935worker2 # [ 2.199829] systemd[1]: Finished Virtual Console Setup.1936lb # [ 2.160101] systemd[1]: Starting Virtual Console Setup...1937worker1 # [ 2.177245] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938worker1 # [ 2.180651] systemd[1]: Finished Virtual Console Setup.1939client # [ 2.216466] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940client # [ 2.219854] systemd[1]: Finished Virtual Console Setup.1941lb # [ 2.209163] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942lb # [ 2.211774] systemd[1]: Finished Virtual Console Setup.1943worker2 # [ 2.793223] systemd[1]: Finished Coldplug All udev Devices.1944worker2 # [ 2.794173] systemd[1]: Reached target System Initialization.1945worker2 # [ 2.794995] systemd[1]: Reached target Basic System.1946worker1 # [ 2.777313] systemd[1]: Finished Coldplug All udev Devices.1947worker1 # [ 2.778282] systemd[1]: Reached target System Initialization.1948worker1 # [ 2.779096] systemd[1]: Reached target Basic System.1949lb # [ 2.793954] systemd[1]: Finished Coldplug All udev Devices.1950lb # [ 2.794893] systemd[1]: Reached target System Initialization.1951lb # [ 2.795694] systemd[1]: Reached target Basic System.1952client # [ 2.861135] systemd[1]: Finished Coldplug All udev Devices.1953client # [ 2.862080] systemd[1]: Reached target System Initialization.1954client # [ 2.862897] systemd[1]: Reached target Basic System.1955worker2 # [ 2.922873] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1956worker2 # [ 2.957739] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1957worker1 # [ 2.915903] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1958worker2 # [ 2.961856] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1959client # [ 2.971834] (udev-worker)[107]: Network interface NamePolicy= disabled on kernel command line.1960lb # [ 2.941890] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1961worker1 # [ 2.958241] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1962worker1 # [ 2.964159] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1963worker2 # [ 3.017653] systemd[1]: Found device /dev/disk/by-label/nixos.1964lb # [ 2.969397] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1965worker2 # [ 3.019750] systemd[1]: Reached target Initrd Root Device.1966lb # [ 2.973588] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1967worker2 # [ 3.023593] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1968client # [ 3.025167] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1969client # [ 3.032206] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1970worker2 # [ 3.069197] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1971worker1 # [ 3.030045] systemd[1]: Found device /dev/disk/by-label/nixos.1972worker2 # [ 3.076472] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1973worker1 # [ 3.035547] systemd[1]: Reached target Initrd Root Device.1974lb # [ 3.032797] systemd[1]: Found device /dev/disk/by-label/nixos.1975worker2 # [ 3.083933] systemd[1]: Mounting /sysroot...1976worker1 # [ 3.041080] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1977lb # [ 3.039580] systemd[1]: Reached target Initrd Root Device.1978lb # [ 3.043902] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1979worker2 # [ 3.130460] EXT4-fs (vda): mounted filesystem 2beda237-e6d3-47f2-9eca-17fbc2e4866f r/w with ordered data mode. Quota mode: none.1980client # [ 3.108209] systemd[1]: Found device /dev/disk/by-label/nixos.1981worker2 # [ 3.121106] systemd[1]: Mounted /sysroot.1982worker2 # [ 3.122979] systemd[1]: Reached target Initrd Root File System.1983worker1 # [ 3.080409] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1984client # [ 3.117492] systemd[1]: Reached target Initrd Root Device.1985worker2 # [ 3.128121] systemd[1]: Starting Mountpoints Configured in the Real Root...1986worker1 # [ 3.088147] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1987client # [ 3.121532] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1988worker1 # [ 3.092171] systemd[1]: Mounting /sysroot...1989lb # [ 3.091694] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1990lb # [ 3.096778] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1991worker2 # [ 3.148357] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1992lb # [ 3.106769] systemd[1]: Mounting /sysroot...1993worker2 # [ 3.154928] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1994worker2 # [ 3.158764] systemd[1]: Reloading...1995worker1 # [ 3.136445] EXT4-fs (vda): mounted filesystem 8c240b0b-2896-44a2-ab91-e1cc35788eff r/w with ordered data mode. Quota mode: none.1996worker1 # [ 3.129411] systemd[1]: Mounted /sysroot.1997worker1 # [ 3.132132] systemd[1]: Reached target Initrd Root File System.1998client # [ 3.164959] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1999worker1 # [ 3.134598] systemd[1]: Starting Mountpoints Configured in the Real Root...2000client # [ 3.171999] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.3213lb # [ 12.366416] (udev-worker)[362]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3214worker1 # [ 12.391034] mousedev: PS/2 mouse device common for all mice3215lb # [ 12.374697] (udev-worker)[362]: Network interface NamePolicy= disabled on kernel command line.3216client # [ 12.427107] 8021q: adding VLAN 0 to HW filter on device eth13217worker2 # [ 12.441526] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3218worker2 # [ 12.441991] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3219worker2 # [ 12.447209] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23220worker2 # [ 12.447518] cfg80211: failed to load regulatory.db3221client # [ 12.441831] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3222client # [ 12.442328] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3223client # [ 12.448451] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23224client # [ 12.448796] cfg80211: failed to load regulatory.db3225lb # [ 12.399570] (udev-worker)[379]: Network interface NamePolicy= disabled on kernel command line.3226worker1 # [ 12.423019] 8021q: adding VLAN 0 to HW filter on device eth13227client # [ 12.445366] network-addresses-eth1-start[548]: adding address 192.168.1.1/24... done3228worker2 # [ 12.456513] network-addresses-eth1-start[634]: adding address 192.168.1.4/24... done3229lb # [ 12.416606] systemd[1]: Finished Permit User Sessions.3230worker2 # [ 12.470301] systemd[1]: Finished Permit User Sessions.3231lb # [ 12.425406] systemd[1]: Started Getty on tty1.3232client # [ 12.465061] network-addresses-eth1-start[548]: adding address 2001:db8:1::1/64... done3233worker2 # [ 12.478281] systemd[1]: Started Getty on tty1.3234worker1 # [ 12.435964] network-addresses-eth1-start[655]: adding address 192.168.1.3/24... done3235lb # [ 12.445534] cfg80211: Loading compiled-in X.509 certificates for regulatory database3236lb # [ 12.434401] systemd[1]: Reached target Login Prompts.3237worker2 # [ 12.479959] systemd[1]: Reached target Login Prompts.3238worker2 # [ 12.495017] network-addresses-eth1-start[634]: adding address 2001:db8:1::4/64... done3239worker1 # [ 12.452519] network-addresses-eth1-start[655]: adding address 2001:db8:1::3/64... done3240worker1 # [ 12.471449] 8021q: adding VLAN 0 to HW filter on device eth03241worker1 # [ 12.460496] dhcpcd[644]: eth0: waiting for carrier3242worker1 # [ 12.463255] dhcpcd[644]: eth0: waiting for carrier3243worker1 # [ 12.464375] dhcpcd[644]: eth0: carrier acquired3244client # [ 12.498777] systemd[1]: Finished Address configuration of eth1.3245worker2 # [ 12.522134] systemd[1]: Finished Address configuration of eth1.3246worker1 # [ 12.479111] systemd[1]: Finished Address configuration of eth1.3247worker1 # [ 12.482558] dhcpcd[644]: DUID 00:01:00:01:32:42:5e:34:52:54:00:12:34:563248worker1 # [ 12.483672] dhcpcd[644]: eth0: IAID 00:12:34:563249worker1 # [ 12.485815] dhcpcd[644]: eth0: adding address fe80::5054:ff:fe12:34563250client # [ 12.527576] dhcpcd[588]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (551) - Operation not permitted3251client # [ 12.534993] dhcpcd[588]: .resolvconf-wrapped: clearing stale lock pid 5513252lb # [ 12.510102] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3253lb # [ 12.510599] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3254worker2 # [ 12.562877] 8021q: adding VLAN 0 to HW filter on device eth03255worker2 # [ 12.548810] dhcpcd[640]: eth0: waiting for carrier3256worker2 # [ 12.551507] dhcpcd[640]: libudev: received NULL device3257worker2 # [ 12.553208] dhcpcd[640]: libudev: received NULL device3258lb # [ 12.517568] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23259lb # [ 12.517939] cfg80211: failed to load regulatory.db3260worker2 # [ 12.554545] dhcpcd[640]: eth0: carrier acquired3261worker2 # [ 12.564819] dhcpcd[640]: DUID 00:01:00:01:32:42:5e:34:52:54:00:12:34:563262worker2 # [ 12.565933] dhcpcd[640]: eth0: IAID 00:12:34:563263worker2 # [ 12.566812] dhcpcd[640]: eth0: adding address fe80::5054:ff:fe12:34563264worker2 # [ 12.586180] dhcpcd[640]: eth0: soliciting a DHCP lease3265worker2 # [ 12.592516] dhcpcd[640]: eth0: offered 10.0.2.15 from 10.0.2.23266client # [ 12.597444] 8021q: adding VLAN 0 to HW filter on device eth03267client # [ 12.586063] dhcpcd[543]: eth0: waiting for carrier3268worker2 # [ 12.600225] dhcpcd[640]: eth0: probing address 10.0.2.15/243269client # [ 12.589617] dhcpcd[543]: libudev: received NULL device3270client # [ 12.591727] dhcpcd[543]: libudev: received NULL device3271client # [ 12.595576] dhcpcd[543]: eth0: carrier acquired3272lb # [ 12.562576] systemd[1]: Condition check resulted in Virtio network device being skipped.3273client # [ 12.609965] dhcpcd[543]: DUID 00:01:00:01:32:42:5e:34:52:54:00:12:34:563274client # [ 12.612672] dhcpcd[543]: eth0: IAID 00:12:34:563275client # [ 12.613368] dhcpcd[543]: eth0: adding address fe80::5054:ff:fe12:34563276lb # [ 12.575511] systemd[1]: Starting Address configuration of eth1...3277client # [ 12.619558] systemd[1]: Finished Extra networking commands..3278worker1 # [ 12.587398] systemd-logind[521]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3279client # [ 12.621207] systemd[1]: Reached target Network.3280client # [ 12.625201] systemd[1]: Starting Permit User Sessions...3281lb # [ 12.642154] 8021q: adding VLAN 0 to HW filter on device eth03282lb # [ 12.632468] dhcpcd[669]: eth0: waiting for carrier3283client # [ 12.673019] systemd[1]: Finished Permit User Sessions.3284lb # [ 12.638641] dhcpcd[669]: eth0: waiting for carrier3285lb # [ 12.640496] dhcpcd[669]: eth0: carrier acquired3286client # [ 12.681521] systemd[1]: Started Getty on tty1.3287client # [ 12.684755] systemd[1]: Reached target Login Prompts.3288worker2 # [ 12.699307] systemd-logind[511]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3289lb # [ 12.664566] dhcpcd[669]: DUID 00:01:00:01:32:42:5e:34:52:54:00:12:34:563290lb # [ 12.666887] dhcpcd[669]: eth0: IAID 00:12:34:563291lb # [ 12.668397] dhcpcd[669]: eth0: adding address fe80::5054:ff:fe12:34563292lb # [ 12.736532] 8021q: adding VLAN 0 to HW filter on device eth13293lb # [ 12.753295] network-addresses-eth1-start[706]: adding address 192.168.1.2/24... done3294lb # [ 12.774681] postgresql-pre-start[703]: The files belonging to this database system will be owned by user "postgres".3295lb # [ 12.778255] postgresql-pre-start[703]: This user must also own the server process.3296lb # [ 12.782489] network-addresses-eth1-start[706]: adding address 2001:db8:1::2/64... done3297client: (finished: waiting for unit network-addresses-eth1.service, in 13.20 seconds)3298client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3299lb # [ 12.796829] postgresql-pre-start[703]: The database cluster will be initialized with locale "en_US.UTF-8".3300lb # [ 12.801671] postgresql-pre-start[703]: The default database encoding has accordingly been set to "UTF8".3301lb # [ 12.806035] postgresql-pre-start[703]: The default text search configuration will be set to "english".3302lb # [ 12.812441] postgresql-pre-start[703]: Data page checksums are enabled.3303lb # [ 12.817810] postgresql-pre-start[703]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3304lb # [ 12.823812] postgresql-pre-start[703]: creating subdirectories ... ok3305lb # [ 12.827852] postgresql-pre-start[703]: selecting dynamic shared memory implementation ... posix3306lb # [ 12.832447] systemd[1]: Finished Address configuration of eth1.3307client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3308lb: waiting for unit network-addresses-eth1.service3309lb: waiting for the VM to finish booting3310lb: Guest shell says: b'Spawning backdoor root shell...\n'3311lb: connected to guest root shell3312lb: (connecting took 0.00 seconds)3313lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3314lb # [ 12.952840] systemd-logind[529]: Watching system buttons on /dev/input/event0 (gpio-keys)3315lb: (finished: waiting for unit network-addresses-eth1.service, in 0.13 seconds)3316lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3317lb # [ 13.039570] postgresql-pre-start[703]: selecting default "max_connections" ... 1003318lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.09 seconds)3319worker1: waiting for unit network-addresses-eth1.service3320worker1: waiting for the VM to finish booting3321worker1: Guest shell says: b'Spawning backdoor root shell...\n'3322worker1: connected to guest root shell3323worker1: (connecting took 0.00 seconds)3324worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3325worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3326worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3327lb # [ 13.189871] postgresql-pre-start[703]: selecting default "shared_buffers" ... 128MB3328worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3329worker2: waiting for unit network-addresses-eth1.service3330worker2: waiting for the VM to finish booting3331worker2: Guest shell says: b'Spawning backdoor root shell...\n'3332worker2: connected to guest root shell3333worker2: (connecting took 0.00 seconds)3334worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3335worker2 # [ 13.289090] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33336client # [ 13.294774] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33337lb # [ 13.258545] mousedev: PS/2 mouse device common for all mice3338worker1 # [ 13.298539] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33339worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3340worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3341worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3342lb: waiting for unit niks3.service3343lb # [ 13.449914] systemd-logind[529]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3344client # [ 13.596484] systemd[1]: Starting Virtual Console Setup...3345worker1 # [ 13.564607] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3346worker1 # [ 13.585879] systemd[1]: Starting Virtual Console Setup...3347worker2 # [ 13.635620] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3348worker2 # [ 13.643099] systemd[1]: Starting Virtual Console Setup...3349client # [ 13.636155] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3350worker1 # [ 13.607397] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3351worker1 # [ 13.612430] systemd[1]: Stopped Virtual Console Setup.3352worker1 # [ 13.615267] systemd[1]: Starting Virtual Console Setup...3353worker2 # [ 13.663570] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3354worker2 # [ 13.668328] systemd[1]: Stopped Virtual Console Setup.3355worker2 # [ 13.672843] systemd[1]: Starting Virtual Console Setup...3356worker1 # [ 13.654478] systemd-logind[521]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3357client # [ 13.691299] systemd-logind[432]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3358worker2 # [ 13.722658] systemd-logind[511]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3359worker1 # [ 13.726547] dhcpcd[644]: eth0: soliciting a DHCP lease3360worker1 # [ 13.732491] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.23361worker1 # [ 13.740158] dhcpcd[644]: eth0: probing address 10.0.2.15/243362client # [ 14.033436] systemd-vconsole-setup[649]: Configuration of first virtual console was skipped, ignoring remaining ones.3363client # [ 14.037665] systemd[1]: Finished Virtual Console Setup.3364worker1 # [ 14.031824] systemd-vconsole-setup[709]: Configuration of first virtual console was skipped, ignoring remaining ones.3365worker1 # [ 14.036352] systemd[1]: Finished Virtual Console Setup.3366worker2 # [ 14.084556] systemd-vconsole-setup[710]: Configuration of first virtual console was skipped, ignoring remaining ones.3367worker2 # [ 14.089673] systemd[1]: Finished Virtual Console Setup.3368client # [ 14.272388] dhcpcd[543]: eth0: soliciting a DHCP lease3369client # [ 14.277067] dhcpcd[543]: eth0: offered 10.0.2.15 from 10.0.2.23370client # [ 14.284558] dhcpcd[543]: eth0: probing address 10.0.2.15/243371worker1 # [ 14.302317] dhcpcd[644]: eth0: soliciting an IPv6 router3372worker1 # [ 14.305848] dhcpcd[644]: eth0: Router Advertisement from fe80::23373worker1 # [ 14.308487] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/643374worker1 # [ 14.311376] dhcpcd[644]: eth0: adding route to fec0::/643375lb # [ 14.321390] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33376worker1 # [ 14.313712] dhcpcd[644]: eth0: adding default route via fe80::23377lb # [ 14.388895] dhcpcd[669]: eth0: soliciting a DHCP lease3378lb # [ 14.396461] dhcpcd[669]: eth0: offered 10.0.2.15 from 10.0.2.23379lb # [ 14.404195] dhcpcd[669]: eth0: probing address 10.0.2.15/243380lb # [ 14.433417] dhcpcd[669]: eth0: soliciting an IPv6 router3381lb # [ 14.436602] dhcpcd[669]: eth0: Router Advertisement from fe80::23382lb # [ 14.437734] dhcpcd[669]: eth0: adding address fec0::5054:ff:fe12:3456/643383lb # [ 14.440046] dhcpcd[669]: eth0: adding route to fec0::/643384lb # [ 14.443249] dhcpcd[669]: eth0: adding default route via fe80::23385lb # [ 14.779067] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3386lb # [ 14.796694] systemd[1]: Starting Virtual Console Setup...3387lb # [ 14.821757] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3388lb # [ 14.825864] systemd[1]: Stopped Virtual Console Setup.3389lb # [ 14.831812] systemd[1]: Starting Virtual Console Setup...3390lb # [ 14.908176] systemd-logind[529]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3391worker2 # [ 15.185591] dhcpcd[640]: eth0: soliciting an IPv6 router3392worker2 # [ 15.189082] dhcpcd[640]: eth0: Router Advertisement from fe80::23393worker2 # [ 15.191593] dhcpcd[640]: eth0: adding address fec0::5054:ff:fe12:3456/643394worker2 # [ 15.195914] dhcpcd[640]: eth0: adding route to fec0::/643395worker2 # [ 15.198281] dhcpcd[640]: eth0: adding default route via fe80::23396client # [ 15.208839] dhcpcd[543]: eth0: soliciting an IPv6 router3397client # [ 15.212409] dhcpcd[543]: eth0: Router Advertisement from fe80::23398client # [ 15.215073] dhcpcd[543]: eth0: adding address fec0::5054:ff:fe12:3456/643399client # [ 15.218707] dhcpcd[543]: eth0: adding route to fec0::/643400client # [ 15.221052] dhcpcd[543]: eth0: adding default route via fe80::23401lb # [ 15.306286] systemd-vconsole-setup[773]: Configuration of first virtual console was skipped, ignoring remaining ones.3402lb # [ 15.311183] systemd[1]: Finished Virtual Console Setup.3403lb # [ 15.635268] postgresql-pre-start[703]: selecting default time zone ... UTC3404lb # [ 15.639406] postgresql-pre-start[703]: creating configuration files ... ok3405lb # [ 15.988171] postgresql-pre-start[703]: running bootstrap script ... ok3406lb # [ 16.610153] postgresql-pre-start[703]: performing post-bootstrap initialization ... ok3407lb # [ 16.765034] postgresql-pre-start[703]: syncing data to disk ... ok3408lb # [ 16.766372] postgresql-pre-start[703]: initdb: warning: enabling "trust" authentication for local connections3409lb # [ 16.769205] postgresql-pre-start[703]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3410lb # [ 16.771500] postgresql-pre-start[703]: Success. You can now start the database server using:3411lb # [ 16.773291] postgresql-pre-start[703]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3412lb # [ 16.926534] postgres[802]: [802] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3413lb # [ 16.931143] postgres[802]: [802] LOG: listening on IPv6 address "::1", port 54323414lb # [ 16.932506] postgres[802]: [802] LOG: listening on IPv4 address "127.0.0.1", port 54323415lb # [ 16.934179] postgres[802]: [802] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3416lb # [ 16.948435] postgres[816]: [816] LOG: database system was shut down at 2026-09-20 09:04:56 GMT3417lb # [ 16.954173] postgres[802]: [802] LOG: database system is ready to accept connections3418lb # [ 16.958838] systemd[1]: Started PostgreSQL Server.3419lb # [ 16.967619] systemd[1]: Starting PostgreSQL Setup Scripts...3420lb # [ 17.189143] postgresql-setup-start[827]: CREATE DATABASE3421lb # [ 17.245549] postgresql-setup-start[832]: CREATE ROLE3422lb # [ 17.270885] postgresql-setup-start[834]: ALTER DATABASE3423lb # [ 17.278293] systemd[1]: Finished PostgreSQL Setup Scripts.3424lb # [ 17.280161] systemd[1]: Reached target PostgreSQL.3425worker2 # [ 17.390104] dhcpcd[640]: eth0: leased 10.0.2.15 for 86400 seconds3426worker2 # [ 17.392857] dhcpcd[640]: eth0: adding route to 10.0.2.0/243427worker2 # [ 17.395143] dhcpcd[640]: eth0: adding default route via 10.0.2.23428worker2 # [ 17.593830] systemd[1]: Started DHCP Client.3429worker2 # [ 17.595958] systemd[1]: Reached target Multi-User System.3430worker2 # [ 17.597481] systemd[1]: Startup finished in 925ms (kernel) + 5.443s (initrd) + 11.227s (userspace) = 17.595s.3431worker1 # [ 19.252485] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds3432worker1 # [ 19.256172] dhcpcd[644]: eth0: adding route to 10.0.2.0/243433worker1 # [ 19.259032] dhcpcd[644]: eth0: adding default route via 10.0.2.23434client # [ 19.342331] dhcpcd[543]: eth0: leased 10.0.2.15 for 86400 seconds3435worker1 # [ 19.419170] systemd[1]: Started DHCP Client.3436worker1 # [ 19.421111] systemd[1]: Reached target Multi-User System.3437worker1 # [ 19.422816] systemd[1]: Startup finished in 915ms (kernel) + 5.403s (initrd) + 13.102s (userspace) = 19.422s.3438client # [ 19.346401] dhcpcd[543]: eth0: adding route to 10.0.2.0/243439client # [ 19.346575] dhcpcd[543]: eth0: adding default route via 10.0.2.23440client # [ 19.508216] systemd[1]: Started DHCP Client.3441client # [ 19.511974] systemd[1]: Reached target Multi-User System.3442client # [ 19.513128] systemd[1]: Startup finished in 923ms (kernel) + 5.426s (initrd) + 13.161s (userspace) = 19.511s.3443lb # [ 19.708631] dhcpcd[669]: eth0: leased 10.0.2.15 for 86400 seconds3444lb # [ 19.711776] dhcpcd[669]: eth0: adding route to 10.0.2.0/243445lb # [ 19.715081] dhcpcd[669]: eth0: adding default route via 10.0.2.23446lb # [ 19.879794] systemd[1]: Started DHCP Client.3447lb # [ 19.883069] systemd[1]: Reached target Network is Online.3448lb # [ 19.889553] systemd[1]: Started Envoy reverse proxy.3449lb # [ 19.897631] systemd[1]: Started mock-oidc.service.3450lb # [ 19.995599] mock-oidc-server[912]: Mock OIDC Server running3451lb # [ 19.997136] mock-oidc-server[912]: OIDC Address: 192.168.1.2:80803452lb # [ 19.998613] mock-oidc-server[912]: Issue Address: 0.0.0.0:80813453lb # [ 19.999841] mock-oidc-server[912]: Issuer: http://192.168.1.2:8080/oidc3454lb # [ 20.001590] mock-oidc-server[912]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3455lb # [ 20.003023] mock-oidc-server[912]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3456lb # [ 20.004926] mock-oidc-server[912]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3457lb # [ 20.590053] envoy[911]: [2026-09-20 09:05:00.240][911][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3458lb # [ 20.592988] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:469] statically linked extensions:3459lb # [ 20.594616] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3460lb # [ 20.600358] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3461lb # [ 20.602820] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3462lb # [ 20.605367] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3463lb # [ 20.607320] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3464lb # [ 20.609996] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3465lb # [ 20.613784] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3466lb # [ 20.616572] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3467lb # [ 20.619212] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3468lb # [ 20.621893] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3469lb # [ 20.623993] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3470lb # [ 20.648695] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3471lb # [ 20.650485] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3472lb # [ 20.652854] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3473lb # [ 20.655644] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3474lb # [ 20.658294] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3475lb # [ 20.662295] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3476lb # [ 20.665408] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3477lb # [ 20.672806] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3478lb # [ 20.681811] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3479lb # [ 20.685501] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3480lb # [ 20.687408] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3481lb # [ 20.689686] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3482lb # [ 20.691463] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3483lb # [ 20.693700] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3484lb # [ 20.699160] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3485lb # [ 20.702290] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3486lb # [ 20.704073] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3487lb # [ 20.706178] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83488lb # [ 20.708863] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3489lb # [ 20.710964] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3490lb # [ 20.713947] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3491lb # [ 20.716957] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3492lb # [ 20.722025] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3493lb # [ 20.753762] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3494lb # [ 20.756712] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3495lb # [ 20.758557] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3496lb # [ 20.760702] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3497lb # [ 20.763772] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3498lb # [ 20.767417] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3499lb # [ 20.770260] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3500lb # [ 20.773346] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3501lb # [ 20.777950] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3502lb # [ 20.781494] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3503lb # [ 20.783419] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3504lb # [ 20.785616] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3505lb # [ 20.793206] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3506lb # [ 20.795366] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3507lb # [ 20.797658] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3508lb # [ 20.799657] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3509lb # [ 20.803630] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3510lb # [ 20.805819] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3511lb # [ 20.807895] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3512lb # [ 20.812892] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23513lb # [ 20.815330] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3514lb # [ 20.818073] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3515lb # [ 20.820058] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3516lb # [ 20.822375] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3517lb # [ 20.825620] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3518lb # [ 20.828431] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3519lb # [ 20.830155] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3520lb # [ 20.833262] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3521lb # [ 20.835058] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3522lb # [ 20.843735] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3523lb # [ 20.846823] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3524lb # [ 20.852545] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3525lb # [ 20.854376] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13526lb # [ 20.857457] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3527lb # [ 20.859601] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3528lb # [ 20.861704] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3529lb # [ 20.864584] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23530lb # [ 20.866512] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3531lb # [ 20.868530] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3532lb # [ 20.873784] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3533lb # [ 20.877813] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3534lb # [ 20.881189] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3535lb # [ 20.883831] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3536lb # [ 20.889862] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3537lb # [ 20.891866] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3538lb # [ 20.894258] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3539lb # [ 20.896470] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3540lb # [ 20.899125] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3541lb # [ 20.902324] envoy[911]: [2026-09-20 09:05:00.243][911][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3542lb # [ 20.903947] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3543lb # [ 20.906142] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3544lb # [ 20.919833] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3545lb # [ 20.922182] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3546lb # [ 20.927083] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3547lb # [ 20.932497] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3548lb # [ 20.936388] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3549lb # [ 20.943739] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3550lb # [ 20.945804] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3551lb # [ 20.948468] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3552lb # [ 20.951238] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3553lb # [ 20.954291] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3554lb # [ 20.956518] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3555lb # [ 20.958522] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23556lb # [ 20.960556] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3557lb # [ 20.971732] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3558lb # [ 20.973973] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3559lb # [ 20.976816] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3560lb # [ 20.979028] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3561lb # [ 20.981976] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3562lb # [ 20.985170] envoy[911]: [2026-09-20 09:05:00.244][911][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3563lb # [ 20.991892] envoy[911]: [2026-09-20 09:05:00.286][911][info][main] [source/server/server.cc:531] HTTP header map info:3564lb # [ 20.993547] envoy[911]: [2026-09-20 09:05:00.288][911][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3565lb # [ 21.009819] envoy[911]: [2026-09-20 09:05:00.288][911][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3566lb # [ 21.011429] envoy[911]: [2026-09-20 09:05:00.288][911][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3567lb # [ 21.020877] envoy[911]: [2026-09-20 09:05:00.288][911][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3568lb # [ 21.022903] envoy[911]: [2026-09-20 09:05:00.484][911][info][main] [source/server/server.cc:968] runtime: {}3569lb # [ 21.024397] envoy[911]: [2026-09-20 09:05:00.510][911][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3570lb # [ 21.026176] envoy[911]: [2026-09-20 09:05:00.510][911][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013571lb # [ 21.027894] envoy[911]: [2026-09-20 09:05:00.510][911][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013572lb # [ 21.029830] envoy[911]: [2026-09-20 09:05:00.517][911][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3573lb # [ 21.031589] envoy[911]: [2026-09-20 09:05:00.517][911][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3574lb # [ 21.033433] envoy[911]: [2026-09-20 09:05:00.517][911][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3575lb # [ 21.053749] envoy[911]: [2026-09-20 09:05:00.704][911][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3576lb # [ 21.064061] envoy[911]: [2026-09-20 09:05:00.715][911][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3577worker1 # [ 21.069851] systemd[1]: Starting Nix worker-protocol over gRPC...3578lb # [ 21.066723] envoy[911]: [2026-09-20 09:05:00.717][911][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3579worker2 # [ 21.116834] systemd[1]: Starting Nix worker-protocol over gRPC...3580lb # [ 21.070236] envoy[911]: [2026-09-20 09:05:00.717][911][info][main] [source/server/server.cc:1077] starting main dispatch loop3581worker1 # [ 21.318049] nix-grpc-daemon[774]: ts=2026-09-20T09:05:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3582worker2 # [ 21.367023] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3583worker1 # [ 21.329516] nix-grpc-daemon[774]: ts=2026-09-20T09:05:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13584worker2 # [ 21.378703] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13585worker1 # [ 21.375156] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3586worker1 # [ 21.380132] systemd[1]: Started Nix worker-protocol over gRPC.3587worker2 # [ 21.423402] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3588worker2 # [ 21.428654] systemd[1]: Started Nix worker-protocol over gRPC.3589lb # [ 21.413229] envoy[911]: [2026-09-20 09:05:01.063][911][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3590lb # [ 21.421420] envoy[911]: [2026-09-20 09:05:01.063][911][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3591lb # [ 21.432232] envoy[911]: [2026-09-20 09:05:01.063][911][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3592lb # [ 21.440237] envoy[911]: [2026-09-20 09:05:01.063][911][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3593worker1 # [ 21.457731] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500513594worker2 # [ 21.502749] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500513595worker1 # [ 21.470297] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3596worker2 # [ 21.517797] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3597worker1 # [ 21.672448] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500513598worker2 # [ 21.719195] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500513599worker1 # [ 21.680184] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3600worker2 # [ 21.725132] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3601worker1 # [ 21.881322] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500513602worker2 # [ 21.927232] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500513603worker1 # [ 21.888149] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3604worker2 # [ 21.933086] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3605worker1 # [ 22.089224] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500513606worker2 # [ 22.134311] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500513607worker2 # [ 22.140365] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3608worker1 # [ 22.098283] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3609worker2 # [ 22.340970] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500513610worker1 # [ 22.299800] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500513611worker2 # [ 22.352459] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3612worker1 # [ 22.309395] nix-grpc-daemon[774]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3613worker2 # [ 22.556275] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500513614worker1 # [ 22.518687] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500513615worker2 # [ 22.562283] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3616worker1 # [ 22.523078] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3617worker1 # [ 22.718717] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500513618worker2 # [ 22.763046] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500513619worker2 # [ 22.769407] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3620worker1 # [ 22.726731] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3621worker1 # [ 22.928197] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500513622worker2 # [ 22.971698] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500513623worker1 # [ 22.936558] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3624worker2 # [ 22.980799] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3625worker1 # [ 23.137856] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500513626worker2 # [ 23.181984] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500513627worker2 # [ 23.188788] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3628worker1 # [ 23.147122] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3629worker2 # [ 23.390548] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500513630worker1 # [ 23.350768] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500513631worker1 # [ 23.356870] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3632worker2 # [ 23.400231] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3633worker2 # [ 23.602131] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500513634worker1 # [ 23.559353] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500513635worker1 # [ 23.566249] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3636worker2 # [ 23.609379] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3637worker2 # [ 23.810715] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500513638worker1 # [ 23.767704] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500513639worker2 # [ 23.818568] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3640worker1 # [ 23.775617] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3641worker1 # [ 23.976781] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500513642worker2 # [ 24.022068] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500513643worker1 # [ 23.987450] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3644worker2 # [ 24.030475] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3645worker2 # [ 24.229955] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500513646worker1 # [ 24.189850] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500513647worker2 # [ 24.237354] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3648worker1 # [ 24.198596] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3649worker2 # [ 24.438975] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500513650worker1 # [ 24.399532] nix-grpc-daemon[774]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500513651worker2 # [ 24.447334] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3652worker1 # [ 24.408463] nix-grpc-daemon[774]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3653worker2 # [ 24.650036] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500513654worker1 # [ 24.613638] nix-grpc-daemon[774]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500513655worker2 # [ 24.657928] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3656worker1 # [ 24.618297] nix-grpc-daemon[774]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3657worker1 # [ 24.814826] nix-grpc-daemon[774]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500513658worker2 # [ 24.861240] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500513659worker1 # [ 24.822651] nix-grpc-daemon[774]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3660worker2 # [ 24.867458] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3661worker1 # [ 25.023167] nix-grpc-daemon[774]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500513662worker2 # [ 25.071419] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500513663worker1 # [ 25.030218] nix-grpc-daemon[774]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3664worker2 # [ 25.078037] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3665worker1 # [ 25.230986] nix-grpc-daemon[774]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500513666worker2 # [ 25.278443] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500513667worker1 # [ 25.238687] nix-grpc-daemon[774]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3668worker2 # [ 25.284191] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3669worker1 # [ 25.439029] nix-grpc-daemon[774]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500513670worker2 # [ 25.488197] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500513671worker1 # [ 25.444673] nix-grpc-daemon[774]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3672worker2 # [ 25.497281] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3673worker1 # [ 25.647632] nix-grpc-daemon[774]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500513674worker2 # [ 25.698140] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500513675worker2 # [ 25.701195] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3676worker1 # [ 25.659071] nix-grpc-daemon[774]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3677worker1 # [ 25.854522] nix-grpc-daemon[774]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500513678worker2 # [ 25.902346] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500513679worker1 # [ 25.860278] nix-grpc-daemon[774]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3680worker2 # [ 25.911696] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3681worker1 # [ 26.061419] nix-grpc-daemon[774]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500513682worker1 # [ 26.067056] nix-grpc-daemon[774]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3683worker2 # [ 26.113047] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500513684worker2 # [ 26.118398] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3685lb # [ 26.087981] rustfs-bucket-start[984]: mb s3://farm3686lb # [ 26.097275] systemd[1]: Finished rustfs-bucket.service.3687lb # [ 26.106163] systemd[1]: Starting niks3 server...3688worker1 # [ 26.268270] nix-grpc-daemon[774]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500513689worker1 # [ 26.273843] nix-grpc-daemon[774]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3690worker2 # [ 26.319553] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500513691worker2 # [ 26.325383] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3692lb # [ 26.331220] postgres[1002]: [1002] ERROR: relation "goose_db_version" does not exist at character 363693lb # [ 26.336162] postgres[1002]: [1002] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3694lb # [ 26.371753] niks3-server[994]: 2026/09/20 09:05:06 OK 20241026095416_initial_model.sql (25.63ms)3695lb # [ 26.376428] niks3-server[994]: 2026/09/20 09:05:06 OK 20251210153512_drop_unused_gin_index.sql (2.75ms)3696lb # [ 26.383035] niks3-server[994]: 2026/09/20 09:05:06 OK 20251218171726_add_pins.sql (6.55ms)3697lb # [ 26.390767] niks3-server[994]: 2026/09/20 09:05:06 OK 20260628120000_add_object_size_and_stats.sql (7.63ms)3698lb # [ 26.396513] niks3-server[994]: 2026/09/20 09:05:06 OK 20260905000000_add_claims.sql (5.72ms)3699lb # [ 26.402660] niks3-server[994]: 2026/09/20 09:05:06 OK 20260920000000_drop_claims.sql (5.96ms)3700lb # [ 26.403965] niks3-server[994]: 2026/09/20 09:05:06 goose: successfully migrated database to version: 202609200000003701lb # [ 26.410366] niks3-server[994]: 2026/09/20 09:05:06 OK 1_commit_pending_closure.sql (7.68ms)3702lb # [ 26.413712] niks3-server[994]: 2026/09/20 09:05:06 OK 2_object_stats_trigger.sql (3.18ms)3703lb # [ 26.414981] niks3-server[994]: 2026/09/20 09:05:06 goose: up to current file version: 23704lb # [ 26.419614] niks3-server[994]: 2026/09/20 09:05:06 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3705lb # [ 26.471266] niks3-server[994]: 2026/09/20 09:05:06 INFO Read proxy enabled — serving cache objects from S33706worker1 # [ 26.474769] nix-grpc-daemon[774]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500513707lb # [ 26.476189] niks3-server[994]: 2026/09/20 09:05:06 INFO Using socket-activated listener address=0.0.0.0:57513708lb # [ 26.477645] niks3-server[994]: 2026/09/20 09:05:06 INFO systemd watchdog enabled interval=15s3709worker1 # [ 26.480759] nix-grpc-daemon[774]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3710worker2 # [ 26.526461] nix-grpc-daemon[775]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500513711lb # [ 26.486347] systemd[1]: Started niks3 server.3712lb # [ 26.488320] niks3-server[994]: 2026/09/20 09:05:06 INFO Starting HTTP server address=0.0.0.0:57513713lb # [ 26.489621] systemd[1]: Reached target Multi-User System.3714worker2 # [ 26.533542] nix-grpc-daemon[775]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3715lb # [ 26.490447] systemd[1]: Startup finished in 916ms (kernel) + 5.431s (initrd) + 20.135s (userspace) = 26.483s.3716lb # [ 26.497588] niks3-server[994]: 2026/09/20 09:05:06 INFO lead: acquired remote=192.168.1.4:495563717worker2 # [ 26.549625] nix-grpc-daemon[775]: ts=2026-09-20T09:05:06Z level=info event=scheduler_take_over3718worker1 # [ 26.683232] nix-grpc-daemon[774]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500513719worker2 # [ 26.730523] nix-grpc-daemon[775]: ts=2026-09-20T09:05:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03720worker2 # [ 26.737899] nix-grpc-daemon[775]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500513721worker2 # [ 26.743517] nix-grpc-daemon[775]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3722worker2 # [ 26.944748] nix-grpc-daemon[775]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500513723worker2 # [ 26.950706] nix-grpc-daemon[775]: ts=2026-09-20T09:05:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03724lb: (finished: waiting for unit niks3.service, in 13.62 seconds)3725lb: waiting for TCP port 5751 on localhost3726lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3727lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds)3728lb: waiting for unit envoy.service3729lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3730lb: waiting for TCP port 50051 on localhost3731lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3732lb # [ 27.188881] envoy[911]: conn peer=[::1]:46114 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=43733lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3734lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3735??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3736 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283737lb: must succeed: curl -sf localhost:9901/clusters3738lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)3739lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.12 seconds)3740subtest: one node schedules and both builders hold a WorkerSession on it3741lb: must succeed: curl -sf localhost:9901/clusters3742lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3743worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3744worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.11 seconds)3745(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.17 seconds)3746subtest: balancer auth: client cert, bearer token, nothing, unknown CN3747worker2 # [ 28.154160] nix-grpc-daemon[775]: ts=2026-09-20T09:05:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473963748worker2 # [ 28.175991] systemd[1]: Started Nix Daemon.3749worker2 # [ 28.470592] nix-daemon[836]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3750worker2 # [ 28.517522] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5)3751worker2 # [ 28.563180] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 108 ms (attempt 2/5)3752worker2 # [ 28.677200] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 155 ms (attempt 3/5)3753worker2 # [ 28.840399] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 535 ms (attempt 4/5)3754worker2 # [ 29.387552] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3755worker1 # [ 29.398089] nix-grpc-daemon[774]: ts=2026-09-20T09:05:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:342583756worker1 # [ 29.419433] systemd[1]: Started Nix Daemon.3757worker1 # [ 29.746936] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3758worker1 # [ 29.779926] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)3759worker1 # [ 29.818804] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 2/5)3760worker1 # [ 29.822119] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 113 ms (attempt 3/5)3761worker1 # [ 29.935603] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 700 ms (attempt 4/5)3762worker1 # [ 30.641001] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3763worker1 # [ 30.659546] nix-grpc-daemon[774]: ts=2026-09-20T09:05:10Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3764worker2 # [ 30.715701] nix-grpc-daemon[775]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:473963765worker2 # [ 30.736982] nix-grpc-daemon[775]: ts=2026-09-20T09:05:10Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3766client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3767client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.13 seconds)3768client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3769client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3770lb # [ 31.061513] envoy[911]: conn peer=[2001:db8:1::1]:56334 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=26533771worker1 # [ 31.216676] nix-grpc-daemon[774]: ts=2026-09-20T09:05:10Z level=info event=oidc_jwks provider=mock keys=13772worker1 # [ 31.227115] nix-grpc-daemon[774]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:342583773worker2 # [ 31.300217] nix-grpc-daemon[775]: ts=2026-09-20T09:05:10Z level=info event=oidc_jwks provider=mock keys=13774worker2 # [ 31.307360] nix-grpc-daemon[775]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:473963775worker2 # [ 31.317093] nix-grpc-daemon[775]: ts=2026-09-20T09:05:10Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3776worker1 # [ 31.281509] nix-grpc-daemon[774]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:342583777worker1 # [ 31.295827] nix-grpc-daemon[774]: ts=2026-09-20T09:05:10Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3778client: must succeed: rm -r /var/lib/nix-grpc-store3779client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3780worker2 # [ 33.657694] nix-grpc-daemon[775]: ts=2026-09-20T09:05:13Z level=info event=denied method=QueryMissing cn=- role=none3781worker1 # [ 33.877748] nix-grpc-daemon[774]: ts=2026-09-20T09:05:13Z level=info event=denied method=QueryMissing cn=stranger role=none3782(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 6.21 seconds)3783subtest: DAG build is scheduled across workers and lands in the cache3784client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23785worker2 # [ 34.168807] nix-grpc-daemon[775]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473963786client # don't know how to build these paths:3787client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3788worker2 # [ 34.184705] nix-grpc-daemon[775]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473963789worker2 # [ 34.225700] nix-grpc-daemon[775]: ts=2026-09-20T09:05:13Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03790worker2 # [ 34.231517] nix-grpc-daemon[775]: ts=2026-09-20T09:05:13Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13791worker1 # [ 34.234635] nix-grpc-daemon[774]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342583792worker1 # [ 34.256387] nix-grpc-daemon[774]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342583793client # copying 1 paths to 'lb:50051'...3794worker1 # [ 34.272107] nix-grpc-daemon[774]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:342583795client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3796worker1 # [ 34.302984] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3797worker1 # [ 34.337695] nix-grpc-daemon[774]: ts=2026-09-20T09:05:13Z level=info event=niks3_push_started pid=8413798worker1 # [ 34.811375] nix-daemon[831]: accepted connection from pid 854, user nix-grpc-daemon (trusted)3799worker1 # [ 34.829567] nix-daemon[831]: reaped child process 857, status = succeeded3800worker1 # [ 35.003660] nix-daemon[831]: accepted connection from pid 859, user nix-grpc-daemon (trusted)3801worker1 # [ 35.019588] nix-daemon[831]: reaped child process 862, status = succeeded3802lb # [ 35.030337] niks3-server[994]: 2026/09/20 09:05:14 INFO Received uploads request method=POST path=/api/pending_closures3803worker1 # [ 35.060558] nix-grpc-daemon[841]: time=2026-09-20T09:05:14.712Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3804worker1 # [ 35.064112] nix-grpc-daemon[841]: time=2026-09-20T09:05:14.714Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3805lb # [ 35.098227] niks3-server[994]: 2026/09/20 09:05:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3806lb # [ 35.140115] niks3-server[994]: 2026/09/20 09:05:14 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3807lb # [ 35.147345] niks3-server[994]: 2026/09/20 09:05:14 INFO Signed narinfos id=1 count=13808worker1 # [ 35.155627] nix-grpc-daemon[841]: time=2026-09-20T09:05:14.807Z level=INFO msg="Uploading 1 narinfos"3809lb # [ 35.160636] niks3-server[994]: 2026/09/20 09:05:14 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3810lb # [ 35.169656] niks3-server[994]: 2026/09/20 09:05:14 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3811lb # [ 35.177839] niks3-server[994]: 2026/09/20 09:05:14 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3812lb # [ 35.183643] niks3-server[994]: 2026/09/20 09:05:14 INFO Completed upload id=13813worker1 # [ 35.189333] nix-grpc-daemon[841]: time=2026-09-20T09:05:14.841Z level=INFO msg="Upload complete. (560ms)"3814worker1 # [ 35.205337] nix-grpc-daemon[774]: ts=2026-09-20T09:05:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_in=5043815worker1 # [ 35.220697] nix-grpc-daemon[774]: ts=2026-09-20T09:05:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342583816worker1 # [ 35.233448] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3817worker1 # [ 35.237730] nix-daemon[831]: reaped child process 839, status = succeeded3818client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3819client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3820worker1 # [ 35.251419] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3821client # farm-a> LOG-farm-a-t13822worker1 # [ 36.094691] nix-daemon[831]: reaped child process 866, status = succeeded3823worker1 # [ 36.277669] nix-daemon[831]: accepted connection from pid 882, user nix-grpc-daemon (trusted)3824worker1 # [ 36.296527] nix-daemon[831]: reaped child process 885, status = succeeded3825lb # [ 36.303408] niks3-server[994]: 2026/09/20 09:05:15 INFO Received uploads request method=POST path=/api/pending_closures3826worker1 # [ 36.322092] nix-grpc-daemon[841]: time=2026-09-20T09:05:15.973Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3827worker1 # [ 36.323829] nix-grpc-daemon[841]: time=2026-09-20T09:05:15.973Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3828lb # [ 36.358136] niks3-server[994]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3829worker1 # [ 36.375247] nix-grpc-daemon[841]: time=2026-09-20T09:05:16.026Z level=INFO msg="Uploading 1 narinfos"3830lb # [ 36.371062] niks3-server[994]: 2026/09/20 09:05:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3831lb # [ 36.378999] niks3-server[994]: 2026/09/20 09:05:16 INFO Signed narinfos id=2 count=13832lb # [ 36.388319] niks3-server[994]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3833lb # [ 36.397516] niks3-server[994]: 2026/09/20 09:05:16 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3834lb # [ 36.401194] niks3-server[994]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3835lb # [ 36.405604] niks3-server[994]: 2026/09/20 09:05:16 INFO Completed upload id=23836worker1 # [ 36.410202] nix-grpc-daemon[841]: time=2026-09-20T09:05:16.062Z level=INFO msg="Upload complete. (347ms)"3837lb # [ 36.408239] niks3-server[994]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3838worker1 # [ 36.421041] nix-grpc-daemon[774]: ts=2026-09-20T09:05:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13839worker1 # [ 36.438506] nix-daemon[831]: reaped child process 864, status = succeeded3840worker2 # [ 36.478671] nix-grpc-daemon[775]: ts=2026-09-20T09:05:16Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03841worker2 # [ 36.484558] nix-grpc-daemon[775]: ts=2026-09-20T09:05:16Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13842worker1 # [ 36.481820] nix-grpc-daemon[774]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342583843worker1 # [ 36.499172] nix-grpc-daemon[774]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342583844worker1 # [ 36.514989] nix-grpc-daemon[841]: time=2026-09-20T09:05:16.167Z level=INFO msg="All 1 paths already cached"3845client # copying 1 paths to 'lb:50051'...3846worker1 # [ 36.525371] nix-grpc-daemon[774]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:342583847client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3848worker1 # [ 36.548537] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3849worker1 # [ 36.753763] nix-daemon[831]: accepted connection from pid 889, user nix-grpc-daemon (trusted)3850worker1 # [ 36.774148] nix-daemon[831]: reaped child process 892, status = succeeded3851worker1 # [ 36.942600] nix-daemon[831]: accepted connection from pid 894, user nix-grpc-daemon (trusted)3852worker1 # [ 36.961003] nix-daemon[831]: reaped child process 897, status = succeeded3853lb # [ 36.970094] niks3-server[994]: 2026/09/20 09:05:16 INFO Received uploads request method=POST path=/api/pending_closures3854worker1 # [ 36.986426] nix-grpc-daemon[841]: time=2026-09-20T09:05:16.638Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3855worker1 # [ 36.987969] nix-grpc-daemon[841]: time=2026-09-20T09:05:16.638Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3856lb # [ 37.007263] niks3-server[994]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3857lb # [ 37.017688] niks3-server[994]: 2026/09/20 09:05:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3858worker1 # [ 37.029392] nix-grpc-daemon[841]: time=2026-09-20T09:05:16.681Z level=INFO msg="Uploading 1 narinfos"3859lb # [ 37.029103] niks3-server[994]: 2026/09/20 09:05:16 INFO Signed narinfos id=3 count=13860lb # [ 37.031568] niks3-server[994]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3861lb # [ 37.040973] niks3-server[994]: 2026/09/20 09:05:16 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3862lb # [ 37.046938] niks3-server[994]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3863lb # [ 37.052038] niks3-server[994]: 2026/09/20 09:05:16 INFO Completed upload id=33864worker1 # [ 37.057260] nix-grpc-daemon[841]: time=2026-09-20T09:05:16.709Z level=INFO msg="Upload complete. (490ms)"3865worker1 # [ 37.064996] nix-grpc-daemon[774]: ts=2026-09-20T09:05:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_in=6243866worker1 # [ 37.078951] nix-grpc-daemon[774]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342583867worker1 # [ 37.085404] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3868worker1 # [ 37.090279] nix-daemon[831]: reaped child process 887, status = succeeded3869client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3870client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3871worker1 # [ 37.104461] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3872client # farm-b> LOG-farm-b-t13873worker1 # [ 37.949018] nix-daemon[831]: reaped child process 901, status = succeeded3874worker1 # [ 38.138809] nix-daemon[831]: accepted connection from pid 916, user nix-grpc-daemon (trusted)3875worker1 # [ 38.157283] nix-daemon[831]: reaped child process 919, status = succeeded3876lb # [ 38.165968] niks3-server[994]: 2026/09/20 09:05:17 INFO Received uploads request method=POST path=/api/pending_closures3877worker1 # [ 38.181735] nix-grpc-daemon[841]: time=2026-09-20T09:05:17.833Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3878worker1 # [ 38.183236] nix-grpc-daemon[841]: time=2026-09-20T09:05:17.833Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3879lb # [ 38.201484] niks3-server[994]: 2026/09/20 09:05:17 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3880lb # [ 38.214915] niks3-server[994]: 2026/09/20 09:05:17 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3881worker1 # [ 38.232623] nix-grpc-daemon[841]: time=2026-09-20T09:05:17.884Z level=INFO msg="Uploading 1 narinfos"3882lb # [ 38.227954] niks3-server[994]: 2026/09/20 09:05:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3883lb # [ 38.242487] niks3-server[994]: 2026/09/20 09:05:17 INFO Signed narinfos id=4 count=13884lb # [ 38.246711] niks3-server[994]: 2026/09/20 09:05:17 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3885worker1 # [ 38.261340] nix-grpc-daemon[841]: time=2026-09-20T09:05:17.913Z level=INFO msg="Upload complete. (346ms)"3886lb # [ 38.256732] niks3-server[994]: 2026/09/20 09:05:17 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3887lb # [ 38.262280] niks3-server[994]: 2026/09/20 09:05:17 INFO Completed upload id=43888lb # [ 38.265726] niks3-server[994]: 2026/09/20 09:05:17 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3889worker1 # [ 38.271492] nix-grpc-daemon[774]: ts=2026-09-20T09:05:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13890worker2 # [ 38.322861] nix-grpc-daemon[775]: ts=2026-09-20T09:05:17Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03891worker1 # [ 38.290907] nix-daemon[831]: reaped child process 899, status = succeeded3892worker1 # [ 38.331333] nix-grpc-daemon[774]: ts=2026-09-20T09:05:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342583893worker1 # [ 38.346587] nix-grpc-daemon[774]: ts=2026-09-20T09:05:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342583894worker1 # [ 38.361004] nix-grpc-daemon[841]: time=2026-09-20T09:05:18.013Z level=INFO msg="All 2 paths already cached"3895client # copying 1 paths to 'lb:50051'...3896worker1 # [ 38.371381] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:342583897client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3898worker1 # [ 38.394740] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3899worker1 # [ 38.603016] nix-daemon[831]: accepted connection from pid 923, user nix-grpc-daemon (trusted)3900worker1 # [ 38.621986] nix-daemon[831]: reaped child process 926, status = succeeded3901worker1 # [ 38.796856] nix-daemon[831]: accepted connection from pid 928, user nix-grpc-daemon (trusted)3902worker1 # [ 38.813224] nix-daemon[831]: reaped child process 931, status = succeeded3903lb # [ 38.821001] niks3-server[994]: 2026/09/20 09:05:18 INFO Received uploads request method=POST path=/api/pending_closures3904worker1 # [ 38.835863] nix-grpc-daemon[841]: time=2026-09-20T09:05:18.487Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3905worker1 # [ 38.837473] nix-grpc-daemon[841]: time=2026-09-20T09:05:18.488Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3906lb # [ 38.847602] niks3-server[994]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3907worker1 # [ 38.866257] nix-grpc-daemon[841]: time=2026-09-20T09:05:18.518Z level=INFO msg="Uploading 1 narinfos"3908lb # [ 38.865633] niks3-server[994]: 2026/09/20 09:05:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3909lb # [ 38.875479] niks3-server[994]: 2026/09/20 09:05:18 INFO Signed narinfos id=5 count=13910lb # [ 38.881829] niks3-server[994]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3911worker1 # [ 38.900609] nix-grpc-daemon[841]: time=2026-09-20T09:05:18.551Z level=INFO msg="Upload complete. (484ms)"3912lb # [ 38.894025] niks3-server[994]: 2026/09/20 09:05:18 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3913worker1 # [ 38.902703] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_in=7523914lb # [ 38.900720] niks3-server[994]: 2026/09/20 09:05:18 INFO Completed upload id=53915lb # [ 38.904651] niks3-server[994]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3916worker2 # [ 38.328523] nix-grpc-daemon[775]: ts=2026-09-20T09:05:17Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13917worker1 # [ 38.916370] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342583918worker1 # [ 38.929015] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3919worker1 # [ 38.933194] nix-daemon[831]: reaped child process 921, status = succeeded3920client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3921client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3922worker1 # [ 38.958084] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3923client # farm-top> LOG-farm-top-t13924worker1 # [ 40.612801] nix-daemon[831]: reaped child process 935, status = succeeded3925worker1 # [ 40.794598] nix-daemon[831]: accepted connection from pid 951, user nix-grpc-daemon (trusted)3926worker1 # [ 40.812321] nix-daemon[831]: reaped child process 954, status = succeeded3927lb # [ 40.822018] niks3-server[994]: 2026/09/20 09:05:20 INFO Received uploads request method=POST path=/api/pending_closures3928worker1 # [ 40.840654] nix-grpc-daemon[841]: time=2026-09-20T09:05:20.490Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3929worker1 # [ 40.843256] nix-grpc-daemon[841]: time=2026-09-20T09:05:20.490Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3930lb # [ 40.866764] niks3-server[994]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3931lb # [ 40.879791] niks3-server[994]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3932worker1 # [ 40.894168] nix-grpc-daemon[841]: time=2026-09-20T09:05:20.546Z level=INFO msg="Uploading 1 narinfos"3933lb # [ 40.889520] niks3-server[994]: 2026/09/20 09:05:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3934lb # [ 40.895947] niks3-server[994]: 2026/09/20 09:05:20 INFO Signed narinfos id=6 count=13935lb # [ 40.898154] niks3-server[994]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3936lb # [ 40.910832] niks3-server[994]: 2026/09/20 09:05:20 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3937lb # [ 40.916061] niks3-server[994]: 2026/09/20 09:05:20 INFO Completed upload id=63938worker1 # [ 40.921326] nix-grpc-daemon[841]: time=2026-09-20T09:05:20.573Z level=INFO msg="Upload complete. (347ms)"3939lb # [ 40.918693] niks3-server[994]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3940worker1 # [ 40.933156] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13941worker1 # [ 40.951951] nix-daemon[831]: reaped child process 933, status = succeeded3942client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.08 seconds)3943client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3944lb # [ 41.058938] envoy[911]: conn peer=[2001:db8:1::1]:42768 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1133945lb # [ 41.065274] envoy[911]: conn peer=[2001:db8:1::1]:42774 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=183946lb # [ 41.071493] envoy[911]: conn peer=[2001:db8:1::1]:42782 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=193947lb # [ 41.077079] envoy[911]: conn peer=[2001:db8:1::1]:42794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9536 tx=3862 ms=68363948client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds)3949client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3950client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)3951client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3952client # copying 3 paths...3953client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3954client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3955client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3956client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)3957(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.76 seconds)3958subtest: repeat is answered Cached by the scheduler without building3959worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3960worker1 # finding garbage collector roots...3961worker1 # deleting specified paths...3962worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3963worker1 # deleting unused links...3964worker1 # note: hard linking is currently saving 0.0 KiB3965worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.27 seconds)3966worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3967worker2 # finding garbage collector roots...3968worker2 # deleting specified paths...3969worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3970worker2 # deleting unused links...3971worker2 # note: hard linking is currently saving 0.0 KiB3972worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds)3973client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23974client # don't know how to build these paths:3975client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3976worker2 # [ 42.551355] nix-grpc-daemon[775]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473963977worker1 # [ 42.514265] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342583978worker1 # [ 42.522551] nix-grpc-daemon[841]: time=2026-09-20T09:05:22.174Z level=INFO msg="All 2 paths already cached"3979worker2 # [ 42.583274] nix-grpc-daemon[775]: ts=2026-09-20T09:05:22Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=13980client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.30 seconds)3981client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3982client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds)3983lb: must succeed: curl -sf localhost:9901/clusters3984lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)3985lb: must succeed: curl -sf localhost:9901/clusters3986lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3987worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true3988worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds)3989(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.46 seconds)3990subtest: inputs already in the cache are not sent to the scheduler3991lb: must succeed: curl -sf localhost:9901/clusters3992lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3993lb: must succeed: curl -sf localhost:9901/clusters3994lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3995worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true3996worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)3997client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&23998client # don't know how to build these paths:3999client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4000worker2 # [ 43.616614] nix-grpc-daemon[775]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473964001worker1 # [ 43.577061] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342584002worker1 # [ 43.588437] nix-grpc-daemon[841]: time=2026-09-20T09:05:23.239Z level=INFO msg="All 2 paths already cached"4003worker2 # [ 43.646356] nix-grpc-daemon[775]: ts=2026-09-20T09:05:23Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04004worker2 # [ 43.652734] nix-grpc-daemon[775]: ts=2026-09-20T09:05:23Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14005worker1 # [ 43.612959] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342584006worker1 # [ 43.628228] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342584007worker1 # [ 43.641811] nix-grpc-daemon[841]: time=2026-09-20T09:05:23.294Z level=INFO msg="All 2 paths already cached"4008client # copying 1 paths to 'lb:50051'...4009client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4010worker1 # [ 43.651416] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:342584011worker1 # [ 43.665615] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4012worker1 # [ 43.867438] nix-daemon[831]: accepted connection from pid 972, user nix-grpc-daemon (trusted)4013worker1 # [ 43.887570] nix-daemon[831]: reaped child process 975, status = succeeded4014worker1 # [ 44.061484] nix-daemon[831]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4015worker1 # [ 44.080537] nix-daemon[831]: reaped child process 980, status = succeeded4016lb # [ 44.087957] niks3-server[994]: 2026/09/20 09:05:23 INFO Received uploads request method=POST path=/api/pending_closures4017worker1 # [ 44.102596] nix-grpc-daemon[841]: time=2026-09-20T09:05:23.754Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4018worker1 # [ 44.104274] nix-grpc-daemon[841]: time=2026-09-20T09:05:23.754Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4019lb # [ 44.115252] niks3-server[994]: 2026/09/20 09:05:23 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4020worker1 # [ 44.135649] nix-grpc-daemon[841]: time=2026-09-20T09:05:23.787Z level=INFO msg="Uploading 1 narinfos"4021lb # [ 44.133702] niks3-server[994]: 2026/09/20 09:05:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4022lb # [ 44.144220] niks3-server[994]: 2026/09/20 09:05:23 INFO Signed narinfos id=7 count=14023lb # [ 44.148514] niks3-server[994]: 2026/09/20 09:05:23 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4024lb # [ 44.158614] niks3-server[994]: 2026/09/20 09:05:23 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4025lb # [ 44.164279] niks3-server[994]: 2026/09/20 09:05:23 INFO Completed upload id=74026worker1 # [ 44.169388] nix-grpc-daemon[841]: time=2026-09-20T09:05:23.821Z level=INFO msg="Upload complete. (487ms)"4027lb # [ 44.167426] niks3-server[994]: 2026/09/20 09:05:23 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4028worker1 # [ 44.176294] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_in=7524029worker1 # [ 44.191553] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342584030worker1 # [ 44.198627] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4031worker1 # [ 44.203701] nix-daemon[831]: reaped child process 970, status = succeeded4032client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4033client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4034worker1 # [ 44.218658] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4035worker1 # [ 45.038563] nix-daemon[831]: reaped child process 984, status = succeeded4036client # farm-top> LOG-farm-top-t1b4037worker1 # [ 45.195571] nix-daemon[831]: accepted connection from pid 999, user nix-grpc-daemon (trusted)4038worker1 # [ 45.214633] nix-daemon[831]: reaped child process 1002, status = succeeded4039lb # [ 45.227535] niks3-server[994]: 2026/09/20 09:05:24 INFO Received uploads request method=POST path=/api/pending_closures4040worker1 # [ 45.244426] nix-grpc-daemon[841]: time=2026-09-20T09:05:24.895Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4041worker1 # [ 45.245959] nix-grpc-daemon[841]: time=2026-09-20T09:05:24.895Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4042lb # [ 45.270638] niks3-server[994]: 2026/09/20 09:05:24 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4043lb # [ 45.281902] niks3-server[994]: 2026/09/20 09:05:24 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4044worker1 # [ 45.296484] nix-grpc-daemon[841]: time=2026-09-20T09:05:24.948Z level=INFO msg="Uploading 1 narinfos"4045lb # [ 45.296697] niks3-server[994]: 2026/09/20 09:05:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4046lb # [ 45.305653] niks3-server[994]: 2026/09/20 09:05:24 INFO Signed narinfos id=8 count=14047lb # [ 45.309823] niks3-server[994]: 2026/09/20 09:05:24 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4048worker1 # [ 45.323075] nix-grpc-daemon[841]: time=2026-09-20T09:05:24.975Z level=INFO msg="Upload complete. (295ms)"4049lb # [ 45.319135] niks3-server[994]: 2026/09/20 09:05:24 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4050lb # [ 45.324985] niks3-server[994]: 2026/09/20 09:05:24 INFO Completed upload id=84051lb # [ 45.327851] niks3-server[994]: 2026/09/20 09:05:24 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4052worker1 # [ 45.337031] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14053worker1 # [ 45.346352] nix-daemon[831]: reaped child process 982, status = succeeded4054client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.06 seconds)4055client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4056client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.26 seconds)4057lb: must succeed: curl -sf localhost:9901/clusters4058lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4059lb: must succeed: curl -sf localhost:9901/clusters4060lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4061worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4062worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4063(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.71 seconds)4064subtest: two clients wanting the same drv build it once4065client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4066client # [ 45.949036] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4067client # Running as unit: dedup1.service; invocation ID: da34398a0dcf461cb9d37e478ff760ff4068client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4069client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4070client # [ 46.198944] nix[886]: don't know how to build these paths:4071client # [ 46.199967] nix[886]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4072worker1 # [ 46.164891] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:342584073worker2 # [ 46.224388] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04074worker2 # [ 46.224800] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14075worker2 # [ 46.269013] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473964076worker2 # [ 46.289828] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473964077client # [ 46.292149] nix[886]: copying 1 paths to 'lb:50051'...4078client # [ 46.297411] nix[886]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4079worker2 # [ 46.307995] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473964080worker2 # [ 46.324469] nix-daemon[836]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4081worker2 # [ 46.353466] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=info event=niks3_push_started pid=8914082worker2 # [ 46.809004] nix-daemon[836]: accepted connection from pid 904, user nix-grpc-daemon (trusted)4083worker2 # [ 46.829802] nix-daemon[836]: reaped child process 907, status = succeeded4084worker2 # [ 47.003335] nix-daemon[836]: accepted connection from pid 909, user nix-grpc-daemon (trusted)4085worker2 # [ 47.022163] nix-daemon[836]: reaped child process 912, status = succeeded4086lb # [ 46.986675] niks3-server[994]: 2026/09/20 09:05:26 INFO Received uploads request method=POST path=/api/pending_closures4087worker2 # [ 47.046452] nix-grpc-daemon[891]: time=2026-09-20T09:05:26.688Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4088worker2 # [ 47.050289] nix-grpc-daemon[891]: time=2026-09-20T09:05:26.689Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4089lb # [ 47.028662] niks3-server[994]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4090client # [ 47.063697] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4091worker2 # [ 47.092357] nix-grpc-daemon[891]: time=2026-09-20T09:05:26.734Z level=INFO msg="Uploading 1 narinfos"4092lb # [ 47.043540] niks3-server[994]: 2026/09/20 09:05:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4093lb # [ 47.055245] niks3-server[994]: 2026/09/20 09:05:26 INFO Signed narinfos id=9 count=14094client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4095lb # [ 47.061488] niks3-server[994]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4096worker2 # [ 47.124614] nix-grpc-daemon[891]: time=2026-09-20T09:05:26.767Z level=INFO msg="Upload complete. (496ms)"4097lb # [ 47.076395] niks3-server[994]: 2026/09/20 09:05:26 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4098lb # [ 47.083629] niks3-server[994]: 2026/09/20 09:05:26 INFO Completed upload id=94099worker2 # [ 47.131817] nix-grpc-daemon[775]: ts=2026-09-20T09:05:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47396 duration_s=0 paths=1 nar_bytes_in=4324100lb # [ 47.087725] niks3-server[994]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4101worker2 # [ 47.146505] nix-grpc-daemon[775]: ts=2026-09-20T09:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473964102worker2 # [ 47.156253] nix-daemon[836]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4103worker2 # [ 47.159117] nix-daemon[836]: reaped child process 889, status = succeeded4104client # Running as unit: dedup2.service; invocation ID: 4ec8fa63ceb34c8caa1a1a9479ca70154105client # [ 47.158466] nix[886]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4106worker2 # [ 47.170115] nix-daemon[836]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4107worker2 # [ 47.397151] nix-grpc-daemon[775]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473964108client # [ 47.400847] nix[902]: this derivation will be built:4109worker1 # [ 47.374439] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:342584110worker1 # [ 47.388078] nix-grpc-daemon[774]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'...4111client # [ 47.444153] nix[902]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4112worker2 # [ 47.468149] nix-grpc-daemon[775]: ts=2026-09-20T09:05:27Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04113worker2 # [ 47.483347] nix-grpc-daemon[775]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473964114client # [ 47.480111] nix[902]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4115client: must succeed: sleep 24116lb # [ 51.054704] envoy[911]: conn peer=[2001:db8:1::1]:36878 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=634117lb # [ 51.059593] envoy[911]: conn peer=[2001:db8:1::1]:36880 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4142 tx=1709 ms=17794118client: (finished: must succeed: sleep 2, in 2.06 seconds)4119??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4120 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394121client: waiting for success: ! systemctl is-active dedup1 dedup24122??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4123 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394124worker2 # [ 52.025920] nix-daemon[836]: reaped child process 916, status = succeeded4125worker2 # [ 52.207630] nix-daemon[836]: accepted connection from pid 951, user nix-grpc-daemon (trusted)4126worker2 # [ 52.223644] nix-daemon[836]: reaped child process 954, status = succeeded4127lb # [ 52.191452] niks3-server[994]: 2026/09/20 09:05:31 INFO Received uploads request method=POST path=/api/pending_closures4128worker2 # [ 52.250940] nix-grpc-daemon[891]: time=2026-09-20T09:05:31.892Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4129worker2 # [ 52.253095] nix-grpc-daemon[891]: time=2026-09-20T09:05:31.892Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4130lb # [ 52.230703] niks3-server[994]: 2026/09/20 09:05:31 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4131lb # [ 52.245710] niks3-server[994]: 2026/09/20 09:05:31 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4132lb # [ 52.258061] niks3-server[994]: 2026/09/20 09:05:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4133lb # [ 52.265850] niks3-server[994]: 2026/09/20 09:05:31 INFO Signed narinfos id=10 count=14134worker2 # [ 52.314260] nix-grpc-daemon[891]: time=2026-09-20T09:05:31.955Z level=INFO msg="Uploading 1 narinfos"4135lb # [ 52.269600] niks3-server[994]: 2026/09/20 09:05:31 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4136lb # [ 52.284960] niks3-server[994]: 2026/09/20 09:05:31 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4137lb # [ 52.292126] niks3-server[994]: 2026/09/20 09:05:31 INFO Completed upload id=104138worker2 # [ 52.339151] nix-grpc-daemon[891]: time=2026-09-20T09:05:31.981Z level=INFO msg="Upload complete. (350ms)"4139lb # [ 52.295204] niks3-server[994]: 2026/09/20 09:05:31 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4140worker2 # [ 52.356912] nix-grpc-daemon[775]: ts=2026-09-20T09:05:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47396 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14141worker2 # [ 52.369442] nix-grpc-daemon[775]: ts=2026-09-20T09:05:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47396 duration_s=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14142worker2 # [ 52.375288] nix-daemon[836]: reaped child process 914, status = succeeded4143client # [ 52.388794] systemd[1]: dedup1.service: Deactivated successfully.4144client # [ 52.397549] systemd[1]: dedup1.service: Consumed 155ms CPU time over 6.444s wall clock time, 37.2M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.4145client # [ 52.433012] systemd[1]: dedup2.service: Deactivated successfully.4146client # [ 52.435307] systemd[1]: dedup2.service: Consumed 181ms CPU time over 5.372s wall clock time, 27M memory peak, 7.9K incoming IP traffic, 6.5K outgoing IP traffic.4147client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds)4148client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4149client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4150worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4151worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4152worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4153worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4154worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4155worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4156worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4157worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4158(finished: subtest: two clients wanting the same drv build it once, in 7.47 seconds)4159subtest: build hook: nix-daemon with builders = grpc://lb4160client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4161client # [ 53.564543] systemd[1]: Started Nix Daemon.4162client # [ 53.756573] nix-daemon[943]: accepted connection from pid 940, user root (trusted)4163worker1 # [ 53.923310] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:342584164worker2 # [ 53.973024] nix-grpc-daemon[775]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473964165worker2 # [ 53.986865] nix-grpc-daemon[775]: ts=2026-09-20T09:05:33Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04166worker1 # [ 53.948969] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342584167worker2 # [ 53.993078] nix-grpc-daemon[775]: ts=2026-09-20T09:05:33Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14168worker1 # [ 53.967936] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342584169worker1 # [ 53.982191] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:342584170worker1 # [ 53.997291] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4171worker1 # [ 54.201252] nix-daemon[831]: accepted connection from pid 1035, user nix-grpc-daemon (trusted)4172worker1 # [ 54.220279] nix-daemon[831]: reaped child process 1038, status = succeeded4173worker1 # [ 54.394378] nix-daemon[831]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4174worker1 # [ 54.411212] nix-daemon[831]: reaped child process 1043, status = succeeded4175lb # [ 54.418140] niks3-server[994]: 2026/09/20 09:05:34 INFO Received uploads request method=POST path=/api/pending_closures4176worker1 # [ 54.433901] nix-grpc-daemon[841]: time=2026-09-20T09:05:34.085Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4177worker1 # [ 54.435378] nix-grpc-daemon[841]: time=2026-09-20T09:05:34.085Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4178lb # [ 54.451324] niks3-server[994]: 2026/09/20 09:05:34 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4179worker1 # [ 54.478101] nix-grpc-daemon[841]: time=2026-09-20T09:05:34.130Z level=INFO msg="Uploading 1 narinfos"4180lb # [ 54.465726] niks3-server[994]: 2026/09/20 09:05:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4181lb # [ 54.478641] niks3-server[994]: 2026/09/20 09:05:34 INFO Signed narinfos id=11 count=14182lb # [ 54.486558] niks3-server[994]: 2026/09/20 09:05:34 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4183lb # [ 54.497892] niks3-server[994]: 2026/09/20 09:05:34 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4184lb # [ 54.502994] niks3-server[994]: 2026/09/20 09:05:34 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4185lb # [ 54.507707] niks3-server[994]: 2026/09/20 09:05:34 INFO Completed upload id=114186worker1 # [ 54.513706] nix-grpc-daemon[841]: time=2026-09-20T09:05:34.166Z level=INFO msg="Upload complete. (498ms)"4187worker1 # [ 54.523594] nix-grpc-daemon[774]: ts=2026-09-20T09:05:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_in=5124188worker1 # [ 54.537582] nix-grpc-daemon[774]: ts=2026-09-20T09:05:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342584189worker1 # [ 54.546990] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4190worker1 # [ 54.549591] nix-daemon[831]: reaped child process 1033, status = succeeded4191worker1 # [ 54.563733] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4192worker1 # [ 55.212863] nix-daemon[831]: reaped child process 1047, status = succeeded4193worker1 # [ 55.383210] nix-daemon[831]: accepted connection from pid 1062, user nix-grpc-daemon (trusted)4194worker1 # [ 55.402091] nix-daemon[831]: reaped child process 1065, status = succeeded4195lb # [ 55.408673] niks3-server[994]: 2026/09/20 09:05:35 INFO Received uploads request method=POST path=/api/pending_closures4196worker1 # [ 55.424098] nix-grpc-daemon[841]: time=2026-09-20T09:05:35.075Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4197worker1 # [ 55.425747] nix-grpc-daemon[841]: time=2026-09-20T09:05:35.075Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4198lb # [ 55.448911] niks3-server[994]: 2026/09/20 09:05:35 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4199lb # [ 55.464622] niks3-server[994]: 2026/09/20 09:05:35 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4200lb # [ 55.474065] niks3-server[994]: 2026/09/20 09:05:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4201worker1 # [ 55.485495] nix-grpc-daemon[841]: time=2026-09-20T09:05:35.136Z level=INFO msg="Uploading 1 narinfos"4202lb # [ 55.479240] niks3-server[994]: 2026/09/20 09:05:35 INFO Signed narinfos id=12 count=14203lb # [ 55.488449] niks3-server[994]: 2026/09/20 09:05:35 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4204worker1 # [ 55.504510] nix-grpc-daemon[841]: time=2026-09-20T09:05:35.156Z level=INFO msg="Upload complete. (330ms)"4205lb # [ 55.499273] niks3-server[994]: 2026/09/20 09:05:35 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4206lb # [ 55.503886] niks3-server[994]: 2026/09/20 09:05:35 INFO Completed upload id=124207lb # [ 55.506956] niks3-server[994]: 2026/09/20 09:05:35 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4208worker1 # [ 55.515659] nix-grpc-daemon[774]: ts=2026-09-20T09:05:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14209worker1 # [ 55.530086] nix-daemon[831]: reaped child process 1045, status = succeeded4210worker2 # [ 55.605320] nix-grpc-daemon[775]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:473964211worker2 # [ 55.621889] nix-grpc-daemon[775]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4212worker1 # [ 55.626748] nix-grpc-daemon[774]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:342584213worker1 # [ 55.633843] nix-grpc-daemon[774]: ts=2026-09-20T09:05:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_out=1284214worker2 # [ 55.949643] nix-grpc-daemon[775]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:473964215worker2 # [ 55.957498] nix-grpc-daemon[775]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473964216worker2 # [ 55.965218] nix-grpc-daemon[891]: time=2026-09-20T09:05:35.606Z level=INFO msg="All 1 paths already cached"4217worker2 # [ 55.977756] nix-grpc-daemon[775]: ts=2026-09-20T09:05:35Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04218worker2 # [ 55.983820] nix-grpc-daemon[775]: ts=2026-09-20T09:05:35Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14219worker1 # [ 55.981296] nix-grpc-daemon[774]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342584220worker1 # [ 55.998520] nix-grpc-daemon[774]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342584221worker1 # [ 56.013868] nix-grpc-daemon[841]: time=2026-09-20T09:05:35.666Z level=INFO msg="All 1 paths already cached"4222worker1 # [ 56.023800] nix-grpc-daemon[774]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:342584223worker1 # [ 56.041806] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4224worker1 # [ 56.248535] nix-daemon[831]: accepted connection from pid 1069, user nix-grpc-daemon (trusted)4225worker1 # [ 56.266252] nix-daemon[831]: reaped child process 1072, status = succeeded4226worker1 # [ 56.439052] nix-daemon[831]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4227worker1 # [ 56.457889] nix-daemon[831]: reaped child process 1077, status = succeeded4228lb # [ 56.464795] niks3-server[994]: 2026/09/20 09:05:36 INFO Received uploads request method=POST path=/api/pending_closures4229worker1 # [ 56.479015] nix-grpc-daemon[841]: time=2026-09-20T09:05:36.131Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4230worker1 # [ 56.480679] nix-grpc-daemon[841]: time=2026-09-20T09:05:36.131Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4231lb # [ 56.497492] niks3-server[994]: 2026/09/20 09:05:36 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4232lb # [ 56.510318] niks3-server[994]: 2026/09/20 09:05:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4233worker1 # [ 56.522196] nix-grpc-daemon[841]: time=2026-09-20T09:05:36.173Z level=INFO msg="Uploading 1 narinfos"4234lb # [ 56.520932] niks3-server[994]: 2026/09/20 09:05:36 INFO Signed narinfos id=13 count=14235lb # [ 56.523626] niks3-server[994]: 2026/09/20 09:05:36 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4236lb # [ 56.532510] niks3-server[994]: 2026/09/20 09:05:36 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4237worker1 # [ 56.544473] nix-grpc-daemon[841]: time=2026-09-20T09:05:36.196Z level=INFO msg="Upload complete. (485ms)"4238lb # [ 56.539597] niks3-server[994]: 2026/09/20 09:05:36 INFO Completed upload id=134239lb # [ 56.542684] niks3-server[994]: 2026/09/20 09:05:36 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4240worker1 # [ 56.552902] nix-grpc-daemon[774]: ts=2026-09-20T09:05:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_in=6244241worker1 # [ 56.566049] nix-grpc-daemon[774]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342584242worker1 # [ 56.574212] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4243worker1 # [ 56.577061] nix-daemon[831]: reaped child process 1067, status = succeeded4244worker1 # [ 56.589502] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4245worker1 # [ 57.630787] nix-daemon[831]: reaped child process 1081, status = succeeded4246worker1 # [ 57.814520] nix-daemon[831]: accepted connection from pid 1096, user nix-grpc-daemon (trusted)4247worker1 # [ 57.832319] nix-daemon[831]: reaped child process 1099, status = succeeded4248lb # [ 57.839712] niks3-server[994]: 2026/09/20 09:05:37 INFO Received uploads request method=POST path=/api/pending_closures4249worker1 # [ 57.854903] nix-grpc-daemon[841]: time=2026-09-20T09:05:37.506Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4250worker1 # [ 57.856471] nix-grpc-daemon[841]: time=2026-09-20T09:05:37.506Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4251lb # [ 57.874592] niks3-server[994]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4252worker1 # [ 57.893688] nix-grpc-daemon[841]: time=2026-09-20T09:05:37.545Z level=INFO msg="Uploading 1 narinfos"4253lb # [ 57.888309] niks3-server[994]: 2026/09/20 09:05:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4254lb # [ 57.898247] niks3-server[994]: 2026/09/20 09:05:37 INFO Signed narinfos id=14 count=14255lb # [ 57.906612] niks3-server[994]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4256lb # [ 57.914031] niks3-server[994]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4257lb # [ 57.921832] niks3-server[994]: 2026/09/20 09:05:37 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4258worker1 # [ 57.931598] nix-grpc-daemon[841]: time=2026-09-20T09:05:37.583Z level=INFO msg="Upload complete. (332ms)"4259lb # [ 57.927268] niks3-server[994]: 2026/09/20 09:05:37 INFO Completed upload id=144260lb # [ 57.931157] niks3-server[994]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4261worker1 # [ 57.940985] nix-grpc-daemon[774]: ts=2026-09-20T09:05:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14262worker1 # [ 57.955003] nix-daemon[831]: reaped child process 1079, status = succeeded4263worker1 # [ 57.984670] nix-grpc-daemon[774]: ts=2026-09-20T09:05:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:342584264worker1 # [ 58.016138] nix-grpc-daemon[774]: ts=2026-09-20T09:05:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:342584265worker1 # [ 58.022724] nix-grpc-daemon[774]: ts=2026-09-20T09:05:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_out=1764266worker2 # [ 58.379712] nix-grpc-daemon[775]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:473964267worker2 # [ 58.387405] nix-grpc-daemon[775]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473964268worker2 # [ 58.401141] nix-grpc-daemon[891]: time=2026-09-20T09:05:38.042Z level=INFO msg="All 1 paths already cached"4269worker2 # [ 58.414409] nix-grpc-daemon[775]: ts=2026-09-20T09:05:38Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04270worker2 # [ 58.420995] nix-grpc-daemon[775]: ts=2026-09-20T09:05:38Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14271worker1 # [ 58.381347] nix-grpc-daemon[774]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342584272worker1 # [ 58.396824] nix-grpc-daemon[774]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342584273worker1 # [ 58.410568] nix-grpc-daemon[841]: time=2026-09-20T09:05:38.062Z level=INFO msg="All 2 paths already cached"4274worker1 # [ 58.420976] nix-grpc-daemon[774]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:342584275worker1 # [ 58.434179] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4276worker1 # [ 58.631905] nix-daemon[831]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)4277worker1 # [ 58.651861] nix-daemon[831]: reaped child process 1106, status = succeeded4278worker1 # [ 58.825314] nix-daemon[831]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)4279worker1 # [ 58.842443] nix-daemon[831]: reaped child process 1111, status = succeeded4280lb # [ 58.849584] niks3-server[994]: 2026/09/20 09:05:38 INFO Received uploads request method=POST path=/api/pending_closures4281worker1 # [ 58.864370] nix-grpc-daemon[841]: time=2026-09-20T09:05:38.516Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4282worker1 # [ 58.865854] nix-grpc-daemon[841]: time=2026-09-20T09:05:38.516Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4283lb # [ 58.880658] niks3-server[994]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4284worker1 # [ 58.897367] nix-grpc-daemon[841]: time=2026-09-20T09:05:38.549Z level=INFO msg="Uploading 1 narinfos"4285lb # [ 58.895941] niks3-server[994]: 2026/09/20 09:05:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4286lb # [ 58.905846] niks3-server[994]: 2026/09/20 09:05:38 INFO Signed narinfos id=15 count=14287lb # [ 58.913805] niks3-server[994]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4288lb # [ 58.917697] niks3-server[994]: 2026/09/20 09:05:38 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4289worker1 # [ 58.926852] nix-grpc-daemon[841]: time=2026-09-20T09:05:38.579Z level=INFO msg="Upload complete. (475ms)"4290lb # [ 58.922179] niks3-server[994]: 2026/09/20 09:05:38 INFO Completed upload id=154291lb # [ 58.924940] niks3-server[994]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4292worker1 # [ 58.936232] nix-grpc-daemon[774]: ts=2026-09-20T09:05:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_in=7524293worker1 # [ 58.946625] nix-grpc-daemon[774]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342584294worker1 # [ 58.956218] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4295worker1 # [ 58.958350] nix-daemon[831]: reaped child process 1101, status = succeeded4296worker1 # [ 58.971220] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4297worker1 # [ 60.212913] nix-daemon[831]: reaped child process 1115, status = succeeded4298worker1 # [ 60.385230] nix-daemon[831]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)4299worker1 # [ 60.404448] nix-daemon[831]: reaped child process 1133, status = succeeded4300lb # [ 60.411738] niks3-server[994]: 2026/09/20 09:05:40 INFO Received uploads request method=POST path=/api/pending_closures4301worker1 # [ 60.428385] nix-grpc-daemon[841]: time=2026-09-20T09:05:40.078Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4302worker1 # [ 60.429852] nix-grpc-daemon[841]: time=2026-09-20T09:05:40.078Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4303lb # [ 60.458242] niks3-server[994]: 2026/09/20 09:05:40 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4304lb # [ 60.469945] niks3-server[994]: 2026/09/20 09:05:40 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4305lb # [ 60.479136] niks3-server[994]: 2026/09/20 09:05:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4306worker1 # [ 60.490891] nix-grpc-daemon[841]: time=2026-09-20T09:05:40.142Z level=INFO msg="Uploading 1 narinfos"4307lb # [ 60.487238] niks3-server[994]: 2026/09/20 09:05:40 INFO Signed narinfos id=16 count=14308lb # [ 60.491905] niks3-server[994]: 2026/09/20 09:05:40 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4309lb # [ 60.499214] niks3-server[994]: 2026/09/20 09:05:40 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4310lb # [ 60.507158] niks3-server[994]: 2026/09/20 09:05:40 INFO Completed upload id=164311worker1 # [ 60.512362] nix-grpc-daemon[841]: time=2026-09-20T09:05:40.164Z level=INFO msg="Upload complete. (331ms)"4312lb # [ 60.509709] niks3-server[994]: 2026/09/20 09:05:40 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4313worker1 # [ 60.526307] nix-grpc-daemon[774]: ts=2026-09-20T09:05:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14314worker1 # [ 60.541986] nix-grpc-daemon[774]: ts=2026-09-20T09:05:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:342584315worker1 # [ 60.546681] nix-daemon[831]: reaped child process 1113, status = succeeded4316worker1 # [ 60.551974] nix-grpc-daemon[774]: ts=2026-09-20T09:05:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:342584317worker1 # [ 60.556658] nix-grpc-daemon[774]: ts=2026-09-20T09:05:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_out=2324318client # [ 60.715086] nix-daemon[943]: reaped child process 945, status = succeeded4319client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.40 seconds)4320client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4321client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4322client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4323client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4324client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4325client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4326(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.53 seconds)4327subtest: an input only one worker has still reaches the builder4328client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4329client # this derivation will be built:4330client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4331lb # [ 61.056403] envoy[911]: conn peer=[2001:db8:1::1]:36882 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1373 ms=61624332lb # [ 61.056664] envoy[911]: conn peer=[2001:db8:1::1]:36898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1487 ms=50134333lb # [ 61.056841] envoy[911]: conn peer=[2001:db8:1::1]:44962 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3392 tx=1751 ms=17334334lb # [ 61.056944] envoy[911]: conn peer=[2001:db8:1::1]:44970 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=364335lb # [ 61.057039] envoy[911]: conn peer=[2001:db8:1::1]:44976 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3892 tx=1869 ms=21754336lb # [ 61.057134] envoy[911]: conn peer=[2001:db8:1::1]:44978 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=714337lb # [ 61.057229] envoy[911]: conn peer=[2001:db8:1::1]:44992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4313 tx=2104 ms=22744338lb # [ 61.057324] envoy[911]: conn peer=[2001:db8:1::1]:45004 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=634339client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4340client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds)4341client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4342client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4343worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4344worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.23 seconds)4345worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4346worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4347client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24348client # [ 61.986355] nix-daemon[943]: accepted connection from pid 1026, user root (trusted)4349client # this derivation will be built:4350client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4351worker2 # [ 62.196621] nix-grpc-daemon[775]: ts=2026-09-20T09:05:41Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:473964352client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4353worker1 # [ 62.159095] nix-grpc-daemon[774]: ts=2026-09-20T09:05:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342584354worker1 # [ 62.364986] nix-daemon[831]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)4355worker1 # [ 62.382404] nix-daemon[831]: reaped child process 1143, status = succeeded4356lb # [ 62.389673] niks3-server[994]: 2026/09/20 09:05:42 INFO Received uploads request method=POST path=/api/pending_closures4357worker1 # [ 62.404139] nix-grpc-daemon[841]: time=2026-09-20T09:05:42.055Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4358worker1 # [ 62.405605] nix-grpc-daemon[841]: time=2026-09-20T09:05:42.056Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4359lb # [ 62.415372] niks3-server[994]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4360worker1 # [ 62.442198] nix-grpc-daemon[841]: time=2026-09-20T09:05:42.094Z level=INFO msg="Uploading 1 narinfos"4361lb # [ 62.430968] niks3-server[994]: 2026/09/20 09:05:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4362lb # [ 62.443128] niks3-server[994]: 2026/09/20 09:05:42 INFO Signed narinfos id=17 count=14363lb # [ 62.449267] niks3-server[994]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4364lb # [ 62.457635] niks3-server[994]: 2026/09/20 09:05:42 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4365lb # [ 62.462940] niks3-server[994]: 2026/09/20 09:05:42 INFO Completed upload id=174366worker1 # [ 62.468162] nix-grpc-daemon[841]: time=2026-09-20T09:05:42.120Z level=INFO msg="Upload complete. (303ms)"4367lb # [ 62.465976] niks3-server[994]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4368worker2 # [ 62.536257] nix-grpc-daemon[775]: ts=2026-09-20T09:05:42Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04369worker2 # [ 62.543843] nix-grpc-daemon[775]: ts=2026-09-20T09:05:42Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14370worker2 # [ 62.584580] nix-grpc-daemon[775]: ts=2026-09-20T09:05:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473964371worker2 # [ 62.600140] nix-grpc-daemon[775]: ts=2026-09-20T09:05:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473964372client # copying 2 paths to 'lb:50051'...4373client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4374worker2 # [ 62.620120] nix-grpc-daemon[775]: ts=2026-09-20T09:05:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473964375client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4376worker2 # [ 62.634987] nix-daemon[836]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4377worker2 # [ 62.846876] nix-daemon[836]: accepted connection from pid 981, user nix-grpc-daemon (trusted)4378worker2 # [ 62.866447] nix-daemon[836]: reaped child process 984, status = succeeded4379worker2 # [ 63.041861] nix-daemon[836]: accepted connection from pid 986, user nix-grpc-daemon (trusted)4380worker2 # [ 63.061441] nix-daemon[836]: reaped child process 989, status = succeeded4381lb # [ 63.024488] niks3-server[994]: 2026/09/20 09:05:42 INFO Received uploads request method=POST path=/api/pending_closures4382lb # [ 63.034629] niks3-server[994]: 2026/09/20 09:05:42 INFO Received uploads request method=POST path=/api/pending_closures4383worker2 # [ 63.092584] nix-grpc-daemon[891]: time=2026-09-20T09:05:42.734Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4384worker2 # [ 63.094111] nix-grpc-daemon[891]: time=2026-09-20T09:05:42.734Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4385worker2 # [ 63.095810] nix-grpc-daemon[891]: time=2026-09-20T09:05:42.734Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4386lb # [ 63.074891] niks3-server[994]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4387lb # [ 63.085699] niks3-server[994]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4388lb # [ 63.098725] niks3-server[994]: 2026/09/20 09:05:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4389worker2 # [ 63.155367] nix-grpc-daemon[891]: time=2026-09-20T09:05:42.797Z level=INFO msg="Uploading 3 narinfos"4390lb # [ 63.109651] niks3-server[994]: 2026/09/20 09:05:42 INFO Signed narinfos id=18 count=14391lb # [ 63.111623] niks3-server[994]: 2026/09/20 09:05:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4392lb # [ 63.121425] niks3-server[994]: 2026/09/20 09:05:42 INFO Signed narinfos id=19 count=24393lb # [ 63.123262] niks3-server[994]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4394lb # [ 63.130974] niks3-server[994]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4395lb # [ 63.143607] niks3-server[994]: 2026/09/20 09:05:42 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4396lb # [ 63.152420] niks3-server[994]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4397lb # [ 63.154592] niks3-server[994]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4398lb # [ 63.157865] niks3-server[994]: 2026/09/20 09:05:42 INFO Completed upload id=184399lb # [ 63.160825] niks3-server[994]: 2026/09/20 09:05:42 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4400lb # [ 63.162896] niks3-server[994]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4401lb # [ 63.165468] niks3-server[994]: 2026/09/20 09:05:42 INFO Completed upload id=194402worker2 # [ 63.213811] nix-grpc-daemon[891]: time=2026-09-20T09:05:42.856Z level=INFO msg="Upload complete. (558ms)"4403worker2 # [ 63.224949] nix-grpc-daemon[775]: ts=2026-09-20T09:05:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47396 duration_s=0 paths=2 nar_bytes_in=9844404worker2 # [ 63.240384] nix-grpc-daemon[775]: ts=2026-09-20T09:05:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473964405worker2 # [ 63.257016] nix-daemon[836]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4406worker2 # [ 63.261734] nix-daemon[836]: reaped child process 979, status = succeeded4407worker2 # [ 63.279951] nix-grpc-daemon[775]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4408client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4409worker2 # [ 63.299264] nix-daemon[836]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4410client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4411worker2 # [ 64.531273] nix-daemon[836]: reaped child process 994, status = succeeded4412worker2 # [ 64.702165] nix-daemon[836]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)4413worker2 # [ 64.721653] nix-daemon[836]: reaped child process 1012, status = succeeded4414lb # [ 64.689797] niks3-server[994]: 2026/09/20 09:05:44 INFO Received uploads request method=POST path=/api/pending_closures4415worker2 # [ 64.752150] nix-grpc-daemon[891]: time=2026-09-20T09:05:44.393Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4416lb # [ 64.727217] niks3-server[994]: 2026/09/20 09:05:44 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4417lb # [ 64.739813] niks3-server[994]: 2026/09/20 09:05:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4418worker2 # [ 64.792912] nix-grpc-daemon[891]: time=2026-09-20T09:05:44.435Z level=INFO msg="Uploading 1 narinfos"4419lb # [ 64.749793] niks3-server[994]: 2026/09/20 09:05:44 INFO Signed narinfos id=20 count=14420lb # [ 64.755009] niks3-server[994]: 2026/09/20 09:05:44 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4421lb # [ 64.765016] niks3-server[994]: 2026/09/20 09:05:44 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4422lb # [ 64.773496] niks3-server[994]: 2026/09/20 09:05:44 INFO Completed upload id=204423worker2 # [ 64.821373] nix-grpc-daemon[891]: time=2026-09-20T09:05:44.464Z level=INFO msg="Upload complete. (305ms)"4424lb # [ 64.775821] niks3-server[994]: 2026/09/20 09:05:44 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4425worker2 # [ 64.833115] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47396 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14426worker2 # [ 64.848412] nix-daemon[836]: reaped child process 991, status = succeeded4427client # copying 1 paths...4428worker2 # [ 64.878242] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:473964429client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4430worker1 # [ 64.869249] nix-grpc-daemon[774]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:342584431worker1 # [ 64.887484] nix-grpc-daemon[774]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4432worker1 # [ 64.906949] nix-grpc-daemon[774]: ts=2026-09-20T09:05:44Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_out=1204433client # [ 65.074342] nix-daemon[943]: reaped child process 1029, status = succeeded4434client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.32 seconds)4435client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24436client # [ 65.332682] nix-daemon[943]: accepted connection from pid 1048, user root (trusted)4437client # this derivation will be built:4438client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4439worker1 # [ 65.511354] nix-grpc-daemon[774]: ts=2026-09-20T09:05:45Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:342584440worker2 # [ 65.558754] nix-grpc-daemon[775]: ts=2026-09-20T09:05:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473964441client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4442worker2 # [ 65.571577] nix-grpc-daemon[891]: time=2026-09-20T09:05:45.214Z level=INFO msg="All 1 paths already cached"4443worker2 # [ 65.590868] nix-grpc-daemon[775]: ts=2026-09-20T09:05:45Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04444worker2 # [ 65.597683] nix-grpc-daemon[775]: ts=2026-09-20T09:05:45Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14445worker1 # [ 65.557995] nix-grpc-daemon[774]: ts=2026-09-20T09:05:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342584446worker1 # [ 65.574977] nix-grpc-daemon[774]: ts=2026-09-20T09:05:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342584447client # copying 1 paths to 'lb:50051'...4448client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4449worker1 # [ 65.598568] nix-grpc-daemon[774]: ts=2026-09-20T09:05:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:342584450worker1 # [ 65.614681] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4451worker1 # [ 65.640843] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5)4452worker1 # [ 65.731046] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 2/5)4453worker1 # [ 65.758539] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 224 ms (attempt 3/5)4454worker1 # [ 65.991858] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 123 ms (attempt 4/5)4455worker1 # [ 66.115091] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4456worker1 # [ 66.126906] nix-grpc-daemon[774]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4457worker1 # [ 66.372467] nix-daemon[831]: accepted connection from pid 1152, user nix-grpc-daemon (trusted)4458worker1 # [ 66.390991] nix-daemon[831]: reaped child process 1155, status = succeeded4459worker1 # [ 66.584901] nix-daemon[831]: accepted connection from pid 1157, user nix-grpc-daemon (trusted)4460worker1 # [ 66.604186] nix-daemon[831]: reaped child process 1160, status = succeeded4461lb # [ 66.611593] niks3-server[994]: 2026/09/20 09:05:46 INFO Received uploads request method=POST path=/api/pending_closures4462worker1 # [ 66.629785] nix-grpc-daemon[841]: time=2026-09-20T09:05:46.280Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4463worker1 # [ 66.631287] nix-grpc-daemon[841]: time=2026-09-20T09:05:46.280Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4464lb # [ 66.653292] niks3-server[994]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4465lb # [ 66.666955] niks3-server[994]: 2026/09/20 09:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4466worker1 # [ 66.678164] nix-grpc-daemon[841]: time=2026-09-20T09:05:46.330Z level=INFO msg="Uploading 1 narinfos"4467lb # [ 66.676612] niks3-server[994]: 2026/09/20 09:05:46 INFO Signed narinfos id=21 count=14468lb # [ 66.678855] niks3-server[994]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4469lb # [ 66.690864] niks3-server[994]: 2026/09/20 09:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4470lb # [ 66.696830] niks3-server[994]: 2026/09/20 09:05:46 INFO Completed upload id=214471worker1 # [ 66.702198] nix-grpc-daemon[841]: time=2026-09-20T09:05:46.354Z level=INFO msg="Upload complete. (542ms)"4472lb # [ 66.700035] niks3-server[994]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4473worker1 # [ 66.712388] nix-grpc-daemon[774]: ts=2026-09-20T09:05:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=1 paths=1 nar_bytes_in=5684474worker1 # [ 66.723799] nix-grpc-daemon[774]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342584475worker1 # [ 66.735342] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4476worker1 # [ 66.748400] nix-daemon[831]: reaped child process 1146, status = succeeded4477client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4478client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4479worker1 # [ 66.760238] nix-daemon[831]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4480worker1 # [ 67.815804] nix-daemon[831]: reaped child process 1164, status = succeeded4481worker1 # [ 68.008608] nix-daemon[831]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)4482worker1 # [ 68.029690] nix-daemon[831]: reaped child process 1182, status = succeeded4483lb # [ 68.037988] niks3-server[994]: 2026/09/20 09:05:47 INFO Received uploads request method=POST path=/api/pending_closures4484worker1 # [ 68.052380] nix-grpc-daemon[841]: time=2026-09-20T09:05:47.703Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4485lb # [ 68.067809] niks3-server[994]: 2026/09/20 09:05:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4486worker1 # [ 68.080124] nix-grpc-daemon[841]: time=2026-09-20T09:05:47.732Z level=INFO msg="Uploading 1 narinfos"4487lb # [ 68.083529] niks3-server[994]: 2026/09/20 09:05:47 INFO Signed narinfos id=22 count=14488lb # [ 68.089634] niks3-server[994]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4489lb # [ 68.095623] niks3-server[994]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4490worker1 # [ 68.109460] nix-grpc-daemon[841]: time=2026-09-20T09:05:47.761Z level=INFO msg="Upload complete. (335ms)"4491lb # [ 68.104409] niks3-server[994]: 2026/09/20 09:05:47 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4492lb # [ 68.109421] niks3-server[994]: 2026/09/20 09:05:47 INFO Completed upload id=224493lb # [ 68.112180] niks3-server[994]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4494client # copying 1 paths...4495worker1 # [ 68.116761] nix-grpc-daemon[774]: ts=2026-09-20T09:05:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14496worker1 # [ 68.129464] nix-daemon[831]: reaped child process 1162, status = succeeded4497worker2 # [ 68.171060] nix-grpc-daemon[775]: ts=2026-09-20T09:05:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:473964498worker2 # [ 68.185363] nix-grpc-daemon[775]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4499client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4500worker2 # [ 68.233777] nix-grpc-daemon[775]: ts=2026-09-20T09:05:47Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:473964501worker2 # [ 68.240465] nix-grpc-daemon[775]: ts=2026-09-20T09:05:47Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47396 duration_s=0 paths=1 nar_bytes_out=1204502client # [ 68.361985] nix-daemon[943]: reaped child process 1051, status = succeeded4503client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.29 seconds)4504client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24505client # [ 68.583852] nix-daemon[943]: accepted connection from pid 1070, user root (trusted)4506client # this derivation will be built:4507client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4508worker1 # [ 68.753902] nix-grpc-daemon[774]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:342584509client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4510worker1 # [ 68.761330] nix-grpc-daemon[774]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342584511worker1 # [ 68.767989] nix-grpc-daemon[841]: time=2026-09-20T09:05:48.419Z level=INFO msg="All 1 paths already cached"4512worker2 # [ 68.823281] nix-grpc-daemon[775]: ts=2026-09-20T09:05:48Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04513worker2 # [ 68.830533] nix-grpc-daemon[775]: ts=2026-09-20T09:05:48Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14514worker2 # [ 68.867725] nix-grpc-daemon[775]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473964515worker2 # [ 68.885169] nix-grpc-daemon[775]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473964516worker2 # [ 68.903325] nix-grpc-daemon[891]: time=2026-09-20T09:05:48.545Z level=INFO msg="All 1 paths already cached"4517client # copying 1 paths to 'lb:50051'...4518client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4519worker2 # [ 68.913863] nix-grpc-daemon[775]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473964520worker2 # [ 68.930528] nix-daemon[836]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4521worker2 # [ 69.144160] nix-daemon[836]: accepted connection from pid 1021, user nix-grpc-daemon (trusted)4522worker2 # [ 69.162929] nix-daemon[836]: reaped child process 1024, status = succeeded4523worker2 # [ 69.335299] nix-daemon[836]: accepted connection from pid 1026, user nix-grpc-daemon (trusted)4524worker2 # [ 69.351491] nix-daemon[836]: reaped child process 1029, status = succeeded4525lb # [ 69.319267] niks3-server[994]: 2026/09/20 09:05:48 INFO Received uploads request method=POST path=/api/pending_closures4526worker2 # [ 69.377152] nix-grpc-daemon[891]: time=2026-09-20T09:05:49.019Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4527worker2 # [ 69.378639] nix-grpc-daemon[891]: time=2026-09-20T09:05:49.019Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4528lb # [ 69.346946] niks3-server[994]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4529lb # [ 69.361921] niks3-server[994]: 2026/09/20 09:05:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4530worker2 # [ 69.415715] nix-grpc-daemon[891]: time=2026-09-20T09:05:49.058Z level=INFO msg="Uploading 1 narinfos"4531lb # [ 69.374052] niks3-server[994]: 2026/09/20 09:05:49 INFO Signed narinfos id=23 count=14532lb # [ 69.383291] niks3-server[994]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4533lb # [ 69.391268] niks3-server[994]: 2026/09/20 09:05:49 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4534lb # [ 69.399506] niks3-server[994]: 2026/09/20 09:05:49 INFO Completed upload id=234535worker2 # [ 69.448247] nix-grpc-daemon[891]: time=2026-09-20T09:05:49.090Z level=INFO msg="Upload complete. (498ms)"4536lb # [ 69.402674] niks3-server[994]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4537worker2 # [ 69.456852] nix-grpc-daemon[775]: ts=2026-09-20T09:05:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47396 duration_s=0 paths=1 nar_bytes_in=5684538worker2 # [ 69.470295] nix-grpc-daemon[775]: ts=2026-09-20T09:05:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473964539worker2 # [ 69.478581] nix-daemon[836]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4540worker2 # [ 69.480987] nix-daemon[836]: reaped child process 1019, status = succeeded4541client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4542worker2 # [ 69.494827] nix-daemon[836]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4543client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4544worker2 # [ 70.137393] nix-daemon[836]: reaped child process 1033, status = succeeded4545worker2 # [ 70.305597] nix-daemon[836]: accepted connection from pid 1048, user nix-grpc-daemon (trusted)4546worker2 # [ 70.323285] nix-daemon[836]: reaped child process 1051, status = succeeded4547lb # [ 70.290656] niks3-server[994]: 2026/09/20 09:05:49 INFO Received uploads request method=POST path=/api/pending_closures4548worker2 # [ 70.348489] nix-grpc-daemon[891]: time=2026-09-20T09:05:49.990Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4549lb # [ 70.322763] niks3-server[994]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4550lb # [ 70.332652] niks3-server[994]: 2026/09/20 09:05:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4551worker2 # [ 70.388217] nix-grpc-daemon[891]: time=2026-09-20T09:05:50.030Z level=INFO msg="Uploading 1 narinfos"4552lb # [ 70.342877] niks3-server[994]: 2026/09/20 09:05:49 INFO Signed narinfos id=24 count=14553lb # [ 70.350214] niks3-server[994]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4554lb # [ 70.363641] niks3-server[994]: 2026/09/20 09:05:50 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4555lb # [ 70.370535] niks3-server[994]: 2026/09/20 09:05:50 INFO Completed upload id=244556worker2 # [ 70.417828] nix-grpc-daemon[891]: time=2026-09-20T09:05:50.060Z level=INFO msg="Upload complete. (313ms)"4557lb # [ 70.373501] niks3-server[994]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4558worker2 # [ 70.428353] nix-grpc-daemon[775]: ts=2026-09-20T09:05:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47396 duration_s=0 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14559worker2 # [ 70.445530] nix-daemon[836]: reaped child process 1031, status = succeeded4560client # copying 1 paths...4561worker2 # [ 70.478613] nix-grpc-daemon[775]: ts=2026-09-20T09:05:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:473964562client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4563worker1 # [ 70.465074] nix-grpc-daemon[774]: ts=2026-09-20T09:05:50Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:342584564worker1 # [ 70.479856] nix-grpc-daemon[774]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4565worker1 # [ 70.497043] nix-grpc-daemon[774]: ts=2026-09-20T09:05:50Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34258 duration_s=0 paths=1 nar_bytes_out=1204566client # [ 70.659119] nix-daemon[943]: reaped child process 1073, status = succeeded4567client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.29 seconds)4568(finished: subtest: an input only one worker has still reaches the builder, in 9.80 seconds)4569subtest: upload whose reference the worker lacks is completed from the cache4570client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4571client # this derivation will be built:4572client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4573client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4574lb # [ 71.059636] envoy[911]: conn peer=[2001:db8:1::1]:59628 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1064575lb # [ 71.064649] envoy[911]: conn peer=[2001:db8:1::1]:59618 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3851 tx=1765 ms=28164576lb # [ 71.069394] envoy[911]: conn peer=[2001:db8:1::1]:59642 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=724577lb # [ 71.074116] envoy[911]: conn peer=[2001:db8:1::1]:59636 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3700 tx=1914 ms=27474578lb # [ 71.079005] envoy[911]: conn peer=[2001:db8:1::1]:59656 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3757 tx=1796 ms=17994579lb # [ 71.083839] envoy[911]: conn peer=[2001:db8:1::1]:59658 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=944580client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds)4581client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4582client # this derivation will be built:4583client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4584client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4585client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds)4586client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4587client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4588worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4589worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.24 seconds)4590worker2 # [ 72.086114] systemd[1]: Stopping Nix worker-protocol over gRPC...4591worker2 # [ 72.453869] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=signal_exit4592worker2 # [ 72.694872] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=scheduler_yield4593worker2 # [ 72.700456] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=scheduler_restarting addr=lb:500514594lb # [ 72.656159] niks3-server[994]: 2026/09/20 09:05:52 INFO lead: released remote=192.168.1.4:495564595worker2 # [ 72.705749] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:473944596worker2 # [ 72.710494] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=worker_gone addr=192.168.1.4:500514597worker1 # [ 72.668874] nix-grpc-daemon[774]: ts=2026-09-20T09:05:52Z level=info event=scheduler_restarting addr=lb:500514598worker2 # [ 72.716343] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:473944599worker2 # [ 72.720842] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=worker_gone addr=192.168.1.3:500514600worker2 # [ 72.901208] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500514601worker2 # [ 72.906440] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4602worker1 # [ 72.869106] nix-grpc-daemon[774]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500514603worker1 # [ 72.885662] nix-grpc-daemon[774]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4604worker2 # [ 73.107399] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500514605worker2 # [ 73.112839] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4606worker1 # [ 73.086938] nix-grpc-daemon[774]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500514607worker1 # [ 73.092402] nix-grpc-daemon[774]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4608worker2 # [ 73.313651] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500514609worker2 # [ 73.319132] nix-grpc-daemon[775]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4610worker1 # [ 73.293111] nix-grpc-daemon[774]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500514611worker1 # [ 73.298536] nix-grpc-daemon[774]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4612worker2 # [ 73.520771] nix-grpc-daemon[775]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500514613worker2 # [ 73.525814] nix-grpc-daemon[775]: ts=2026-09-20T09:05:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4614worker1 # [ 73.499365] nix-grpc-daemon[774]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500514615worker1 # [ 73.504930] nix-grpc-daemon[774]: ts=2026-09-20T09:05:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4616worker2 # [ 73.701006] nix-grpc-daemon[775]: ts=2026-09-20T09:05:53Z level=info event=scheduler_restarting4617worker2 # [ 73.751244] nix-grpc-daemon[775]: ts=2026-09-20T09:05:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4618worker1 # [ 73.707924] nix-grpc-daemon[774]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500514619worker1 # [ 73.713362] nix-grpc-daemon[774]: ts=2026-09-20T09:05:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4620worker2 # [ 73.765455] nix-daemon[836]: reaped child process 838, status = succeeded4621worker1 # [ 73.914068] nix-grpc-daemon[774]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500514622worker2 # [ 73.959066] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4623worker2 # [ 73.963619] nix-grpc-daemon[775]: E0000 00:00:1789895153.601605 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4624worker2 # [ 74.630156] nix-grpc-daemon[775]: E0000 00:00:1789895154.271552 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4625worker2 # [ 74.636710] nix-grpc-daemon[775]: E0000 00:00:1789895154.271873 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4626worker1 # [ 75.350304] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4627worker2 # [ 75.413095] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4628worker2 # [ 75.418615] systemd[1]: Stopped Nix worker-protocol over gRPC.4629worker2 # [ 75.424587] systemd[1]: nix-grpc-daemon.service: Consumed 1.862s CPU time over 54.294s wall clock time, 54.3M memory peak, 50.9K incoming IP traffic, 91.7K outgoing IP traffic.4630worker2 # [ 75.437883] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4631worker2 # [ 75.439933] systemd[1]: Closed Nix worker-protocol over gRPC.4632worker2 # [ 75.444812] systemd[1]: nix-grpc-daemon.socket: Consumed 553us CPU time over 1min 4.076s wall clock time, 256K memory peak, 87.3K incoming IP traffic, 72.4K outgoing IP traffic.4633lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4634lb: must succeed: curl -sf localhost:9901/clusters4635lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4636lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4637client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24638worker1 # [ 75.550094] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500514639worker1 # [ 75.557471] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4640worker1 # [ 75.735941] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:342584641worker1 # [ 75.745588] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:342584642client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4643worker1 # [ 75.758224] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500514644worker1 # [ 75.763523] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4645client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4646worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4647worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4648worker2 # [ 75.937843] systemd[1]: Listening on Nix worker-protocol over gRPC.4649worker1 # [ 75.966632] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500514650worker1 # [ 75.971807] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4651worker1 # [ 75.991463] systemd[1]: Stopping Nix worker-protocol over gRPC...4652worker1 # [ 76.172558] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500514653worker2 # [ 76.229079] systemd[1]: Starting Nix worker-protocol over gRPC...4654worker2 # [ 76.446601] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4655worker2 # [ 76.449226] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14656worker2 # [ 76.456768] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:56Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4657worker2 # [ 76.458745] systemd[1]: Started Nix worker-protocol over gRPC.4658worker1 # [ 76.425534] nix-grpc-daemon[774]: ts=2026-09-20T09:05:56Z level=info event=signal_exit4659worker2 # [ 76.473614] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:56Z level=info event=scheduler_take_over4660lb # [ 76.426748] niks3-server[994]: 2026/09/20 09:05:56 INFO lead: acquired remote=192.168.1.4:468204661worker2 # [ 76.490393] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04662worker2 # [ 76.506330] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500514663worker2 # [ 76.508201] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:56Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04664worker1 # [ 77.501757] nix-grpc-daemon[774]: ts=2026-09-20T09:05:57Z level=info event=scheduler_restarting4665worker2 # [ 77.554444] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:453304666worker2 # [ 77.554720] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:57Z level=info event=worker_gone addr=192.168.1.3:500514667worker1 # [ 77.543806] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4668worker1 # [ 77.552556] nix-grpc-daemon[774]: E0000 00:00:1789895157.194845 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4669worker1 # [ 77.566281] nix-grpc-daemon[774]: E0000 00:00:1789895157.195354 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4670worker1 # [ 77.571524] nix-grpc-daemon[774]: ts=2026-09-20T09:05:57Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4671worker1 # [ 77.575625] nix-daemon[831]: reaped child process 833, status = succeeded4672worker1 # [ 79.290894] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4673worker1 # [ 79.297500] systemd[1]: Stopped Nix worker-protocol over gRPC.4674worker1 # [ 79.303583] systemd[1]: nix-grpc-daemon.service: Consumed 3.712s CPU time over 58.220s wall clock time, 62.1M memory peak, 85K incoming IP traffic, 152.2K outgoing IP traffic.4675worker1 # [ 79.318129] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4676worker1 # [ 79.323737] systemd[1]: Closed Nix worker-protocol over gRPC.4677worker1 # [ 79.326923] systemd[1]: nix-grpc-daemon.socket: Consumed 520us CPU time over 1min 8.017s wall clock time, 256K memory peak, 93K incoming IP traffic, 77.2K outgoing IP traffic.4678lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4679lb: must succeed: curl -sf localhost:9901/clusters4680lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4681lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4682client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24683worker2 # [ 79.688842] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:453624684worker2 # [ 79.703822] nix-daemon[836]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)4685worker2 # [ 79.730888] nix-grpc-daemon[1072]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5)4686worker2 # [ 79.769740] nix-grpc-daemon[1072]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 2/5)4687worker2 # [ 79.906322] nix-grpc-daemon[1072]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 180 ms (attempt 3/5)4688worker2 # [ 80.093969] nix-grpc-daemon[1072]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 187 ms (attempt 4/5)4689worker2 # [ 80.281796] nix-grpc-daemon[1072]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4690client # copying 2 paths...4691client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4692worker2 # [ 80.308908] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:453624693client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4694worker2 # [ 80.326705] nix-daemon[836]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)4695worker2 # [ 80.355683] nix-grpc-daemon[1072]: ts=2026-09-20T09:05:59Z level=info event=niks3_push_started pid=11284696worker2 # [ 80.741065] nix-daemon[836]: accepted connection from pid 1141, user nix-grpc-daemon (trusted)4697worker2 # [ 80.758799] nix-daemon[836]: reaped child process 1144, status = succeeded4698lb # [ 80.724120] niks3-server[994]: 2026/09/20 09:06:00 INFO Received uploads request method=POST path=/api/pending_closures4699lb # [ 80.734092] niks3-server[994]: 2026/09/20 09:06:00 INFO Received uploads request method=POST path=/api/pending_closures4700worker2 # [ 80.792449] nix-grpc-daemon[1128]: time=2026-09-20T09:06:00.434Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4701worker2 # [ 80.793953] nix-grpc-daemon[1128]: time=2026-09-20T09:06:00.434Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4702worker2 # [ 80.795647] nix-grpc-daemon[1128]: time=2026-09-20T09:06:00.434Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4703lb # [ 80.784595] niks3-server[994]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4704lb # [ 80.798567] niks3-server[994]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4705lb # [ 80.814586] niks3-server[994]: 2026/09/20 09:06:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4706worker2 # [ 80.876161] nix-grpc-daemon[1128]: time=2026-09-20T09:06:00.516Z level=INFO msg="Uploading 3 narinfos"4707lb # [ 80.826136] niks3-server[994]: 2026/09/20 09:06:00 INFO Signed narinfos id=25 count=14708lb # [ 80.836329] niks3-server[994]: 2026/09/20 09:06:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4709lb # [ 80.847449] niks3-server[994]: 2026/09/20 09:06:00 INFO Signed narinfos id=26 count=24710lb # [ 80.854311] niks3-server[994]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4711lb # [ 80.871680] niks3-server[994]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4712lb # [ 80.880510] niks3-server[994]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4713lb # [ 80.887020] niks3-server[994]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4714lb # [ 80.892647] niks3-server[994]: 2026/09/20 09:06:00 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4715lb # [ 80.895500] niks3-server[994]: 2026/09/20 09:06:00 INFO Completed upload id=254716lb # [ 80.898620] niks3-server[994]: 2026/09/20 09:06:00 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4717lb # [ 80.901389] niks3-server[994]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4718lb # [ 80.903374] niks3-server[994]: 2026/09/20 09:06:00 INFO Completed upload id=264719worker2 # [ 80.949823] nix-grpc-daemon[1128]: time=2026-09-20T09:06:00.592Z level=INFO msg="Upload complete. (380ms)"4720worker2 # [ 80.961416] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45362 duration_s=0 paths=2 nar_bytes_in=3124721worker2 # [ 80.979426] nix-daemon[836]: reaped child process 1126, status = succeeded4722client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.54 seconds)4723worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4724worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4725lb # [ 81.060567] envoy[911]: conn peer=[2001:db8:1::4]:39926 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5011 tx=1525 ms=522414726lb # [ 81.066616] envoy[911]: conn peer=[2001:db8:1::1]:44988 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=304727lb # [ 81.071543] envoy[911]: conn peer=[2001:db8:1::3]:51592 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6790 tx=2153 ms=560784728worker1 # [ 81.081083] systemd[1]: Listening on Nix worker-protocol over gRPC.4729lb # [ 81.077303] envoy[911]: conn peer=[2001:db8:1::1]:45002 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1010 tx=305 ms=12874730worker1 # [ 81.091676] systemd[1]: Starting Nix worker-protocol over gRPC...4731worker1 # [ 81.294502] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4732worker1 # [ 81.296886] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14733worker1 # [ 81.308361] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4734worker1 # [ 81.310137] systemd[1]: Started Nix worker-protocol over gRPC.4735lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4736lb: must succeed: curl -sf localhost:9901/clusters4737worker1 # [ 81.356827] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500514738worker2 # [ 81.404046] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04739lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4740lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4741(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.80 seconds)4742subtest: scheduler down: the other node takes the lock and keeps it4743lb: must succeed: curl -sf localhost:9901/clusters4744lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4745lb: must succeed: curl -sf localhost:9901/clusters4746lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4747lb: must succeed: curl -sf localhost:9901/clusters4748lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4749lb: must succeed: curl -sf localhost:9901/clusters4750lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4751worker2 # [ 81.745949] systemd[1]: Stopping Nix worker-protocol over gRPC...4752worker2 # [ 82.469329] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=signal_exit4753worker2 # [ 82.673191] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=scheduler_yield4754lb # [ 82.630393] niks3-server[994]: 2026/09/20 09:06:02 INFO lead: released remote=192.168.1.4:468204755worker1 # [ 82.636618] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:02Z level=info event=scheduler_restarting addr=lb:500514756worker2 # [ 82.679818] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:453304757worker2 # [ 82.684647] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=worker_gone addr=192.168.1.3:500514758worker2 # [ 82.691784] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=scheduler_restarting addr=lb:500514759worker2 # [ 82.696134] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:453304760worker2 # [ 82.700532] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=worker_gone addr=192.168.1.4:500514761worker1 # [ 82.836289] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500514762worker1 # [ 82.846731] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4763worker2 # [ 82.891604] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500514764worker2 # [ 82.910794] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4765worker1 # [ 83.047721] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500514766worker1 # [ 83.054958] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4767worker2 # [ 83.111767] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500514768worker2 # [ 83.118602] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4769worker1 # [ 83.255955] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500514770worker1 # [ 83.262250] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4771worker2 # [ 83.319662] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500514772worker2 # [ 83.326379] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4773worker1 # [ 83.463294] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500514774worker1 # [ 83.470133] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4775worker2 # [ 83.530011] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500514776worker2 # [ 83.534209] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4777worker2 # [ 83.681339] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:03Z level=info event=scheduler_restarting4778worker2 # [ 83.709085] nix-daemon[836]: reaped child process 1121, status = succeeded4779worker1 # [ 83.674009] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500514780worker1 # [ 83.678274] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4781worker2 # [ 83.750328] nix-grpc-daemon[1072]: ts=2026-09-20T09:06:03Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4782worker1 # [ 83.875267] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500514783worker2 # [ 83.920284] nix-grpc-daemon[1072]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4784worker2 # [ 83.924696] nix-grpc-daemon[1072]: E0000 00:00:1789895163.562797 1115 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4785worker1 # [ 84.430820] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4786worker2 # [ 84.494929] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4787worker2 # [ 84.503551] systemd[1]: Stopped Nix worker-protocol over gRPC.4788worker2 # [ 84.511082] systemd[1]: nix-grpc-daemon.service: Consumed 486ms CPU time over 8.265s wall clock time, 33.8M memory peak, 17.7K incoming IP traffic, 21.9K outgoing IP traffic.4789worker2 # [ 84.525304] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4790worker2 # [ 84.527574] systemd[1]: Closed Nix worker-protocol over gRPC.4791worker2 # [ 84.531037] systemd[1]: nix-grpc-daemon.socket: Consumed 847us CPU time over 8.593s wall clock time, 256K memory peak, 27.1K incoming IP traffic, 23.4K outgoing IP traffic.4792worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4793worker1 # [ 84.632008] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:04Z level=info event=scheduler_connected addr=lb:500514794worker1 # [ 84.639228] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4795worker1 # [ 84.841781] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:04Z level=info event=scheduler_connected addr=lb:500514796worker1 # [ 84.847013] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4797worker1 # [ 85.047949] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:04Z level=info event=scheduler_connected addr=lb:500514798worker1 # [ 85.054762] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4799worker1 # [ 85.255839] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:04Z level=info event=scheduler_connected addr=lb:500514800worker1 # [ 85.261188] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4801worker1 # [ 85.461884] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_connected addr=lb:500514802worker1 # [ 85.468684] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4803worker1 # [ 85.669571] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_connected addr=lb:500514804worker1 # [ 85.673390] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4805worker1 # [ 85.876771] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_connected addr=lb:500514806worker1 # [ 85.881628] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4807worker1 # [ 86.078825] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_connected addr=lb:500514808worker1 # [ 86.084312] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4809worker1 # [ 86.285270] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_connected addr=lb:500514810worker1 # [ 86.292385] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4811lb # [ 86.317397] niks3-server[994]: 2026/09/20 09:06:05 INFO lead: acquired remote=192.168.1.3:560004812worker1 # [ 86.323289] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:05Z level=info event=scheduler_take_over4813worker1 # [ 86.493504] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:06Z level=info event=scheduler_connected addr=lb:500514814worker1 # [ 86.499111] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04815worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.25 seconds)4816worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4817worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4818client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24819worker1 # [ 87.057274] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:537244820worker1 # [ 87.074371] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4821client # don't know how to build these paths:4822client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4823worker1 # [ 87.095087] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537244824worker1 # [ 87.115412] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5)4825worker1 # [ 87.128303] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 2/5)4826worker1 # [ 87.232695] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 3/5)4827worker1 # [ 87.337416] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 442 ms (attempt 4/5)4828worker1 # [ 87.787861] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4829worker1 # [ 87.820146] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:07Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04830worker1 # [ 87.826352] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:07Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14831worker1 # [ 87.873782] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537244832worker1 # [ 87.889880] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537244833client # copying 1 paths to 'lb:50051'...4834client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4835worker1 # [ 87.905835] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:537244836worker1 # [ 87.920150] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4837worker1 # [ 87.948492] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:07Z level=info event=niks3_push_started pid=12874838worker1 # [ 88.344652] nix-daemon[831]: accepted connection from pid 1300, user nix-grpc-daemon (trusted)4839worker1 # [ 88.366398] nix-daemon[831]: reaped child process 1303, status = succeeded4840worker1 # [ 88.543321] nix-daemon[831]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)4841worker1 # [ 88.560787] nix-daemon[831]: reaped child process 1308, status = succeeded4842lb # [ 88.570047] niks3-server[994]: 2026/09/20 09:06:08 INFO Received uploads request method=POST path=/api/pending_closures4843worker1 # [ 88.587381] nix-grpc-daemon[1287]: time=2026-09-20T09:06:08.238Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4844worker1 # [ 88.589311] nix-grpc-daemon[1287]: time=2026-09-20T09:06:08.238Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4845lb # [ 88.608649] niks3-server[994]: 2026/09/20 09:06:08 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4846worker1 # [ 88.634595] nix-grpc-daemon[1287]: time=2026-09-20T09:06:08.286Z level=INFO msg="Uploading 1 narinfos"4847lb # [ 88.623049] niks3-server[994]: 2026/09/20 09:06:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4848lb # [ 88.633791] niks3-server[994]: 2026/09/20 09:06:08 INFO Signed narinfos id=27 count=14849lb # [ 88.642583] niks3-server[994]: 2026/09/20 09:06:08 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4850lb # [ 88.652935] niks3-server[994]: 2026/09/20 09:06:08 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4851worker1 # [ 88.663620] nix-grpc-daemon[1287]: time=2026-09-20T09:06:08.315Z level=INFO msg="Upload complete. (489ms)"4852lb # [ 88.660377] niks3-server[994]: 2026/09/20 09:06:08 INFO Completed upload id=274853lb # [ 88.664874] niks3-server[994]: 2026/09/20 09:06:08 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4854worker1 # [ 88.672972] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=5204855worker1 # [ 88.687223] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537244856worker1 # [ 88.695084] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4857worker1 # [ 88.700105] nix-daemon[831]: reaped child process 1285, status = succeeded4858client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4859client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4860worker1 # [ 88.714113] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4861client # farm-a> LOG-farm-a-on-standby4862worker1 # [ 89.554654] nix-daemon[831]: reaped child process 1312, status = succeeded4863worker1 # [ 89.725108] nix-daemon[831]: accepted connection from pid 1327, user nix-grpc-daemon (trusted)4864worker1 # [ 89.742268] nix-daemon[831]: reaped child process 1330, status = succeeded4865lb # [ 89.748989] niks3-server[994]: 2026/09/20 09:06:09 INFO Received uploads request method=POST path=/api/pending_closures4866worker1 # [ 89.764413] nix-grpc-daemon[1287]: time=2026-09-20T09:06:09.415Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4867worker1 # [ 89.765924] nix-grpc-daemon[1287]: time=2026-09-20T09:06:09.415Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4868lb # [ 89.787317] niks3-server[994]: 2026/09/20 09:06:09 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4869lb # [ 89.803357] niks3-server[994]: 2026/09/20 09:06:09 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4870lb # [ 89.815747] niks3-server[994]: 2026/09/20 09:06:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4871worker1 # [ 89.828186] nix-grpc-daemon[1287]: time=2026-09-20T09:06:09.479Z level=INFO msg="Uploading 1 narinfos"4872lb # [ 89.823730] niks3-server[994]: 2026/09/20 09:06:09 INFO Signed narinfos id=28 count=14873lb # [ 89.830391] niks3-server[994]: 2026/09/20 09:06:09 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4874lb # [ 89.841678] niks3-server[994]: 2026/09/20 09:06:09 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4875lb # [ 89.851223] niks3-server[994]: 2026/09/20 09:06:09 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4876lb # [ 89.858851] niks3-server[994]: 2026/09/20 09:06:09 INFO Completed upload id=284877worker1 # [ 89.864228] nix-grpc-daemon[1287]: time=2026-09-20T09:06:09.516Z level=INFO msg="Upload complete. (340ms)"4878worker1 # [ 89.889138] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14879worker1 # [ 89.904456] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:09Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04880worker1 # [ 89.908201] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:09Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14881worker1 # [ 89.911779] nix-daemon[831]: reaped child process 1310, status = succeeded4882worker1 # [ 89.929797] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537244883worker1 # [ 89.944801] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537244884worker1 # [ 89.959852] nix-grpc-daemon[1287]: time=2026-09-20T09:06:09.612Z level=INFO msg="All 1 paths already cached"4885client # copying 1 paths to 'lb:50051'...4886client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4887worker1 # [ 89.970176] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:537244888worker1 # [ 89.983982] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4889worker1 # [ 90.189567] nix-daemon[831]: accepted connection from pid 1336, user nix-grpc-daemon (trusted)4890worker1 # [ 90.206826] nix-daemon[831]: reaped child process 1339, status = succeeded4891worker1 # [ 90.384928] nix-daemon[831]: accepted connection from pid 1341, user nix-grpc-daemon (trusted)4892worker1 # [ 90.402099] nix-daemon[831]: reaped child process 1344, status = succeeded4893lb # [ 90.407715] niks3-server[994]: 2026/09/20 09:06:10 INFO Received uploads request method=POST path=/api/pending_closures4894worker1 # [ 90.424705] nix-grpc-daemon[1287]: time=2026-09-20T09:06:10.076Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4895worker1 # [ 90.426251] nix-grpc-daemon[1287]: time=2026-09-20T09:06:10.076Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4896lb # [ 90.440182] niks3-server[994]: 2026/09/20 09:06:10 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4897lb # [ 90.452321] niks3-server[994]: 2026/09/20 09:06:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4898worker1 # [ 90.465408] nix-grpc-daemon[1287]: time=2026-09-20T09:06:10.117Z level=INFO msg="Uploading 1 narinfos"4899lb # [ 90.463298] niks3-server[994]: 2026/09/20 09:06:10 INFO Signed narinfos id=29 count=14900lb # [ 90.470195] niks3-server[994]: 2026/09/20 09:06:10 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4901lb # [ 90.482421] niks3-server[994]: 2026/09/20 09:06:10 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4902worker1 # [ 90.494677] nix-grpc-daemon[1287]: time=2026-09-20T09:06:10.147Z level=INFO msg="Upload complete. (494ms)"4903lb # [ 90.489516] niks3-server[994]: 2026/09/20 09:06:10 INFO Completed upload id=294904lb # [ 90.493087] niks3-server[994]: 2026/09/20 09:06:10 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4905worker1 # [ 90.502206] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=6404906worker1 # [ 90.520160] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537244907worker1 # [ 90.524986] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4908worker1 # [ 90.530808] nix-daemon[831]: reaped child process 1334, status = succeeded4909client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4910worker1 # [ 90.540672] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4911client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4912lb # [ 91.054570] envoy[911]: conn peer=[2001:db8:1::4]:41986 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1003 tx=362 ms=72334913client # farm-b> LOG-farm-b-on-standby4914worker1 # [ 91.177552] nix-daemon[831]: reaped child process 1348, status = succeeded4915worker1 # [ 91.340041] nix-daemon[831]: accepted connection from pid 1363, user nix-grpc-daemon (trusted)4916worker1 # [ 91.359641] nix-daemon[831]: reaped child process 1366, status = succeeded4917lb # [ 91.366834] niks3-server[994]: 2026/09/20 09:06:11 INFO Received uploads request method=POST path=/api/pending_closures4918worker1 # [ 91.381615] nix-grpc-daemon[1287]: time=2026-09-20T09:06:11.033Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4919worker1 # [ 91.383793] nix-grpc-daemon[1287]: time=2026-09-20T09:06:11.035Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4920lb # [ 91.410796] niks3-server[994]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4921worker1 # [ 91.425069] nix-grpc-daemon[1287]: time=2026-09-20T09:06:11.076Z level=INFO msg="Uploading 1 narinfos"4922lb # [ 91.419725] niks3-server[994]: 2026/09/20 09:06:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4923lb # [ 91.431208] niks3-server[994]: 2026/09/20 09:06:11 INFO Signed narinfos id=30 count=14924lb # [ 91.437213] niks3-server[994]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4925lb # [ 91.442532] niks3-server[994]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4926worker1 # [ 91.456357] nix-grpc-daemon[1287]: time=2026-09-20T09:06:11.108Z level=INFO msg="Upload complete. (304ms)"4927lb # [ 91.451908] niks3-server[994]: 2026/09/20 09:06:11 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4928lb # [ 91.457995] niks3-server[994]: 2026/09/20 09:06:11 INFO Completed upload id=304929lb # [ 91.461089] niks3-server[994]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4930worker1 # [ 91.469098] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14931worker1 # [ 91.484730] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:11Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04932worker1 # [ 91.491145] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:11Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14933worker1 # [ 91.495467] nix-daemon[831]: reaped child process 1346, status = succeeded4934worker1 # [ 91.529640] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537244935worker1 # [ 91.544436] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537244936worker1 # [ 91.558094] nix-grpc-daemon[1287]: time=2026-09-20T09:06:11.210Z level=INFO msg="All 2 paths already cached"4937client # copying 1 paths to 'lb:50051'...4938client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4939worker1 # [ 91.568088] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:537244940worker1 # [ 91.582118] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4941worker1 # [ 91.784618] nix-daemon[831]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)4942worker1 # [ 91.801373] nix-daemon[831]: reaped child process 1375, status = succeeded4943worker1 # [ 91.972114] nix-daemon[831]: accepted connection from pid 1377, user nix-grpc-daemon (trusted)4944worker1 # [ 91.987950] nix-daemon[831]: reaped child process 1380, status = succeeded4945lb # [ 91.996804] niks3-server[994]: 2026/09/20 09:06:11 INFO Received uploads request method=POST path=/api/pending_closures4946worker1 # [ 92.010897] nix-grpc-daemon[1287]: time=2026-09-20T09:06:11.662Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4947worker1 # [ 92.012429] nix-grpc-daemon[1287]: time=2026-09-20T09:06:11.663Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4948lb # [ 92.022788] niks3-server[994]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4949worker1 # [ 92.040699] nix-grpc-daemon[1287]: time=2026-09-20T09:06:11.692Z level=INFO msg="Uploading 1 narinfos"4950lb # [ 92.039615] niks3-server[994]: 2026/09/20 09:06:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4951lb # [ 92.049696] niks3-server[994]: 2026/09/20 09:06:11 INFO Signed narinfos id=31 count=14952lb # [ 92.054573] niks3-server[994]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls4953lb # [ 92.062484] niks3-server[994]: 2026/09/20 09:06:11 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete4954worker1 # [ 92.072037] nix-grpc-daemon[1287]: time=2026-09-20T09:06:11.724Z level=INFO msg="Upload complete. (473ms)"4955lb # [ 92.067438] niks3-server[994]: 2026/09/20 09:06:11 INFO Completed upload id=314956lb # [ 92.071211] niks3-server[994]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo4957worker1 # [ 92.080235] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=7684958worker1 # [ 92.091280] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537244959worker1 # [ 92.096924] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4960worker1 # [ 92.101567] nix-daemon[831]: reaped child process 1370, status = succeeded4961client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...4962client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4963worker1 # [ 92.114567] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4964worker1 # [ 92.934821] nix-daemon[831]: reaped child process 1384, status = succeeded4965client # farm-top> LOG-farm-top-on-standby4966worker1 # [ 93.092347] nix-daemon[831]: accepted connection from pid 1399, user nix-grpc-daemon (trusted)4967worker1 # [ 93.109454] nix-daemon[831]: reaped child process 1402, status = succeeded4968lb # [ 93.117944] niks3-server[994]: 2026/09/20 09:06:12 INFO Received uploads request method=POST path=/api/pending_closures4969worker1 # [ 93.135608] nix-grpc-daemon[1287]: time=2026-09-20T09:06:12.786Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4970worker1 # [ 93.137256] nix-grpc-daemon[1287]: time=2026-09-20T09:06:12.786Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"4971lb # [ 93.158165] niks3-server[994]: 2026/09/20 09:06:12 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst4972lb # [ 93.169271] niks3-server[994]: 2026/09/20 09:06:12 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4973worker1 # [ 93.182036] nix-grpc-daemon[1287]: time=2026-09-20T09:06:12.834Z level=INFO msg="Uploading 1 narinfos"4974lb # [ 93.180271] niks3-server[994]: 2026/09/20 09:06:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign4975lb # [ 93.183687] niks3-server[994]: 2026/09/20 09:06:12 INFO Signed narinfos id=32 count=14976lb # [ 93.190478] niks3-server[994]: 2026/09/20 09:06:12 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls4977lb # [ 93.197247] niks3-server[994]: 2026/09/20 09:06:12 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete4978lb # [ 93.201196] niks3-server[994]: 2026/09/20 09:06:12 INFO Completed upload id=324979lb # [ 93.203454] niks3-server[994]: 2026/09/20 09:06:12 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo4980worker1 # [ 93.206448] nix-grpc-daemon[1287]: time=2026-09-20T09:06:12.858Z level=INFO msg="Upload complete. (283ms)"4981worker1 # [ 93.217059] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=14982worker1 # [ 93.231818] nix-daemon[831]: reaped child process 1382, status = succeeded4983client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.47 seconds)4984client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath4985client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds)4986worker2 # [ 93.630344] systemd[1]: Listening on Nix worker-protocol over gRPC.4987worker2 # [ 93.639159] systemd[1]: Starting Nix worker-protocol over gRPC...4988worker2 # [ 93.833865] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4989worker2 # [ 93.836348] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14990worker2 # [ 93.843968] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4991worker2 # [ 93.845816] systemd[1]: Started Nix worker-protocol over gRPC.4992lb: must succeed: curl -sf localhost:9901/clusters4993worker2 # [ 93.886243] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:13Z level=info event=scheduler_connected addr=lb:500514994worker1 # [ 93.845162] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04995lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4996worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4997worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4998lb: must succeed: curl -sf localhost:9901/clusters4999lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5000lb: must succeed: curl -sf localhost:9901/clusters5001lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5002worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5003worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5004(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.77 seconds)5005subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5006client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5007client # [ 94.309405] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5008client # Running as unit: rs.service; invocation ID: 1fd3fbc27054426c903045fe2df939af5009client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5010client # [ 94.547276] nix[1173]: don't know how to build these paths:5011client # [ 94.548736] nix[1173]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5012worker1 # [ 94.513000] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:537245013worker1 # [ 94.528642] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:14Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05014worker1 # [ 94.535710] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:14Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15015worker1 # [ 94.573244] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537245016worker1 # [ 94.588761] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537245017client # [ 94.635974] nix[1173]: copying 1 paths to 'lb:50051'...5018worker1 # [ 94.603372] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:537245019client # [ 94.638441] nix[1173]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5020worker1 # [ 94.618685] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5021worker1 # [ 94.821146] nix-daemon[831]: accepted connection from pid 1417, user nix-grpc-daemon (trusted)5022worker1 # [ 94.840153] nix-daemon[831]: reaped child process 1420, status = succeeded5023worker1 # [ 95.011375] nix-daemon[831]: accepted connection from pid 1422, user nix-grpc-daemon (trusted)5024worker1 # [ 95.027853] nix-daemon[831]: reaped child process 1425, status = succeeded5025lb # [ 95.035345] niks3-server[994]: 2026/09/20 09:06:14 INFO Received uploads request method=POST path=/api/pending_closures5026worker1 # [ 95.050743] nix-grpc-daemon[1287]: time=2026-09-20T09:06:14.702Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5027worker1 # [ 95.052339] nix-grpc-daemon[1287]: time=2026-09-20T09:06:14.702Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5028lb # [ 95.060874] niks3-server[994]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5029worker1 # [ 95.078754] nix-grpc-daemon[1287]: time=2026-09-20T09:06:14.730Z level=INFO msg="Uploading 1 narinfos"5030lb # [ 95.070370] niks3-server[994]: 2026/09/20 09:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5031lb # [ 95.077590] niks3-server[994]: 2026/09/20 09:06:14 INFO Signed narinfos id=33 count=15032lb # [ 95.079277] niks3-server[994]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5033lb # [ 95.085709] niks3-server[994]: 2026/09/20 09:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5034lb # [ 95.091231] niks3-server[994]: 2026/09/20 09:06:14 INFO Completed upload id=335035worker1 # [ 95.096156] nix-grpc-daemon[1287]: time=2026-09-20T09:06:14.748Z level=INFO msg="Upload complete. (460ms)"5036lb # [ 95.092979] niks3-server[994]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5037worker1 # [ 95.104630] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=0 paths=1 nar_bytes_in=4165038worker1 # [ 95.107656] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537245039worker1 # [ 95.117766] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5040worker1 # [ 95.121955] nix-daemon[831]: reaped child process 1415, status = succeeded5041worker1 # [ 95.131276] nix-daemon[831]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5042client # [ 95.162719] nix[1173]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5043lb: must succeed: curl -sf localhost:9901/clusters5044lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5045lb: must succeed: curl -sf localhost:9901/clusters5046lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5047lb: must succeed: curl -sf localhost:9901/clusters5048lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5049lb: must succeed: curl -sf localhost:9901/clusters5050lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5051worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5052worker2 # [ 97.280213] systemd-journald[274]: Received client request to rotate journal, rotating.5053worker2 # [ 97.299038] systemd-journald[274]: Vacuuming done, freed 0B of archived journals from /var/log/journal/2dbd42c1292943b1aafa99138d888146.5054worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5055worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5056worker1 # [ 97.322276] systemd[1]: Stopping Nix worker-protocol over gRPC...5057worker1 # [ 97.328205] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:16Z level=info event=draining5058worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5059??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5060 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735061client: must succeed: sleep 5.05062lb # [ 101.058157] envoy[911]: conn peer=[2001:db8:1::1]:53570 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9610 tx=3884 ms=61825063client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5064worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5065worker1 # [ 102.774348] nix-daemon[831]: reaped child process 1429, status = succeeded5066worker1 # [ 102.956143] nix-daemon[831]: accepted connection from pid 1469, user nix-grpc-daemon (trusted)5067worker1 # [ 102.973820] nix-daemon[831]: reaped child process 1472, status = succeeded5068lb # [ 102.981041] niks3-server[994]: 2026/09/20 09:06:22 INFO Received uploads request method=POST path=/api/pending_closures5069worker1 # [ 103.003205] nix-grpc-daemon[1287]: time=2026-09-20T09:06:22.652Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5070worker1 # [ 103.004842] nix-grpc-daemon[1287]: time=2026-09-20T09:06:22.652Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5071lb # [ 103.028354] niks3-server[994]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5072lb # [ 103.039740] niks3-server[994]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5073worker1 # [ 103.054772] nix-grpc-daemon[1287]: time=2026-09-20T09:06:22.706Z level=INFO msg="Uploading 1 narinfos"5074lb # [ 103.052721] niks3-server[994]: 2026/09/20 09:06:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5075lb # [ 103.055858] niks3-server[994]: 2026/09/20 09:06:22 INFO Signed narinfos id=34 count=15076lb # [ 103.065319] niks3-server[994]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5077lb # [ 103.073130] niks3-server[994]: 2026/09/20 09:06:22 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5078lb # [ 103.077522] niks3-server[994]: 2026/09/20 09:06:22 INFO Completed upload id=345079worker1 # [ 103.082884] nix-grpc-daemon[1287]: time=2026-09-20T09:06:22.735Z level=INFO msg="Upload complete. (335ms)"5080lb # [ 103.080008] niks3-server[994]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5081worker1 # [ 103.097186] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53724 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15082worker1 # [ 103.114226] nix-daemon[831]: reaped child process 1427, status = succeeded5083client # [ 103.168854] systemd[1]: rs.service: Deactivated successfully.5084client # [ 103.173175] systemd[1]: rs.service: Consumed 153ms CPU time over 8.863s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5085worker1 # [ 103.323807] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:22Z level=info event=signal_exit5086worker1 # [ 103.550204] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=scheduler_yield5087lb # [ 103.549159] niks3-server[994]: 2026/09/20 09:06:23 INFO lead: released remote=192.168.1.3:560005088worker2 # [ 103.599131] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:23Z level=info event=scheduler_restarting addr=lb:500515089worker1 # [ 103.560612] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:537225090worker1 # [ 103.566163] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=worker_gone addr=192.168.1.4:500515091worker1 # [ 103.571862] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=scheduler_restarting addr=lb:500515092worker1 # [ 103.575948] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:537225093worker1 # [ 103.580476] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=worker_gone addr=192.168.1.3:500515094worker2 # [ 103.800185] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500515095worker1 # [ 103.767046] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500515096worker2 # [ 103.812473] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5097worker1 # [ 103.790623] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5098worker2 # [ 103.856221] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:23Z level=info event=scheduler_take_over5099lb # [ 103.807879] niks3-server[994]: 2026/09/20 09:06:23 INFO lead: acquired remote=192.168.1.4:426305100worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.15 seconds)5101client: waiting for success: ! systemctl is-active rs5102client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5103client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5104client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5105client: must fail: journalctl -u rs | grep -q 'reconnecting'5106worker2 # [ 104.013427] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500515107worker2 # [ 104.019343] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05108worker1 # [ 103.991515] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500515109client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5110lb: must succeed: curl -sf localhost:9901/clusters5111worker1 # [ 103.998657] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5112lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5113worker1 # [ 104.200935] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500515114worker2 # [ 104.244713] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=0 running=05115worker1 # [ 104.556111] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:24Z level=info event=scheduler_restarting5116worker2 # [ 104.609062] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:452665117worker2 # [ 104.613939] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:24Z level=info event=worker_gone addr=192.168.1.3:500515118worker1 # [ 104.588725] nix-grpc-daemon[1206]: ts=2026-09-20T09:06:24Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5119worker1 # [ 104.616463] nix-daemon[831]: reaped child process 1278, status = succeeded5120lb: must succeed: curl -sf localhost:9901/clusters5121lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5122worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5123worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5124worker1 # [ 105.383932] nix-grpc-daemon[1206]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5125worker1 # [ 105.388498] nix-grpc-daemon[1206]: E0000 00:00:1789895185.034791 1249 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5126worker1 # [ 105.395081] nix-grpc-daemon[1206]: E0000 00:00:1789895185.035113 1249 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5127worker1 # [ 106.044984] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5128worker1 # [ 106.048858] systemd[1]: Stopped Nix worker-protocol over gRPC.5129worker1 # [ 106.051347] systemd[1]: nix-grpc-daemon.service: Consumed 1.798s CPU time over 24.951s wall clock time, 36.8M memory peak, 46.1K incoming IP traffic, 85.3K outgoing IP traffic.5130worker1 # [ 106.070142] systemd[1]: Starting Nix worker-protocol over gRPC...5131lb: must succeed: curl -sf localhost:9901/clusters5132worker1 # [ 106.267114] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5133worker1 # [ 106.269509] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15134worker1 # [ 106.276782] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5135worker1 # [ 106.278557] systemd[1]: Started Nix worker-protocol over gRPC.5136worker1 # [ 106.314202] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:25Z level=info event=scheduler_connected addr=lb:500515137worker2 # [ 106.363803] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:26Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05138lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5139worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5140worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5141(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.21 seconds)5142subtest: scheduler restart mid-build: build finishes, no double build5143client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5144client # [ 106.516719] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5145client # Running as unit: mid.service; invocation ID: af6159c422f1450d88151468ffcecb825146client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5147worker2 # [ 106.770372] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:452745148worker2 # [ 106.785788] nix-daemon[836]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5149client # [ 106.793292] nix[1209]: don't know how to build these paths:5150client # [ 106.795052] nix[1209]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5151worker2 # [ 106.817541] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:26Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05152worker2 # [ 106.823767] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:26Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15153worker2 # [ 106.869305] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:452745154worker2 # [ 106.886540] nix-grpc-daemon[1165]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 93 ms (attempt 1/5)5155worker2 # [ 106.987249] nix-grpc-daemon[1165]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 2/5)5156worker2 # [ 107.019761] nix-grpc-daemon[1165]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 216 ms (attempt 3/5)5157worker2 # [ 107.243378] nix-grpc-daemon[1165]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 246 ms (attempt 4/5)5158worker2 # [ 107.498875] nix-grpc-daemon[1165]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5159worker2 # [ 107.520490] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:452745160client # [ 107.524211] nix[1209]: copying 1 paths to 'lb:50051'...5161client # [ 107.528715] nix[1209]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5162worker2 # [ 107.540152] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:452745163worker2 # [ 107.554376] nix-daemon[836]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5164worker2 # [ 107.582289] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:27Z level=info event=niks3_push_started pid=12835165worker2 # [ 107.980579] nix-daemon[836]: accepted connection from pid 1300, user nix-grpc-daemon (trusted)5166worker2 # [ 107.999247] nix-daemon[836]: reaped child process 1303, status = succeeded5167worker2 # [ 108.172133] nix-daemon[836]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5168worker2 # [ 108.188355] nix-daemon[836]: reaped child process 1308, status = succeeded5169lb # [ 108.155150] niks3-server[994]: 2026/09/20 09:06:27 INFO Received uploads request method=POST path=/api/pending_closures5170worker2 # [ 108.214622] nix-grpc-daemon[1283]: time=2026-09-20T09:06:27.855Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5171worker2 # [ 108.216353] nix-grpc-daemon[1283]: time=2026-09-20T09:06:27.855Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5172lb # [ 108.190525] niks3-server[994]: 2026/09/20 09:06:27 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5173worker2 # [ 108.252808] nix-grpc-daemon[1283]: time=2026-09-20T09:06:27.894Z level=INFO msg="Uploading 1 narinfos"5174lb # [ 108.204467] niks3-server[994]: 2026/09/20 09:06:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5175lb # [ 108.216646] niks3-server[994]: 2026/09/20 09:06:27 INFO Signed narinfos id=35 count=15176lb # [ 108.226337] niks3-server[994]: 2026/09/20 09:06:27 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5177lb # [ 108.234689] niks3-server[994]: 2026/09/20 09:06:27 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5178lb # [ 108.243675] niks3-server[994]: 2026/09/20 09:06:27 INFO Completed upload id=355179worker2 # [ 108.291743] nix-grpc-daemon[1283]: time=2026-09-20T09:06:27.934Z level=INFO msg="Upload complete. (487ms)"5180worker2 # [ 108.300468] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45274 duration_s=0 paths=1 nar_bytes_in=4245181lb # [ 108.261832] niks3-server[994]: 2026/09/20 09:06:27 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5182worker2 # [ 108.312550] nix-grpc-daemon[1165]: ts=2026-09-20T09:06:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:452745183worker2 # [ 108.319644] nix-daemon[836]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5184worker2 # [ 108.325028] nix-daemon[836]: reaped child process 1281, status = succeeded5185client # [ 108.323738] nix[1209]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5186worker2 # [ 108.337013] nix-daemon[836]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5187lb: must succeed: curl -sf localhost:9901/clusters5188lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5189lb: must succeed: curl -sf localhost:9901/clusters5190lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5191worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5192worker2 # [ 110.530669] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1165 (nix-grpc-daemon) on client request.5193worker2 # [ 110.532854] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5194client # [ 110.523038] nix[1209]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5195worker1 # [ 110.490498] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5196lb # [ 110.492369] niks3-server[994]: 2026/09/20 09:06:30 INFO lead: released remote=192.168.1.4:426305197client # [ 110.529556] nix[1209]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5198worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5199client: must succeed: sleep 5.05200worker2 # [ 110.575607] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5201worker2 # [ 110.577645] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5202worker2 # [ 110.578865] systemd[1]: nix-grpc-daemon.service: Consumed 556ms CPU time over 16.929s wall clock time, 34.1M memory peak, 13.4K incoming IP traffic, 19.1K outgoing IP traffic.5203worker2 # [ 110.587188] nix-daemon[836]: reaped child process 1310, status = succeeded5204worker2 # [ 110.588397] nix-daemon[836]: reaped child process 1274, status = succeeded5205worker2 # [ 110.594689] nix-daemon[1312]: unexpected Nix daemon error: error: interrupted by the user5206worker2 # [ 110.602736] nix-daemon[836]: reaped child process 1312, status = failed with exit code 15207worker2 # [ 110.693822] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5208worker2 # [ 110.703279] systemd[1]: Starting Nix worker-protocol over gRPC...5209worker1 # [ 110.690593] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:30Z level=info event=scheduler_connected addr=lb:500515210worker2 # [ 110.894017] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5211worker2 # [ 110.896383] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15212worker2 # [ 110.903884] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5213lb # [ 110.873621] niks3-server[994]: 2026/09/20 09:06:30 INFO lead: acquired remote=192.168.1.4:590545214worker2 # [ 110.928213] systemd[1]: Started Nix worker-protocol over gRPC.5215worker2 # [ 110.929080] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:30Z level=info event=scheduler_take_over5216worker2 # [ 110.938988] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:30Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05217worker2 # [ 110.952460] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:30Z level=info event=scheduler_connected addr=lb:500515218worker2 # [ 110.954537] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:30Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05219worker2 # [ 111.043858] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:30Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05220worker2 # [ 111.048566] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:30Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15221worker1 # [ 111.061631] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:587705222lb # [ 111.059755] envoy[911]: conn peer=[2001:db8:1::1]:33884 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1349 ms=85975223lb # [ 111.065805] envoy[911]: conn peer=[2001:db8:1::3]:52044 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3905 tx=1291 ms=232245224lb # [ 111.070828] envoy[911]: conn peer=[2001:db8:1::4]:48804 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=786 tx=412 ms=166545225worker1 # [ 111.078398] nix-daemon[831]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5226worker1 # [ 111.102962] nix-grpc-daemon[1479]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 1/5)5227worker1 # [ 111.131840] nix-grpc-daemon[1479]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 2/5)5228worker1 # [ 111.292606] nix-grpc-daemon[1479]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 3/5)5229worker1 # [ 111.401507] nix-grpc-daemon[1479]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 214 ms (attempt 4/5)5230worker1 # [ 111.617390] nix-grpc-daemon[1479]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5231worker1 # [ 111.636641] nix-grpc-daemon[1479]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5232worker1 # [ 111.665919] nix-daemon[831]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5233worker1 # [ 111.684373] nix-daemon[831]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5234client # [ 111.715969] nix[1209]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5235client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5236client: waiting for success: ! systemctl is-active mid5237worker1 # [ 115.921401] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:35Z level=info event=niks3_push_started pid=15805238worker1 # [ 115.951100] nix-daemon[831]: reaped child process 1556, status = succeeded5239worker1 # [ 116.310967] nix-daemon[831]: accepted connection from pid 1593, user nix-grpc-daemon (trusted)5240worker1 # [ 116.328245] nix-daemon[831]: reaped child process 1596, status = succeeded5241lb # [ 116.337632] niks3-server[994]: 2026/09/20 09:06:35 INFO Received uploads request method=POST path=/api/pending_closures5242worker1 # [ 116.355072] nix-grpc-daemon[1580]: time=2026-09-20T09:06:36.005Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5243worker1 # [ 116.357857] nix-grpc-daemon[1580]: time=2026-09-20T09:06:36.005Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5244lb # [ 116.381704] niks3-server[994]: 2026/09/20 09:06:36 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5245lb # [ 116.395149] niks3-server[994]: 2026/09/20 09:06:36 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5246lb # [ 116.407012] niks3-server[994]: 2026/09/20 09:06:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5247worker1 # [ 116.413673] nix-grpc-daemon[1580]: time=2026-09-20T09:06:36.064Z level=INFO msg="Uploading 1 narinfos"5248lb # [ 116.415021] niks3-server[994]: 2026/09/20 09:06:36 INFO Signed narinfos id=36 count=15249lb # [ 116.421973] niks3-server[994]: 2026/09/20 09:06:36 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5250lb # [ 116.427631] niks3-server[994]: 2026/09/20 09:06:36 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5251worker1 # [ 116.441690] nix-grpc-daemon[1580]: time=2026-09-20T09:06:36.094Z level=INFO msg="Upload complete. (301ms)"5252lb # [ 116.438494] niks3-server[994]: 2026/09/20 09:06:36 INFO Completed upload id=365253worker1 # [ 116.452333] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58770 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15254worker1 # [ 116.467250] nix-grpc-daemon[1580]: time=2026-09-20T09:06:36.112Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5255worker1 # [ 116.473477] nix-daemon[831]: reaped child process 1554, status = succeeded5256client # [ 116.529480] systemd[1]: mid.service: Deactivated successfully.5257client # [ 116.533741] systemd[1]: mid.service: Consumed 170ms CPU time over 10.016s wall clock time, 37.2M memory peak, 9.6K incoming IP traffic, 10.6K outgoing IP traffic.5258client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5259client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5260client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5261(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.66 seconds)5262subtest: interrupting the client stops the build on the worker5263client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5264client # [ 117.146000] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5265client # Running as unit: intr.service; invocation ID: d3c5b76c3aca4c5e8c18d0790a55e3095266client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5267worker2 # [ 117.389980] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:585725268worker2 # [ 117.403064] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5269client # [ 117.411979] nix[1245]: don't know how to build these paths:5270client # [ 117.413584] nix[1245]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5271worker2 # [ 117.433559] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:37Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05272worker2 # [ 117.440600] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:37Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15273worker2 # [ 117.488977] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585725274worker2 # [ 117.505618] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 1/5)5275worker2 # [ 117.516263] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 108 ms (attempt 2/5)5276worker2 # [ 117.631833] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 171 ms (attempt 3/5)5277worker2 # [ 117.810657] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 4/5)5278worker2 # [ 117.891695] nix-grpc-daemon[1348]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5279worker2 # [ 117.913909] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585725280client # [ 117.919828] nix[1245]: copying 1 paths to 'lb:50051'...5281worker2 # [ 117.930353] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585725282client # [ 117.922335] nix[1245]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5283worker2 # [ 117.948423] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5284worker2 # [ 117.976087] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:37Z level=info event=niks3_push_started pid=14205285worker2 # [ 118.365791] nix-daemon[836]: accepted connection from pid 1433, user nix-grpc-daemon (trusted)5286worker2 # [ 118.383707] nix-daemon[836]: reaped child process 1436, status = succeeded5287worker2 # [ 118.572180] nix-daemon[836]: accepted connection from pid 1438, user nix-grpc-daemon (trusted)5288worker2 # [ 118.588430] nix-daemon[836]: reaped child process 1445, status = succeeded5289lb # [ 118.555619] niks3-server[994]: 2026/09/20 09:06:38 INFO Received uploads request method=POST path=/api/pending_closures5290worker2 # [ 118.619306] nix-grpc-daemon[1420]: time=2026-09-20T09:06:38.260Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5291worker2 # [ 118.621114] nix-grpc-daemon[1420]: time=2026-09-20T09:06:38.260Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5292lb # [ 118.608009] niks3-server[994]: 2026/09/20 09:06:38 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5293worker2 # [ 118.670315] nix-grpc-daemon[1420]: time=2026-09-20T09:06:38.312Z level=INFO msg="Uploading 1 narinfos"5294lb # [ 118.624747] niks3-server[994]: 2026/09/20 09:06:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5295lb # [ 118.634529] niks3-server[994]: 2026/09/20 09:06:38 INFO Signed narinfos id=37 count=15296lb # [ 118.638947] niks3-server[994]: 2026/09/20 09:06:38 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5297lb # [ 118.648196] niks3-server[994]: 2026/09/20 09:06:38 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5298lb # [ 118.653991] niks3-server[994]: 2026/09/20 09:06:38 INFO Completed upload id=375299lb # [ 118.657071] niks3-server[994]: 2026/09/20 09:06:38 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5300worker2 # [ 118.702368] nix-grpc-daemon[1420]: time=2026-09-20T09:06:38.345Z level=INFO msg="Upload complete. (510ms)"5301worker2 # [ 118.714409] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=0 paths=1 nar_bytes_in=4245302worker2 # [ 118.726615] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585725303worker2 # [ 118.733684] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5304worker2 # [ 118.738766] nix-daemon[836]: reaped child process 1418, status = succeeded5305client # [ 118.739317] nix[1245]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5306worker2 # [ 118.753048] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5307client: must succeed: systemctl kill -s INT intr5308client # [ 120.883091] systemd[1]: intr.service: Sent signal SIGINT to main process 1245 (nix) on client request.5309client # [ 120.890679] nix[1245]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5310client # [ 120.898130] nix[1245]: error: interrupted by the user5311client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5312client # [ 120.931552] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5313client # [ 120.936576] systemd[1]: intr.service: Failed with result 'exit-code'.5314client # [ 120.938672] systemd[1]: intr.service: Consumed 146ms CPU time over 3.788s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5315worker2 # [ 120.980417] nix-daemon[1449]: unexpected Nix daemon error: error: interrupted by the user5316worker2 # [ 120.986469] nix-daemon[836]: reaped child process 1447, status = succeeded5317worker2 # [ 120.990653] nix-daemon[836]: reaped child process 1449, status = failed with exit code 15318(finished: subtest: interrupting the client stops the build on the worker, in 3.92 seconds)5319subtest: a deploy mid-build drains: the build finishes, the new generation takes over5320client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5321lb # [ 121.055413] envoy[911]: conn peer=[2001:db8:1::1]:37844 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3828 tx=1638 ms=97435322lb # [ 121.060555] envoy[911]: conn peer=[2001:db8:1::1]:38200 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=732 ms=35505323client # [ 121.093709] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5324client # Running as unit: sw.service; invocation ID: 1bdec606e2104403b2df9d94abebb7305325client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5326worker1 # [ 121.296777] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:587705327client # [ 121.336433] nix[1265]: don't know how to build these paths:5328client # [ 121.338230] nix[1265]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5329worker2 # [ 121.359812] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:41Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05330worker2 # [ 121.365594] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:41Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15331worker1 # [ 121.361895] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:587705332worker1 # [ 121.377920] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:587705333client # [ 121.424203] nix[1265]: copying 1 paths to 'lb:50051'...5334worker1 # [ 121.393133] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:587705335client # [ 121.428147] nix[1265]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5336worker1 # [ 121.407966] nix-daemon[831]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5337worker1 # [ 121.620170] nix-daemon[831]: accepted connection from pid 1624, user nix-grpc-daemon (trusted)5338worker1 # [ 121.637375] nix-daemon[831]: reaped child process 1627, status = succeeded5339worker1 # [ 121.812440] nix-daemon[831]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)5340worker1 # [ 121.829513] nix-daemon[831]: reaped child process 1632, status = succeeded5341lb # [ 121.838451] niks3-server[994]: 2026/09/20 09:06:41 INFO Received uploads request method=POST path=/api/pending_closures5342worker1 # [ 121.854445] nix-grpc-daemon[1580]: time=2026-09-20T09:06:41.506Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5343worker1 # [ 121.855944] nix-grpc-daemon[1580]: time=2026-09-20T09:06:41.506Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5344lb # [ 121.870124] niks3-server[994]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5345worker1 # [ 121.889426] nix-grpc-daemon[1580]: time=2026-09-20T09:06:41.541Z level=INFO msg="Uploading 1 narinfos"5346lb # [ 121.884008] niks3-server[994]: 2026/09/20 09:06:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5347lb # [ 121.895753] niks3-server[994]: 2026/09/20 09:06:41 INFO Signed narinfos id=38 count=15348lb # [ 121.905387] niks3-server[994]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5349lb # [ 121.920124] niks3-server[994]: 2026/09/20 09:06:41 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5350lb # [ 121.928632] niks3-server[994]: 2026/09/20 09:06:41 INFO Completed upload id=385351worker1 # [ 121.933180] nix-grpc-daemon[1580]: time=2026-09-20T09:06:41.585Z level=INFO msg="Upload complete. (508ms)"5352lb # [ 121.931570] niks3-server[994]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5353worker1 # [ 121.944966] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58770 duration_s=0 paths=1 nar_bytes_in=4165354worker1 # [ 121.956386] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:587705355worker1 # [ 121.966996] nix-daemon[831]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5356worker1 # [ 121.970709] nix-daemon[831]: reaped child process 1622, status = succeeded5357client # [ 122.013655] nix[1265]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5358worker1 # [ 121.983007] nix-daemon[831]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5359worker1: must succeed: systemctl reload nix-grpc-daemon.service5360worker1 # [ 123.757272] systemd[1]: Reloading Nix worker-protocol over gRPC...5361worker1 # [ 123.805113] systemd[1]: Reloaded Nix worker-protocol over gRPC.5362worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.10 seconds)5363worker1: must succeed: pgrep -f 'read -t [9]0 x'5364worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5365client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25366worker2 # [ 124.149576] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:585725367client # don't know how to build these paths:5368client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5369worker2 # [ 124.160502] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585725370worker2 # [ 124.186442] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:43Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05371worker2 # [ 124.193390] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:43Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15372worker2 # [ 124.237136] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585725373worker2 # [ 124.252524] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585725374client # copying 1 paths to 'lb:50051'...5375worker2 # [ 124.268621] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585725376client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5377worker2 # [ 124.292388] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5378worker1 # [ 124.292784] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:43Z level=info event=draining5379worker2 # [ 124.505719] nix-daemon[836]: accepted connection from pid 1499, user nix-grpc-daemon (trusted)5380worker2 # [ 124.523458] nix-daemon[836]: reaped child process 1502, status = succeeded5381worker2 # [ 124.700358] nix-daemon[836]: accepted connection from pid 1504, user nix-grpc-daemon (trusted)5382worker2 # [ 124.718850] nix-daemon[836]: reaped child process 1507, status = succeeded5383lb # [ 124.683112] niks3-server[994]: 2026/09/20 09:06:44 INFO Received uploads request method=POST path=/api/pending_closures5384worker2 # [ 124.742257] nix-grpc-daemon[1420]: time=2026-09-20T09:06:44.384Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5385worker2 # [ 124.743722] nix-grpc-daemon[1420]: time=2026-09-20T09:06:44.384Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5386lb # [ 124.710593] niks3-server[994]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5387lb # [ 124.727994] niks3-server[994]: 2026/09/20 09:06:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5388worker2 # [ 124.781506] nix-grpc-daemon[1420]: time=2026-09-20T09:06:44.424Z level=INFO msg="Uploading 1 narinfos"5389lb # [ 124.739899] niks3-server[994]: 2026/09/20 09:06:44 INFO Signed narinfos id=39 count=15390lb # [ 124.746215] niks3-server[994]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5391worker2 # [ 124.804635] nix-grpc-daemon[1420]: time=2026-09-20T09:06:44.447Z level=INFO msg="Upload complete. (495ms)"5392lb # [ 124.755372] niks3-server[994]: 2026/09/20 09:06:44 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5393lb # [ 124.763360] niks3-server[994]: 2026/09/20 09:06:44 INFO Completed upload id=395394worker2 # [ 124.812118] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=0 paths=1 nar_bytes_in=5285395lb # [ 124.766905] niks3-server[994]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5396worker2 # [ 124.826642] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585725397worker2 # [ 124.833627] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5398worker2 # [ 124.838681] nix-daemon[836]: reaped child process 1497, status = succeeded5399client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5400worker2 # [ 124.848943] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5401client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5402client # farm-a> LOG-farm-a-during-drain5403worker2 # [ 125.270898] nix-daemon[836]: reaped child process 1511, status = succeeded5404worker2 # [ 125.433362] nix-daemon[836]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)5405worker2 # [ 125.451714] nix-daemon[836]: reaped child process 1529, status = succeeded5406lb # [ 125.415273] niks3-server[994]: 2026/09/20 09:06:45 INFO Received uploads request method=POST path=/api/pending_closures5407worker2 # [ 125.475177] nix-grpc-daemon[1420]: time=2026-09-20T09:06:45.115Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5408worker2 # [ 125.477596] nix-grpc-daemon[1420]: time=2026-09-20T09:06:45.115Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5409lb # [ 125.452932] niks3-server[994]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5410lb # [ 125.471030] niks3-server[994]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5411lb # [ 125.482792] niks3-server[994]: 2026/09/20 09:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5412worker2 # [ 125.536152] nix-grpc-daemon[1420]: time=2026-09-20T09:06:45.178Z level=INFO msg="Uploading 1 narinfos"5413lb # [ 125.488638] niks3-server[994]: 2026/09/20 09:06:45 INFO Signed narinfos id=40 count=15414lb # [ 125.492894] niks3-server[994]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5415lb # [ 125.509214] niks3-server[994]: 2026/09/20 09:06:45 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5416lb # [ 125.515073] niks3-server[994]: 2026/09/20 09:06:45 INFO Completed upload id=405417worker2 # [ 125.563138] nix-grpc-daemon[1420]: time=2026-09-20T09:06:45.205Z level=INFO msg="Upload complete. (304ms)"5418lb # [ 125.517977] niks3-server[994]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5419worker2 # [ 125.576893] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=0 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15420worker2 # [ 125.588490] nix-daemon[836]: reaped child process 1509, status = succeeded5421worker2 # [ 125.622164] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:45Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05422worker2 # [ 125.628864] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:45Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15423worker2 # [ 125.681923] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585725424worker2 # [ 125.698326] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585725425worker2 # [ 125.713758] nix-grpc-daemon[1420]: time=2026-09-20T09:06:45.356Z level=INFO msg="All 1 paths already cached"5426client # copying 1 paths to 'lb:50051'...5427worker2 # [ 125.723792] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585725428client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5429worker2 # [ 125.746931] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5430worker2 # [ 125.952285] nix-daemon[836]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5431worker2 # [ 125.970137] nix-daemon[836]: reaped child process 1538, status = succeeded5432worker2 # [ 126.145663] nix-daemon[836]: accepted connection from pid 1540, user nix-grpc-daemon (trusted)5433worker2 # [ 126.162213] nix-daemon[836]: reaped child process 1543, status = succeeded5434lb # [ 126.126667] niks3-server[994]: 2026/09/20 09:06:45 INFO Received uploads request method=POST path=/api/pending_closures5435worker2 # [ 126.185263] nix-grpc-daemon[1420]: time=2026-09-20T09:06:45.827Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5436worker2 # [ 126.186741] nix-grpc-daemon[1420]: time=2026-09-20T09:06:45.827Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5437lb # [ 126.157142] niks3-server[994]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5438lb # [ 126.174390] niks3-server[994]: 2026/09/20 09:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5439worker2 # [ 126.227494] nix-grpc-daemon[1420]: time=2026-09-20T09:06:45.869Z level=INFO msg="Uploading 1 narinfos"5440lb # [ 126.186029] niks3-server[994]: 2026/09/20 09:06:45 INFO Signed narinfos id=41 count=15441lb # [ 126.192720] niks3-server[994]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5442lb # [ 126.201299] niks3-server[994]: 2026/09/20 09:06:45 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5443lb # [ 126.211007] niks3-server[994]: 2026/09/20 09:06:45 INFO Completed upload id=415444worker2 # [ 126.259147] nix-grpc-daemon[1420]: time=2026-09-20T09:06:45.901Z level=INFO msg="Upload complete. (494ms)"5445lb # [ 126.214302] niks3-server[994]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5446worker2 # [ 126.268231] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=0 paths=1 nar_bytes_in=6405447worker2 # [ 126.280348] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585725448worker2 # [ 126.288339] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5449worker2 # [ 126.293723] nix-daemon[836]: reaped child process 1533, status = succeeded5450client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5451client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5452worker2 # [ 126.307690] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5453client # farm-b> LOG-farm-b-during-drain5454worker2 # [ 127.941861] nix-daemon[836]: reaped child process 1547, status = succeeded5455worker2 # [ 128.119675] nix-daemon[836]: accepted connection from pid 1562, user nix-grpc-daemon (trusted)5456worker2 # [ 128.137465] nix-daemon[836]: reaped child process 1565, status = succeeded5457lb # [ 128.103526] niks3-server[994]: 2026/09/20 09:06:47 INFO Received uploads request method=POST path=/api/pending_closures5458worker2 # [ 128.163109] nix-grpc-daemon[1420]: time=2026-09-20T09:06:47.804Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5459worker2 # [ 128.164709] nix-grpc-daemon[1420]: time=2026-09-20T09:06:47.805Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5460lb # [ 128.142476] niks3-server[994]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5461lb # [ 128.155818] niks3-server[994]: 2026/09/20 09:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5462worker2 # [ 128.209905] nix-grpc-daemon[1420]: time=2026-09-20T09:06:47.852Z level=INFO msg="Uploading 1 narinfos"5463lb # [ 128.167124] niks3-server[994]: 2026/09/20 09:06:47 INFO Signed narinfos id=42 count=15464lb # [ 128.175170] niks3-server[994]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5465lb # [ 128.182883] niks3-server[994]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5466worker2 # [ 128.239933] nix-grpc-daemon[1420]: time=2026-09-20T09:06:47.882Z level=INFO msg="Upload complete. (321ms)"5467lb # [ 128.194807] niks3-server[994]: 2026/09/20 09:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5468lb # [ 128.200214] niks3-server[994]: 2026/09/20 09:06:47 INFO Completed upload id=425469lb # [ 128.203193] niks3-server[994]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5470worker2 # [ 128.254526] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15471worker2 # [ 128.269693] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:47Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05472worker2 # [ 128.276945] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:47Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15473worker2 # [ 128.281375] nix-daemon[836]: reaped child process 1545, status = succeeded5474worker2 # [ 128.317052] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585725475worker2 # [ 128.332916] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585725476worker2 # [ 128.347144] nix-grpc-daemon[1420]: time=2026-09-20T09:06:47.989Z level=INFO msg="All 2 paths already cached"5477client # copying 1 paths to 'lb:50051'...5478worker2 # [ 128.357844] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585725479client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5480worker2 # [ 128.386870] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5481worker2 # [ 128.597361] nix-daemon[836]: accepted connection from pid 1571, user nix-grpc-daemon (trusted)5482worker2 # [ 128.616548] nix-daemon[836]: reaped child process 1574, status = succeeded5483worker2 # [ 128.797811] nix-daemon[836]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)5484worker2 # [ 128.815360] nix-daemon[836]: reaped child process 1579, status = succeeded5485lb # [ 128.778934] niks3-server[994]: 2026/09/20 09:06:48 INFO Received uploads request method=POST path=/api/pending_closures5486worker2 # [ 128.837080] nix-grpc-daemon[1420]: time=2026-09-20T09:06:48.479Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5487worker2 # [ 128.839167] nix-grpc-daemon[1420]: time=2026-09-20T09:06:48.481Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5488lb # [ 128.808563] niks3-server[994]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5489lb # [ 128.820207] niks3-server[994]: 2026/09/20 09:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5490worker2 # [ 128.875452] nix-grpc-daemon[1420]: time=2026-09-20T09:06:48.517Z level=INFO msg="Uploading 1 narinfos"5491lb # [ 128.832334] niks3-server[994]: 2026/09/20 09:06:48 INFO Signed narinfos id=43 count=15492lb # [ 128.835224] niks3-server[994]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5493lb # [ 128.847721] niks3-server[994]: 2026/09/20 09:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5494lb # [ 128.855164] niks3-server[994]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5495lb # [ 128.859830] niks3-server[994]: 2026/09/20 09:06:48 INFO Completed upload id=435496worker2 # [ 128.907621] nix-grpc-daemon[1420]: time=2026-09-20T09:06:48.550Z level=INFO msg="Upload complete. (503ms)"5497worker2 # [ 128.915548] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=0 paths=1 nar_bytes_in=7685498worker2 # [ 128.924952] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585725499worker2 # [ 128.935554] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5500worker2 # [ 128.941881] nix-daemon[836]: reaped child process 1569, status = succeeded5501client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5502client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5503worker2 # [ 128.954725] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5504client # farm-top> LOG-farm-top-during-drain5505worker2 # [ 130.191397] nix-daemon[836]: reaped child process 1583, status = succeeded5506worker2 # [ 130.363630] nix-daemon[836]: accepted connection from pid 1598, user nix-grpc-daemon (trusted)5507worker2 # [ 130.383260] nix-daemon[836]: reaped child process 1601, status = succeeded5508lb # [ 130.349593] niks3-server[994]: 2026/09/20 09:06:49 INFO Received uploads request method=POST path=/api/pending_closures5509worker2 # [ 130.408400] nix-grpc-daemon[1420]: time=2026-09-20T09:06:50.050Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5510worker2 # [ 130.409960] nix-grpc-daemon[1420]: time=2026-09-20T09:06:50.050Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5511lb # [ 130.392623] niks3-server[994]: 2026/09/20 09:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5512worker2 # [ 130.453825] nix-grpc-daemon[1420]: time=2026-09-20T09:06:50.096Z level=INFO msg="Uploading 1 narinfos"5513lb # [ 130.413157] niks3-server[994]: 2026/09/20 09:06:50 INFO Signed narinfos id=44 count=15514lb # [ 130.428496] niks3-server[994]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5515lb # [ 130.441352] niks3-server[994]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5516worker2 # [ 130.493266] nix-grpc-daemon[1420]: time=2026-09-20T09:06:50.136Z level=INFO msg="Upload complete. (328ms)"5517lb # [ 130.448184] niks3-server[994]: 2026/09/20 09:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5518lb # [ 130.456268] niks3-server[994]: 2026/09/20 09:06:50 INFO Completed upload id=445519lb # [ 130.458574] niks3-server[994]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5520worker2 # [ 130.505606] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15521lb # [ 130.466546] niks3-server[994]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5522worker2 # [ 130.523621] nix-daemon[836]: reaped child process 1581, status = succeeded5523client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.65 seconds)5524client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5525client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5526worker1: must succeed: pkill -f 'read -t [9]0 x'5527worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5528client: waiting for success: ! systemctl is-active sw5529worker1 # [ 131.039414] nix-daemon[831]: reaped child process 1636, status = succeeded5530lb # [ 131.059684] envoy[911]: conn peer=[2001:db8:1::1]:35326 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9599 tx=3870 ms=63755531worker1 # [ 131.225792] nix-daemon[831]: accepted connection from pid 1676, user nix-grpc-daemon (trusted)5532worker1 # [ 131.244591] nix-daemon[831]: reaped child process 1679, status = succeeded5533lb # [ 131.252911] niks3-server[994]: 2026/09/20 09:06:50 INFO Received uploads request method=POST path=/api/pending_closures5534worker1 # [ 131.273279] nix-grpc-daemon[1580]: time=2026-09-20T09:06:50.924Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5535worker1 # [ 131.274896] nix-grpc-daemon[1580]: time=2026-09-20T09:06:50.924Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5536lb # [ 131.298765] niks3-server[994]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5537lb # [ 131.311041] niks3-server[994]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5538lb # [ 131.319902] niks3-server[994]: 2026/09/20 09:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5539lb # [ 131.325549] niks3-server[994]: 2026/09/20 09:06:50 INFO Signed narinfos id=45 count=15540worker1 # [ 131.331665] nix-grpc-daemon[1580]: time=2026-09-20T09:06:50.982Z level=INFO msg="Uploading 1 narinfos"5541lb # [ 131.330563] niks3-server[994]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5542lb # [ 131.340278] niks3-server[994]: 2026/09/20 09:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5543lb # [ 131.346669] niks3-server[994]: 2026/09/20 09:06:50 INFO Completed upload id=455544worker1 # [ 131.351390] nix-grpc-daemon[1580]: time=2026-09-20T09:06:51.003Z level=INFO msg="Upload complete. (345ms)"5545lb # [ 131.350304] niks3-server[994]: 2026/09/20 09:06:51 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5546worker1 # [ 131.365225] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58770 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15547worker1 # [ 131.382885] nix-daemon[831]: reaped child process 1634, status = succeeded5548client # [ 131.438544] systemd[1]: sw.service: Deactivated successfully.5549client # [ 131.443151] systemd[1]: sw.service: Consumed 155ms CPU time over 10.347s wall clock time, 37M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5550client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5551client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5552client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5553worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5554worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.07 seconds)5555lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5556lb: must succeed: curl -sf localhost:9901/clusters5557lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5558worker1 # [ 132.296600] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:51Z level=info event=signal_exit5559lb: must succeed: curl -sf localhost:9901/clusters5560lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5561worker2 # [ 133.566338] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:452845562worker2 # [ 133.566688] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:53Z level=info event=worker_gone addr=192.168.1.3:500515563worker1 # [ 133.517256] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:53Z level=info event=scheduler_restarting5564worker1 # [ 133.548471] nix-grpc-daemon[1479]: ts=2026-09-20T09:06:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5565worker1 # [ 133.572592] nix-daemon[831]: reaped child process 1548, status = succeeded5566worker1 # [ 134.126852] nix-grpc-daemon[1479]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5567worker1 # [ 134.131583] nix-grpc-daemon[1479]: E0000 00:00:1789895213.778790 1522 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5568worker1 # [ 134.138310] nix-grpc-daemon[1479]: E0000 00:00:1789895213.779163 1522 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5569lb: must succeed: curl -sf localhost:9901/clusters5570lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5571worker1 # [ 134.336946] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5572worker1 # [ 134.339789] systemd[1]: nix-grpc-daemon.service: Consumed 881ms CPU time over 28.265s wall clock time, 33M memory peak, 20.5K incoming IP traffic, 26.8K outgoing IP traffic.5573lb: must succeed: curl -sf localhost:9901/clusters5574worker1 # [ 135.330989] systemd[1]: Starting Nix worker-protocol over gRPC...5575lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5576worker1 # [ 135.539810] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5577worker1 # [ 135.542500] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15578worker1 # [ 135.550385] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5579worker1 # [ 135.561218] systemd[1]: Started Nix worker-protocol over gRPC.5580worker1 # [ 135.596837] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:55Z level=info event=scheduler_connected addr=lb:500515581worker2 # [ 135.643244] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:55Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05582lb: must succeed: curl -sf localhost:9901/clusters5583lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5584lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 4.42 seconds)5585lb: must succeed: curl -sf localhost:9901/clusters5586lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5587worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5588worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5589(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.62 seconds)5590subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5591client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15592worker2 # [ 136.915647] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:585725593worker1 # [ 136.889317] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:364945594worker1 # [ 136.905145] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5595worker1 # [ 136.929408] nix-grpc-daemon[1691]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 1/5)5596worker1 # [ 136.982261] nix-grpc-daemon[1691]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 186 ms (attempt 2/5)5597worker1 # [ 137.176095] nix-grpc-daemon[1691]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 368 ms (attempt 3/5)5598worker1 # [ 137.552753] nix-grpc-daemon[1691]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 746 ms (attempt 4/5)5599worker1 # [ 138.309826] nix-grpc-daemon[1691]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5600worker2 # [ 138.405213] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:58Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05601worker2 # [ 138.411145] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:58Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15602worker2 # [ 138.417179] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:58Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05603worker2 # [ 138.422526] nix-grpc-daemon[1348]: ts=2026-09-20T09:06:58Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05604worker1 # [ 138.411024] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945605worker1 # [ 138.427481] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:364945606worker1 # [ 138.442235] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:364945607worker1 # [ 138.457814] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5608worker1 # [ 138.486737] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:58Z level=info event=niks3_push_started pid=17475609worker1 # [ 138.882652] nix-daemon[831]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)5610worker1 # [ 138.901460] nix-daemon[831]: reaped child process 1763, status = succeeded5611worker1 # [ 139.075009] nix-daemon[831]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)5612worker1 # [ 139.093052] nix-daemon[831]: reaped child process 1768, status = succeeded5613lb # [ 139.102561] niks3-server[994]: 2026/09/20 09:06:58 INFO Received uploads request method=POST path=/api/pending_closures5614worker1 # [ 139.119966] nix-grpc-daemon[1747]: time=2026-09-20T09:06:58.770Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5615worker1 # [ 139.121896] nix-grpc-daemon[1747]: time=2026-09-20T09:06:58.770Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5616lb # [ 139.143817] niks3-server[994]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5617worker1 # [ 139.162338] nix-grpc-daemon[1747]: time=2026-09-20T09:06:58.814Z level=INFO msg="Uploading 1 narinfos"5618lb # [ 139.157112] niks3-server[994]: 2026/09/20 09:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5619lb # [ 139.169518] niks3-server[994]: 2026/09/20 09:06:58 INFO Signed narinfos id=46 count=15620lb # [ 139.175406] niks3-server[994]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5621lb # [ 139.183724] niks3-server[994]: 2026/09/20 09:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5622lb # [ 139.197717] niks3-server[994]: 2026/09/20 09:06:58 INFO Completed upload id=465623worker1 # [ 139.203118] nix-grpc-daemon[1747]: time=2026-09-20T09:06:58.855Z level=INFO msg="Upload complete. (500ms)"5624lb # [ 139.201249] niks3-server[994]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5625worker1 # [ 139.212295] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=0 paths=1 nar_bytes_in=5125626worker1 # [ 139.228384] nix-grpc-daemon[1691]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945627worker1 # [ 139.236596] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5628worker1 # [ 139.242319] nix-daemon[831]: reaped child process 1745, status = succeeded5629worker1 # [ 139.254214] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5630worker1 # [ 140.300889] nix-daemon[831]: reaped child process 1772, status = succeeded5631worker1 # [ 140.482101] nix-daemon[831]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)5632worker1 # [ 140.501023] nix-daemon[831]: reaped child process 1790, status = succeeded5633lb # [ 140.510560] niks3-server[994]: 2026/09/20 09:07:00 INFO Received uploads request method=POST path=/api/pending_closures5634worker1 # [ 140.528270] nix-grpc-daemon[1747]: time=2026-09-20T09:07:00.177Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5635worker1 # [ 140.529817] nix-grpc-daemon[1747]: time=2026-09-20T09:07:00.177Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5636lb # [ 140.544600] niks3-server[994]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5637lb # [ 140.557519] niks3-server[994]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5638lb # [ 140.572533] niks3-server[994]: 2026/09/20 09:07:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5639worker1 # [ 140.585930] nix-grpc-daemon[1747]: time=2026-09-20T09:07:00.237Z level=INFO msg="Uploading 1 narinfos"5640lb # [ 140.587252] niks3-server[994]: 2026/09/20 09:07:00 INFO Signed narinfos id=47 count=15641lb # [ 140.593436] niks3-server[994]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5642lb # [ 140.600087] niks3-server[994]: 2026/09/20 09:07:00 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5643lb # [ 140.606664] niks3-server[994]: 2026/09/20 09:07:00 INFO Completed upload id=475644worker1 # [ 140.611432] nix-grpc-daemon[1747]: time=2026-09-20T09:07:00.263Z level=INFO msg="Upload complete. (343ms)"5645lb # [ 140.609708] niks3-server[994]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5646worker1 # [ 140.622433] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15647worker2 # [ 140.668727] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:00Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15648worker2 # [ 140.677692] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:00Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05649worker1 # [ 140.641873] nix-daemon[831]: reaped child process 1770, status = succeeded5650worker1 # [ 140.669662] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945651worker1 # [ 140.685470] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:364945652worker1 # [ 140.700086] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:364945653worker1 # [ 140.713966] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5654worker1 # [ 140.920105] nix-daemon[831]: accepted connection from pid 1794, user nix-grpc-daemon (trusted)5655worker1 # [ 140.937126] nix-daemon[831]: reaped child process 1797, status = succeeded5656lb # [ 141.059858] envoy[911]: conn peer=[2001:db8:1::1]:35320 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1350 ms=100815657lb # [ 141.065048] envoy[911]: conn peer=[2001:db8:1::3]:52432 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=272185658worker1 # [ 141.120117] nix-daemon[831]: accepted connection from pid 1799, user nix-grpc-daemon (trusted)5659worker1 # [ 141.137000] nix-daemon[831]: reaped child process 1802, status = succeeded5660lb # [ 141.145460] niks3-server[994]: 2026/09/20 09:07:00 INFO Received uploads request method=POST path=/api/pending_closures5661worker1 # [ 141.160060] nix-grpc-daemon[1747]: time=2026-09-20T09:07:00.812Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5662worker1 # [ 141.161600] nix-grpc-daemon[1747]: time=2026-09-20T09:07:00.812Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5663lb # [ 141.179579] niks3-server[994]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5664worker1 # [ 141.203587] nix-grpc-daemon[1747]: time=2026-09-20T09:07:00.855Z level=INFO msg="Uploading 1 narinfos"5665lb # [ 141.191873] niks3-server[994]: 2026/09/20 09:07:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5666lb # [ 141.202916] niks3-server[994]: 2026/09/20 09:07:00 INFO Signed narinfos id=48 count=15667lb # [ 141.210159] niks3-server[994]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5668lb # [ 141.216461] niks3-server[994]: 2026/09/20 09:07:00 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5669lb # [ 141.225597] niks3-server[994]: 2026/09/20 09:07:00 INFO Completed upload id=485670worker1 # [ 141.230875] nix-grpc-daemon[1747]: time=2026-09-20T09:07:00.883Z level=INFO msg="Upload complete. (501ms)"5671lb # [ 141.228859] niks3-server[994]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5672worker1 # [ 141.240321] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=0 paths=1 nar_bytes_in=5125673worker1 # [ 141.255182] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945674worker1 # [ 141.261962] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5675worker1 # [ 141.267130] nix-daemon[831]: reaped child process 1792, status = succeeded5676worker1 # [ 141.282433] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5677worker1 # [ 142.926700] nix-daemon[831]: reaped child process 1806, status = succeeded5678worker1 # [ 143.096071] nix-daemon[831]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)5679worker1 # [ 143.112637] nix-daemon[831]: reaped child process 1824, status = succeeded5680lb # [ 143.122702] niks3-server[994]: 2026/09/20 09:07:02 INFO Received uploads request method=POST path=/api/pending_closures5681worker1 # [ 143.137879] nix-grpc-daemon[1747]: time=2026-09-20T09:07:02.789Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5682worker1 # [ 143.139448] nix-grpc-daemon[1747]: time=2026-09-20T09:07:02.789Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5683lb # [ 143.161293] niks3-server[994]: 2026/09/20 09:07:02 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5684worker1 # [ 143.179251] nix-grpc-daemon[1747]: time=2026-09-20T09:07:02.831Z level=INFO msg="Uploading 1 narinfos"5685lb # [ 143.177788] niks3-server[994]: 2026/09/20 09:07:02 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5686lb # [ 143.186959] niks3-server[994]: 2026/09/20 09:07:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5687lb # [ 143.192527] niks3-server[994]: 2026/09/20 09:07:02 INFO Signed narinfos id=49 count=15688lb # [ 143.201025] niks3-server[994]: 2026/09/20 09:07:02 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5689lb # [ 143.205472] niks3-server[994]: 2026/09/20 09:07:02 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5690worker1 # [ 143.215208] nix-grpc-daemon[1747]: time=2026-09-20T09:07:02.867Z level=INFO msg="Upload complete. (319ms)"5691lb # [ 143.210662] niks3-server[994]: 2026/09/20 09:07:02 INFO Completed upload id=495692lb # [ 143.214093] niks3-server[994]: 2026/09/20 09:07:02 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5693worker1 # [ 143.225038] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15694worker2 # [ 143.269334] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:02Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15695worker2 # [ 143.282574] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:02Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05696worker1 # [ 143.244405] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945697worker1 # [ 143.251604] nix-daemon[831]: reaped child process 1804, status = succeeded5698worker1 # [ 143.256336] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:364945699worker1 # [ 143.265931] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:364945700worker1 # [ 143.279573] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5701worker1 # [ 143.470263] nix-daemon[831]: accepted connection from pid 1828, user nix-grpc-daemon (trusted)5702worker1 # [ 143.491354] nix-daemon[831]: reaped child process 1831, status = succeeded5703worker1 # [ 143.675309] nix-daemon[831]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)5704worker1 # [ 143.695599] nix-daemon[831]: reaped child process 1836, status = succeeded5705lb # [ 143.703455] niks3-server[994]: 2026/09/20 09:07:03 INFO Received uploads request method=POST path=/api/pending_closures5706worker1 # [ 143.718221] nix-grpc-daemon[1747]: time=2026-09-20T09:07:03.370Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5707worker1 # [ 143.719792] nix-grpc-daemon[1747]: time=2026-09-20T09:07:03.370Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5708lb # [ 143.735470] niks3-server[994]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5709worker1 # [ 143.755052] nix-grpc-daemon[1747]: time=2026-09-20T09:07:03.407Z level=INFO msg="Uploading 1 narinfos"5710lb # [ 143.753205] niks3-server[994]: 2026/09/20 09:07:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5711lb # [ 143.762557] niks3-server[994]: 2026/09/20 09:07:03 INFO Signed narinfos id=50 count=15712worker1 # [ 143.777287] nix-grpc-daemon[1747]: time=2026-09-20T09:07:03.429Z level=INFO msg="Upload complete. (485ms)"5713lb # [ 143.772230] niks3-server[994]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5714lb # [ 143.776451] niks3-server[994]: 2026/09/20 09:07:03 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5715lb # [ 143.780549] niks3-server[994]: 2026/09/20 09:07:03 INFO Completed upload id=505716worker1 # [ 143.784125] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=0 paths=1 nar_bytes_in=5125717lb # [ 143.782475] niks3-server[994]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5718worker1 # [ 143.797595] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945719worker1 # [ 143.803664] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5720worker1 # [ 143.808892] nix-daemon[831]: reaped child process 1826, status = succeeded5721worker1 # [ 143.821958] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5722worker1 # [ 144.447576] nix-daemon[831]: reaped child process 1840, status = succeeded5723worker1 # [ 144.616846] nix-daemon[831]: accepted connection from pid 1855, user nix-grpc-daemon (trusted)5724worker1 # [ 144.634692] nix-daemon[831]: reaped child process 1858, status = succeeded5725lb # [ 144.642901] niks3-server[994]: 2026/09/20 09:07:04 INFO Received uploads request method=POST path=/api/pending_closures5726worker1 # [ 144.659392] nix-grpc-daemon[1747]: time=2026-09-20T09:07:04.310Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5727worker1 # [ 144.661091] nix-grpc-daemon[1747]: time=2026-09-20T09:07:04.310Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5728lb # [ 144.675951] niks3-server[994]: 2026/09/20 09:07:04 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5729lb # [ 144.693131] niks3-server[994]: 2026/09/20 09:07:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5730worker1 # [ 144.703928] nix-grpc-daemon[1747]: time=2026-09-20T09:07:04.356Z level=INFO msg="Uploading 1 narinfos"5731lb # [ 144.704946] niks3-server[994]: 2026/09/20 09:07:04 INFO Signed narinfos id=51 count=15732lb # [ 144.707275] niks3-server[994]: 2026/09/20 09:07:04 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5733lb # [ 144.715348] niks3-server[994]: 2026/09/20 09:07:04 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5734lb # [ 144.722382] niks3-server[994]: 2026/09/20 09:07:04 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5735lb # [ 144.726025] niks3-server[994]: 2026/09/20 09:07:04 INFO Completed upload id=515736worker1 # [ 144.727409] nix-grpc-daemon[1747]: time=2026-09-20T09:07:04.379Z level=INFO msg="Upload complete. (296ms)"5737lb # [ 144.728830] niks3-server[994]: 2026/09/20 09:07:04 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5738worker2 # [ 144.778782] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:04Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15739worker1 # [ 144.737128] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=0 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15740worker2 # [ 144.791982] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:04Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05741worker1 # [ 144.752665] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945742worker1 # [ 144.757870] nix-daemon[831]: reaped child process 1838, status = succeeded5743worker1 # [ 144.765093] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:364945744worker1 # [ 144.777011] nix-grpc-daemon[1747]: time=2026-09-20T09:07:04.429Z level=INFO msg="All 1 paths already cached"5745worker1 # [ 144.784096] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:364945746worker1 # [ 144.801620] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5747worker1 # [ 144.991788] nix-daemon[831]: accepted connection from pid 1862, user nix-grpc-daemon (trusted)5748worker1 # [ 145.009968] nix-daemon[831]: reaped child process 1865, status = succeeded5749worker1 # [ 145.186427] nix-daemon[831]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)5750worker1 # [ 145.204491] nix-daemon[831]: reaped child process 1870, status = succeeded5751lb # [ 145.211013] niks3-server[994]: 2026/09/20 09:07:04 INFO Received uploads request method=POST path=/api/pending_closures5752worker1 # [ 145.230115] nix-grpc-daemon[1747]: time=2026-09-20T09:07:04.882Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5753worker1 # [ 145.231696] nix-grpc-daemon[1747]: time=2026-09-20T09:07:04.882Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5754lb # [ 145.246275] niks3-server[994]: 2026/09/20 09:07:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5755worker1 # [ 145.259825] nix-grpc-daemon[1747]: time=2026-09-20T09:07:04.912Z level=INFO msg="Uploading 1 narinfos"5756lb # [ 145.259920] niks3-server[994]: 2026/09/20 09:07:04 INFO Signed narinfos id=52 count=15757lb # [ 145.262671] niks3-server[994]: 2026/09/20 09:07:04 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5758lb # [ 145.276480] niks3-server[994]: 2026/09/20 09:07:04 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5759lb # [ 145.280309] niks3-server[994]: 2026/09/20 09:07:04 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5760lb # [ 145.284499] niks3-server[994]: 2026/09/20 09:07:04 INFO Completed upload id=525761worker1 # [ 145.289358] nix-grpc-daemon[1747]: time=2026-09-20T09:07:04.941Z level=INFO msg="Upload complete. (475ms)"5762lb # [ 145.286743] niks3-server[994]: 2026/09/20 09:07:04 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5763worker1 # [ 145.296284] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=0 paths=1 nar_bytes_in=6245764worker1 # [ 145.311185] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945765worker1 # [ 145.317927] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5766worker1 # [ 145.322938] nix-daemon[831]: reaped child process 1860, status = succeeded5767worker1 # [ 145.336193] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5768worker1 # [ 146.983906] nix-daemon[831]: reaped child process 1874, status = succeeded5769worker1 # [ 147.162154] nix-daemon[831]: accepted connection from pid 1889, user nix-grpc-daemon (trusted)5770worker1 # [ 147.181133] nix-daemon[831]: reaped child process 1892, status = succeeded5771lb # [ 147.190993] niks3-server[994]: 2026/09/20 09:07:06 INFO Received uploads request method=POST path=/api/pending_closures5772worker1 # [ 147.207824] nix-grpc-daemon[1747]: time=2026-09-20T09:07:06.858Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5773worker1 # [ 147.211598] nix-grpc-daemon[1747]: time=2026-09-20T09:07:06.858Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5774lb # [ 147.225367] niks3-server[994]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5775lb # [ 147.239206] niks3-server[994]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5776lb # [ 147.255830] niks3-server[994]: 2026/09/20 09:07:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5777worker1 # [ 147.267564] nix-grpc-daemon[1747]: time=2026-09-20T09:07:06.919Z level=INFO msg="Uploading 1 narinfos"5778lb # [ 147.267975] niks3-server[994]: 2026/09/20 09:07:06 INFO Signed narinfos id=53 count=15779lb # [ 147.274699] niks3-server[994]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5780worker1 # [ 147.288705] nix-grpc-daemon[1747]: time=2026-09-20T09:07:06.941Z level=INFO msg="Upload complete. (340ms)"5781lb # [ 147.284129] niks3-server[994]: 2026/09/20 09:07:06 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5782lb # [ 147.290524] niks3-server[994]: 2026/09/20 09:07:06 INFO Completed upload id=535783lb # [ 147.293645] niks3-server[994]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5784worker2 # [ 147.339530] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:06Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15785worker1 # [ 147.300492] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15786worker2 # [ 147.353726] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:06Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05787worker1 # [ 147.320718] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945788worker1 # [ 147.328495] nix-daemon[831]: reaped child process 1872, status = succeeded5789worker1 # [ 147.336623] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:364945790worker1 # [ 147.348577] nix-grpc-daemon[1747]: time=2026-09-20T09:07:07.000Z level=INFO msg="All 1 paths already cached"5791worker1 # [ 147.357569] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:364945792worker1 # [ 147.370657] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5793worker1 # [ 147.566439] nix-daemon[831]: accepted connection from pid 1896, user nix-grpc-daemon (trusted)5794worker1 # [ 147.585483] nix-daemon[831]: reaped child process 1899, status = succeeded5795worker1 # [ 147.762710] nix-daemon[831]: accepted connection from pid 1901, user nix-grpc-daemon (trusted)5796worker1 # [ 147.781519] nix-daemon[831]: reaped child process 1904, status = succeeded5797lb # [ 147.787980] niks3-server[994]: 2026/09/20 09:07:07 INFO Received uploads request method=POST path=/api/pending_closures5798worker1 # [ 147.801724] nix-grpc-daemon[1747]: time=2026-09-20T09:07:07.453Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5799worker1 # [ 147.803260] nix-grpc-daemon[1747]: time=2026-09-20T09:07:07.453Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5800lb # [ 147.814069] niks3-server[994]: 2026/09/20 09:07:07 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5801lb # [ 147.828148] niks3-server[994]: 2026/09/20 09:07:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5802worker1 # [ 147.838969] nix-grpc-daemon[1747]: time=2026-09-20T09:07:07.491Z level=INFO msg="Uploading 1 narinfos"5803lb # [ 147.840347] niks3-server[994]: 2026/09/20 09:07:07 INFO Signed narinfos id=54 count=15804lb # [ 147.846134] niks3-server[994]: 2026/09/20 09:07:07 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5805worker1 # [ 147.860154] nix-grpc-daemon[1747]: time=2026-09-20T09:07:07.512Z level=INFO msg="Upload complete. (475ms)"5806lb # [ 147.855563] niks3-server[994]: 2026/09/20 09:07:07 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5807lb # [ 147.861386] niks3-server[994]: 2026/09/20 09:07:07 INFO Completed upload id=545808worker1 # [ 147.866397] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=0 paths=1 nar_bytes_in=6245809lb # [ 147.864964] niks3-server[994]: 2026/09/20 09:07:07 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5810worker1 # [ 147.879279] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945811worker1 # [ 147.885207] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5812worker1 # [ 147.890070] nix-daemon[831]: reaped child process 1894, status = succeeded5813worker1 # [ 147.900688] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5814worker1 # [ 148.749663] nix-daemon[831]: reaped child process 1908, status = succeeded5815worker1 # [ 148.938407] nix-daemon[831]: accepted connection from pid 1923, user nix-grpc-daemon (trusted)5816worker1 # [ 148.955840] nix-daemon[831]: reaped child process 1926, status = succeeded5817lb # [ 148.963317] niks3-server[994]: 2026/09/20 09:07:08 INFO Received uploads request method=POST path=/api/pending_closures5818worker1 # [ 148.980433] nix-grpc-daemon[1747]: time=2026-09-20T09:07:08.630Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5819worker1 # [ 148.982121] nix-grpc-daemon[1747]: time=2026-09-20T09:07:08.630Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5820lb # [ 149.003398] niks3-server[994]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5821lb # [ 149.015772] niks3-server[994]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5822worker1 # [ 149.039300] nix-grpc-daemon[1747]: time=2026-09-20T09:07:08.691Z level=INFO msg="Uploading 1 narinfos"5823lb # [ 149.029325] niks3-server[994]: 2026/09/20 09:07:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5824lb # [ 149.038807] niks3-server[994]: 2026/09/20 09:07:08 INFO Signed narinfos id=55 count=15825lb # [ 149.044650] niks3-server[994]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5826lb # [ 149.051120] niks3-server[994]: 2026/09/20 09:07:08 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5827lb # [ 149.058580] niks3-server[994]: 2026/09/20 09:07:08 INFO Completed upload id=555828worker1 # [ 149.063321] nix-grpc-daemon[1747]: time=2026-09-20T09:07:08.715Z level=INFO msg="Upload complete. (350ms)"5829lb # [ 149.061607] niks3-server[994]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5830worker2 # [ 149.118566] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:08Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15831worker2 # [ 149.129612] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:08Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05832worker1 # [ 149.077851] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15833worker1 # [ 149.093678] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945834worker1 # [ 149.105259] nix-daemon[831]: reaped child process 1906, status = succeeded5835worker1 # [ 149.111645] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:364945836worker1 # [ 149.125873] nix-grpc-daemon[1747]: time=2026-09-20T09:07:08.778Z level=INFO msg="All 1 paths already cached"5837worker1 # [ 149.134515] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:364945838worker1 # [ 149.148844] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5839worker1 # [ 149.349918] nix-daemon[831]: accepted connection from pid 1930, user nix-grpc-daemon (trusted)5840worker1 # [ 149.369417] nix-daemon[831]: reaped child process 1933, status = succeeded5841worker1 # [ 149.547460] nix-daemon[831]: accepted connection from pid 1935, user nix-grpc-daemon (trusted)5842worker1 # [ 149.567287] nix-daemon[831]: reaped child process 1938, status = succeeded5843lb # [ 149.573860] niks3-server[994]: 2026/09/20 09:07:09 INFO Received uploads request method=POST path=/api/pending_closures5844worker1 # [ 149.587799] nix-grpc-daemon[1747]: time=2026-09-20T09:07:09.239Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5845worker1 # [ 149.589570] nix-grpc-daemon[1747]: time=2026-09-20T09:07:09.239Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5846lb # [ 149.603106] niks3-server[994]: 2026/09/20 09:07:09 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5847worker1 # [ 149.619517] nix-grpc-daemon[1747]: time=2026-09-20T09:07:09.271Z level=INFO msg="Uploading 1 narinfos"5848lb # [ 149.617845] niks3-server[994]: 2026/09/20 09:07:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5849lb # [ 149.628993] niks3-server[994]: 2026/09/20 09:07:09 INFO Signed narinfos id=56 count=15850lb # [ 149.636779] niks3-server[994]: 2026/09/20 09:07:09 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5851worker1 # [ 149.646247] nix-grpc-daemon[1747]: time=2026-09-20T09:07:09.298Z level=INFO msg="Upload complete. (483ms)"5852lb # [ 149.641911] niks3-server[994]: 2026/09/20 09:07:09 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5853lb # [ 149.647556] niks3-server[994]: 2026/09/20 09:07:09 INFO Completed upload id=565854worker1 # [ 149.656250] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=0 paths=1 nar_bytes_in=6245855lb # [ 149.651965] niks3-server[994]: 2026/09/20 09:07:09 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5856worker1 # [ 149.665792] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945857worker1 # [ 149.672264] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5858worker1 # [ 149.677094] nix-daemon[831]: reaped child process 1928, status = succeeded5859worker1 # [ 149.689265] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5860worker1 # [ 150.709126] nix-daemon[831]: reaped child process 1942, status = succeeded5861worker1 # [ 150.869546] nix-daemon[831]: accepted connection from pid 1957, user nix-grpc-daemon (trusted)5862worker1 # [ 150.888450] nix-daemon[831]: reaped child process 1960, status = succeeded5863lb # [ 150.895595] niks3-server[994]: 2026/09/20 09:07:10 INFO Received uploads request method=POST path=/api/pending_closures5864worker1 # [ 150.910566] nix-grpc-daemon[1747]: time=2026-09-20T09:07:10.561Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5865worker1 # [ 150.912120] nix-grpc-daemon[1747]: time=2026-09-20T09:07:10.561Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5866lb # [ 150.933580] niks3-server[994]: 2026/09/20 09:07:10 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5867worker1 # [ 150.950979] nix-grpc-daemon[1747]: time=2026-09-20T09:07:10.603Z level=INFO msg="Uploading 1 narinfos"5868lb # [ 150.945982] niks3-server[994]: 2026/09/20 09:07:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5869lb # [ 150.955843] niks3-server[994]: 2026/09/20 09:07:10 INFO Signed narinfos id=57 count=15870worker1 # [ 150.969342] nix-grpc-daemon[1747]: time=2026-09-20T09:07:10.621Z level=INFO msg="Upload complete. (271ms)"5871lb # [ 150.965038] niks3-server[994]: 2026/09/20 09:07:10 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5872lb # [ 150.970133] niks3-server[994]: 2026/09/20 09:07:10 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5873lb # [ 150.973749] niks3-server[994]: 2026/09/20 09:07:10 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5874worker2 # [ 151.019391] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:10Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15875lb # [ 150.977211] niks3-server[994]: 2026/09/20 09:07:10 INFO Completed upload id=575876lb # [ 150.979497] niks3-server[994]: 2026/09/20 09:07:10 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5877worker1 # [ 150.976720] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=15878worker1 # [ 150.991400] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945879worker2 # [ 151.033374] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:10Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05880worker1 # [ 150.996240] nix-daemon[831]: reaped child process 1940, status = succeeded5881worker1 # [ 151.002815] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:364945882worker1 # [ 151.013009] nix-grpc-daemon[1747]: time=2026-09-20T09:07:10.665Z level=INFO msg="All 2 paths already cached"5883worker1 # [ 151.019812] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:364945884worker1 # [ 151.030446] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5885worker1 # [ 151.217368] nix-daemon[831]: accepted connection from pid 1964, user nix-grpc-daemon (trusted)5886worker1 # [ 151.234654] nix-daemon[831]: reaped child process 1967, status = succeeded5887worker1 # [ 151.408378] nix-daemon[831]: accepted connection from pid 1969, user nix-grpc-daemon (trusted)5888worker1 # [ 151.423886] nix-daemon[831]: reaped child process 1972, status = succeeded5889lb # [ 151.434747] niks3-server[994]: 2026/09/20 09:07:11 INFO Received uploads request method=POST path=/api/pending_closures5890worker1 # [ 151.449095] nix-grpc-daemon[1747]: time=2026-09-20T09:07:11.101Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5891worker1 # [ 151.450815] nix-grpc-daemon[1747]: time=2026-09-20T09:07:11.101Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5892lb # [ 151.460615] niks3-server[994]: 2026/09/20 09:07:11 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5893worker1 # [ 151.478435] nix-grpc-daemon[1747]: time=2026-09-20T09:07:11.130Z level=INFO msg="Uploading 1 narinfos"5894lb # [ 151.476482] niks3-server[994]: 2026/09/20 09:07:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5895lb # [ 151.487197] niks3-server[994]: 2026/09/20 09:07:11 INFO Signed narinfos id=58 count=15896lb # [ 151.495411] niks3-server[994]: 2026/09/20 09:07:11 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5897lb # [ 151.504725] niks3-server[994]: 2026/09/20 09:07:11 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5898lb # [ 151.508710] niks3-server[994]: 2026/09/20 09:07:11 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5899worker1 # [ 151.513923] nix-grpc-daemon[1747]: time=2026-09-20T09:07:11.166Z level=INFO msg="Upload complete. (472ms)"5900lb # [ 151.512144] niks3-server[994]: 2026/09/20 09:07:11 INFO Completed upload id=585901worker1 # [ 151.523425] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=0 paths=1 nar_bytes_in=7525902worker1 # [ 151.535054] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945903worker1 # [ 151.543449] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5904worker1 # [ 151.545846] nix-daemon[831]: reaped child process 1962, status = succeeded5905worker1 # [ 151.558947] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5906worker1 # [ 152.582161] nix-daemon[831]: reaped child process 1976, status = succeeded5907worker1 # [ 152.747790] nix-daemon[831]: accepted connection from pid 1991, user nix-grpc-daemon (trusted)5908worker1 # [ 152.763980] nix-daemon[831]: reaped child process 1994, status = succeeded5909lb # [ 152.774706] niks3-server[994]: 2026/09/20 09:07:12 INFO Received uploads request method=POST path=/api/pending_closures5910worker1 # [ 152.792410] nix-grpc-daemon[1747]: time=2026-09-20T09:07:12.441Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5911worker1 # [ 152.793963] nix-grpc-daemon[1747]: time=2026-09-20T09:07:12.441Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5912lb # [ 152.806855] niks3-server[994]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5913lb # [ 152.819941] niks3-server[994]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5914lb # [ 152.835552] niks3-server[994]: 2026/09/20 09:07:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5915worker1 # [ 152.847359] nix-grpc-daemon[1747]: time=2026-09-20T09:07:12.499Z level=INFO msg="Uploading 1 narinfos"5916lb # [ 152.848292] niks3-server[994]: 2026/09/20 09:07:12 INFO Signed narinfos id=59 count=15917lb # [ 152.853955] niks3-server[994]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5918worker1 # [ 152.868355] nix-grpc-daemon[1747]: time=2026-09-20T09:07:12.520Z level=INFO msg="Upload complete. (299ms)"5919lb # [ 152.863357] niks3-server[994]: 2026/09/20 09:07:12 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5920lb # [ 152.868775] niks3-server[994]: 2026/09/20 09:07:12 INFO Completed upload id=595921lb # [ 152.871902] niks3-server[994]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5922worker2 # [ 152.918812] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:12Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15923worker1 # [ 152.878269] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=15924worker1 # [ 152.893895] nix-daemon[831]: reaped child process 1974, status = succeeded5925worker1 # [ 152.920994] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945926worker1 # [ 152.936626] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:364945927worker1 # [ 152.950676] nix-grpc-daemon[1747]: time=2026-09-20T09:07:12.603Z level=INFO msg="All 2 paths already cached"5928worker1 # [ 152.959770] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:364945929worker1 # [ 152.973905] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5930worker1 # [ 153.171632] nix-daemon[831]: accepted connection from pid 1998, user nix-grpc-daemon (trusted)5931worker1 # [ 153.190849] nix-daemon[831]: reaped child process 2001, status = succeeded5932worker1 # [ 153.359939] nix-daemon[831]: accepted connection from pid 2003, user nix-grpc-daemon (trusted)5933worker1 # [ 153.377803] nix-daemon[831]: reaped child process 2006, status = succeeded5934lb # [ 153.384234] niks3-server[994]: 2026/09/20 09:07:13 INFO Received uploads request method=POST path=/api/pending_closures5935worker1 # [ 153.397831] nix-grpc-daemon[1747]: time=2026-09-20T09:07:13.049Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5936worker1 # [ 153.399361] nix-grpc-daemon[1747]: time=2026-09-20T09:07:13.050Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"5937lb # [ 153.409407] niks3-server[994]: 2026/09/20 09:07:13 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst5938lb # [ 153.422680] niks3-server[994]: 2026/09/20 09:07:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign5939worker1 # [ 153.433867] nix-grpc-daemon[1747]: time=2026-09-20T09:07:13.086Z level=INFO msg="Uploading 1 narinfos"5940lb # [ 153.435562] niks3-server[994]: 2026/09/20 09:07:13 INFO Signed narinfos id=60 count=15941lb # [ 153.441838] niks3-server[994]: 2026/09/20 09:07:13 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls5942worker1 # [ 153.454101] nix-grpc-daemon[1747]: time=2026-09-20T09:07:13.106Z level=INFO msg="Upload complete. (464ms)"5943lb # [ 153.450258] niks3-server[994]: 2026/09/20 09:07:13 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete5944lb # [ 153.455731] niks3-server[994]: 2026/09/20 09:07:13 INFO Completed upload id=605945lb # [ 153.459134] niks3-server[994]: 2026/09/20 09:07:13 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo5946worker1 # [ 153.465001] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=0 paths=1 nar_bytes_in=7525947worker1 # [ 153.472902] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945948worker1 # [ 153.481714] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5949worker1 # [ 153.484268] nix-daemon[831]: reaped child process 1996, status = succeeded5950worker1 # [ 153.496203] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5951worker1 # [ 154.943350] nix-daemon[831]: reaped child process 2010, status = succeeded5952worker1 # [ 155.133066] nix-daemon[831]: accepted connection from pid 2025, user nix-grpc-daemon (trusted)5953worker1 # [ 155.152871] nix-daemon[831]: reaped child process 2028, status = succeeded5954lb # [ 155.161465] niks3-server[994]: 2026/09/20 09:07:14 INFO Received uploads request method=POST path=/api/pending_closures5955worker1 # [ 155.175746] nix-grpc-daemon[1747]: time=2026-09-20T09:07:14.826Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5956worker1 # [ 155.177856] nix-grpc-daemon[1747]: time=2026-09-20T09:07:14.826Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"5957lb # [ 155.194762] niks3-server[994]: 2026/09/20 09:07:14 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv5958lb # [ 155.207364] niks3-server[994]: 2026/09/20 09:07:14 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst5959lb # [ 155.216937] niks3-server[994]: 2026/09/20 09:07:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign5960worker1 # [ 155.227668] nix-grpc-daemon[1747]: time=2026-09-20T09:07:14.879Z level=INFO msg="Uploading 1 narinfos"5961lb # [ 155.226020] niks3-server[994]: 2026/09/20 09:07:14 INFO Signed narinfos id=61 count=15962lb # [ 155.232151] niks3-server[994]: 2026/09/20 09:07:14 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls5963lb # [ 155.238089] niks3-server[994]: 2026/09/20 09:07:14 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete5964lb # [ 155.247008] niks3-server[994]: 2026/09/20 09:07:14 INFO Completed upload id=615965worker1 # [ 155.252378] nix-grpc-daemon[1747]: time=2026-09-20T09:07:14.904Z level=INFO msg="Upload complete. (343ms)"5966lb # [ 155.249896] niks3-server[994]: 2026/09/20 09:07:14 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo5967worker2 # [ 155.304542] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:14Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=15968worker1 # [ 155.265338] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=15969worker1 # [ 155.283113] nix-daemon[831]: reaped child process 2008, status = succeeded5970worker1 # [ 155.306074] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945971worker1 # [ 155.321379] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:364945972worker1 # [ 155.335639] nix-grpc-daemon[1747]: time=2026-09-20T09:07:14.987Z level=INFO msg="All 2 paths already cached"5973worker1 # [ 155.346061] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:364945974worker1 # [ 155.359449] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5975worker1 # [ 155.554279] nix-daemon[831]: accepted connection from pid 2032, user nix-grpc-daemon (trusted)5976worker1 # [ 155.573785] nix-daemon[831]: reaped child process 2035, status = succeeded5977worker1 # [ 155.746335] nix-daemon[831]: accepted connection from pid 2037, user nix-grpc-daemon (trusted)5978worker1 # [ 155.763675] nix-daemon[831]: reaped child process 2040, status = succeeded5979lb # [ 155.773858] niks3-server[994]: 2026/09/20 09:07:15 INFO Received uploads request method=POST path=/api/pending_closures5980worker1 # [ 155.787465] nix-grpc-daemon[1747]: time=2026-09-20T09:07:15.439Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5981worker1 # [ 155.789137] nix-grpc-daemon[1747]: time=2026-09-20T09:07:15.439Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"5982lb # [ 155.798573] niks3-server[994]: 2026/09/20 09:07:15 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst5983worker1 # [ 155.816775] nix-grpc-daemon[1747]: time=2026-09-20T09:07:15.469Z level=INFO msg="Uploading 1 narinfos"5984lb # [ 155.813108] niks3-server[994]: 2026/09/20 09:07:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign5985lb # [ 155.824433] niks3-server[994]: 2026/09/20 09:07:15 INFO Signed narinfos id=62 count=15986lb # [ 155.830882] niks3-server[994]: 2026/09/20 09:07:15 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls5987lb # [ 155.839672] niks3-server[994]: 2026/09/20 09:07:15 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete5988worker1 # [ 155.850520] nix-grpc-daemon[1747]: time=2026-09-20T09:07:15.502Z level=INFO msg="Upload complete. (476ms)"5989lb # [ 155.845348] niks3-server[994]: 2026/09/20 09:07:15 INFO Completed upload id=625990lb # [ 155.848491] niks3-server[994]: 2026/09/20 09:07:15 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo5991worker1 # [ 155.856326] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=0 paths=1 nar_bytes_in=7525992worker1 # [ 155.864546] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:364945993worker1 # [ 155.874358] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5994worker1 # [ 155.878971] nix-daemon[831]: reaped child process 2030, status = succeeded5995worker1 # [ 155.891400] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5996worker1 # [ 157.335890] nix-daemon[831]: reaped child process 2044, status = succeeded5997worker1 # [ 157.522467] nix-daemon[831]: accepted connection from pid 2059, user nix-grpc-daemon (trusted)5998worker1 # [ 157.540035] nix-daemon[831]: reaped child process 2062, status = succeeded5999lb # [ 157.547927] niks3-server[994]: 2026/09/20 09:07:17 INFO Received uploads request method=POST path=/api/pending_closures6000worker1 # [ 157.570317] nix-grpc-daemon[1747]: time=2026-09-20T09:07:17.219Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6001worker1 # [ 157.572075] nix-grpc-daemon[1747]: time=2026-09-20T09:07:17.219Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6002lb # [ 157.591016] niks3-server[994]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6003lb # [ 157.603453] niks3-server[994]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6004worker1 # [ 157.616431] nix-grpc-daemon[1747]: time=2026-09-20T09:07:17.268Z level=INFO msg="Uploading 1 narinfos"6005lb # [ 157.614460] niks3-server[994]: 2026/09/20 09:07:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6006lb # [ 157.621607] niks3-server[994]: 2026/09/20 09:07:17 INFO Signed narinfos id=63 count=16007lb # [ 157.628905] niks3-server[994]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6008lb # [ 157.632555] niks3-server[994]: 2026/09/20 09:07:17 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6009worker1 # [ 157.637370] nix-grpc-daemon[1747]: time=2026-09-20T09:07:17.289Z level=INFO msg="Upload complete. (335ms)"6010lb # [ 157.636130] niks3-server[994]: 2026/09/20 09:07:17 INFO Completed upload id=636011lb # [ 157.638631] niks3-server[994]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6012worker1 # [ 157.649181] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36494 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16013worker1 # [ 157.665978] nix-daemon[831]: reaped child process 2042, status = succeeded6014client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.11 seconds)6015worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6016worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.09 seconds)6017client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16018worker2 # [ 158.104562] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:585726019worker2 # [ 158.111173] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585726020worker2 # [ 158.134837] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:17Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06021lb # [ 161.064388] envoy[911]: conn peer=[2001:db8:1::1]:51458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27131 tx=10723 ms=207966022client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.32 seconds)6023(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.52 seconds)6024subtest: low disk drains a worker and builds go to the other6025worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6026worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds)6027worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6028worker1 # [ 189.587018] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:49Z level=info event=unhealthy reason=min_free6029worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6030client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26031client # don't know how to build these paths:6032client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6033worker1 # [ 190.615590] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:364946034worker2 # [ 190.664967] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585726035worker2 # [ 190.690402] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:50Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06036worker2 # [ 190.697264] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:50Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16037worker2 # [ 190.735981] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585726038worker2 # [ 190.751318] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585726039client # copying 1 paths to 'lb:50051'...6040client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6041worker2 # [ 190.766867] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585726042worker2 # [ 190.783087] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6043worker2 # [ 190.995673] nix-daemon[836]: accepted connection from pid 1628, user nix-grpc-daemon (trusted)6044worker2 # [ 191.013354] nix-daemon[836]: reaped child process 1631, status = succeeded6045lb # [ 191.066037] envoy[911]: conn peer=[2001:db8:1::1]:40960 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300496046worker2 # [ 191.187441] nix-daemon[836]: accepted connection from pid 1633, user nix-grpc-daemon (trusted)6047worker2 # [ 191.203831] nix-daemon[836]: reaped child process 1636, status = succeeded6048lb # [ 191.168514] niks3-server[994]: 2026/09/20 09:07:50 INFO Received uploads request method=POST path=/api/pending_closures6049worker2 # [ 191.226467] nix-grpc-daemon[1420]: time=2026-09-20T09:07:50.868Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6050worker2 # [ 191.227939] nix-grpc-daemon[1420]: time=2026-09-20T09:07:50.868Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6051lb # [ 191.196990] niks3-server[994]: 2026/09/20 09:07:50 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6052lb # [ 191.216739] niks3-server[994]: 2026/09/20 09:07:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6053worker2 # [ 191.270585] nix-grpc-daemon[1420]: time=2026-09-20T09:07:50.913Z level=INFO msg="Uploading 1 narinfos"6054lb # [ 191.228476] niks3-server[994]: 2026/09/20 09:07:50 INFO Signed narinfos id=64 count=16055lb # [ 191.235385] niks3-server[994]: 2026/09/20 09:07:50 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6056lb # [ 191.245684] niks3-server[994]: 2026/09/20 09:07:50 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6057lb # [ 191.251485] niks3-server[994]: 2026/09/20 09:07:50 INFO Completed upload id=646058worker2 # [ 191.299039] nix-grpc-daemon[1420]: time=2026-09-20T09:07:50.941Z level=INFO msg="Upload complete. (499ms)"6059lb # [ 191.254340] niks3-server[994]: 2026/09/20 09:07:50 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6060worker2 # [ 191.308275] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=0 paths=1 nar_bytes_in=5126061worker2 # [ 191.321066] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585726062worker2 # [ 191.327987] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6063worker2 # [ 191.333686] nix-daemon[836]: reaped child process 1626, status = succeeded6064client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6065worker2 # [ 191.345699] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6066client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6067client # farm-a> LOG-farm-a-drain6068worker2 # [ 192.777686] nix-daemon[836]: reaped child process 1640, status = succeeded6069worker2 # [ 192.935246] nix-daemon[836]: accepted connection from pid 1655, user nix-grpc-daemon (trusted)6070worker2 # [ 192.953145] nix-daemon[836]: reaped child process 1658, status = succeeded6071lb # [ 192.918854] niks3-server[994]: 2026/09/20 09:07:52 INFO Received uploads request method=POST path=/api/pending_closures6072worker2 # [ 192.978262] nix-grpc-daemon[1420]: time=2026-09-20T09:07:52.618Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6073worker2 # [ 192.979738] nix-grpc-daemon[1420]: time=2026-09-20T09:07:52.618Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6074lb # [ 192.952611] niks3-server[994]: 2026/09/20 09:07:52 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6075lb # [ 192.968245] niks3-server[994]: 2026/09/20 09:07:52 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6076worker2 # [ 193.028293] nix-grpc-daemon[1420]: time=2026-09-20T09:07:52.670Z level=INFO msg="Uploading 1 narinfos"6077lb # [ 192.975425] niks3-server[994]: 2026/09/20 09:07:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6078lb # [ 192.984336] niks3-server[994]: 2026/09/20 09:07:52 INFO Signed narinfos id=65 count=16079lb # [ 192.989941] niks3-server[994]: 2026/09/20 09:07:52 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6080lb # [ 192.996797] niks3-server[994]: 2026/09/20 09:07:52 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6081lb # [ 193.001987] niks3-server[994]: 2026/09/20 09:07:52 INFO Completed upload id=656082worker2 # [ 193.049894] nix-grpc-daemon[1420]: time=2026-09-20T09:07:52.692Z level=INFO msg="Upload complete. (290ms)"6083lb # [ 193.004727] niks3-server[994]: 2026/09/20 09:07:52 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6084worker2 # [ 193.062140] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16085worker2 # [ 193.079206] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:52Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06086worker2 # [ 193.083198] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:52Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16087worker2 # [ 193.087429] nix-daemon[836]: reaped child process 1638, status = succeeded6088worker2 # [ 193.116551] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585726089worker2 # [ 193.130042] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585726090worker2 # [ 193.143294] nix-grpc-daemon[1420]: time=2026-09-20T09:07:52.786Z level=INFO msg="All 1 paths already cached"6091client # copying 1 paths to 'lb:50051'...6092client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6093worker2 # [ 193.153472] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585726094worker2 # [ 193.167156] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6095worker2 # [ 193.364488] nix-daemon[836]: accepted connection from pid 1664, user nix-grpc-daemon (trusted)6096worker2 # [ 193.383178] nix-daemon[836]: reaped child process 1667, status = succeeded6097worker2 # [ 193.551259] nix-daemon[836]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)6098worker2 # [ 193.569138] nix-daemon[836]: reaped child process 1672, status = succeeded6099lb # [ 193.532536] niks3-server[994]: 2026/09/20 09:07:53 INFO Received uploads request method=POST path=/api/pending_closures6100worker2 # [ 193.589277] nix-grpc-daemon[1420]: time=2026-09-20T09:07:53.231Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6101worker2 # [ 193.590756] nix-grpc-daemon[1420]: time=2026-09-20T09:07:53.231Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6102lb # [ 193.557336] niks3-server[994]: 2026/09/20 09:07:53 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6103lb # [ 193.570908] niks3-server[994]: 2026/09/20 09:07:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6104worker2 # [ 193.625501] nix-grpc-daemon[1420]: time=2026-09-20T09:07:53.268Z level=INFO msg="Uploading 1 narinfos"6105lb # [ 193.583887] niks3-server[994]: 2026/09/20 09:07:53 INFO Signed narinfos id=66 count=16106lb # [ 193.589759] niks3-server[994]: 2026/09/20 09:07:53 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6107lb # [ 193.597286] niks3-server[994]: 2026/09/20 09:07:53 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6108worker2 # [ 193.649989] nix-grpc-daemon[1420]: time=2026-09-20T09:07:53.292Z level=INFO msg="Upload complete. (469ms)"6109lb # [ 193.604047] niks3-server[994]: 2026/09/20 09:07:53 INFO Completed upload id=666110lb # [ 193.608093] niks3-server[994]: 2026/09/20 09:07:53 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6111worker2 # [ 193.656306] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=0 paths=1 nar_bytes_in=6326112worker2 # [ 193.668711] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585726113worker2 # [ 193.677275] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6114worker2 # [ 193.679982] nix-daemon[836]: reaped child process 1662, status = succeeded6115client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6116client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6117worker2 # [ 193.692677] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6118client # farm-b> LOG-farm-b-drain6119worker2 # [ 195.130486] nix-daemon[836]: reaped child process 1676, status = succeeded6120worker2 # [ 195.312709] nix-daemon[836]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)6121worker2 # [ 195.330748] nix-daemon[836]: reaped child process 1694, status = succeeded6122lb # [ 195.297695] niks3-server[994]: 2026/09/20 09:07:54 INFO Received uploads request method=POST path=/api/pending_closures6123worker2 # [ 195.356387] nix-grpc-daemon[1420]: time=2026-09-20T09:07:54.997Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6124worker2 # [ 195.357861] nix-grpc-daemon[1420]: time=2026-09-20T09:07:54.997Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6125lb # [ 195.338898] niks3-server[994]: 2026/09/20 09:07:54 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6126lb # [ 195.352883] niks3-server[994]: 2026/09/20 09:07:55 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6127lb # [ 195.360962] niks3-server[994]: 2026/09/20 09:07:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6128worker2 # [ 195.414326] nix-grpc-daemon[1420]: time=2026-09-20T09:07:55.056Z level=INFO msg="Uploading 1 narinfos"6129lb # [ 195.369889] niks3-server[994]: 2026/09/20 09:07:55 INFO Signed narinfos id=67 count=16130lb # [ 195.375808] niks3-server[994]: 2026/09/20 09:07:55 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6131lb # [ 195.381505] niks3-server[994]: 2026/09/20 09:07:55 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6132lb # [ 195.391245] niks3-server[994]: 2026/09/20 09:07:55 INFO Completed upload id=676133worker2 # [ 195.439440] nix-grpc-daemon[1420]: time=2026-09-20T09:07:55.082Z level=INFO msg="Upload complete. (336ms)"6134lb # [ 195.394155] niks3-server[994]: 2026/09/20 09:07:55 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6135worker2 # [ 195.455719] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16136worker2 # [ 195.470509] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:55Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06137worker2 # [ 195.474642] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:55Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16138worker2 # [ 195.478513] nix-daemon[836]: reaped child process 1674, status = succeeded6139worker2 # [ 195.500075] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585726140worker2 # [ 195.513622] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585726141worker2 # [ 195.527357] nix-grpc-daemon[1420]: time=2026-09-20T09:07:55.170Z level=INFO msg="All 2 paths already cached"6142client # copying 1 paths to 'lb:50051'...6143client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6144worker2 # [ 195.537813] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585726145worker2 # [ 195.555202] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6146worker2 # [ 195.733126] nix-daemon[836]: accepted connection from pid 1700, user nix-grpc-daemon (trusted)6147worker2 # [ 195.752551] nix-daemon[836]: reaped child process 1703, status = succeeded6148worker2 # [ 195.923822] nix-daemon[836]: accepted connection from pid 1705, user nix-grpc-daemon (trusted)6149worker2 # [ 195.939114] nix-daemon[836]: reaped child process 1708, status = succeeded6150lb # [ 195.907941] niks3-server[994]: 2026/09/20 09:07:55 INFO Received uploads request method=POST path=/api/pending_closures6151worker2 # [ 195.965639] nix-grpc-daemon[1420]: time=2026-09-20T09:07:55.608Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6152worker2 # [ 195.967144] nix-grpc-daemon[1420]: time=2026-09-20T09:07:55.608Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6153lb # [ 195.936268] niks3-server[994]: 2026/09/20 09:07:55 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6154worker2 # [ 195.998205] nix-grpc-daemon[1420]: time=2026-09-20T09:07:55.640Z level=INFO msg="Uploading 1 narinfos"6155lb # [ 195.953083] niks3-server[994]: 2026/09/20 09:07:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6156lb # [ 195.962763] niks3-server[994]: 2026/09/20 09:07:55 INFO Signed narinfos id=68 count=16157lb # [ 195.968388] niks3-server[994]: 2026/09/20 09:07:55 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6158lb # [ 195.975004] niks3-server[994]: 2026/09/20 09:07:55 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6159lb # [ 195.981213] niks3-server[994]: 2026/09/20 09:07:55 INFO Completed upload id=686160worker2 # [ 196.029467] nix-grpc-daemon[1420]: time=2026-09-20T09:07:55.672Z level=INFO msg="Upload complete. (458ms)"6161lb # [ 195.984156] niks3-server[994]: 2026/09/20 09:07:55 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6162worker2 # [ 196.036159] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=0 paths=1 nar_bytes_in=7606163worker2 # [ 196.049507] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585726164worker2 # [ 196.058630] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6165worker2 # [ 196.060998] nix-daemon[836]: reaped child process 1698, status = succeeded6166client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6167client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6168worker2 # [ 196.075525] nix-daemon[836]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)6169client # farm-top> LOG-farm-top-drain6170worker2 # [ 197.322231] nix-daemon[836]: reaped child process 1712, status = succeeded6171worker2 # [ 197.501565] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)6172worker2 # [ 197.518632] nix-daemon[836]: reaped child process 1730, status = succeeded6173lb # [ 197.483834] niks3-server[994]: 2026/09/20 09:07:57 INFO Received uploads request method=POST path=/api/pending_closures6174worker2 # [ 197.545414] nix-grpc-daemon[1420]: time=2026-09-20T09:07:57.186Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6175worker2 # [ 197.547342] nix-grpc-daemon[1420]: time=2026-09-20T09:07:57.186Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6176lb # [ 197.522692] niks3-server[994]: 2026/09/20 09:07:57 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6177lb # [ 197.534120] niks3-server[994]: 2026/09/20 09:07:57 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6178worker2 # [ 197.601002] nix-grpc-daemon[1420]: time=2026-09-20T09:07:57.243Z level=INFO msg="Uploading 1 narinfos"6179lb # [ 197.545806] niks3-server[994]: 2026/09/20 09:07:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6180lb # [ 197.557343] niks3-server[994]: 2026/09/20 09:07:57 INFO Signed narinfos id=69 count=16181lb # [ 197.563197] niks3-server[994]: 2026/09/20 09:07:57 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6182lb # [ 197.572884] niks3-server[994]: 2026/09/20 09:07:57 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6183lb # [ 197.577766] niks3-server[994]: 2026/09/20 09:07:57 INFO Completed upload id=696184worker2 # [ 197.625982] nix-grpc-daemon[1420]: time=2026-09-20T09:07:57.268Z level=INFO msg="Upload complete. (338ms)"6185lb # [ 197.580476] niks3-server[994]: 2026/09/20 09:07:57 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6186worker2 # [ 197.637140] nix-grpc-daemon[1348]: ts=2026-09-20T09:07:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58572 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16187worker2 # [ 197.655074] nix-daemon[836]: reaped child process 1710, status = succeeded6188client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.31 seconds)6189client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6190client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds)6191worker1: must succeed: rm /nix/.rw-store/fill6192worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6193worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6194worker1 # [ 198.591716] nix-grpc-daemon[1691]: ts=2026-09-20T09:07:58Z level=info event=healthy reason=min_free6195worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.13 seconds)6196(finished: subtest: low disk drains a worker and builds go to the other, in 11.17 seconds)6197(finished: run the VM test script, in 200.19 seconds)6198test script finished in 200.48s6199cleanup6200kill QemuMachine (pid 50)6201client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6202kill QemuMachine (pid 49)6203lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6204kill QemuMachine (pid 51)6205worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6206kill QemuMachine (pid 52)6207worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6208(finished: cleanup, in 1.03 seconds)6209additionally exposed symbols:6210 client, lb, worker1, worker2,6211 vlan1,6212 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh