vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #253
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13worker1 # Disk image does not exist, creating the virtualisation disk image...14client: QEMU running (pid 49)15worker1: QEMU running (pid 50)16client # Formatting '/build/vm-state-client/tmp.q74dps0CBE', fmt=raw size=107374182417worker1 # Formatting '/build/vm-state-worker1/tmp.mnaLYyiIeJ', fmt=raw size=107374182418lb # Disk image does not exist, creating the virtualisation disk image...19client # mke2fs 1.47.4 (6-Mar-2025)20worker2 # Disk image does not exist, creating the virtualisation disk image...21lb: QEMU running (pid 51)22worker2: QEMU running (pid 52)23worker1 # mke2fs 1.47.4 (6-Mar-2025)24lb # Formatting '/build/vm-state-lb/tmp.0oSWtUsMN8', fmt=raw size=107374182425worker2 # Formatting '/build/vm-state-worker2/tmp.8rmFzd55un', fmt=raw size=107374182426client # Discarding device blocks: 0/262144 done27(finished: start all VMs, in 0.49 seconds)28worker2 # mke2fs 1.47.4 (6-Mar-2025)29client # Creating filesystem with 262144 4k blocks and 65536 inodes30client: waiting for unit network-addresses-eth1.service31worker2 # Discarding device blocks: 0/262144 done32client # Filesystem UUID: 42add490-c8c1-4885-bada-6f20ea65d99e33client: waiting for the VM to finish booting34worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes35client # Superblock backups stored on blocks:36lb # mke2fs 1.47.4 (6-Mar-2025)37worker1 # Discarding device blocks: 0/262144 done38worker2 # Filesystem UUID: 0346c41c-860c-4c4b-b074-956f148720bc39client # 32768, 98304, 163840, 22937640lb # Discarding device blocks: 0/262144 done41worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes42worker2 # Superblock backups stored on blocks:43client # 44lb # Creating filesystem with 262144 4k blocks and 65536 inodes45worker1 # Filesystem UUID: 19877930-4729-46ab-bfbd-32174aef56a846worker2 # 32768, 98304, 163840, 22937647client # Allocating group tables: 0/8 done48lb # Filesystem UUID: 2763e31e-c98e-45c3-8e2d-f907edb1cbdb49worker1 # Superblock backups stored on blocks:50worker2 # 51client # Writing inode tables: 0/8 done52lb # Superblock backups stored on blocks:53worker1 # 32768, 98304, 163840, 22937654worker2 # Allocating group tables: 0/8 done55client # Creating journal (8192 blocks): done56lb # 32768, 98304, 163840, 22937657worker1 # 58worker2 # Writing inode tables: 0/8 done59client # Writing superblocks and filesystem accounting information: 0/8 done60lb # 61worker1 # Allocating group tables: 0/8 done62worker2 # Creating journal (8192 blocks): done63client # 64lb # Allocating group tables: 0/8 done65worker1 # Writing inode tables: 0/8 done66worker2 # Writing superblocks and filesystem accounting information: 0/8 done67client # Virtualisation disk image created.68lb # Writing inode tables: 0/8 done69worker1 # Creating journal (8192 blocks): done70lb # Creating journal (8192 blocks): done71worker1 # Writing superblocks and filesystem accounting information: 0/8 done72lb # Writing superblocks and filesystem accounting information: 0/8 done73worker1 # 74lb # 75worker1 # Virtualisation disk image created.76lb # Virtualisation disk image created.77worker2 # 78worker2 # Virtualisation disk image created.79worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker2 # [ 0.000000] KASLR enabled82worker2 # [ 0.000000] random: crng init done83worker2 # [ 0.000000] Machine model: linux,dummy-virt84worker2 # [ 0.000000] efi: UEFI not found.85worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]88worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]89worker2 # [ 0.000000] Zone ranges:90worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]91lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202692worker2 # [ 0.000000] DMA32 empty93lb # [ 0.000000] KASLR enabled94worker2 # [ 0.000000] Normal empty95worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]96lb # [ 0.000000] random: crng init done97worker2 # [ 0.000000] Device empty98lb # [ 0.000000] Machine model: linux,dummy-virt99worker2 # [ 0.000000] Movable zone start for each node100lb # [ 0.000000] efi: UEFI not found.101worker2 # [ 0.000000] Early memory node ranges102worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026103lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT104worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]105worker1 # [ 0.000000] KASLR enabled106worker1 # [ 0.000000] random: crng init done107lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]108worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]109worker1 # [ 0.000000] Machine model: linux,dummy-virt110worker1 # [ 0.000000] efi: UEFI not found.111worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000112lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]113lb # [ 0.000000] Zone ranges:114worker2 # [ 0.000000] psci: probing for conduit method from DT.115worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT116lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]117worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.118lb # [ 0.000000] DMA32 empty119worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]120lb # [ 0.000000] Normal empty121worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs122lb # [ 0.000000] Device empty123worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]124worker2 # [ 0.000000] psci: Trusted OS migration not required125lb # [ 0.000000] Movable zone start for each node126worker1 # [ 0.000000] Zone ranges:127worker2 # [ 0.000000] psci: SMC Calling Convention v1.1128lb # [ 0.000000] Early memory node ranges129worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]130worker1 # [ 0.000000] DMA32 empty131lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]132worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)133worker1 # [ 0.000000] Normal empty134worker1 # [ 0.000000] Device empty135lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]136worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296137client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]138worker1 # [ 0.000000] Movable zone start for each node139lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000140worker2 # [ 0.000000] Detected PIPT I-cache on CPU0141worker1 # [ 0.000000] Early memory node ranges142lb # [ 0.000000] psci: probing for conduit method from DT.143worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]144worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)145lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.146client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026147client # [ 0.000000] KASLR enabled148worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface149lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs150worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]151client # [ 0.000000] random: crng init done152worker2 # [ 0.000000] CPU features: detected: Spectre-v4153lb # [ 0.000000] psci: Trusted OS migration not required154worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000155client # [ 0.000000] Machine model: linux,dummy-virt156client # [ 0.000000] efi: UEFI not found.157worker2 # [ 0.000000] CPU features: detected: Spectre-BHB158lb # [ 0.000000] psci: SMC Calling Convention v1.1159worker1 # [ 0.000000] psci: probing for conduit method from DT.160worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38161worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.162client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT163lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)164worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs165worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23166client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]167lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296168worker1 # [ 0.000000] psci: Trusted OS migration not required169worker2 # [ 0.000000] alternatives: applying boot alternatives170client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]171worker1 # [ 0.000000] psci: SMC Calling Convention v1.1172lb # [ 0.000000] Detected PIPT I-cache on CPU0173client # [ 0.000000] Zone ranges:174lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)175client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]176worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)177client # [ 0.000000] DMA32 empty178lb # [ 0.000000] CPU features: detected: GICv3 CPU interface179client # [ 0.000000] Normal empty180worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296181client # [ 0.000000] Device empty182lb # [ 0.000000] CPU features: detected: Spectre-v4183worker1 # [ 0.000000] Detected PIPT I-cache on CPU0184client # [ 0.000000] Movable zone start for each node185lb # [ 0.000000] CPU features: detected: Spectre-BHB186client # [ 0.000000] Early memory node ranges187worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)188lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38189worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1d3l1q1rzfvh0f7kbcwmr9fszyp0b0dz-nixos-system-worker2-test/init regInfo=/nix/store/ff87zia02lc2pva4ypygaxx75p990h0m-closure-info/registration console=ttyAMA0,115200n8 console=tty0190client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]191worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface192lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23193worker1 # [ 0.000000] CPU features: detected: Spectre-v4194client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]195lb # [ 0.000000] alternatives: applying boot alternatives196worker1 # [ 0.000000] CPU features: detected: Spectre-BHB197client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000198worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ff87zia02lc2pva4ypygaxx75p990h0m-closure-info/registration", will be passed to user space.199worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38200client # [ 0.000000] psci: probing for conduit method from DT.201worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23202client # [ 0.000000] psci: PSCIv1.3 detected in firmware.203worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes204worker1 # [ 0.000000] alternatives: applying boot alternatives205client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs206worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)207client # [ 0.000000] psci: Trusted OS migration not required208client # [ 0.000000] psci: SMC Calling Convention v1.1209lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0210worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)211client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)212worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB213worker2 # [ 0.000000] software IO TLB: area num 1.214client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296215lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.216worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB217client # [ 0.000000] Detected PIPT I-cache on CPU0218worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j8hg5v2mna41b2rmqffhgiw2p9n7fx0y-nixos-system-worker1-test/init regInfo=/nix/store/jsp8jrhhk8b4cd1nrwsv3w1mv7c8x67x-closure-info/registration console=ttyAMA0,115200n8 console=tty0219worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)220client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)221lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes222worker2 # [ 0.000000] Fallback order for Node 0: 0223client # [ 0.000000] CPU features: detected: GICv3 CPU interface224worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/jsp8jrhhk8b4cd1nrwsv3w1mv7c8x67x-closure-info/registration", will be passed to user space.225lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)226client # [ 0.000000] CPU features: detected: Spectre-v4227worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216228worker2 # [ 0.000000] Policy zone: DMA229client # [ 0.000000] CPU features: detected: Spectre-BHB230lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)231worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off232client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38233worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes234lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB235client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23236worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1237lb # [ 0.000000] software IO TLB: area num 1.238worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)239worker2 # [ 0.000000] allocated 3145728 bytes of page_ext240client # [ 0.000000] alternatives: applying boot alternatives241lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB242worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages243worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)244worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups245lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)246worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB247lb # [ 0.000000] Fallback order for Node 0: 0248worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.249worker2 # [ 0.000000] rcu: RCU event tracing is enabled.250lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216251worker1 # [ 0.000000] software IO TLB: area num 1.252lb # [ 0.000000] Policy zone: DMA253worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.254worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB255lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off256client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test/init regInfo=/nix/store/bs9wr4dhg08lmmqzzj6b672rzvy73rhp-closure-info/registration console=ttyAMA0,115200n8 console=tty0257worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.258worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.259worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)260lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1261worker1 # [ 0.000000] Fallback order for Node 0: 0262worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.263lb # [ 0.000000] allocated 3145728 bytes of page_ext264worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216265lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages266worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.267worker1 # [ 0.000000] Policy zone: DMA268client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/bs9wr4dhg08lmmqzzj6b672rzvy73rhp-closure-info/registration", will be passed to user space.269lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups270worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1271lb # [ 0.000000] rcu: Hierarchical RCU implementation.272client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes273lb # [ 0.000000] rcu: RCU event tracing is enabled.274worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.275client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)276worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off277lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.278lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.279worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.280client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)281worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1282lb # [ 0.000000] Rude variant of Tasks RCU enabled.283worker1 # [ 0.000000] allocated 3145728 bytes of page_ext284client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB285worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.286lb # [ 0.000000] Tracing variant of Tasks RCU enabled.287worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages288client # [ 0.000000] software IO TLB: area num 1.289worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0290worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups291lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.292client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB293worker2 # [ 0.000000] GICv3: 256 SPIs implemented294worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.295worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented296lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1297client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)298worker1 # [ 0.000000] rcu: RCU event tracing is enabled.299worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq300client # [ 0.000000] Fallback order for Node 0: 0301lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.302worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI303worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.304client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216305worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0306worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.307client # [ 0.000000] Policy zone: DMA308lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.309worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.310worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000311client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off312worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.313worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]314lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.315client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1316worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.317lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0318client # [ 0.000000] allocated 3145728 bytes of page_ext319worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)320lb # [ 0.000000] GICv3: 256 SPIs implemented321worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1322client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages323lb # [ 0.000000] GICv3: 0 Extended SPIs implemented324client # [ 0.000000] ftrace: allocated 294 pages with 4 groups325worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)326lb # [ 0.000000] Root IRQ handler: gic_handle_irq327worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.328client # [ 0.000000] rcu: Hierarchical RCU implementation.329lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI330worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000331client # [ 0.000000] rcu: RCU event tracing is enabled.332lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0333worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.334worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000335client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.336lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000337worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.338worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.339lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]340client # [ 0.000000] Trampoline variant of Tasks RCU enabled.341client # [ 0.000000] Rude variant of Tasks RCU enabled.342worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0343client # [ 0.000000] Tracing variant of Tasks RCU enabled.344worker1 # [ 0.000000] GICv3: 256 SPIs implemented345worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns346lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)347worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented348worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).349client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.350worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq351lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)352worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI353client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1354lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000355worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns356worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0357client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.358lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000359worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns360worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000361worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]362worker2 # [ 0.000035] arm-pv: using stolen time PV363lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.364client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.365worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)366worker2 # [ 0.000601] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)367lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns368client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.369worker2 # [ 0.000782] Console: colour dummy device 80x25370lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).371client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0372worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)373worker2 # [ 0.000790] printk: legacy console [tty0] enabled374client # [ 0.000000] GICv3: 256 SPIs implemented375worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000376client # [ 0.000000] GICv3: 0 Extended SPIs implemented377lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns378worker2 # [ 0.000988] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)379client # [ 0.000000] Root IRQ handler: gic_handle_irq380worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000381worker2 # [ 0.000994] pid_max: default: 32768 minimum: 301382client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI383lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns384worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.385lb # [ 0.000040] arm-pv: using stolen time PV386client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0387worker2 # [ 0.001064] LSM: initializing lsm=capability,landlock,yama,bpf,ima388worker2 # [ 0.001224] landlock: Up and running.389client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000390worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns391worker2 # [ 0.001227] Yama: becoming mindful.392lb # [ 0.000551] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)393client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]394worker2 # [ 0.001764] LSM support for eBPF active395lb # [ 0.000719] Console: colour dummy device 80x25396worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).397lb # [ 0.000727] printk: legacy console [tty0] enabled398worker2 # [ 0.001938] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)399client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)400worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns401worker2 # [ 0.001971] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)402lb # [ 0.000937] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)403client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)404worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns405worker2 # [ 0.003291] cacheinfo: Unable to detect cache hierarchy for CPU 0406lb # [ 0.000945] pid_max: default: 32768 minimum: 301407client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000408worker1 # [ 0.000028] arm-pv: using stolen time PV409worker2 # [ 0.004063] rcu: Hierarchical SRCU implementation.410lb # [ 0.001022] LSM: initializing lsm=capability,landlock,yama,bpf,ima411worker2 # [ 0.004066] rcu: Max phase no-delay instances is 1000.412lb # [ 0.001181] landlock: Up and running.413client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000414worker1 # [ 0.000396] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)415lb # [ 0.001184] Yama: becoming mindful.416worker2 # [ 0.005261] fsl-mc MSI: its@8080000 domain created417client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.418worker1 # [ 0.000543] Console: colour dummy device 80x25419lb # [ 0.001699] LSM support for eBPF active420worker2 # [ 0.005354] EFI services will not be available.421worker1 # [ 0.000550] printk: legacy console [tty0] enabled422worker2 # [ 0.005426] smp: Bringing up secondary CPUs ...423lb # [ 0.001855] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)424client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns425worker2 # [ 0.005439] smp: Brought up 1 node, 1 CPU426worker2 # [ 0.005463] SMP: Total of 1 processors activated.427client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).428worker1 # [ 0.000765] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)429lb # [ 0.001888] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)430worker2 # [ 0.005468] CPU: All CPU(s) started at EL1431worker1 # [ 0.000771] pid_max: default: 32768 minimum: 301432lb # [ 0.003104] cacheinfo: Unable to detect cache hierarchy for CPU 0433worker2 # [ 0.005479] CPU features: detected: Branch Target Identification434worker1 # [ 0.000854] LSM: initializing lsm=capability,landlock,yama,bpf,ima435lb # [ 0.003889] rcu: Hierarchical SRCU implementation.436client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns437worker1 # [ 0.001030] landlock: Up and running.438lb # [ 0.003893] rcu: Max phase no-delay instances is 1000.439worker2 # [ 0.005484] CPU features: detected: ARMv8.4 Translation Table Level440worker1 # [ 0.001033] Yama: becoming mindful.441client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns442lb # [ 0.005140] fsl-mc MSI: its@8080000 domain created443worker1 # [ 0.001485] LSM support for eBPF active444client # [ 0.000034] arm-pv: using stolen time PV445lb # [ 0.005241] EFI services will not be available.446worker2 # [ 0.005488] CPU features: detected: Instruction cache invalidation not required for I/D coherence447worker1 # [ 0.001614] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)448lb # [ 0.005317] smp: Bringing up secondary CPUs ...449client # [ 0.000416] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)450lb # [ 0.005331] smp: Brought up 1 node, 1 CPU451worker2 # [ 0.005491] CPU features: detected: Data cache clean to the PoU not required for I/D coherence452worker1 # [ 0.001652] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)453client # [ 0.000590] Console: colour dummy device 80x25454lb # [ 0.005334] SMP: Total of 1 processors activated.455worker2 # [ 0.005495] CPU features: detected: Common not Private translations456client # [ 0.000597] printk: legacy console [tty0] enabled457lb # [ 0.005339] CPU: All CPU(s) started at EL1458worker1 # [ 0.002786] cacheinfo: Unable to detect cache hierarchy for CPU 0459worker2 # [ 0.005498] CPU features: detected: CRC32 instructions460worker1 # [ 0.003504] rcu: Hierarchical SRCU implementation.461lb # [ 0.005351] CPU features: detected: Branch Target Identification462client # [ 0.000788] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)463worker1 # [ 0.003508] rcu: Max phase no-delay instances is 1000.464worker2 # [ 0.005501] CPU features: detected: Data cache clean to Point of Deep Persistence465lb # [ 0.005356] CPU features: detected: ARMv8.4 Translation Table Level466worker1 # [ 0.004655] fsl-mc MSI: its@8080000 domain created467client # [ 0.000795] pid_max: default: 32768 minimum: 301468worker2 # [ 0.005505] CPU features: detected: Data cache clean to Point of Persistence469worker1 # [ 0.004744] EFI services will not be available.470client # [ 0.000863] LSM: initializing lsm=capability,landlock,yama,bpf,ima471lb # [ 0.005359] CPU features: detected: Instruction cache invalidation not required for I/D coherence472worker1 # [ 0.004820] smp: Bringing up secondary CPUs ...473worker2 # [ 0.005508] CPU features: detected: Data independent timing control (DIT)474client # [ 0.001016] landlock: Up and running.475worker1 # [ 0.004828] smp: Brought up 1 node, 1 CPU476client # [ 0.001019] Yama: becoming mindful.477worker2 # [ 0.005510] CPU features: detected: E0PD478lb # [ 0.005363] CPU features: detected: Data cache clean to the PoU not required for I/D coherence479client # [ 0.001478] LSM support for eBPF active480worker1 # [ 0.004831] SMP: Total of 1 processors activated.481worker2 # [ 0.005513] CPU features: detected: Enhanced Counter Virtualization482lb # [ 0.005366] CPU features: detected: Common not Private translations483worker1 # [ 0.004836] CPU: All CPU(s) started at EL1484client # [ 0.001632] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)485lb # [ 0.005370] CPU features: detected: CRC32 instructions486worker2 # [ 0.005516] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)487worker1 # [ 0.004846] CPU features: detected: Branch Target Identification488client # [ 0.001666] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)489worker2 # [ 0.005519] CPU features: detected: Enhanced Virtualization Traps490worker1 # [ 0.004851] CPU features: detected: ARMv8.4 Translation Table Level491lb # [ 0.005372] CPU features: detected: Data cache clean to Point of Deep Persistence492client # [ 0.002861] cacheinfo: Unable to detect cache hierarchy for CPU 0493worker2 # [ 0.005522] CPU features: detected: Fine Grained Traps494lb # [ 0.005376] CPU features: detected: Data cache clean to Point of Persistence495worker1 # [ 0.004854] CPU features: detected: Instruction cache invalidation not required for I/D coherence496client # [ 0.003612] rcu: Hierarchical SRCU implementation.497worker2 # [ 0.005526] CPU features: detected: Generic authentication (architected QARMA5 algorithm)498lb # [ 0.005379] CPU features: detected: Data independent timing control (DIT)499client # [ 0.003615] rcu: Max phase no-delay instances is 1000.500worker1 # [ 0.004858] CPU features: detected: Data cache clean to the PoU not required for I/D coherence501worker2 # [ 0.005530] CPU features: detected: RCpc load-acquire (LDAPR)502lb # [ 0.005382] CPU features: detected: E0PD503client # [ 0.004811] fsl-mc MSI: its@8080000 domain created504worker1 # [ 0.004861] CPU features: detected: Common not Private translations505worker2 # [ 0.005533] CPU features: detected: LSE atomic instructions506client # [ 0.004914] EFI services will not be available.507lb # [ 0.005385] CPU features: detected: Enhanced Counter Virtualization508worker1 # [ 0.004865] CPU features: detected: CRC32 instructions509client # [ 0.004981] smp: Bringing up secondary CPUs ...510worker2 # [ 0.005536] CPU features: detected: Privileged Access Never511lb # [ 0.005388] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)512client # [ 0.004990] smp: Brought up 1 node, 1 CPU513worker2 # [ 0.005539] CPU features: detected: PMUv3514worker1 # [ 0.004868] CPU features: detected: Data cache clean to Point of Deep Persistence515client # [ 0.004993] SMP: Total of 1 processors activated.516worker2 # [ 0.005541] CPU features: detected: RAS Extension Support517lb # [ 0.005391] CPU features: detected: Enhanced Virtualization Traps518client # [ 0.004998] CPU: All CPU(s) started at EL1519lb # [ 0.005394] CPU features: detected: Fine Grained Traps520worker1 # [ 0.004871] CPU features: detected: Data cache clean to Point of Persistence521worker2 # [ 0.005544] CPU features: detected: RASv1p1 Extension Support522client # [ 0.005009] CPU features: detected: Branch Target Identification523worker2 # [ 0.005547] CPU features: detected: Random Number Generator524worker1 # [ 0.004874] CPU features: detected: Data independent timing control (DIT)525lb # [ 0.005397] CPU features: detected: Generic authentication (architected QARMA5 algorithm)526client # [ 0.005014] CPU features: detected: ARMv8.4 Translation Table Level527worker1 # [ 0.004877] CPU features: detected: E0PD528lb # [ 0.005404] CPU features: detected: RCpc load-acquire (LDAPR)529worker1 # [ 0.004880] CPU features: detected: Enhanced Counter Virtualization530lb # [ 0.005407] CPU features: detected: LSE atomic instructions531client # [ 0.005017] CPU features: detected: Instruction cache invalidation not required for I/D coherence532worker1 # [ 0.004883] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)533lb # [ 0.005410] CPU features: detected: Privileged Access Never534client # [ 0.005020] CPU features: detected: Data cache clean to the PoU not required for I/D coherence535lb # [ 0.005412] CPU features: detected: PMUv3536worker1 # [ 0.004886] CPU features: detected: Enhanced Virtualization Traps537lb # [ 0.005415] CPU features: detected: RAS Extension Support538client # [ 0.005024] CPU features: detected: Common not Private translations539worker1 # [ 0.004889] CPU features: detected: Fine Grained Traps540client # [ 0.005027] CPU features: detected: CRC32 instructions541lb # [ 0.005417] CPU features: detected: RASv1p1 Extension Support542worker1 # [ 0.004893] CPU features: detected: Generic authentication (architected QARMA5 algorithm)543lb # [ 0.005420] CPU features: detected: Random Number Generator544client # [ 0.005030] CPU features: detected: Data cache clean to Point of Deep Persistence545worker1 # [ 0.004898] CPU features: detected: RCpc load-acquire (LDAPR)546lb # [ 0.005422] CPU features: detected: Speculation barrier (SB)547client # [ 0.005033] CPU features: detected: Data cache clean to Point of Persistence548worker1 # [ 0.004901] CPU features: detected: LSE atomic instructions549lb # [ 0.005425] CPU features: detected: Stage-2 Force Write-Back550worker1 # [ 0.004904] CPU features: detected: Privileged Access Never551client # [ 0.005037] CPU features: detected: Data independent timing control (DIT)552worker1 # [ 0.004906] CPU features: detected: PMUv3553lb # [ 0.005428] CPU features: detected: TLB range maintenance instructions554client # [ 0.005040] CPU features: detected: E0PD555worker1 # [ 0.004909] CPU features: detected: RAS Extension Support556client # [ 0.005042] CPU features: detected: Enhanced Counter Virtualization557lb # [ 0.005433] CPU features: detected: Speculative Store Bypassing Safe (SSBS)558worker1 # [ 0.004912] CPU features: detected: RASv1p1 Extension Support559lb # [ 0.005472] alternatives: applying system-wide alternatives560client # [ 0.005046] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)561worker1 # [ 0.004915] CPU features: detected: Random Number Generator562worker2 # [ 0.005549] CPU features: detected: Speculation barrier (SB)563lb # [ 0.009491] CPU features: detected: BBM Level 2 without TLB conflict abort564client # [ 0.005049] CPU features: detected: Enhanced Virtualization Traps565worker2 # [ 0.005552] CPU features: detected: Stage-2 Force Write-Back566worker1 # [ 0.004917] CPU features: detected: Speculation barrier (SB)567client # [ 0.005052] CPU features: detected: Fine Grained Traps568worker1 # [ 0.004920] CPU features: detected: Stage-2 Force Write-Back569worker2 # [ 0.005555] CPU features: detected: TLB range maintenance instructions570client # [ 0.005055] CPU features: detected: Generic authentication (architected QARMA5 algorithm)571lb # [ 0.009655] Memory: 1406552K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)572worker1 # [ 0.004923] CPU features: detected: TLB range maintenance instructions573worker2 # [ 0.005559] CPU features: detected: Speculative Store Bypassing Safe (SSBS)574lb # [ 0.010048] devtmpfs: initialized575client # [ 0.005060] CPU features: detected: RCpc load-acquire (LDAPR)576worker1 # [ 0.004927] CPU features: detected: Speculative Store Bypassing Safe (SSBS)577worker2 # [ 0.005599] alternatives: applying system-wide alternatives578lb # [ 0.011899] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)579client # [ 0.005063] CPU features: detected: LSE atomic instructions580worker1 # [ 0.004961] alternatives: applying system-wide alternatives581worker2 # [ 0.010094] CPU features: detected: BBM Level 2 without TLB conflict abort582client # [ 0.005066] CPU features: detected: Privileged Access Never583lb # [ 0.011922] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).584client # [ 0.005069] CPU features: detected: PMUv3585worker1 # [ 0.007876] CPU features: detected: BBM Level 2 without TLB conflict abort586lb # [ 0.012104] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL587client # [ 0.005071] CPU features: detected: RAS Extension Support588worker2 # [ 0.010239] Memory: 1406572K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)589worker2 # [ 0.010615] devtmpfs: initialized590client # [ 0.005074] CPU features: detected: RASv1p1 Extension Support591worker1 # [ 0.008063] Memory: 1406572K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)592worker1 # [ 0.008421] devtmpfs: initialized593client # [ 0.005077] CPU features: detected: Random Number Generator594worker2 # [ 0.012388] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)595client # [ 0.005079] CPU features: detected: Speculation barrier (SB)596worker1 # [ 0.010222] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)597worker2 # [ 0.012416] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).598client # [ 0.005081] CPU features: detected: Stage-2 Force Write-Back599worker1 # [ 0.010243] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).600worker2 # [ 0.012626] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL601client # [ 0.005084] CPU features: detected: TLB range maintenance instructions602worker2 # [ 0.012632] 0 pages in range for non-PLT usage603worker1 # [ 0.010410] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL604client # [ 0.005089] CPU features: detected: Speculative Store Bypassing Safe (SSBS)605worker2 # [ 0.012633] 508288 pages in range for PLT usage606worker1 # [ 0.010419] 0 pages in range for non-PLT usage607worker2 # [ 0.012744] pinctrl core: initialized pinctrl subsystem608client # [ 0.005128] alternatives: applying system-wide alternatives609worker1 # [ 0.010420] 508288 pages in range for PLT usage610worker2 # [ 0.013522] DMI not present or invalid.611worker1 # [ 0.010528] pinctrl core: initialized pinctrl subsystem612client # [ 0.009166] CPU features: detected: BBM Level 2 without TLB conflict abort613worker1 # [ 0.011278] DMI not present or invalid.614worker2 # [ 0.016733] NET: Registered PF_NETLINK/PF_ROUTE protocol family615worker1 # [ 0.014586] NET: Registered PF_NETLINK/PF_ROUTE protocol family616worker2 # [ 0.018921] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations617client # [ 0.009331] Memory: 1406492K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)618worker1 # [ 0.016786] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations619client # [ 0.009740] devtmpfs: initialized620worker2 # [ 0.019126] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations621lb # [ 0.012109] 0 pages in range for non-PLT usage622worker1 # [ 0.016959] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations623client # [ 0.011573] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)624worker2 # [ 0.019335] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations625lb # [ 0.012110] 508288 pages in range for PLT usage626worker2 # [ 0.019357] audit: initializing netlink subsys (disabled)627worker1 # [ 0.017160] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations628lb # [ 0.012215] pinctrl core: initialized pinctrl subsystem629lb # [ 0.012997] DMI not present or invalid.630worker1 # [ 0.017181] audit: initializing netlink subsys (disabled)631worker2 # [ 0.019923] thermal_sys: Registered thermal governor 'fair_share'632lb # [ 0.016058] NET: Registered PF_NETLINK/PF_ROUTE protocol family633worker1 # [ 0.017734] thermal_sys: Registered thermal governor 'fair_share'634worker2 # [ 0.019925] thermal_sys: Registered thermal governor 'bang_bang'635lb # [ 0.018247] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations636worker1 # [ 0.017736] thermal_sys: Registered thermal governor 'bang_bang'637worker2 # [ 0.019929] thermal_sys: Registered thermal governor 'step_wise'638worker1 # [ 0.017740] thermal_sys: Registered thermal governor 'step_wise'639worker2 # [ 0.019934] thermal_sys: Registered thermal governor 'user_space'640lb # [ 0.018425] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations641worker1 # [ 0.017745] thermal_sys: Registered thermal governor 'user_space'642worker2 # [ 0.019937] thermal_sys: Registered thermal governor 'power_allocator'643lb # [ 0.018628] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations644lb # [ 0.018651] audit: initializing netlink subsys (disabled)645worker2 # [ 0.019961] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1646worker2 # [ 0.019969] cpuidle: using governor ladder647lb # [ 0.019192] thermal_sys: Registered thermal governor 'fair_share'648worker2 # [ 0.019975] cpuidle: using governor menu649lb # [ 0.019194] thermal_sys: Registered thermal governor 'bang_bang'650worker2 # [ 0.020161] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.651lb # [ 0.019198] thermal_sys: Registered thermal governor 'step_wise'652worker2 # [ 0.020177] ASID allocator initialised with 65536 entries653lb # [ 0.019203] thermal_sys: Registered thermal governor 'user_space'654worker2 # [ 0.021355] Serial: AMBA PL011 UART driver655lb # [ 0.019206] thermal_sys: Registered thermal governor 'power_allocator'656client # [ 0.011595] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).657worker2 # [ 0.026577] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1658worker2 # [ 0.026728] printk: console [ttyAMA0] enabled659lb # [ 0.019233] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1660client # [ 0.011798] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL661lb # [ 0.019242] cpuidle: using governor ladder662client # [ 0.011803] 0 pages in range for non-PLT usage663lb # [ 0.019248] cpuidle: using governor menu664client # [ 0.011804] 508288 pages in range for PLT usage665worker2 # [ 0.147429] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages666lb # [ 0.019462] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.667client # [ 0.011920] pinctrl core: initialized pinctrl subsystem668worker2 # [ 0.147449] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page669client # [ 0.012699] DMI not present or invalid.670lb # [ 0.019480] ASID allocator initialised with 65536 entries671client # [ 0.015863] NET: Registered PF_NETLINK/PF_ROUTE protocol family672worker2 # [ 0.147454] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages673lb # [ 0.020700] Serial: AMBA PL011 UART driver674worker1 # [ 0.017748] thermal_sys: Registered thermal governor 'power_allocator'675worker2 # [ 0.147459] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page676client # [ 0.018046] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations677lb # [ 0.026015] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1678worker1 # [ 0.017770] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1679lb # [ 0.026136] printk: console [ttyAMA0] enabled680worker2 # [ 0.147463] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages681worker1 # [ 0.017780] cpuidle: using governor ladder682client # [ 0.018225] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations683worker1 # [ 0.017785] cpuidle: using governor menu684worker2 # [ 0.147467] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page685client # [ 0.018426] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations686worker1 # [ 0.017981] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.687lb # [ 0.145666] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages688worker2 # [ 0.147472] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages689client # [ 0.018446] audit: initializing netlink subsys (disabled)690lb # [ 0.145686] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page691worker1 # [ 0.017996] ASID allocator initialised with 65536 entries692worker2 # [ 0.147476] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page693client # [ 0.019061] thermal_sys: Registered thermal governor 'fair_share'694worker1 # [ 0.019146] Serial: AMBA PL011 UART driver695lb # [ 0.145691] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages696client # [ 0.019063] thermal_sys: Registered thermal governor 'bang_bang'697worker1 # [ 0.024367] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1698lb # [ 0.145696] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page699client # [ 0.019066] thermal_sys: Registered thermal governor 'step_wise'700worker1 # [ 0.024513] printk: console [ttyAMA0] enabled701lb # [ 0.145700] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages702client # [ 0.019072] thermal_sys: Registered thermal governor 'user_space'703worker2 # [ 0.154756] fbcon: Taking over console704lb # [ 0.145704] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page705worker2 # [ 0.154770] ACPI: Interpreter disabled.706client # [ 0.019074] thermal_sys: Registered thermal governor 'power_allocator'707worker1 # [ 0.145913] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages708lb # [ 0.145708] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages709client # [ 0.019099] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1710worker1 # [ 0.145934] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page711lb # [ 0.145713] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page712client # [ 0.019108] cpuidle: using governor ladder713worker1 # [ 0.145939] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages714client # [ 0.019114] cpuidle: using governor menu715worker1 # [ 0.145943] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page716client # [ 0.019313] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.717worker1 # [ 0.145948] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages718client # [ 0.019328] ASID allocator initialised with 65536 entries719lb # [ 0.152953] fbcon: Taking over console720client # [ 0.020571] Serial: AMBA PL011 UART driver721worker1 # [ 0.145952] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page722lb # [ 0.152968] ACPI: Interpreter disabled.723lb # [ 0.154804] iommu: Default domain type: Translated724worker1 # [ 0.145956] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages725client # [ 0.025885] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1726client # [ 0.026041] printk: console [ttyAMA0] enabled727worker1 # [ 0.145960] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page728lb # [ 0.154813] iommu: DMA domain TLB invalidation policy: strict mode729worker2 # [ 0.161758] iommu: Default domain type: Translated730worker2 # [ 0.161767] iommu: DMA domain TLB invalidation policy: strict mode731lb # [ 0.156476] SCSI subsystem initialized732client # [ 0.145947] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages733worker2 # [ 0.163389] SCSI subsystem initialized734client # [ 0.145967] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page735worker1 # [ 0.153356] fbcon: Taking over console736client # [ 0.145972] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages737worker1 # [ 0.153371] ACPI: Interpreter disabled.738worker2 # [ 0.164067] usbcore: registered new interface driver usbfs739client # [ 0.145977] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page740worker1 # [ 0.155243] iommu: Default domain type: Translated741worker2 # [ 0.164099] usbcore: registered new interface driver hub742worker2 # [ 0.164117] usbcore: registered new device driver usb743worker1 # [ 0.155254] iommu: DMA domain TLB invalidation policy: strict mode744client # [ 0.145982] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages745worker2 # [ 0.164403] pps_core: LinuxPPS API ver. 1 registered746client # [ 0.145986] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page747worker1 # [ 0.156975] SCSI subsystem initialized748worker2 # [ 0.164409] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>749client # [ 0.145991] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages750worker2 # [ 0.164420] PTP clock support registered751client # [ 0.145995] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page752worker2 # [ 0.164468] EDAC MC: Ver: 3.0.0753worker2 # [ 0.169080] scmi_core: SCMI protocol bus registered754worker2 # [ 0.170061] FPGA manager framework755lb # [ 0.163855] usbcore: registered new interface driver usbfs756client # [ 0.153444] fbcon: Taking over console757worker2 # [ 0.171011] vgaarb: loaded758lb # [ 0.163888] usbcore: registered new interface driver hub759client # [ 0.153459] ACPI: Interpreter disabled.760lb # [ 0.163907] usbcore: registered new device driver usb761worker2 # [ 0.171630] clocksource: Switched to clocksource arch_sys_counter762client # [ 0.155309] iommu: Default domain type: Translated763lb # [ 0.164211] pps_core: LinuxPPS API ver. 1 registered764client # [ 0.155318] iommu: DMA domain TLB invalidation policy: strict mode765lb # [ 0.164217] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>766client # [ 0.157057] SCSI subsystem initialized767lb # [ 0.164228] PTP clock support registered768lb # [ 0.164269] EDAC MC: Ver: 3.0.0769worker2 # [ 0.174982] VFS: Disk quotas dquot_6.6.0770worker1 # [ 0.164598] usbcore: registered new interface driver usbfs771lb # [ 0.168877] scmi_core: SCMI protocol bus registered772worker1 # [ 0.164649] usbcore: registered new interface driver hub773worker2 # [ 0.175010] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)774lb # [ 0.169841] FPGA manager framework775worker1 # [ 0.164670] usbcore: registered new device driver usb776lb # [ 0.170775] vgaarb: loaded777worker1 # [ 0.164947] pps_core: LinuxPPS API ver. 1 registered778worker1 # [ 0.164953] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>779lb # [ 0.171424] clocksource: Switched to clocksource arch_sys_counter780worker1 # [ 0.164963] PTP clock support registered781worker2 # [ 0.178745] netfs: FS-Cache loaded782lb # [ 0.172007] VFS: Disk quotas dquot_6.6.0783worker1 # [ 0.165003] EDAC MC: Ver: 3.0.0784worker2 # [ 0.178879] pnp: PnP ACPI: disabled785lb # [ 0.172038] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)786worker1 # [ 0.169632] scmi_core: SCMI protocol bus registered787lb # [ 0.174357] netfs: FS-Cache loaded788lb # [ 0.174478] pnp: PnP ACPI: disabled789worker1 # [ 0.170626] FPGA manager framework790worker1 # [ 0.171622] vgaarb: loaded791client # [ 0.164683] usbcore: registered new interface driver usbfs792client # [ 0.164717] usbcore: registered new interface driver hub793worker1 # [ 0.172265] clocksource: Switched to clocksource arch_sys_counter794client # [ 0.164747] usbcore: registered new device driver usb795worker1 # [ 0.173664] VFS: Disk quotas dquot_6.6.0796client # [ 0.165035] pps_core: LinuxPPS API ver. 1 registered797worker2 # [ 0.182790] NET: Registered PF_INET protocol family798worker1 # [ 0.173704] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)799worker2 # [ 0.183041] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)800client # [ 0.165041] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>801client # [ 0.165051] PTP clock support registered802worker1 # [ 0.175225] netfs: FS-Cache loaded803client # [ 0.165094] EDAC MC: Ver: 3.0.0804worker1 # [ 0.175349] pnp: PnP ACPI: disabled805client # [ 0.169738] scmi_core: SCMI protocol bus registered806client # [ 0.170712] FPGA manager framework807client # [ 0.171620] vgaarb: loaded808client # [ 0.172261] clocksource: Switched to clocksource arch_sys_counter809lb # [ 0.180314] NET: Registered PF_INET protocol family810client # [ 0.173655] VFS: Disk quotas dquot_6.6.0811lb # [ 0.180573] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)812client # [ 0.173685] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)813client # [ 0.175247] netfs: FS-Cache loaded814client # [ 0.175371] pnp: PnP ACPI: disabled815worker1 # [ 0.181304] NET: Registered PF_INET protocol family816worker1 # [ 0.181572] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)817client # [ 0.181333] NET: Registered PF_INET protocol family818client # [ 0.181617] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)819worker2 # [ 0.212471] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)820worker2 # [ 0.212518] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)821worker2 # [ 0.212545] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)822lb # [ 0.209658] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)823worker2 # [ 0.212615] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)824lb # [ 0.209705] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)825worker2 # [ 0.212757] TCP: Hash tables configured (established 16384 bind 16384)826lb # [ 0.209732] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)827worker2 # [ 0.212848] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)828lb # [ 0.209804] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)829worker2 # [ 0.212884] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)830lb # [ 0.209946] TCP: Hash tables configured (established 16384 bind 16384)831worker2 # [ 0.212919] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)832lb # [ 0.210029] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)833worker2 # [ 0.213009] NET: Registered PF_UNIX/PF_LOCAL protocol family834lb # [ 0.210066] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)835worker2 # [ 0.213033] NET: Registered PF_XDP protocol family836lb # [ 0.210102] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)837worker2 # [ 0.213050] PCI: CLS 0 bytes, default 64838lb # [ 0.210189] NET: Registered PF_UNIX/PF_LOCAL protocol family839worker2 # [ 0.213298] Trying to unpack rootfs image as initramfs...840lb # [ 0.210218] NET: Registered PF_XDP protocol family841lb # [ 0.210236] PCI: CLS 0 bytes, default 64842lb # [ 0.210509] Trying to unpack rootfs image as initramfs...843worker1 # [ 0.212944] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)844worker2 # [ 0.229570] kvm [1]: HYP mode not available845worker1 # [ 0.213011] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)846worker1 # [ 0.213045] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)847worker1 # [ 0.213123] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)848worker1 # [ 0.213267] TCP: Hash tables configured (established 16384 bind 16384)849worker1 # [ 0.213361] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)850worker1 # [ 0.213398] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)851worker1 # [ 0.213434] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)852client # [ 0.211227] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)853lb # [ 0.225336] kvm [1]: HYP mode not available854worker1 # [ 0.213556] NET: Registered PF_UNIX/PF_LOCAL protocol family855worker1 # [ 0.213592] NET: Registered PF_XDP protocol family856client # [ 0.211274] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)857worker1 # [ 0.213625] PCI: CLS 0 bytes, default 64858client # [ 0.211301] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)859worker1 # [ 0.213914] Trying to unpack rootfs image as initramfs...860client # [ 0.211373] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)861client # [ 0.211517] TCP: Hash tables configured (established 16384 bind 16384)862client # [ 0.211606] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)863client # [ 0.211658] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)864client # [ 0.211694] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)865client # [ 0.211796] NET: Registered PF_UNIX/PF_LOCAL protocol family866client # [ 0.211819] NET: Registered PF_XDP protocol family867client # [ 0.211838] PCI: CLS 0 bytes, default 64868client # [ 0.212106] Trying to unpack rootfs image as initramfs...869worker1 # [ 0.230148] kvm [1]: HYP mode not available870client # [ 0.230043] kvm [1]: HYP mode not available871worker2 # [ 0.324232] Initialise system trusted keyrings872worker2 # [ 0.325020] workingset: timestamp_bits=42 max_order=19 bucket_order=0873lb # [ 0.320107] Initialise system trusted keyrings874worker2 # [ 0.326336] squashfs: version 4.0 (2009/01/31) Phillip Lougher875lb # [ 0.320868] workingset: timestamp_bits=42 max_order=19 bucket_order=0876worker2 # [ 0.327115] 9p: Installing v9fs 9p2000 file system support877lb # [ 0.322140] squashfs: version 4.0 (2009/01/31) Phillip Lougher878lb # [ 0.322913] 9p: Installing v9fs 9p2000 file system support879worker1 # [ 0.328615] Initialise system trusted keyrings880worker1 # [ 0.329390] workingset: timestamp_bits=42 max_order=19 bucket_order=0881worker1 # [ 0.330687] squashfs: version 4.0 (2009/01/31) Phillip Lougher882client # [ 0.325395] Initialise system trusted keyrings883worker1 # [ 0.331485] 9p: Installing v9fs 9p2000 file system support884client # [ 0.326174] workingset: timestamp_bits=42 max_order=19 bucket_order=0885client # [ 0.327461] squashfs: version 4.0 (2009/01/31) Phillip Lougher886client # [ 0.328226] 9p: Installing v9fs 9p2000 file system support887worker2 # [ 0.356435] Key type asymmetric registered888worker2 # [ 0.356478] Asymmetric key parser 'x509' registered889lb # [ 0.351581] Key type asymmetric registered890worker2 # [ 0.356575] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)891lb # [ 0.351609] Asymmetric key parser 'x509' registered892worker2 # [ 0.358768] io scheduler mq-deadline registered893lb # [ 0.351678] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)894worker2 # [ 0.358793] io scheduler kyber registered895lb # [ 0.353847] io scheduler mq-deadline registered896lb # [ 0.353858] io scheduler kyber registered897worker1 # [ 0.355468] Key type asymmetric registered898worker1 # [ 0.355498] Asymmetric key parser 'x509' registered899worker1 # [ 0.355579] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)900lb # [ 0.363567] pl061_gpio 9030000.pl061: PL061 GPIO chip registered901lb # [ 0.364978] ledtrig-cpu: registered to indicate activity on CPUs902client # [ 0.357076] Key type asymmetric registered903client # [ 0.357120] Asymmetric key parser 'x509' registered904lb # [ 0.365383] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:905client # [ 0.357234] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)906lb # [ 0.365400] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000907client # [ 0.359453] io scheduler mq-deadline registered908client # [ 0.359464] io scheduler kyber registered909lb # [ 0.365415] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000910lb # [ 0.365424] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000911worker1 # [ 0.364348] io scheduler mq-deadline registered912lb # [ 0.365448] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits913worker1 # [ 0.364372] io scheduler kyber registered914worker2 # [ 0.373427] pl061_gpio 9030000.pl061: PL061 GPIO chip registered915lb # [ 0.365473] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]916worker1 # [ 0.369693] pl061_gpio 9030000.pl061: PL061 GPIO chip registered917worker2 # [ 0.374018] ledtrig-cpu: registered to indicate activity on CPUs918lb # [ 0.365553] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00919worker2 # [ 0.374407] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:920lb # [ 0.365568] pci_bus 0000:00: root bus resource [bus 00-ff]921lb # [ 0.365574] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]922worker1 # [ 0.370969] ledtrig-cpu: registered to indicate activity on CPUs923worker2 # [ 0.374427] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000924lb # [ 0.365580] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]925worker1 # [ 0.371354] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:926worker2 # [ 0.374442] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000927lb # [ 0.365585] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]928worker1 # [ 0.371371] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000929worker2 # [ 0.374451] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000930lb # [ 0.365680] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint931worker1 # [ 0.371383] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000932worker2 # [ 0.374473] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits933lb # [ 0.366139] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint934worker1 # [ 0.371391] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000935lb # [ 0.366318] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]936worker2 # [ 0.374507] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]937lb # [ 0.366335] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]938worker1 # [ 0.371411] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits939worker2 # [ 0.374590] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00940lb # [ 0.366364] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]941worker2 # [ 0.374602] pci_bus 0000:00: root bus resource [bus 00-ff]942worker1 # [ 0.371433] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]943lb # [ 0.366380] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]944worker2 # [ 0.374608] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]945worker1 # [ 0.371527] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00946lb # [ 0.366837] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint947worker2 # [ 0.374613] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]948worker1 # [ 0.371536] pci_bus 0000:00: root bus resource [bus 00-ff]949lb # [ 0.367015] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]950worker2 # [ 0.374618] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]951worker1 # [ 0.371542] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]952lb # [ 0.367030] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]953client # [ 0.373681] pl061_gpio 9030000.pl061: PL061 GPIO chip registered954worker1 # [ 0.371547] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]955worker2 # [ 0.374681] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint956lb # [ 0.367060] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]957worker1 # [ 0.371552] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]958worker2 # [ 0.375146] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint959worker2 # [ 0.375334] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]960worker1 # [ 0.371611] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint961worker2 # [ 0.375350] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]962lb # [ 0.386371] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint963worker1 # [ 0.372062] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint964lb # [ 0.386558] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]965worker2 # [ 0.375380] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]966worker1 # [ 0.372248] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]967lb # [ 0.386574] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]968worker2 # [ 0.375396] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]969worker1 # [ 0.372265] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]970lb # [ 0.386604] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]971worker2 # [ 0.375895] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint972lb # [ 0.387062] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint973client # [ 0.375123] ledtrig-cpu: registered to indicate activity on CPUs974worker2 # [ 0.376082] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]975lb # [ 0.387246] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]976worker2 # [ 0.376099] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]977client # [ 0.375600] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:978lb # [ 0.387262] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]979worker1 # [ 0.386273] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]980worker2 # [ 0.376129] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]981client # [ 0.375620] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000982lb # [ 0.387294] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]983worker1 # [ 0.386290] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]984worker2 # [ 0.376587] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint985client # [ 0.375634] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000986worker2 # [ 0.376779] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]987worker1 # [ 0.386761] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint988worker1 # [ 0.386947] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]989worker2 # [ 0.376795] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]990client # [ 0.375646] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000991worker1 # [ 0.386963] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]992worker2 # [ 0.376825] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]993client # [ 0.375682] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits994worker1 # [ 0.386993] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]995worker2 # [ 0.377279] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint996client # [ 0.375715] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]997worker2 # [ 0.377467] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]998worker1 # [ 0.387456] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint999worker1 # [ 0.387640] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1000client # [ 0.375801] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001001worker2 # [ 0.377484] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1002worker1 # [ 0.387657] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1003client # [ 0.375814] pci_bus 0000:00: root bus resource [bus 00-ff]1004worker2 # [ 0.377517] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1005client # [ 0.375820] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1006worker1 # [ 0.387687] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1007worker2 # [ 0.377976] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1008client # [ 0.375826] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1009worker2 # [ 0.378160] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1010worker1 # [ 0.388151] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1011client # [ 0.375831] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1012worker2 # [ 0.378177] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1013worker2 # [ 0.378207] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1014client # [ 0.375898] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1015worker2 # [ 0.378688] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1016client # [ 0.376427] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1017client # [ 0.376615] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1018worker2 # [ 0.378872] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1019worker2 # [ 0.378887] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1020client # [ 0.376642] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1021worker2 # [ 0.378917] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1022client # [ 0.376672] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1023client # [ 0.376687] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1024worker2 # [ 0.379371] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1025worker2 # [ 0.379557] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1026client # [ 0.377147] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1027worker2 # [ 0.379572] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1028client # [ 0.377346] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1029lb # [ 0.399822] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1030client # [ 0.377361] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1031worker2 # [ 0.379601] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1032worker1 # [ 0.400412] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1033lb # [ 0.400019] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1034worker1 # [ 0.400448] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1035client # [ 0.377390] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1036lb # [ 0.400036] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1037worker2 # [ 0.379617] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1038worker1 # [ 0.400481] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1039lb # [ 0.400067] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1040client # [ 0.377849] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1041client # [ 0.378031] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1042worker1 # [ 0.401000] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1043lb # [ 0.400521] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1044client # [ 0.378046] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1045worker1 # [ 0.401188] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1046lb # [ 0.400705] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1047worker1 # [ 0.401205] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1048client # [ 0.378075] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1049lb # [ 0.400720] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1050worker1 # [ 0.401234] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1051client # [ 0.378548] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1052lb # [ 0.400750] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1053client # [ 0.378740] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1054worker1 # [ 0.401687] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1055lb # [ 0.401202] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1056client # [ 0.378756] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1057worker1 # [ 0.401872] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1058lb # [ 0.401384] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1059worker1 # [ 0.401888] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1060client # [ 0.378790] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1061lb # [ 0.401400] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1062worker1 # [ 0.401918] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1063client # [ 0.379257] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1064lb # [ 0.401429] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1065client # [ 0.379439] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1066worker1 # [ 0.402414] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1067lb # [ 0.401445] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1068client # [ 0.379458] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1069worker1 # [ 0.402601] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1070lb # [ 0.401941] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1071worker2 # [ 0.420161] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1072worker1 # [ 0.402618] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1073client # [ 0.379500] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1074lb # [ 0.402131] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1075worker2 # [ 0.420371] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1076worker1 # [ 0.402647] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1077client # [ 0.380016] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1078lb # [ 0.402162] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1079worker2 # [ 0.420401] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1080worker1 # [ 0.402664] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1081client # [ 0.380200] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1082lb # [ 0.402619] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1083worker2 # [ 0.420864] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1084client # [ 0.380216] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1085worker1 # [ 0.403120] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1086lb # [ 0.402810] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1087worker2 # [ 0.421055] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1088worker1 # [ 0.403308] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1089client # [ 0.380257] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1090lb # [ 0.402839] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1091worker1 # [ 0.403339] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1092worker2 # [ 0.421085] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1093lb # [ 0.403231] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1094worker1 # [ 0.403807] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1095worker2 # [ 0.421482] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1096lb # [ 0.403420] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1097worker2 # [ 0.421666] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1098worker1 # [ 0.403996] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1099lb # [ 0.403681] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1100worker1 # [ 0.404026] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1101worker2 # [ 0.421916] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1102lb # [ 0.403947] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1103worker2 # [ 0.422179] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1104lb # [ 0.403965] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1105worker2 # [ 0.422196] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1106lb # [ 0.403995] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1107worker2 # [ 0.422227] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1108lb # [ 0.404467] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1109worker2 # [ 0.422694] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1110lb # [ 0.404650] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1111worker2 # [ 0.422880] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1112lb # [ 0.404665] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1113worker2 # [ 0.422896] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1114lb # [ 0.404695] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1115worker2 # [ 0.422925] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1116lb # [ 0.405282] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1117worker2 # [ 0.423504] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1118client # [ 0.416767] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1119lb # [ 0.405293] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1120worker2 # [ 0.423516] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1121client # [ 0.416966] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1122lb # [ 0.405299] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1123client # [ 0.416983] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1124worker1 # [ 0.424531] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1125worker2 # [ 0.423521] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1126client # [ 0.417013] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1127lb # [ 0.405342] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1128worker1 # [ 0.424732] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1129worker2 # [ 0.423567] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1130client # [ 0.417030] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1131lb # [ 0.405388] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1132worker1 # [ 0.424989] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1133worker2 # [ 0.423614] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1134worker1 # [ 0.425276] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1135client # [ 0.417492] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1136lb # [ 0.405441] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1137worker1 # [ 0.425294] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1138client # [ 0.417679] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1139lb # [ 0.405488] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1140worker1 # [ 0.425324] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1141client # [ 0.417708] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1142lb # [ 0.405533] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1143worker1 # [ 0.425792] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1144client # [ 0.418168] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1145worker1 # [ 0.425976] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1146lb # [ 0.405580] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1147client # [ 0.418356] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1148worker1 # [ 0.425992] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1149client # [ 0.418385] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1150lb # [ 0.405628] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1151worker1 # [ 0.426020] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1152client # [ 0.418777] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1153lb # [ 0.405677] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1154worker1 # [ 0.426605] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1155client # [ 0.418959] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1156lb # [ 0.405724] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1157worker1 # [ 0.426617] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1158client # [ 0.419207] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1159lb # [ 0.405784] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1160worker1 # [ 0.426622] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1161client # [ 0.419461] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1162lb # [ 0.405840] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1163client # [ 0.419478] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1164worker1 # [ 0.426667] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1165lb # [ 0.405861] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1166client # [ 0.419507] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1167worker1 # [ 0.426715] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1168lb # [ 0.405883] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1169client # [ 0.419985] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1170lb # [ 0.405909] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1171worker1 # [ 0.426763] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1172client # [ 0.420168] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1173lb # [ 0.405934] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1174worker2 # [ 0.447694] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1175worker1 # [ 0.426810] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1176client # [ 0.420184] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1177lb # [ 0.405966] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1178client # [ 0.420214] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1179worker1 # [ 0.426858] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1180worker2 # [ 0.447753] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1181lb # [ 0.405992] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1182worker1 # [ 0.426907] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1183worker2 # [ 0.447802] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1184lb # [ 0.406014] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1185worker1 # [ 0.426956] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1186worker2 # [ 0.447851] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1187lb # [ 0.406036] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1188worker1 # [ 0.427003] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1189lb # [ 0.406059] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1190worker2 # [ 0.447899] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1191lb # [ 0.406090] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1192worker1 # [ 0.427052] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1193worker2 # [ 0.447948] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1194lb # [ 0.406117] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1195worker1 # [ 0.427120] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1196worker2 # [ 0.447997] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1197lb # [ 0.406150] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1198worker1 # [ 0.427166] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1199worker2 # [ 0.448090] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1200lb # [ 0.406171] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1201worker1 # [ 0.427188] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1202worker2 # [ 0.448139] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1203lb # [ 0.406193] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1204worker1 # [ 0.427210] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1205lb # [ 0.406214] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1206worker2 # [ 0.448162] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1207worker1 # [ 0.427233] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1208lb # [ 0.406235] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1209worker2 # [ 0.448184] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1210worker1 # [ 0.427258] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1211lb # [ 0.406257] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1212worker2 # [ 0.448206] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1213lb # [ 0.406289] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1214worker1 # [ 0.427280] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1215worker2 # [ 0.448230] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1216lb # [ 0.406313] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1217worker1 # [ 0.427302] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1218worker2 # [ 0.448252] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1219lb # [ 0.406339] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1220worker1 # [ 0.427323] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1221worker2 # [ 0.448274] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1222lb # [ 0.406365] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1223worker1 # [ 0.427346] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1224lb # [ 0.406375] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1225worker2 # [ 0.448296] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1226worker1 # [ 0.427369] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1227client # [ 0.444966] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1228lb # [ 0.406380] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1229worker2 # [ 0.448319] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1230worker1 # [ 0.427393] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1231client # [ 0.444992] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1232worker2 # [ 0.448342] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1233worker1 # [ 0.427416] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1234client # [ 0.444999] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1235worker2 # [ 0.448365] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1236worker1 # [ 0.427456] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1237worker2 # [ 0.448388] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1238client # [ 0.445050] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1239worker1 # [ 0.427479] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1240worker2 # [ 0.448409] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1241client # [ 0.445100] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1242worker1 # [ 0.427500] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1243worker2 # [ 0.448431] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1244worker1 # [ 0.427522] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1245client # [ 0.445147] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1246worker2 # [ 0.448453] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1247worker1 # [ 0.427543] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1248client # [ 0.445195] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1249worker2 # [ 0.448475] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1250worker1 # [ 0.427565] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1251lb # [ 0.463587] pci 0000:00:0a.0: enabling device (0000 -> 0002)1252worker2 # [ 0.448497] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1253client # [ 0.445242] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1254worker1 # [ 0.427586] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1255worker2 # [ 0.448519] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1256worker1 # [ 0.427608] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1257client # [ 0.445290] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1258worker2 # [ 0.448541] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1259worker1 # [ 0.427631] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1260worker2 # [ 0.448563] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1261client # [ 0.445339] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1262worker1 # [ 0.427658] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1263worker2 # [ 0.448585] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1264client # [ 0.445387] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1265worker1 # [ 0.427667] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1266worker2 # [ 0.448614] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1267worker1 # [ 0.427672] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1268client # [ 0.445435] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1269worker2 # [ 0.448623] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1270client # [ 0.445535] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1271worker2 # [ 0.448628] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1272worker2 # [ 0.449829] pci 0000:00:0a.0: enabling device (0000 -> 0002)1273client # [ 0.445583] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1274client # [ 0.445604] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1275client # [ 0.445626] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1276client # [ 0.445648] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1277client # [ 0.445673] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1278client # [ 0.445694] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1279client # [ 0.445715] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1280client # [ 0.445736] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1281client # [ 0.445758] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1282worker1 # [ 0.472878] pci 0000:00:0a.0: enabling device (0000 -> 0002)1283client # [ 0.445780] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1284client # [ 0.445804] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1285client # [ 0.445827] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1286client # [ 0.445849] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1287client # [ 0.445870] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1288client # [ 0.445891] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1289client # [ 0.445912] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1290client # [ 0.445932] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1291client # [ 0.445954] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1292client # [ 0.445975] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1293client # [ 0.445996] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1294client # [ 0.446017] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1295client # [ 0.446044] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1296client # [ 0.446054] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1297client # [ 0.446059] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1298client # [ 0.447232] pci 0000:00:0a.0: enabling device (0000 -> 0002)1299lb # [ 0.489970] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1300worker2 # [ 0.498121] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1301lb # [ 0.496032] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1302worker1 # [ 0.493842] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1303lb # [ 0.497988] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1304worker1 # [ 0.495970] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1305worker2 # [ 0.508292] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1306worker1 # [ 0.507085] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1307worker2 # [ 0.515837] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1308worker2 # [ 0.517967] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1309lb # [ 0.508069] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1310lb # [ 0.510031] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1311lb # [ 0.511986] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1312lb # [ 0.514106] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1313worker1 # [ 0.513217] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1314worker1 # [ 0.515356] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1315worker2 # [ 0.527795] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1316worker2 # [ 0.530587] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1317client # [ 0.508817] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1318lb # [ 0.524636] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1319client # [ 0.510989] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1320lb # [ 0.526792] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1321client # [ 0.513247] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1322client # [ 0.515268] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1323worker1 # [ 0.525725] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1324worker1 # [ 0.527892] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1325worker2 # [ 0.541906] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1326client # [ 0.525479] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1327lb # [ 0.537874] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1328client # [ 0.527549] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1329worker1 # [ 0.539385] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1330lb # [ 0.544441] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1331worker2 # [ 0.544918] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1332worker2 # [ 0.547024] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1333worker2 # [ 0.549005] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1334worker2 # [ 0.551514] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1335client # [ 0.538868] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1336worker1 # [ 0.545575] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1337worker1 # [ 0.547453] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1338lb # [ 0.553471] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1339client # [ 0.541958] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1340client # [ 0.543940] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1341lb # [ 0.560655] msm_serial: driver initialized1342lb # [ 0.560812] SuperH (H)SCI(F) driver initialized1343worker1 # [ 0.558019] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1344lb # [ 0.560871] STM32 USART driver initialized1345worker2 # [ 0.572948] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1346client # [ 0.553798] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1347client # [ 0.556125] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1348worker2 # [ 0.575632] msm_serial: driver initialized1349worker2 # [ 0.575852] SuperH (H)SCI(F) driver initialized1350worker2 # [ 0.575909] STM32 USART driver initialized1351worker1 # [ 0.573973] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1352worker1 # [ 0.577798] msm_serial: driver initialized1353worker1 # [ 0.577950] SuperH (H)SCI(F) driver initialized1354client # [ 0.573509] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1355worker1 # [ 0.578004] STM32 USART driver initialized1356lb # [ 0.590221] loop: module loaded1357lb # [ 0.590403] virtio_blk virtio5: 1/0/0 default/read/poll queues1358lb # [ 0.591169] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1359client # [ 0.581257] msm_serial: driver initialized1360client # [ 0.581411] SuperH (H)SCI(F) driver initialized1361client # [ 0.581472] STM32 USART driver initialized1362worker2 # [ 0.613062] loop: module loaded1363worker2 # [ 0.613247] virtio_blk virtio5: 1/0/0 default/read/poll queues1364worker2 # [ 0.614005] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1365lb # [ 0.604108] megasas: 07.734.00.00-rc11366lb # [ 0.604859] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1367lb # [ 0.607000] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001368lb # [ 0.607033] Intel/Sharp Extended Query Table at 0x00311369lb # [ 0.608666] Using buffer write method1370lb # [ 0.608727] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1371lb # [ 0.610405] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001372worker1 # [ 0.612562] loop: module loaded1373lb # [ 0.610436] Intel/Sharp Extended Query Table at 0x00311374worker1 # [ 0.612768] virtio_blk virtio5: 1/0/0 default/read/poll queues1375worker1 # [ 0.613544] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1376client # [ 0.611145] loop: module loaded1377client # [ 0.611347] virtio_blk virtio5: 1/0/0 default/read/poll queues1378lb # [ 0.623966] Using buffer write method1379lb # [ 0.623997] Concatenating MTD devices:1380lb # [ 0.624001] (0): "0.flash"1381client # [ 0.612153] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1382lb # [ 0.624005] (1): "0.flash"1383lb # [ 0.624009] into device "0.flash"1384worker2 # [ 0.624428] megasas: 07.734.00.00-rc11385worker2 # [ 0.625483] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1386worker2 # [ 0.627370] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001387worker2 # [ 0.627404] Intel/Sharp Extended Query Table at 0x00311388worker2 # [ 0.629024] Using buffer write method1389worker2 # [ 0.629098] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1390worker2 # [ 0.630787] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001391worker1 # [ 0.620979] megasas: 07.734.00.00-rc11392worker2 # [ 0.630814] Intel/Sharp Extended Query Table at 0x00311393worker1 # [ 0.621745] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1394worker1 # [ 0.624089] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001395worker1 # [ 0.624126] Intel/Sharp Extended Query Table at 0x00311396worker1 # [ 0.625716] Using buffer write method1397worker1 # [ 0.625791] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1398worker1 # [ 0.627653] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001399client # [ 0.620393] megasas: 07.734.00.00-rc11400worker1 # [ 0.627690] Intel/Sharp Extended Query Table at 0x00311401client # [ 0.621478] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1402client # [ 0.623647] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001403client # [ 0.623671] Intel/Sharp Extended Query Table at 0x00311404client # [ 0.625260] Using buffer write method1405worker2 # [ 0.649073] Using buffer write method1406worker2 # [ 0.649128] Concatenating MTD devices:1407worker2 # [ 0.649133] (0): "0.flash"1408client # [ 0.625346] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1409worker2 # [ 0.649137] (1): "0.flash"1410worker2 # [ 0.649140] into device "0.flash"1411client # [ 0.626951] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001412client # [ 0.627004] Intel/Sharp Extended Query Table at 0x00311413worker1 # [ 0.646297] Using buffer write method1414worker1 # [ 0.646341] Concatenating MTD devices:1415worker1 # [ 0.646345] (0): "0.flash"1416worker1 # [ 0.646350] (1): "0.flash"1417worker1 # [ 0.646353] into device "0.flash"1418client # [ 0.644336] Using buffer write method1419client # [ 0.644365] Concatenating MTD devices:1420client # [ 0.644369] (0): "0.flash"1421client # [ 0.644373] (1): "0.flash"1422client # [ 0.644377] into device "0.flash"1423lb # [ 0.887130] Freeing initrd memory: 26140K1424lb # [ 0.894610] tun: Universal TUN/TAP device driver, 1.61425lb # [ 0.898414] thunder_xcv, ver 1.01426lb # [ 0.898460] thunder_bgx, ver 1.01427lb # [ 0.898486] nicpf, ver 1.01428lb # [ 0.899088] e1000: Intel(R) PRO/1000 Network Driver1429lb # [ 0.899098] e1000: Copyright (c) 1999-2006 Intel Corporation.1430client # [ 0.891252] Freeing initrd memory: 26160K1431lb # [ 0.899122] e1000e: Intel(R) PRO/1000 Network Driver1432lb # [ 0.899130] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1433lb # [ 0.899163] igb: Intel(R) Gigabit Ethernet Network Driver1434lb # [ 0.899170] igb: Copyright (c) 2007-2014 Intel Corporation.1435lb # [ 0.899194] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436lb # [ 0.899201] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1437lb # [ 0.899347] sky2: driver version 1.301438worker1 # [ 0.902620] Freeing initrd memory: 26148K1439worker2 # [ 0.912736] Freeing initrd memory: 26148K1440client # [ 0.897565] tun: Universal TUN/TAP device driver, 1.61441lb # [ 0.908125] usbcore: registered new interface driver usb-storage1442lb # [ 0.908256] usbcore: registered new interface driver usbserial_generic1443lb # [ 0.908272] usbserial: USB Serial support registered for generic1444lb # [ 0.908899] hv_vmbus: registering driver hyperv_keyboard1445worker1 # [ 0.908927] tun: Universal TUN/TAP device driver, 1.61446lb # [ 0.910147] ehci-pci 0000:00:0a.0: EHCI Host Controller1447lb # [ 0.910185] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11448worker2 # [ 0.920494] tun: Universal TUN/TAP device driver, 1.61449lb # [ 0.910354] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001450client # [ 0.901283] thunder_xcv, ver 1.01451client # [ 0.901329] thunder_bgx, ver 1.01452client # [ 0.901355] nicpf, ver 1.01453client # [ 0.901998] e1000: Intel(R) PRO/1000 Network Driver1454lb # [ 0.916008] rtc-pl031 9010000.pl031: registered as rtc01455client # [ 0.902009] e1000: Copyright (c) 1999-2006 Intel Corporation.1456lb # [ 0.916041] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:24 UTC (1789895064)1457client # [ 0.902038] e1000e: Intel(R) PRO/1000 Network Driver1458lb # [ 0.916393] i2c_dev: i2c /dev entries driver1459client # [ 0.902045] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1460client # [ 0.902080] igb: Intel(R) Gigabit Ethernet Network Driver1461client # [ 0.902087] igb: Copyright (c) 2007-2014 Intel Corporation.1462client # [ 0.902114] igbvf: Intel(R) Gigabit Virtual Function Network Driver1463worker1 # [ 0.912784] thunder_xcv, ver 1.01464worker1 # [ 0.912831] thunder_bgx, ver 1.01465client # [ 0.902123] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1466worker1 # [ 0.912852] nicpf, ver 1.01467worker2 # [ 0.924523] thunder_xcv, ver 1.01468client # [ 0.902268] sky2: driver version 1.301469worker1 # [ 0.913427] e1000: Intel(R) PRO/1000 Network Driver1470worker2 # [ 0.924564] thunder_bgx, ver 1.01471client # [ 0.903958] usbcore: registered new interface driver usb-storage1472worker2 # [ 0.924593] nicpf, ver 1.01473worker1 # [ 0.913435] e1000: Copyright (c) 1999-2006 Intel Corporation.1474lb # [ 0.921712] sdhci: Secure Digital Host Controller Interface driver1475worker2 # [ 0.925189] e1000: Intel(R) PRO/1000 Network Driver1476worker1 # [ 0.913465] e1000e: Intel(R) PRO/1000 Network Driver1477client # [ 0.904019] usbcore: registered new interface driver usbserial_generic1478lb # [ 0.921728] sdhci: Copyright(c) Pierre Ossman1479worker2 # [ 0.925199] e1000: Copyright (c) 1999-2006 Intel Corporation.1480worker1 # [ 0.913472] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1481client # [ 0.904037] usbserial: USB Serial support registered for generic1482lb # [ 0.922009] Synopsys Designware Multimedia Card Interface Driver1483worker2 # [ 0.925225] e1000e: Intel(R) PRO/1000 Network Driver1484worker1 # [ 0.913501] igb: Intel(R) Gigabit Ethernet Network Driver1485client # [ 0.905049] ehci-pci 0000:00:0a.0: EHCI Host Controller1486lb # [ 0.922468] sdhci-pltfm: SDHCI platform and OF driver helper1487worker2 # [ 0.925231] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1488worker1 # [ 0.913506] igb: Copyright (c) 2007-2014 Intel Corporation.1489client # [ 0.905081] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11490lb # [ 0.926021] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001491worker2 # [ 0.925264] igb: Intel(R) Gigabit Ethernet Network Driver1492worker1 # [ 0.913529] igbvf: Intel(R) Gigabit Virtual Function Network Driver1493client # [ 0.905347] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001494worker2 # [ 0.925271] igb: Copyright (c) 2007-2014 Intel Corporation.1495lb # [ 0.927115] hub 1-0:1.0: USB hub found1496worker1 # [ 0.913535] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1497worker1 # [ 0.913673] sky2: driver version 1.301498worker2 # [ 0.925296] igbvf: Intel(R) Gigabit Virtual Function Network Driver1499lb # [ 0.927665] hub 1-0:1.0: 6 ports detected1500client # [ 0.916867] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001501worker1 # [ 0.915323] usbcore: registered new interface driver usb-storage1502worker2 # [ 0.925303] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1503client # [ 0.917269] hub 1-0:1.0: USB hub found1504worker2 # [ 0.925457] sky2: driver version 1.301505worker1 # [ 0.915414] usbcore: registered new interface driver usbserial_generic1506client # [ 0.917283] hub 1-0:1.0: 6 ports detected1507worker2 # [ 0.927158] usbcore: registered new interface driver usb-storage1508worker1 # [ 0.915430] usbserial: USB Serial support registered for generic1509worker2 # [ 0.927255] usbcore: registered new interface driver usbserial_generic1510worker1 # [ 0.916066] hv_vmbus: registering driver hyperv_keyboard1511client # [ 0.919687] hv_vmbus: registering driver hyperv_keyboard1512worker1 # [ 0.917069] ehci-pci 0000:00:0a.0: EHCI Host Controller1513worker2 # [ 0.927276] usbserial: USB Serial support registered for generic1514lb # [ 0.929752] hid: raw HID events driver (C) Jiri Kosina1515lb # [ 0.929999] usbcore: registered new interface driver usbhid1516worker2 # [ 0.928325] ehci-pci 0000:00:0a.0: EHCI Host Controller1517worker1 # [ 0.917103] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11518lb # [ 0.930006] usbhid: USB HID core driver1519worker2 # [ 0.928364] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11520client # [ 0.921237] rtc-pl031 9010000.pl031: registered as rtc01521worker1 # [ 0.917399] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001522worker2 # [ 0.928573] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001523client # [ 0.921268] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:24 UTC (1789895064)1524worker1 # [ 0.928632] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001525client # [ 0.921578] i2c_dev: i2c /dev entries driver1526worker1 # [ 0.928983] hub 1-0:1.0: USB hub found1527worker1 # [ 0.929001] hub 1-0:1.0: 6 ports detected1528worker2 # [ 0.940143] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001529lb # [ 0.932930] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1530worker2 # [ 0.940544] hub 1-0:1.0: USB hub found1531worker2 # [ 0.940590] hub 1-0:1.0: 6 ports detected1532lb # [ 0.934708] drop_monitor: Initializing network drop monitor service1533lb # [ 0.934879] NET: Registered PF_INET6 protocol family1534worker1 # [ 0.932491] rtc-pl031 9010000.pl031: registered as rtc01535worker2 # [ 0.943176] hv_vmbus: registering driver hyperv_keyboard1536lb # [ 0.937944] Segment Routing with IPv61537lb # [ 0.937961] In-situ OAM (IOAM) with IPv61538worker1 # [ 0.932525] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:24 UTC (1789895064)1539client # [ 0.926615] sdhci: Secure Digital Host Controller Interface driver1540lb # [ 0.938002] NET: Registered PF_PACKET protocol family1541worker1 # [ 0.932838] i2c_dev: i2c /dev entries driver1542client # [ 0.926626] sdhci: Copyright(c) Pierre Ossman1543client # [ 0.926906] Synopsys Designware Multimedia Card Interface Driver1544worker2 # [ 0.945210] rtc-pl031 9010000.pl031: registered as rtc01545client # [ 0.927299] sdhci-pltfm: SDHCI platform and OF driver helper1546worker2 # [ 0.945263] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:24 UTC (1789895064)1547worker2 # [ 0.945630] i2c_dev: i2c /dev entries driver1548client # [ 0.931742] hid: raw HID events driver (C) Jiri Kosina1549lb # [ 0.939655] 9pnet: Installing 9P2000 support1550client # [ 0.932009] usbcore: registered new interface driver usbhid1551lb # [ 0.941799] Key type dns_resolver registered1552client # [ 0.932015] usbhid: USB HID core driver1553worker1 # [ 0.937868] sdhci: Secure Digital Host Controller Interface driver1554worker1 # [ 0.937883] sdhci: Copyright(c) Pierre Ossman1555worker1 # [ 0.938151] Synopsys Designware Multimedia Card Interface Driver1556worker2 # [ 0.951365] sdhci: Secure Digital Host Controller Interface driver1557worker2 # [ 0.951381] sdhci: Copyright(c) Pierre Ossman1558worker1 # [ 0.938526] sdhci-pltfm: SDHCI platform and OF driver helper1559client # [ 0.935094] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1560worker1 # [ 0.943040] hid: raw HID events driver (C) Jiri Kosina1561worker1 # [ 0.943299] usbcore: registered new interface driver usbhid1562client # [ 0.937853] drop_monitor: Initializing network drop monitor service1563worker1 # [ 0.943306] usbhid: USB HID core driver1564client # [ 0.938075] NET: Registered PF_INET6 protocol family1565worker2 # [ 0.953043] Synopsys Designware Multimedia Card Interface Driver1566worker2 # [ 0.953490] sdhci-pltfm: SDHCI platform and OF driver helper1567client # [ 0.940098] Segment Routing with IPv61568worker2 # [ 0.955621] hid: raw HID events driver (C) Jiri Kosina1569client # [ 0.940127] In-situ OAM (IOAM) with IPv61570client # [ 0.940169] NET: Registered PF_PACKET protocol family1571lb # [ 0.949342] registered taskstats version 11572lb # [ 0.949579] Loading compiled-in X.509 certificates1573worker1 # [ 0.946253] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1574worker1 # [ 0.947845] drop_monitor: Initializing network drop monitor service1575worker2 # [ 0.958093] usbcore: registered new interface driver usbhid1576worker2 # [ 0.958118] usbhid: USB HID core driver1577worker1 # [ 0.947998] NET: Registered PF_INET6 protocol family1578client # [ 0.942040] 9pnet: Installing 9P2000 support1579worker1 # [ 0.951200] Segment Routing with IPv61580client # [ 0.944184] Key type dns_resolver registered1581worker1 # [ 0.951219] In-situ OAM (IOAM) with IPv61582worker1 # [ 0.951248] NET: Registered PF_PACKET protocol family1583worker2 # [ 0.960789] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1584worker2 # [ 0.962411] drop_monitor: Initializing network drop monitor service1585worker2 # [ 0.962597] NET: Registered PF_INET6 protocol family1586worker2 # [ 0.965895] Segment Routing with IPv61587worker1 # [ 0.953094] 9pnet: Installing 9P2000 support1588worker2 # [ 0.965915] In-situ OAM (IOAM) with IPv61589lb # [ 0.959861] Demotion targets for Node 0: null1590worker1 # [ 0.955268] Key type dns_resolver registered1591worker2 # [ 0.965948] NET: Registered PF_PACKET protocol family1592lb # [ 0.960032] Key type .fscrypt registered1593worker2 # [ 0.967589] 9pnet: Installing 9P2000 support1594lb # [ 0.960041] Key type fscrypt-provisioning registered1595lb # [ 0.960169] ima: No TPM chip found, activating TPM-bypass!1596client # [ 0.951532] registered taskstats version 11597lb # [ 0.960205] ima: Allocated hash algorithm: sha11598client # [ 0.951754] Loading compiled-in X.509 certificates1599lb # [ 0.960237] ima: No architecture policies found1600lb # [ 0.964392] input: gpio-keys as /devices/platform/gpio-keys/input/input01601worker2 # [ 0.970284] Key type dns_resolver registered1602worker1 # [ 0.962187] registered taskstats version 11603worker1 # [ 0.962367] Loading compiled-in X.509 certificates1604client # [ 0.961012] Demotion targets for Node 0: null1605client # [ 0.961153] Key type .fscrypt registered1606client # [ 0.961164] Key type fscrypt-provisioning registered1607worker2 # [ 0.976913] registered taskstats version 11608client # [ 0.961300] ima: No TPM chip found, activating TPM-bypass!1609client # [ 0.961335] ima: Allocated hash algorithm: sha11610worker2 # [ 0.977094] Loading compiled-in X.509 certificates1611client # [ 0.961381] ima: No architecture policies found1612worker1 # [ 0.971586] Demotion targets for Node 0: null1613client # [ 0.965598] input: gpio-keys as /devices/platform/gpio-keys/input/input01614worker1 # [ 0.971757] Key type .fscrypt registered1615worker1 # [ 0.971767] Key type fscrypt-provisioning registered1616worker1 # [ 0.971891] ima: No TPM chip found, activating TPM-bypass!1617worker1 # [ 0.971918] ima: Allocated hash algorithm: sha11618worker1 # [ 0.971944] ima: No architecture policies found1619worker2 # [ 0.985746] Demotion targets for Node 0: null1620worker2 # [ 0.985876] Key type .fscrypt registered1621worker1 # [ 0.976418] input: gpio-keys as /devices/platform/gpio-keys/input/input01622worker2 # [ 0.985882] Key type fscrypt-provisioning registered1623worker2 # [ 0.985992] ima: No TPM chip found, activating TPM-bypass!1624worker2 # [ 0.986019] ima: Allocated hash algorithm: sha11625worker2 # [ 0.986050] ima: No architecture policies found1626worker2 # [ 0.990154] input: gpio-keys as /devices/platform/gpio-keys/input/input01627lb # [ 0.984321] clk: Disabling unused clocks1628lb # [ 0.984345] PM: genpd: Disabling unused power domains1629lb # [ 0.990152] Freeing unused kernel memory: 4736K1630lb # [ 0.990458] Run /init as init process1631client # [ 0.988810] clk: Disabling unused clocks1632client # [ 0.988833] PM: genpd: Disabling unused power domains1633worker2 # [ 1.008557] clk: Disabling unused clocks1634worker2 # [ 1.008579] PM: genpd: Disabling unused power domains1635client # [ 0.994386] Freeing unused kernel memory: 4736K1636client # [ 0.994676] Run /init as init process1637lb # [ 1.006444] systemd[1]: Successfully made /usr/ read-only.1638worker2 # [ 1.014288] Freeing unused kernel memory: 4736K1639worker2 # [ 1.014569] Run /init as init process1640worker1 # [ 1.012972] clk: Disabling unused clocks1641worker1 # [ 1.013009] PM: genpd: Disabling unused power domains1642client # [ 1.010525] systemd[1]: Successfully made /usr/ read-only.1643worker1 # [ 1.018692] Freeing unused kernel memory: 4736K1644worker1 # [ 1.018908] Run /init as init process1645worker2 # [ 1.029943] systemd[1]: Successfully made /usr/ read-only.1646worker1 # [ 1.034522] systemd[1]: Successfully made /usr/ read-only.1647client # [ 1.164356] usb 1-1: new high-speed USB device number 2 using ehci-pci1648lb # [ 1.175493] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.176359] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.187718] usb 1-1: new high-speed USB device number 2 using ehci-pci1651lb # [ 1.332506] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652client # [ 1.321018] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653worker1 # [ 1.328738] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11654worker2 # [ 1.340156] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11655lb # [ 1.341623] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1656lb # [ 1.354460] systemd[1]: Detected virtualization qemu.1657lb # [ 1.356679] systemd[1]: Detected architecture arm64.1658lb # [ 1.358623] systemd[1]: Running in initrd.1659lb # [ 1.361699] systemd[1]: Initializing machine ID from random generator.1660lb # [ 1.364885] systemd[1]: Hostname set to <lb>.1661client # [ 1.345915] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1662worker2 # [ 1.364866] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1663client # [ 1.358570] systemd[1]: Detected virtualization qemu.1664worker2 # [ 1.377289] systemd[1]: Detected virtualization qemu.1665client # [ 1.360874] systemd[1]: Detected architecture arm64.1666client # [ 1.362901] systemd[1]: Running in initrd.1667worker2 # [ 1.379452] systemd[1]: Detected architecture arm64.1668worker2 # [ 1.381509] systemd[1]: Running in initrd.1669client # [ 1.366473] systemd[1]: Initializing machine ID from random generator.1670worker2 # [ 1.384569] systemd[1]: Initializing machine ID from random generator.1671client # [ 1.369567] systemd[1]: Hostname set to <client>.1672worker2 # [ 1.387968] systemd[1]: Hostname set to <worker2>.1673worker1 # [ 1.369430] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1674worker1 # [ 1.381646] systemd[1]: Detected virtualization qemu.1675worker1 # [ 1.383697] systemd[1]: Detected architecture arm64.1676worker1 # [ 1.386066] systemd[1]: Running in initrd.1677worker1 # [ 1.389151] systemd[1]: Initializing machine ID from random generator.1678worker1 # [ 1.392069] systemd[1]: Hostname set to <worker1>.1679worker1 # [ 1.408690] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01680lb # [ 1.415753] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681worker2 # [ 1.432094] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682client # [ 1.420662] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683lb # [ 1.539531] usb 1-2: new high-speed USB device number 3 using ehci-pci1684worker1 # [ 1.536458] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker2 # [ 1.555685] usb 1-2: new high-speed USB device number 3 using ehci-pci1686client # [ 1.540299] usb 1-2: new high-speed USB device number 3 using ehci-pci1687lb # [ 1.685550] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688worker2 # [ 1.700332] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689worker1 # [ 1.692518] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690worker1 # [ 1.698135] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691lb # [ 1.706843] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21692worker2 # [ 1.715245] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21693client # [ 1.699173] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21694lb # [ 1.712354] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01695worker2 # [ 1.721247] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01696client # [ 1.708804] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697client # [ 1.722356] systemd[1]: bpf-restrict-fs: LSM BPF program attached1698worker1 # [ 1.729340] systemd[1]: bpf-restrict-fs: LSM BPF program attached1699lb # [ 1.808204] systemd[1]: Queued start job for default target Initrd Default Target.1700lb # [ 1.817885] systemd[1]: Created slice Slice /system/modprobe.1701lb # [ 1.819006] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1702lb # [ 1.820295] systemd[1]: Expecting device /dev/disk/by-label/nixos...1703worker2 # [ 1.826385] systemd[1]: Queued start job for default target Initrd Default Target.1704lb # [ 1.821281] systemd[1]: Reached target Path Units.1705lb # [ 1.822013] systemd[1]: Reached target Slice Units.1706lb # [ 1.822761] systemd[1]: Reached target Swaps.1707lb # [ 1.823470] systemd[1]: Reached target Timer Units.1708lb # [ 1.824386] systemd[1]: Listening on D-Bus System Message Bus Socket.1709lb # [ 1.825494] systemd[1]: Listening on Journal Socket (/dev/log).1710lb # [ 1.826602] systemd[1]: Listening on Journal Sockets.1711lb # [ 1.827550] systemd[1]: Listening on udev Control Socket.1712lb # [ 1.828497] systemd[1]: Listening on udev Kernel Socket.1713lb # [ 1.829336] systemd[1]: Reached target Socket Units.1714worker1 # [ 1.827354] systemd[1]: Queued start job for default target Initrd Default Target.1715client # [ 1.820357] systemd[1]: Queued start job for default target Initrd Default Target.1716worker2 # [ 1.837904] systemd[1]: Created slice Slice /system/modprobe.1717lb # [ 1.832372] systemd[1]: Starting Create List of Static Device Nodes...1718worker2 # [ 1.838994] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1719worker2 # [ 1.840318] systemd[1]: Expecting device /dev/disk/by-label/nixos...1720worker2 # [ 1.840355] systemd[1]: Reached target Path Units.1721worker2 # [ 1.840374] systemd[1]: Reached target Slice Units.1722worker2 # [ 1.840393] systemd[1]: Reached target Swaps.1723worker2 # [ 1.840410] systemd[1]: Reached target Timer Units.1724worker2 # [ 1.840592] systemd[1]: Listening on D-Bus System Message Bus Socket.1725worker2 # [ 1.840722] systemd[1]: Listening on Journal Socket (/dev/log).1726client # [ 1.830882] systemd[1]: Created slice Slice /system/modprobe.1727worker2 # [ 1.840851] systemd[1]: Listening on Journal Sockets.1728worker2 # [ 1.840971] systemd[1]: Listening on udev Control Socket.1729worker1 # [ 1.838830] systemd[1]: Created slice Slice /system/modprobe.1730client # [ 1.832048] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1731worker2 # [ 1.841067] systemd[1]: Listening on udev Kernel Socket.1732worker2 # [ 1.841085] systemd[1]: Reached target Socket Units.1733worker1 # [ 1.840014] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1734worker2 # [ 1.851080] systemd[1]: Starting Create List of Static Device Nodes...1735lb # [ 1.843645] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1736client # [ 1.833506] systemd[1]: Expecting device /dev/disk/by-label/nixos...1737lb # [ 1.843797] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1738client # [ 1.833545] systemd[1]: Reached target Path Units.1739client # [ 1.833565] systemd[1]: Reached target Slice Units.1740worker1 # [ 1.841478] systemd[1]: Expecting device /dev/disk/by-label/nixos...1741lb # [ 1.848196] systemd[1]: Mounting Kernel Configuration File System...1742client # [ 1.833583] systemd[1]: Reached target Swaps.1743worker1 # [ 1.841513] systemd[1]: Reached target Path Units.1744client # [ 1.833604] systemd[1]: Reached target Timer Units.1745worker1 # [ 1.841531] systemd[1]: Reached target Slice Units.1746client # [ 1.833791] systemd[1]: Listening on D-Bus System Message Bus Socket.1747worker1 # [ 1.841551] systemd[1]: Reached target Swaps.1748worker1 # [ 1.841571] systemd[1]: Reached target Timer Units.1749client # [ 1.833936] systemd[1]: Listening on Journal Socket (/dev/log).1750client # [ 1.834078] systemd[1]: Listening on Journal Sockets.1751worker1 # [ 1.841757] systemd[1]: Listening on D-Bus System Message Bus Socket.1752client # [ 1.834209] systemd[1]: Listening on udev Control Socket.1753worker1 # [ 1.841987] systemd[1]: Listening on Journal Socket (/dev/log).1754client # [ 1.834317] systemd[1]: Listening on udev Kernel Socket.1755worker1 # [ 1.842198] systemd[1]: Listening on Journal Sockets.1756worker2 # [ 1.859892] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1757client # [ 1.834339] systemd[1]: Reached target Socket Units.1758worker1 # [ 1.842404] systemd[1]: Listening on udev Control Socket.1759worker1 # [ 1.842577] systemd[1]: Listening on udev Kernel Socket.1760worker2 # [ 1.860922] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1761client # [ 1.845105] systemd[1]: Starting Create List of Static Device Nodes...1762worker1 # [ 1.842641] systemd[1]: Reached target Socket Units.1763worker1 # [ 1.853508] systemd[1]: Starting Create List of Static Device Nodes...1764client # [ 1.855664] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1765client # [ 1.856983] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1766worker1 # [ 1.864034] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1767worker2 # [ 1.873203] systemd[1]: Mounting Kernel Configuration File System...1768worker1 # [ 1.865345] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1769lb # [ 1.871912] systemd[1]: Starting Journal Service...1770client # [ 1.869881] systemd[1]: Mounting Kernel Configuration File System...1771worker1 # [ 1.878266] systemd[1]: Mounting Kernel Configuration File System...1772worker2 # [ 1.895921] systemd[1]: Starting Journal Service...1773worker2 # [ 1.898330] systemd[1]: Starting Load Kernel Modules...1774worker2 # [ 1.899187] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1775lb # [ 1.899688] systemd[1]: Starting Load Kernel Modules...1776lb # [ 1.900517] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1777client # [ 1.892465] systemd[1]: Starting Journal Service...1778worker1 # [ 1.900070] systemd[1]: Starting Journal Service...1779client # [ 1.894889] systemd[1]: Starting Load Kernel Modules...1780client # [ 1.895739] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1781worker2 # [ 1.913086] systemd[1]: Starting Coldplug All udev Devices...1782worker1 # [ 1.909522] systemd[1]: Starting Load Kernel Modules...1783lb # [ 1.913641] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1784worker1 # [ 1.909639] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1785client # [ 1.914124] systemd[1]: Starting Coldplug All udev Devices...1786lb # [ 1.927606] systemd[1]: Starting Coldplug All udev Devices...1787worker1 # [ 1.924694] systemd[1]: Starting Coldplug All udev Devices...1788lb # [ 1.931095] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1789worker2 # [ 1.936087] systemd[1]: Finished Create List of Static Device Nodes.1790worker2 # [ 1.937412] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1791worker2 # [ 1.937847] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1792worker2 # [ 1.938146] systemd[1]: Mounted Kernel Configuration File System.1793lb # [ 1.935670] systemd[1]: Finished Create List of Static Device Nodes.1794client # [ 1.925814] systemd[1]: Finished Create List of Static Device Nodes.1795lb # [ 1.936756] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1796client # [ 1.926909] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1797lb # [ 1.937064] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1798client # [ 1.927245] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1799lb # [ 1.944977] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01800worker2 # [ 1.952051] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1801lb # [ 1.945236] [drm] features: -virgl +edid -resource_blob -host_visible1802lb # [ 1.945244] [drm] features: -context_init1803lb # [ 1.946059] [drm] number of scanouts: 11804lb # [ 1.946076] [drm] number of cap sets: 01805worker1 # [ 1.948496] systemd[1]: Finished Create List of Static Device Nodes.1806worker1 # [ 1.949508] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1807worker1 # [ 1.949815] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1808client # [ 1.945766] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1809lb # [ 1.959989] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1810lb # [ 1.960399] systemd[1]: Mounted Kernel Configuration File System.1811worker1 # [ 1.960390] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1812lb # [ 1.967392] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1813lb # [ 1.968397] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01814worker1 # [ 1.967817] systemd-journald[73]: Collecting audit messages is disabled.1815worker2 # [ 1.977581] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1816client # [ 1.962104] systemd[1]: Mounted Kernel Configuration File System.1817client # [ 1.973654] systemd-journald[73]: Collecting audit messages is disabled.1818worker1 # [ 1.980389] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1819worker1 # [ 1.985347] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01820worker1 # [ 1.985580] [drm] features: -virgl +edid -resource_blob -host_visible1821worker1 # [ 1.985590] [drm] features: -context_init1822lb # [ 1.993016] systemd-journald[73]: Collecting audit messages is disabled.1823worker1 # [ 1.986306] [drm] number of scanouts: 11824worker2 # [ 1.995955] systemd-journald[73]: Collecting audit messages is disabled.1825worker1 # [ 1.986325] [drm] number of cap sets: 01826worker2 # [ 2.000638] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1827worker1 # [ 1.991003] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1828client # [ 1.991490] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1829worker2 # [ 2.007908] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01830worker2 # [ 2.008151] [drm] features: -virgl +edid -resource_blob -host_visible1831worker2 # [ 2.008161] [drm] features: -context_init1832worker2 # [ 2.008899] [drm] number of scanouts: 11833worker2 # [ 2.008916] [drm] number of cap sets: 01834client # [ 1.994000] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1835client # [ 1.996965] systemd[1]: Starting Create Static Device Nodes in /dev...1836worker1 # [ 2.004360] systemd[1]: Mounted Kernel Configuration File System.1837worker1 # [ 2.008874] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1838lb # [ 2.007375] Console: switching to colour frame buffer device 160x501839lb # [ 2.013849] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1840client # [ 2.007481] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1841worker2 # [ 2.024288] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1842worker1 # [ 2.012709] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1843worker2 # [ 2.026806] systemd[1]: Starting Create Static Device Nodes in /dev...1844worker1 # [ 2.012730] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01845worker1 # [ 2.018410] systemd[1]: Starting Create Static Device Nodes in /dev...1846lb # [ 2.023549] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1847client # [ 2.019787] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01848client # [ 2.020029] [drm] features: -virgl +edid -resource_blob -host_visible1849worker2 # [ 2.031522] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1850client # [ 2.020039] [drm] features: -context_init1851worker2 # [ 2.031541] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01852lb # [ 2.031900] systemd[1]: Starting Create Static Device Nodes in /dev...1853lb # [ 2.044227] systemd[1]: Finished Load Kernel Modules.1854client # [ 2.036134] [drm] number of scanouts: 11855client # [ 2.036163] [drm] number of cap sets: 01856client # [ 2.037822] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1857client # [ 2.037839] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01858lb # [ 2.051842] systemd[1]: Starting Apply Kernel Variables...1859worker2 # [ 2.067978] Console: switching to colour frame buffer device 160x501860worker2 # [ 2.074575] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1861client # [ 2.060859] systemd[1]: Finished Create Static Device Nodes in /dev.1862client # [ 2.061053] systemd[1]: Reached target Preparation for Local File Systems.1863client # [ 2.061079] systemd[1]: Reached target Local File Systems.1864client # [ 2.064992] systemd[1]: Starting Rule-based Manager for Device Events and Files...1865worker1 # [ 2.076989] systemd[1]: Finished Create Static Device Nodes in /dev.1866worker1 # [ 2.077181] systemd[1]: Reached target Preparation for Local File Systems.1867worker1 # [ 2.077205] systemd[1]: Reached target Local File Systems.1868worker2 # [ 2.088324] systemd[1]: Finished Create Static Device Nodes in /dev.1869worker2 # [ 2.088534] systemd[1]: Reached target Preparation for Local File Systems.1870worker2 # [ 2.088568] systemd[1]: Reached target Local File Systems.1871client # [ 2.069204] Console: switching to colour frame buffer device 160x501872worker1 # [ 2.080942] Console: switching to colour frame buffer device 160x501873worker1 # [ 2.081596] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1874worker2 # [ 2.093527] systemd[1]: Starting Rule-based Manager for Device Events and Files...1875worker1 # [ 2.084758] systemd[1]: Starting Rule-based Manager for Device Events and Files...1876lb # [ 2.095099] systemd[1]: Finished Create Static Device Nodes in /dev.1877lb # [ 2.095418] systemd[1]: Reached target Preparation for Local File Systems.1878lb # [ 2.095549] systemd[1]: Reached target Local File Systems.1879lb # [ 2.101278] systemd[1]: Starting Rule-based Manager for Device Events and Files...1880worker1 # [ 2.104407] systemd[1]: Finished Load Kernel Modules.1881worker2 # [ 2.115811] systemd[1]: Finished Load Kernel Modules.1882client # [ 2.100997] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1883worker1 # [ 2.113522] systemd[1]: Starting Apply Kernel Variables...1884worker2 # [ 2.125188] systemd[1]: Starting Apply Kernel Variables...1885client # [ 2.121126] systemd[1]: Finished Load Kernel Modules.1886lb # [ 2.135837] systemd[1]: Finished Apply Kernel Variables.1887client # [ 2.131738] systemd[1]: Starting Apply Kernel Variables...1888lb # [ 2.166529] systemd[1]: Started Journal Service.1889lb # [ 2.164332] systemd-modules-load[74]: Inserted module 'dm_mod'1890lb # [ 2.165538] systemd-modules-load[74]: Module 'virtio_balloon' is built in1891worker2 # [ 2.185258] systemd[1]: Started Journal Service.1892worker1 # [ 2.177210] systemd[1]: Finished Apply Kernel Variables.1893worker2 # [ 2.172992] systemd-modules-load[74]: Inserted module 'dm_mod'1894worker2 # [ 2.174268] systemd-modules-load[74]: Module 'virtio_balloon' is built in1895lb # [ 2.172338] systemd-modules-load[74]: Module 'virtio_console' is built in1896client # [ 2.164458] systemd-modules-load[74]: Inserted module 'dm_mod'1897lb # [ 2.176992] systemd-modules-load[74]: Inserted module 'virtio_gpu'1898worker2 # [ 2.183766] systemd-modules-load[74]: Module 'virtio_console' is built in1899client # [ 2.181864] systemd[1]: Started Journal Service.1900lb # [ 2.181468] systemd-modules-load[74]: Module 'virtio_rng' is built in1901worker1 # [ 2.190934] systemd[1]: Started Journal Service.1902worker2 # [ 2.188421] systemd-modules-load[74]: Inserted module 'virtio_gpu'1903worker2 # [ 2.189413] systemd-modules-load[74]: Module 'virtio_rng' is built in1904worker2 # [ 2.190431] systemd[1]: Starting Create System Files and Directories...1905worker2 # [ 2.191740] systemd-udevd[79]: Using default interface naming scheme 'v261'.1906client # [ 2.176316] systemd-modules-load[74]: Module 'virtio_balloon' is built in1907lb # [ 2.188301] systemd[1]: Starting Create System Files and Directories...1908client # [ 2.177452] systemd-modules-load[74]: Module 'virtio_console' is built in1909worker1 # [ 2.184291] systemd-modules-load[74]: Inserted module 'dm_mod'1910client # [ 2.178553] systemd-modules-load[74]: Inserted module 'virtio_gpu'1911worker1 # [ 2.185544] systemd-modules-load[74]: Module 'virtio_balloon' is built in1912client # [ 2.179533] systemd-modules-load[74]: Module 'virtio_rng' is built in1913worker1 # [ 2.186620] systemd-modules-load[74]: Module 'virtio_console' is built in1914worker1 # [ 2.187693] systemd-modules-load[74]: Inserted module 'virtio_gpu'1915lb # [ 2.196746] systemd-udevd[80]: Using default interface naming scheme 'v261'.1916client # [ 2.188655] systemd-udevd[79]: Using default interface naming scheme 'v261'.1917client # [ 2.189753] systemd[1]: Starting Create System Files and Directories...1918worker1 # [ 2.196573] systemd-modules-load[74]: Module 'virtio_rng' is built in1919client # [ 2.190789] systemd[1]: Finished Apply Kernel Variables.1920worker2 # [ 2.208187] systemd[1]: Finished Apply Kernel Variables.1921worker1 # [ 2.199434] systemd-udevd[80]: Using default interface naming scheme 'v261'.1922worker1 # [ 2.209366] systemd[1]: Starting Create System Files and Directories...1923worker2 # [ 2.222006] systemd[1]: Finished Create System Files and Directories.1924lb # [ 2.217734] systemd[1]: Finished Create System Files and Directories.1925client # [ 2.212965] systemd[1]: Finished Create System Files and Directories.1926worker1 # [ 2.229199] systemd[1]: Finished Create System Files and Directories.1927worker2 # [ 2.246447] systemd[1]: Started Rule-based Manager for Device Events and Files.1928lb # [ 2.240932] systemd[1]: Started Rule-based Manager for Device Events and Files.1929client # [ 2.231926] systemd[1]: Started Rule-based Manager for Device Events and Files.1930worker1 # [ 2.241911] systemd[1]: Started Rule-based Manager for Device Events and Files.1931lb # [ 2.304139] systemd[1]: Starting Virtual Console Setup...1932worker2 # [ 2.312124] systemd[1]: Starting Virtual Console Setup...1933client # [ 2.296224] systemd[1]: Starting Virtual Console Setup...1934worker1 # [ 2.308115] systemd[1]: Starting Virtual Console Setup...1935lb # [ 2.352506] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1936worker2 # [ 2.360513] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1937lb # [ 2.355992] systemd[1]: Finished Virtual Console Setup.1938worker2 # [ 2.363981] systemd[1]: Finished Virtual Console Setup.1939client # [ 2.348512] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940client # [ 2.351856] systemd[1]: Finished Virtual Console Setup.1941worker1 # [ 2.360478] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker1 # [ 2.363884] systemd[1]: Finished Virtual Console Setup.1943worker2 # [ 2.973602] systemd[1]: Finished Coldplug All udev Devices.1944worker2 # [ 2.975104] systemd[1]: Reached target System Initialization.1945worker2 # [ 2.975962] systemd[1]: Reached target Basic System.1946client # [ 2.976517] systemd[1]: Finished Coldplug All udev Devices.1947client # [ 2.978140] systemd[1]: Reached target System Initialization.1948client # [ 2.979007] systemd[1]: Reached target Basic System.1949lb # [ 2.992270] systemd[1]: Finished Coldplug All udev Devices.1950lb # [ 2.993214] systemd[1]: Reached target System Initialization.1951lb # [ 2.994021] systemd[1]: Reached target Basic System.1952worker1 # [ 3.021381] systemd[1]: Finished Coldplug All udev Devices.1953worker1 # [ 3.022342] systemd[1]: Reached target System Initialization.1954worker1 # [ 3.023173] systemd[1]: Reached target Basic System.1955worker2 # [ 3.096297] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1956lb # [ 3.120487] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1957client # [ 3.128091] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958worker2 # [ 3.153756] (udev-worker)[107]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1959worker2 # [ 3.157034] (udev-worker)[107]: Network interface NamePolicy= disabled on kernel command line.1960client # [ 3.143921] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1961lb # [ 3.161856] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1962client # [ 3.163789] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1963lb # [ 3.178429] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1964worker2 # [ 3.216342] systemd[1]: Found device /dev/disk/by-label/nixos.1965worker2 # [ 3.219210] systemd[1]: Reached target Initrd Root Device.1966worker2 # [ 3.224871] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1967worker1 # [ 3.214715] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1968worker1 # [ 3.236189] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1969worker1 # [ 3.238459] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1970lb # [ 3.246040] systemd[1]: Found device /dev/disk/by-label/nixos.1971lb # [ 3.251114] systemd[1]: Reached target Initrd Root Device.1972client # [ 3.240123] systemd[1]: Found device /dev/disk/by-label/nixos.1973client # [ 3.243041] systemd[1]: Reached target Initrd Root Device.1974lb # [ 3.254952] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1975client # [ 3.245696] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976worker2 # [ 3.273287] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1977worker2 # [ 3.280151] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1978worker2 # [ 3.281865] systemd[1]: Mounting /sysroot...1979client # [ 3.289581] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1980client # [ 3.296243] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1981lb # [ 3.307398] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1982client # [ 3.300093] systemd[1]: Mounting /sysroot...1983worker1 # [ 3.308139] systemd[1]: Found device /dev/disk/by-label/nixos.1984worker1 # [ 3.310730] systemd[1]: Reached target Initrd Root Device.1985lb # [ 3.315295] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1986worker2 # [ 3.337465] EXT4-fs (vda): mounted filesystem 0346c41c-860c-4c4b-b074-956f148720bc r/w with ordered data mode. Quota mode: none.1987worker1 # [ 3.314343] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1988worker2 # [ 3.327080] systemd[1]: Mounted /sysroot.1989worker2 # [ 3.329049] systemd[1]: Reached target Initrd Root File System.1990lb # [ 3.323957] systemd[1]: Mounting /sysroot...1991worker2 # [ 3.332619] systemd[1]: Starting Mountpoints Configured in the Real Root...1992client # [ 3.354261] EXT4-fs (vda): mounted filesystem 42add490-c8c1-4885-bada-6f20ea65d99e r/w with ordered data mode. Quota mode: none.1993worker2 # [ 3.359854] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1994client # [ 3.344831] systemd[1]: Mounted /sysroot.1995lb # [ 3.371393] EXT4-fs (vda): mounted filesystem 2763e31e-c98e-45c3-8e2d-f907edb1cbdb r/w with ordered data mode. Quota mode: none.1996client # [ 3.346781] systemd[1]: Reached target Initrd Root File System.1997worker2 # [ 3.366139] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1998client # [ 3.350734] systemd[1]: Starting Mountpoints Configured in the Real Root...1999lb # [ 3.364140] systemd[1]: Mounted /sysroot.2000worker2 # [ 3.371105] systemd[1]: Reloading...
loading 1,370 hidden lines…
3371client # [ 13.985917] systemd[1]: Finished Virtual Console Setup.3372worker2 # [ 14.228334] systemd-vconsole-setup[710]: Configuration of first virtual console was skipped, ignoring remaining ones.3373worker2 # [ 14.232364] systemd[1]: Finished Virtual Console Setup.3374worker1 # [ 14.256362] systemd-vconsole-setup[708]: Configuration of first virtual console was skipped, ignoring remaining ones.3375worker1 # [ 14.260331] systemd[1]: Finished Virtual Console Setup.3376client # [ 14.282253] dhcpcd[541]: eth0: soliciting an IPv6 router3377client # [ 14.285935] dhcpcd[541]: eth0: Router Advertisement from fe80::23378client # [ 14.288870] dhcpcd[541]: eth0: adding address fec0::5054:ff:fe12:3456/643379client # [ 14.291595] dhcpcd[541]: eth0: adding route to fec0::/643380client # [ 14.293970] dhcpcd[541]: eth0: adding default route via fe80::23381lb # [ 14.508974] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33382worker1 # [ 14.527747] dhcpcd[642]: eth0: soliciting an IPv6 router3383worker1 # [ 14.531370] dhcpcd[642]: eth0: Router Advertisement from fe80::23384worker1 # [ 14.533974] dhcpcd[642]: eth0: adding address fec0::5054:ff:fe12:3456/643385worker1 # [ 14.536827] dhcpcd[642]: eth0: adding route to fec0::/643386worker1 # [ 14.538993] dhcpcd[642]: eth0: adding default route via fe80::23387lb # [ 14.953598] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3388lb # [ 14.966696] systemd[1]: Starting Virtual Console Setup...3389lb # [ 15.003523] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3390lb # [ 15.010165] systemd[1]: Stopped Virtual Console Setup.3391lb # [ 15.016097] systemd[1]: Starting Virtual Console Setup...3392lb # [ 15.068369] systemd-logind[532]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3393worker2 # [ 15.209399] dhcpcd[643]: eth0: soliciting an IPv6 router3394worker2 # [ 15.211833] dhcpcd[643]: eth0: Router Advertisement from fe80::23395worker2 # [ 15.214477] dhcpcd[643]: eth0: adding address fec0::5054:ff:fe12:3456/643396worker2 # [ 15.217268] dhcpcd[643]: eth0: adding route to fec0::/643397worker2 # [ 15.219445] dhcpcd[643]: eth0: adding default route via fe80::23398lb # [ 15.247605] dhcpcd[678]: eth0: soliciting an IPv6 router3399lb # [ 15.249296] dhcpcd[678]: eth0: Router Advertisement from fe80::23400lb # [ 15.250512] dhcpcd[678]: eth0: adding address fec0::5054:ff:fe12:3456/643401lb # [ 15.251698] dhcpcd[678]: eth0: adding route to fec0::/643402lb # [ 15.254090] dhcpcd[678]: eth0: adding default route via fe80::23403lb # [ 15.463525] systemd-vconsole-setup[776]: Configuration of first virtual console was skipped, ignoring remaining ones.3404lb # [ 15.469291] systemd[1]: Finished Virtual Console Setup.3405lb # [ 15.774628] postgresql-pre-start[705]: selecting default time zone ... UTC3406lb # [ 15.779248] postgresql-pre-start[705]: creating configuration files ... ok3407lb # [ 16.124123] postgresql-pre-start[705]: running bootstrap script ... ok3408lb # [ 16.745814] postgresql-pre-start[705]: performing post-bootstrap initialization ... ok3409lb # [ 16.896949] postgresql-pre-start[705]: syncing data to disk ... ok3410lb # [ 16.899065] postgresql-pre-start[705]: initdb: warning: enabling "trust" authentication for local connections3411lb # [ 16.900645] postgresql-pre-start[705]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3412lb # [ 16.902794] postgresql-pre-start[705]: Success. You can now start the database server using:3413lb # [ 16.904042] postgresql-pre-start[705]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3414lb # [ 17.048920] postgres[801]: [801] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3415lb # [ 17.054213] postgres[801]: [801] LOG: listening on IPv6 address "::1", port 54323416lb # [ 17.055250] postgres[801]: [801] LOG: listening on IPv4 address "127.0.0.1", port 54323417lb # [ 17.057675] postgres[801]: [801] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3418lb # [ 17.076954] postgres[819]: [819] LOG: database system was shut down at 2026-09-20 09:04:40 GMT3419lb # [ 17.083932] postgres[801]: [801] LOG: database system is ready to accept connections3420lb # [ 17.088915] systemd[1]: Started PostgreSQL Server.3421lb # [ 17.097530] systemd[1]: Starting PostgreSQL Setup Scripts...3422lb # [ 17.317936] postgresql-setup-start[830]: CREATE DATABASE3423lb # [ 17.365334] postgresql-setup-start[835]: CREATE ROLE3424lb # [ 17.388732] postgresql-setup-start[837]: ALTER DATABASE3425lb # [ 17.395465] systemd[1]: Finished PostgreSQL Setup Scripts.3426lb # [ 17.397315] systemd[1]: Reached target PostgreSQL.3427worker2 # [ 17.688812] dhcpcd[643]: eth0: leased 10.0.2.15 for 86400 seconds3428worker2 # [ 17.692349] dhcpcd[643]: eth0: adding route to 10.0.2.0/243429worker2 # [ 17.695351] dhcpcd[643]: eth0: adding default route via 10.0.2.23430client # [ 17.691014] dhcpcd[541]: eth0: leased 10.0.2.15 for 86400 seconds3431client # [ 17.693841] dhcpcd[541]: eth0: adding route to 10.0.2.0/243432client # [ 17.696604] dhcpcd[541]: eth0: adding default route via 10.0.2.23433worker2 # [ 17.846658] systemd[1]: Started DHCP Client.3434worker2 # [ 17.848941] systemd[1]: Reached target Multi-User System.3435worker2 # [ 17.849884] systemd[1]: Startup finished in 1.003s (kernel) + 5.460s (initrd) + 11.384s (userspace) = 17.848s.3436client # [ 17.895115] systemd[1]: Started DHCP Client.3437client # [ 17.897040] systemd[1]: Reached target Multi-User System.3438client # [ 17.898450] systemd[1]: Startup finished in 983ms (kernel) + 5.490s (initrd) + 11.424s (userspace) = 17.898s.3439worker1 # [ 18.202376] dhcpcd[642]: eth0: leased 10.0.2.15 for 86400 seconds3440worker1 # [ 18.205896] dhcpcd[642]: eth0: adding route to 10.0.2.0/243441worker1 # [ 18.208982] dhcpcd[642]: eth0: adding default route via 10.0.2.23442worker1 # [ 18.372151] systemd[1]: Started DHCP Client.3443worker1 # [ 18.374127] systemd[1]: Reached target Multi-User System.3444worker1 # [ 18.374974] systemd[1]: Startup finished in 1.007s (kernel) + 5.467s (initrd) + 11.899s (userspace) = 18.373s.3445lb # [ 18.743332] dhcpcd[678]: eth0: leased 10.0.2.15 for 86400 seconds3446lb # [ 18.746825] dhcpcd[678]: eth0: adding route to 10.0.2.0/243447lb # [ 18.746991] dhcpcd[678]: eth0: adding default route via 10.0.2.23448lb # [ 18.904579] systemd[1]: Started DHCP Client.3449lb # [ 18.911380] systemd[1]: Reached target Network is Online.3450lb # [ 18.914123] systemd[1]: Started Envoy reverse proxy.3451lb # [ 18.921012] systemd[1]: Started mock-oidc.service.3452lb # [ 19.016357] mock-oidc-server[905]: Mock OIDC Server running3453lb # [ 19.017173] mock-oidc-server[905]: OIDC Address: 192.168.1.2:80803454lb # [ 19.018000] mock-oidc-server[905]: Issue Address: 0.0.0.0:80813455lb # [ 19.018769] mock-oidc-server[905]: Issuer: http://192.168.1.2:8080/oidc3456lb # [ 19.019625] mock-oidc-server[905]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3457lb # [ 19.021163] mock-oidc-server[905]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3458lb # [ 19.023185] mock-oidc-server[905]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3459lb # [ 19.632542] envoy[904]: [2026-09-20 09:04:43.231][904][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3460lb # [ 19.635342] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:469] statically linked extensions:3461lb # [ 19.637329] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3462lb # [ 19.639406] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3463lb # [ 19.644981] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3464lb # [ 19.648053] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3465lb # [ 19.651474] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3466lb # [ 19.654106] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3467lb # [ 19.658922] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3468lb # [ 19.661995] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3469lb # [ 19.709151] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3470lb # [ 19.711725] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3471lb # [ 19.714622] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3472lb # [ 19.716901] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3473lb # [ 19.718943] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3474lb # [ 19.726631] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3475lb # [ 19.730458] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3476lb # [ 19.732838] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3477lb # [ 19.734601] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3478lb # [ 19.736978] envoy[904]: [2026-09-20 09:04:43.233][904][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3479lb # [ 19.738737] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3480lb # [ 19.742569] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3481lb # [ 19.744764] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3482lb # [ 19.751664] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23483lb # [ 19.753736] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3484lb # [ 19.757350] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3485lb # [ 19.763160] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3486lb # [ 19.766644] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3487lb # [ 19.768724] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3488lb # [ 19.771373] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3489lb # [ 19.776390] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3490lb # [ 19.778113] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3491lb # [ 19.782559] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3492lb # [ 19.785750] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3493lb # [ 19.791370] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3494lb # [ 19.794451] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23495lb # [ 19.796259] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3496lb # [ 19.798314] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13497lb # [ 19.800685] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3498lb # [ 19.803750] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3499lb # [ 19.807498] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3500lb # [ 19.809647] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3501lb # [ 19.811650] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3502lb # [ 19.814106] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3503lb # [ 19.816606] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3504lb # [ 19.818468] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3505lb # [ 19.821686] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3506lb # [ 19.823731] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3507lb # [ 19.828689] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3508lb # [ 19.832038] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3509lb # [ 19.834934] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3510lb # [ 19.836809] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3511lb # [ 19.838929] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3512lb # [ 19.852748] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3513lb # [ 19.860379] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3514lb # [ 19.863487] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3515lb # [ 19.865542] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3516lb # [ 19.867886] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3517lb # [ 19.870056] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3518lb # [ 19.872606] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3519lb # [ 19.879114] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3520lb # [ 19.880871] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3521lb # [ 19.888258] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3522lb # [ 19.892652] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3523lb # [ 19.895234] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3524lb # [ 19.897350] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3525lb # [ 19.900335] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3526lb # [ 19.907630] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3527lb # [ 19.910164] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3528lb # [ 19.916330] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3529lb # [ 19.918494] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3530lb # [ 19.922915] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3531lb # [ 19.926421] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3532lb # [ 19.928743] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3533lb # [ 19.939744] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3534lb # [ 19.942276] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3535lb # [ 19.943990] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3536lb # [ 19.947135] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3537lb # [ 19.950731] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3538lb # [ 19.952752] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3539lb # [ 19.954797] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3540lb # [ 19.957872] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3541lb # [ 19.960366] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3542lb # [ 19.962316] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3543lb # [ 19.964683] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23544lb # [ 19.967044] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3545lb # [ 19.969084] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3546lb # [ 19.971843] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3547lb # [ 19.974269] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3548lb # [ 19.977782] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3549lb # [ 19.979757] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3550lb # [ 19.981944] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3551lb # [ 19.984642] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3552lb # [ 19.987345] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3553lb # [ 19.990049] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3554lb # [ 19.991868] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3555lb # [ 19.994614] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3556lb # [ 19.997475] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83557lb # [ 19.999414] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3558lb # [ 20.001780] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3559lb # [ 20.007099] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3560lb # [ 20.010114] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3561lb # [ 20.012115] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3562lb # [ 20.013736] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3563lb # [ 20.016605] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3564lb # [ 20.024953] envoy[904]: [2026-09-20 09:04:43.234][904][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3565lb # [ 20.026833] envoy[904]: [2026-09-20 09:04:43.295][904][info][main] [source/server/server.cc:531] HTTP header map info:3566lb # [ 20.028530] envoy[904]: [2026-09-20 09:04:43.297][904][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3567lb # [ 20.044058] envoy[904]: [2026-09-20 09:04:43.297][904][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3568lb # [ 20.045588] envoy[904]: [2026-09-20 09:04:43.297][904][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3569lb # [ 20.054792] envoy[904]: [2026-09-20 09:04:43.297][904][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3570lb # [ 20.056718] envoy[904]: [2026-09-20 09:04:43.487][904][info][main] [source/server/server.cc:968] runtime: {}3571lb # [ 20.058055] envoy[904]: [2026-09-20 09:04:43.525][904][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3572lb # [ 20.059794] envoy[904]: [2026-09-20 09:04:43.525][904][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013573lb # [ 20.061854] envoy[904]: [2026-09-20 09:04:43.525][904][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013574lb # [ 20.063419] envoy[904]: [2026-09-20 09:04:43.527][904][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3575lb # [ 20.065270] envoy[904]: [2026-09-20 09:04:43.527][904][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3576lb # [ 20.066910] envoy[904]: [2026-09-20 09:04:43.527][904][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3577lb # [ 20.088816] envoy[904]: [2026-09-20 09:04:43.688][904][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3578lb # [ 20.098962] envoy[904]: [2026-09-20 09:04:43.698][904][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3579lb # [ 20.101624] envoy[904]: [2026-09-20 09:04:43.700][904][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3580worker2 # [ 20.108004] systemd[1]: Starting Nix worker-protocol over gRPC...3581lb # [ 20.105008] envoy[904]: [2026-09-20 09:04:43.700][904][info][main] [source/server/server.cc:1077] starting main dispatch loop3582worker1 # [ 20.096192] systemd[1]: Starting Nix worker-protocol over gRPC...3583worker1 # [ 20.349497] nix-grpc-daemon[773]: ts=2026-09-20T09:04:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3584worker2 # [ 20.360308] nix-grpc-daemon[775]: ts=2026-09-20T09:04:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3585worker1 # [ 20.360731] nix-grpc-daemon[773]: ts=2026-09-20T09:04:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13586worker2 # [ 20.371815] nix-grpc-daemon[775]: ts=2026-09-20T09:04:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13587worker2 # [ 20.417116] nix-grpc-daemon[775]: ts=2026-09-20T09:04:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3588worker1 # [ 20.406754] nix-grpc-daemon[773]: ts=2026-09-20T09:04:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3589worker2 # [ 20.421907] systemd[1]: Started Nix worker-protocol over gRPC.3590worker1 # [ 20.411399] systemd[1]: Started Nix worker-protocol over gRPC.3591lb # [ 20.451696] envoy[904]: [2026-09-20 09:04:44.050][904][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3592lb # [ 20.458703] envoy[904]: [2026-09-20 09:04:44.050][904][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3593lb # [ 20.468161] envoy[904]: [2026-09-20 09:04:44.050][904][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3594lb # [ 20.476205] envoy[904]: [2026-09-20 09:04:44.050][904][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3595worker2 # [ 20.490709] nix-grpc-daemon[775]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500513596worker1 # [ 20.479965] nix-grpc-daemon[773]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500513597worker2 # [ 20.501473] nix-grpc-daemon[775]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3598worker1 # [ 20.491603] nix-grpc-daemon[773]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3599worker1 # [ 20.692951] nix-grpc-daemon[773]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500513600worker2 # [ 20.702689] nix-grpc-daemon[775]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500513601worker2 # [ 20.709988] nix-grpc-daemon[775]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3602worker1 # [ 20.700331] nix-grpc-daemon[773]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3603worker2 # [ 20.911355] nix-grpc-daemon[775]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500513604worker1 # [ 20.901435] nix-grpc-daemon[773]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 20.918478] nix-grpc-daemon[775]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3606worker1 # [ 20.908542] nix-grpc-daemon[773]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3607worker2 # [ 21.119717] nix-grpc-daemon[775]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500513608worker1 # [ 21.109802] nix-grpc-daemon[773]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 21.126305] nix-grpc-daemon[775]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3610worker1 # [ 21.116405] nix-grpc-daemon[773]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3611worker2 # [ 21.327296] nix-grpc-daemon[775]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500513612worker1 # [ 21.317433] nix-grpc-daemon[773]: ts=2026-09-20T09:04:44Z level=info event=scheduler_connected addr=lb:500513613worker2 # [ 21.334679] nix-grpc-daemon[775]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3614worker1 # [ 21.324198] nix-grpc-daemon[773]: ts=2026-09-20T09:04:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3615worker2 # [ 21.538436] nix-grpc-daemon[775]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500513616worker1 # [ 21.527862] nix-grpc-daemon[773]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500513617worker2 # [ 21.542646] nix-grpc-daemon[775]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3618worker1 # [ 21.532163] nix-grpc-daemon[773]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3619worker1 # [ 21.728752] nix-grpc-daemon[773]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500513620worker2 # [ 21.739369] nix-grpc-daemon[775]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 21.746226] nix-grpc-daemon[775]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3622worker1 # [ 21.735607] nix-grpc-daemon[773]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3623worker2 # [ 21.947332] nix-grpc-daemon[775]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 21.936780] nix-grpc-daemon[773]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500513625worker2 # [ 21.953974] nix-grpc-daemon[775]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3626worker1 # [ 21.943473] nix-grpc-daemon[773]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3627worker2 # [ 22.155104] nix-grpc-daemon[775]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500513628worker1 # [ 22.144770] nix-grpc-daemon[773]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500513629worker2 # [ 22.162000] nix-grpc-daemon[775]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3630worker1 # [ 22.151618] nix-grpc-daemon[773]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3631worker2 # [ 22.363091] nix-grpc-daemon[775]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500513632worker1 # [ 22.352946] nix-grpc-daemon[773]: ts=2026-09-20T09:04:45Z level=info event=scheduler_connected addr=lb:500513633worker2 # [ 22.369785] nix-grpc-daemon[775]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3634worker1 # [ 22.359412] nix-grpc-daemon[773]: ts=2026-09-20T09:04:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3635worker2 # [ 22.571585] nix-grpc-daemon[775]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500513636worker1 # [ 22.563579] nix-grpc-daemon[773]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500513637worker2 # [ 22.577211] nix-grpc-daemon[775]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3638worker1 # [ 22.574146] nix-grpc-daemon[773]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3639worker2 # [ 22.778460] nix-grpc-daemon[775]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500513640worker1 # [ 22.771049] nix-grpc-daemon[773]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500513641worker2 # [ 22.785181] nix-grpc-daemon[775]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3642worker1 # [ 22.778412] nix-grpc-daemon[773]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3643worker2 # [ 22.986204] nix-grpc-daemon[775]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500513644worker1 # [ 22.979426] nix-grpc-daemon[773]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500513645worker2 # [ 22.992961] nix-grpc-daemon[775]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3646worker1 # [ 22.986233] nix-grpc-daemon[773]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3647worker2 # [ 23.194008] nix-grpc-daemon[775]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500513648worker1 # [ 23.187564] nix-grpc-daemon[773]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500513649worker2 # [ 23.201116] nix-grpc-daemon[775]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3650worker1 # [ 23.194237] nix-grpc-daemon[773]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3651worker2 # [ 23.402239] nix-grpc-daemon[775]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500513652worker1 # [ 23.395354] nix-grpc-daemon[773]: ts=2026-09-20T09:04:46Z level=info event=scheduler_connected addr=lb:500513653worker2 # [ 23.408909] nix-grpc-daemon[775]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3654worker1 # [ 23.402105] nix-grpc-daemon[773]: ts=2026-09-20T09:04:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3655worker2 # [ 23.613334] nix-grpc-daemon[775]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500513656worker1 # [ 23.604788] nix-grpc-daemon[773]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500513657worker1 # [ 23.608185] nix-grpc-daemon[773]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3658worker2 # [ 23.617878] nix-grpc-daemon[775]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3659worker2 # [ 23.814351] nix-grpc-daemon[775]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500513660worker1 # [ 23.809076] nix-grpc-daemon[773]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500513661worker2 # [ 23.821441] nix-grpc-daemon[775]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker1 # [ 23.815721] nix-grpc-daemon[773]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3663worker2 # [ 24.022655] nix-grpc-daemon[775]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500513664worker1 # [ 24.016890] nix-grpc-daemon[773]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500513665worker2 # [ 24.029699] nix-grpc-daemon[775]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3666worker1 # [ 24.023375] nix-grpc-daemon[773]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3667worker2 # [ 24.230889] nix-grpc-daemon[775]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500513668worker1 # [ 24.224418] nix-grpc-daemon[773]: ts=2026-09-20T09:04:47Z level=info event=scheduler_connected addr=lb:500513669worker2 # [ 24.237996] nix-grpc-daemon[775]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3670worker1 # [ 24.230862] nix-grpc-daemon[773]: ts=2026-09-20T09:04:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3671worker2 # [ 24.439145] nix-grpc-daemon[775]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500513672worker1 # [ 24.431946] nix-grpc-daemon[773]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 24.446267] nix-grpc-daemon[775]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3674worker1 # [ 24.438296] nix-grpc-daemon[773]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3675worker2 # [ 24.650590] nix-grpc-daemon[775]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500513676worker1 # [ 24.641940] nix-grpc-daemon[773]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 24.655055] nix-grpc-daemon[775]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3678worker1 # [ 24.646176] nix-grpc-daemon[773]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3679worker2 # [ 24.851951] nix-grpc-daemon[775]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 24.842796] nix-grpc-daemon[773]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 24.858923] nix-grpc-daemon[775]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3682worker1 # [ 24.849177] nix-grpc-daemon[773]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3683worker2 # [ 25.059920] nix-grpc-daemon[775]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500513684worker1 # [ 25.050157] nix-grpc-daemon[773]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 25.066771] nix-grpc-daemon[775]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3686worker1 # [ 25.057228] nix-grpc-daemon[773]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3687worker2 # [ 25.267837] nix-grpc-daemon[775]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500513688worker1 # [ 25.258415] nix-grpc-daemon[773]: ts=2026-09-20T09:04:48Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 25.274509] nix-grpc-daemon[775]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3690worker1 # [ 25.264719] nix-grpc-daemon[773]: ts=2026-09-20T09:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3691worker2 # [ 25.475353] nix-grpc-daemon[775]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500513692worker1 # [ 25.465425] nix-grpc-daemon[773]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500513693worker2 # [ 25.482003] nix-grpc-daemon[775]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3694worker1 # [ 25.471562] nix-grpc-daemon[773]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3695worker2 # [ 25.685380] nix-grpc-daemon[775]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500513696worker1 # [ 25.674930] nix-grpc-daemon[773]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500513697worker1 # [ 25.680189] nix-grpc-daemon[773]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3698worker2 # [ 25.690696] nix-grpc-daemon[775]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3699worker2 # [ 25.892194] nix-grpc-daemon[775]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500513700worker1 # [ 25.881230] nix-grpc-daemon[773]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500513701worker2 # [ 25.902395] nix-grpc-daemon[775]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3702worker1 # [ 25.894247] nix-grpc-daemon[773]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3703worker2 # [ 26.100930] nix-grpc-daemon[775]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500513704worker1 # [ 26.091816] nix-grpc-daemon[773]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500513705worker2 # [ 26.107852] nix-grpc-daemon[775]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3706worker1 # [ 26.098718] nix-grpc-daemon[773]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3707worker2 # [ 26.308984] nix-grpc-daemon[775]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500513708worker1 # [ 26.299851] nix-grpc-daemon[773]: ts=2026-09-20T09:04:49Z level=info event=scheduler_connected addr=lb:500513709worker2 # [ 26.315730] nix-grpc-daemon[775]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3710worker1 # [ 26.306266] nix-grpc-daemon[773]: ts=2026-09-20T09:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3711worker2 # [ 26.516663] nix-grpc-daemon[775]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500513712worker1 # [ 26.507288] nix-grpc-daemon[773]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500513713worker2 # [ 26.523797] nix-grpc-daemon[775]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3714worker1 # [ 26.515068] nix-grpc-daemon[773]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3715worker2 # [ 26.726966] nix-grpc-daemon[775]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500513716worker1 # [ 26.718596] nix-grpc-daemon[773]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500513717worker2 # [ 26.732312] nix-grpc-daemon[775]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3718worker1 # [ 26.723741] nix-grpc-daemon[773]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3719worker2 # [ 26.933082] nix-grpc-daemon[775]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500513720worker1 # [ 26.924763] nix-grpc-daemon[773]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500513721worker2 # [ 26.939775] nix-grpc-daemon[775]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3722worker1 # [ 26.931447] nix-grpc-daemon[773]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3723worker2 # [ 27.140859] nix-grpc-daemon[775]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500513724worker1 # [ 27.132528] nix-grpc-daemon[773]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500513725worker2 # [ 27.147408] nix-grpc-daemon[775]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3726worker1 # [ 27.139096] nix-grpc-daemon[773]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3727worker2 # [ 27.348582] nix-grpc-daemon[775]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500513728worker1 # [ 27.340294] nix-grpc-daemon[773]: ts=2026-09-20T09:04:50Z level=info event=scheduler_connected addr=lb:500513729worker2 # [ 27.355199] nix-grpc-daemon[775]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3730worker1 # [ 27.346567] nix-grpc-daemon[773]: ts=2026-09-20T09:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3731worker2 # [ 27.556224] nix-grpc-daemon[775]: ts=2026-09-20T09:04:51Z level=info event=scheduler_connected addr=lb:500513732worker1 # [ 27.547563] nix-grpc-daemon[773]: ts=2026-09-20T09:04:51Z level=info event=scheduler_connected addr=lb:500513733worker2 # [ 27.562727] nix-grpc-daemon[775]: ts=2026-09-20T09:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3734worker1 # [ 27.554259] nix-grpc-daemon[773]: ts=2026-09-20T09:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3735worker2 # [ 27.766448] nix-grpc-daemon[775]: ts=2026-09-20T09:04:51Z level=info event=scheduler_connected addr=lb:500513736worker1 # [ 27.756923] nix-grpc-daemon[773]: ts=2026-09-20T09:04:51Z level=info event=scheduler_connected addr=lb:500513737worker2 # [ 27.771813] nix-grpc-daemon[775]: ts=2026-09-20T09:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3738worker1 # [ 27.763244] nix-grpc-daemon[773]: ts=2026-09-20T09:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3739worker2 # [ 27.972808] nix-grpc-daemon[775]: ts=2026-09-20T09:04:51Z level=info event=scheduler_connected addr=lb:500513740worker1 # [ 27.964306] nix-grpc-daemon[773]: ts=2026-09-20T09:04:51Z level=info event=scheduler_connected addr=lb:500513741worker2 # [ 27.979730] nix-grpc-daemon[775]: ts=2026-09-20T09:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3742worker1 # [ 27.970858] nix-grpc-daemon[773]: ts=2026-09-20T09:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3743worker2 # [ 28.180830] nix-grpc-daemon[775]: ts=2026-09-20T09:04:51Z level=info event=scheduler_connected addr=lb:500513744worker1 # [ 28.172000] nix-grpc-daemon[773]: ts=2026-09-20T09:04:51Z level=info event=scheduler_connected addr=lb:500513745worker2 # [ 28.187507] nix-grpc-daemon[775]: ts=2026-09-20T09:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3746worker1 # [ 28.178351] nix-grpc-daemon[773]: ts=2026-09-20T09:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3747worker2 # [ 28.388826] nix-grpc-daemon[775]: ts=2026-09-20T09:04:51Z level=info event=scheduler_connected addr=lb:500513748worker1 # [ 28.379402] nix-grpc-daemon[773]: ts=2026-09-20T09:04:51Z level=info event=scheduler_connected addr=lb:500513749worker2 # [ 28.395977] nix-grpc-daemon[775]: ts=2026-09-20T09:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3750worker1 # [ 28.386037] nix-grpc-daemon[773]: ts=2026-09-20T09:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3751worker2 # [ 28.597139] nix-grpc-daemon[775]: ts=2026-09-20T09:04:52Z level=info event=scheduler_connected addr=lb:500513752worker1 # [ 28.587333] nix-grpc-daemon[773]: ts=2026-09-20T09:04:52Z level=info event=scheduler_connected addr=lb:500513753worker2 # [ 28.604232] nix-grpc-daemon[775]: ts=2026-09-20T09:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3754worker1 # [ 28.594448] nix-grpc-daemon[773]: ts=2026-09-20T09:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3755worker1 # [ 28.796771] nix-grpc-daemon[773]: ts=2026-09-20T09:04:52Z level=info event=scheduler_connected addr=lb:500513756worker2 # [ 28.812394] nix-grpc-daemon[775]: ts=2026-09-20T09:04:52Z level=info event=scheduler_connected addr=lb:500513757worker1 # [ 28.803276] nix-grpc-daemon[773]: ts=2026-09-20T09:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3758worker2 # [ 28.817604] nix-grpc-daemon[775]: ts=2026-09-20T09:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3759worker1 # [ 29.004148] nix-grpc-daemon[773]: ts=2026-09-20T09:04:52Z level=info event=scheduler_connected addr=lb:500513760worker2 # [ 29.018322] nix-grpc-daemon[775]: ts=2026-09-20T09:04:52Z level=info event=scheduler_connected addr=lb:500513761worker1 # [ 29.010373] nix-grpc-daemon[773]: ts=2026-09-20T09:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3762worker2 # [ 29.023705] nix-grpc-daemon[775]: ts=2026-09-20T09:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3763worker1 # [ 29.211510] nix-grpc-daemon[773]: ts=2026-09-20T09:04:52Z level=info event=scheduler_connected addr=lb:500513764worker2 # [ 29.224368] nix-grpc-daemon[775]: ts=2026-09-20T09:04:52Z level=info event=scheduler_connected addr=lb:500513765worker2 # [ 29.234027] nix-grpc-daemon[775]: ts=2026-09-20T09:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3766worker1 # [ 29.224391] nix-grpc-daemon[773]: ts=2026-09-20T09:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3767worker1 # [ 29.421799] nix-grpc-daemon[773]: ts=2026-09-20T09:04:53Z level=info event=scheduler_connected addr=lb:500513768worker2 # [ 29.434626] nix-grpc-daemon[775]: ts=2026-09-20T09:04:53Z level=info event=scheduler_connected addr=lb:500513769worker1 # [ 29.428330] nix-grpc-daemon[773]: ts=2026-09-20T09:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3770worker2 # [ 29.440277] nix-grpc-daemon[775]: ts=2026-09-20T09:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3771worker1 # [ 29.628971] nix-grpc-daemon[773]: ts=2026-09-20T09:04:53Z level=info event=scheduler_connected addr=lb:500513772worker2 # [ 29.641761] nix-grpc-daemon[775]: ts=2026-09-20T09:04:53Z level=info event=scheduler_connected addr=lb:500513773worker1 # [ 29.635476] nix-grpc-daemon[773]: ts=2026-09-20T09:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3774worker2 # [ 29.647381] nix-grpc-daemon[775]: ts=2026-09-20T09:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3775worker1 # [ 29.838794] nix-grpc-daemon[773]: ts=2026-09-20T09:04:53Z level=info event=scheduler_connected addr=lb:500513776worker2 # [ 29.851181] nix-grpc-daemon[775]: ts=2026-09-20T09:04:53Z level=info event=scheduler_connected addr=lb:500513777worker1 # [ 29.844152] nix-grpc-daemon[773]: ts=2026-09-20T09:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3778worker2 # [ 29.855431] nix-grpc-daemon[775]: ts=2026-09-20T09:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3779worker2 # [ 30.051644] nix-grpc-daemon[775]: ts=2026-09-20T09:04:53Z level=info event=scheduler_connected addr=lb:500513780worker1 # [ 30.044812] nix-grpc-daemon[773]: ts=2026-09-20T09:04:53Z level=info event=scheduler_connected addr=lb:500513781worker2 # [ 30.056643] nix-grpc-daemon[775]: ts=2026-09-20T09:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3782worker1 # [ 30.049776] nix-grpc-daemon[773]: ts=2026-09-20T09:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3783worker2 # [ 30.257767] nix-grpc-daemon[775]: ts=2026-09-20T09:04:53Z level=info event=scheduler_connected addr=lb:500513784worker1 # [ 30.251076] nix-grpc-daemon[773]: ts=2026-09-20T09:04:53Z level=info event=scheduler_connected addr=lb:500513785worker2 # [ 30.264544] nix-grpc-daemon[775]: ts=2026-09-20T09:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3786worker1 # [ 30.257926] nix-grpc-daemon[773]: ts=2026-09-20T09:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3787worker2 # [ 30.465614] nix-grpc-daemon[775]: ts=2026-09-20T09:04:54Z level=info event=scheduler_connected addr=lb:500513788worker1 # [ 30.458953] nix-grpc-daemon[773]: ts=2026-09-20T09:04:54Z level=info event=scheduler_connected addr=lb:500513789worker2 # [ 30.472998] nix-grpc-daemon[775]: ts=2026-09-20T09:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3790worker1 # [ 30.465778] nix-grpc-daemon[773]: ts=2026-09-20T09:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3791worker2 # [ 30.673992] nix-grpc-daemon[775]: ts=2026-09-20T09:04:54Z level=info event=scheduler_connected addr=lb:500513792worker1 # [ 30.666971] nix-grpc-daemon[773]: ts=2026-09-20T09:04:54Z level=info event=scheduler_connected addr=lb:500513793worker2 # [ 30.680677] nix-grpc-daemon[775]: ts=2026-09-20T09:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3794worker1 # [ 30.673386] nix-grpc-daemon[773]: ts=2026-09-20T09:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3795worker2 # [ 30.884879] nix-grpc-daemon[775]: ts=2026-09-20T09:04:54Z level=info event=scheduler_connected addr=lb:500513796worker1 # [ 30.877092] nix-grpc-daemon[773]: ts=2026-09-20T09:04:54Z level=info event=scheduler_connected addr=lb:500513797worker2 # [ 30.889246] nix-grpc-daemon[775]: ts=2026-09-20T09:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3798worker1 # [ 30.881354] nix-grpc-daemon[773]: ts=2026-09-20T09:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3799worker2 # [ 31.086126] nix-grpc-daemon[775]: ts=2026-09-20T09:04:54Z level=info event=scheduler_connected addr=lb:500513800worker1 # [ 31.078273] nix-grpc-daemon[773]: ts=2026-09-20T09:04:54Z level=info event=scheduler_connected addr=lb:500513801worker2 # [ 31.093069] nix-grpc-daemon[775]: ts=2026-09-20T09:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3802worker1 # [ 31.084963] nix-grpc-daemon[773]: ts=2026-09-20T09:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3803worker2 # [ 31.294226] nix-grpc-daemon[775]: ts=2026-09-20T09:04:54Z level=info event=scheduler_connected addr=lb:500513804worker1 # [ 31.286298] nix-grpc-daemon[773]: ts=2026-09-20T09:04:54Z level=info event=scheduler_connected addr=lb:500513805worker2 # [ 31.301036] nix-grpc-daemon[775]: ts=2026-09-20T09:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3806worker1 # [ 31.292943] nix-grpc-daemon[773]: ts=2026-09-20T09:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3807worker2 # [ 31.501925] nix-grpc-daemon[775]: ts=2026-09-20T09:04:55Z level=info event=scheduler_connected addr=lb:500513808worker1 # [ 31.493940] nix-grpc-daemon[773]: ts=2026-09-20T09:04:55Z level=info event=scheduler_connected addr=lb:500513809worker2 # [ 31.508550] nix-grpc-daemon[775]: ts=2026-09-20T09:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3810worker1 # [ 31.500792] nix-grpc-daemon[773]: ts=2026-09-20T09:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3811worker2 # [ 31.709747] nix-grpc-daemon[775]: ts=2026-09-20T09:04:55Z level=info event=scheduler_connected addr=lb:500513812worker1 # [ 31.701930] nix-grpc-daemon[773]: ts=2026-09-20T09:04:55Z level=info event=scheduler_connected addr=lb:500513813worker2 # [ 31.716734] nix-grpc-daemon[775]: ts=2026-09-20T09:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3814worker1 # [ 31.708926] nix-grpc-daemon[773]: ts=2026-09-20T09:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3815worker2 # [ 31.920401] nix-grpc-daemon[775]: ts=2026-09-20T09:04:55Z level=info event=scheduler_connected addr=lb:500513816worker1 # [ 31.913130] nix-grpc-daemon[773]: ts=2026-09-20T09:04:55Z level=info event=scheduler_connected addr=lb:500513817worker2 # [ 31.925931] nix-grpc-daemon[775]: ts=2026-09-20T09:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3818worker1 # [ 31.917334] nix-grpc-daemon[773]: ts=2026-09-20T09:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3819worker1 # [ 32.113724] nix-grpc-daemon[773]: ts=2026-09-20T09:04:55Z level=info event=scheduler_connected addr=lb:500513820worker2 # [ 32.126789] nix-grpc-daemon[775]: ts=2026-09-20T09:04:55Z level=info event=scheduler_connected addr=lb:500513821worker2 # [ 32.134164] nix-grpc-daemon[775]: ts=2026-09-20T09:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3822worker1 # [ 32.123613] nix-grpc-daemon[773]: ts=2026-09-20T09:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3823worker2 # [ 32.334720] nix-grpc-daemon[775]: ts=2026-09-20T09:04:55Z level=info event=scheduler_connected addr=lb:500513824worker1 # [ 32.324911] nix-grpc-daemon[773]: ts=2026-09-20T09:04:55Z level=info event=scheduler_connected addr=lb:500513825worker1 # [ 32.331385] nix-grpc-daemon[773]: ts=2026-09-20T09:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3826worker2 # [ 32.342124] nix-grpc-daemon[775]: ts=2026-09-20T09:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3827worker2 # [ 32.543673] nix-grpc-daemon[775]: ts=2026-09-20T09:04:56Z level=info event=scheduler_connected addr=lb:500513828worker1 # [ 32.533706] nix-grpc-daemon[773]: ts=2026-09-20T09:04:56Z level=info event=scheduler_connected addr=lb:500513829worker1 # [ 32.542935] nix-grpc-daemon[773]: ts=2026-09-20T09:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3830worker2 # [ 32.555741] nix-grpc-daemon[775]: ts=2026-09-20T09:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3831worker1 # [ 32.743831] nix-grpc-daemon[773]: ts=2026-09-20T09:04:56Z level=info event=scheduler_connected addr=lb:500513832worker2 # [ 32.756790] nix-grpc-daemon[775]: ts=2026-09-20T09:04:56Z level=info event=scheduler_connected addr=lb:500513833worker2 # [ 32.762824] nix-grpc-daemon[775]: ts=2026-09-20T09:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3834worker1 # [ 32.752924] nix-grpc-daemon[773]: ts=2026-09-20T09:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3835worker2 # [ 32.965015] nix-grpc-daemon[775]: ts=2026-09-20T09:04:56Z level=info event=scheduler_connected addr=lb:500513836worker1 # [ 32.956954] nix-grpc-daemon[773]: ts=2026-09-20T09:04:56Z level=info event=scheduler_connected addr=lb:500513837worker2 # [ 32.971340] nix-grpc-daemon[775]: ts=2026-09-20T09:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3838worker1 # [ 32.961153] nix-grpc-daemon[773]: ts=2026-09-20T09:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3839worker1 # [ 33.158005] nix-grpc-daemon[773]: ts=2026-09-20T09:04:56Z level=info event=scheduler_connected addr=lb:500513840worker2 # [ 33.172098] nix-grpc-daemon[775]: ts=2026-09-20T09:04:56Z level=info event=scheduler_connected addr=lb:500513841worker1 # [ 33.164535] nix-grpc-daemon[773]: ts=2026-09-20T09:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3842worker2 # [ 33.177827] nix-grpc-daemon[775]: ts=2026-09-20T09:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3843lb # [ 33.213724] rustfs-bucket-start[1042]: mb s3://farm3844lb # [ 33.223382] systemd[1]: Finished rustfs-bucket.service.3845lb # [ 33.234573] systemd[1]: Starting niks3 server...3846worker1 # [ 33.365019] nix-grpc-daemon[773]: ts=2026-09-20T09:04:56Z level=info event=scheduler_connected addr=lb:500513847worker2 # [ 33.378676] nix-grpc-daemon[775]: ts=2026-09-20T09:04:56Z level=info event=scheduler_connected addr=lb:500513848worker1 # [ 33.371330] nix-grpc-daemon[773]: ts=2026-09-20T09:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3849worker2 # [ 33.384324] nix-grpc-daemon[775]: ts=2026-09-20T09:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3850lb # [ 33.449830] postgres[1058]: [1058] ERROR: relation "goose_db_version" does not exist at character 363851lb # [ 33.451127] postgres[1058]: [1058] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3852lb # [ 33.484662] niks3-server[1051]: 2026/09/20 09:04:57 OK 20241026095416_initial_model.sql (21.53ms)3853lb # [ 33.488082] niks3-server[1051]: 2026/09/20 09:04:57 OK 20251210153512_drop_unused_gin_index.sql (3.76ms)3854lb # [ 33.493344] niks3-server[1051]: 2026/09/20 09:04:57 OK 20251218171726_add_pins.sql (5.24ms)3855lb # [ 33.497864] niks3-server[1051]: 2026/09/20 09:04:57 OK 20260628120000_add_object_size_and_stats.sql (4.48ms)3856lb # [ 33.504313] niks3-server[1051]: 2026/09/20 09:04:57 OK 20260905000000_add_claims.sql (6.41ms)3857lb # [ 33.508702] niks3-server[1051]: 2026/09/20 09:04:57 OK 20260920000000_drop_claims.sql (4.26ms)3858lb # [ 33.510095] niks3-server[1051]: 2026/09/20 09:04:57 goose: successfully migrated database to version: 202609200000003859lb # [ 33.515520] niks3-server[1051]: 2026/09/20 09:04:57 OK 1_commit_pending_closure.sql (6.77ms)3860lb # [ 33.518641] niks3-server[1051]: 2026/09/20 09:04:57 OK 2_object_stats_trigger.sql (3.01ms)3861lb # [ 33.520121] niks3-server[1051]: 2026/09/20 09:04:57 goose: up to current file version: 23862lb # [ 33.523812] niks3-server[1051]: 2026/09/20 09:04:57 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3863lb # [ 33.569202] niks3-server[1051]: 2026/09/20 09:04:57 INFO Read proxy enabled — serving cache objects from S33864lb # [ 33.570635] niks3-server[1051]: 2026/09/20 09:04:57 INFO Using socket-activated listener address=0.0.0.0:57513865lb # [ 33.574115] systemd[1]: Started niks3 server.3866lb # [ 33.575825] niks3-server[1051]: 2026/09/20 09:04:57 INFO systemd watchdog enabled interval=15s3867worker1 # [ 33.572074] nix-grpc-daemon[773]: ts=2026-09-20T09:04:57Z level=info event=scheduler_connected addr=lb:500513868lb # [ 33.580948] niks3-server[1051]: 2026/09/20 09:04:57 INFO Starting HTTP server address=0.0.0.0:57513869worker2 # [ 33.585207] nix-grpc-daemon[775]: ts=2026-09-20T09:04:57Z level=info event=scheduler_connected addr=lb:500513870lb # [ 33.583221] systemd[1]: Reached target Multi-User System.3871lb # [ 33.588348] systemd[1]: Startup finished in 979ms (kernel) + 5.489s (initrd) + 27.109s (userspace) = 33.578s.3872lb # [ 33.589706] niks3-server[1051]: 2026/09/20 09:04:57 INFO lead: acquired remote=192.168.1.4:600023873worker2 # [ 33.591395] nix-grpc-daemon[775]: ts=2026-09-20T09:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3874worker1 # [ 33.583169] nix-grpc-daemon[773]: ts=2026-09-20T09:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3875worker2 # [ 33.599507] nix-grpc-daemon[775]: ts=2026-09-20T09:04:57Z level=info event=scheduler_take_over3876lb: (finished: waiting for unit niks3.service, in 20.25 seconds)3877lb: waiting for TCP port 5751 on localhost3878worker2 # [ 33.792253] nix-grpc-daemon[775]: ts=2026-09-20T09:04:57Z level=info event=scheduler_connected addr=lb:500513879worker1 # [ 33.784342] nix-grpc-daemon[773]: ts=2026-09-20T09:04:57Z level=info event=scheduler_connected addr=lb:500513880worker2 # [ 33.799141] nix-grpc-daemon[775]: ts=2026-09-20T09:04:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03881worker1 # [ 33.790973] nix-grpc-daemon[773]: ts=2026-09-20T09:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3882lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3883lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)3884lb: waiting for unit envoy.service3885lb: (finished: waiting for unit envoy.service, in 0.06 seconds)3886lb: waiting for TCP port 50051 on localhost3887lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3888lb # [ 33.955817] envoy[904]: conn peer=[::1]:38004 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33889lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3890worker1 # [ 33.993480] nix-grpc-daemon[773]: ts=2026-09-20T09:04:57Z level=info event=scheduler_connected addr=lb:500513891worker2 # [ 34.005375] nix-grpc-daemon[775]: ts=2026-09-20T09:04:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03892lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3893??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3894 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283895lb: must succeed: curl -sf localhost:9901/clusters3896lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)3897lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)3898subtest: one node schedules and both builders hold a WorkerSession on it3899lb: must succeed: curl -sf localhost:9901/clusters3900lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3901lb: must succeed: curl -sf localhost:9901/clusters3902lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3903worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3904worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)3905(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 1.24 seconds)3906subtest: balancer auth: client cert, bearer token, nothing, unknown CN3907worker2 # [ 35.809824] nix-grpc-daemon[775]: ts=2026-09-20T09:04:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:547763908worker2 # [ 35.826481] systemd[1]: Started Nix Daemon.3909worker2 # [ 36.171154] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3910worker2 # [ 36.208624] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5)3911worker2 # [ 36.264330] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 2/5)3912worker2 # [ 36.453187] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 124 ms (attempt 3/5)3913worker2 # [ 36.577562] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 190 ms (attempt 4/5)3914worker2 # [ 36.777680] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3915worker1 # [ 36.813997] nix-grpc-daemon[773]: ts=2026-09-20T09:05:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:598203916worker1 # [ 36.822025] systemd[1]: Started Nix Daemon.3917worker1 # [ 37.081702] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3918worker1 # [ 37.108759] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5)3919worker1 # [ 37.111916] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 2/5)3920worker1 # [ 37.165111] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 175 ms (attempt 3/5)3921worker1 # [ 37.344635] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 566 ms (attempt 4/5)3922worker1 # [ 37.914244] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3923worker1 # [ 37.929869] nix-grpc-daemon[773]: ts=2026-09-20T09:05:01Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3924worker2 # [ 37.955019] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:547763925worker2 # [ 37.971648] nix-grpc-daemon[775]: ts=2026-09-20T09:05:01Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3926client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3927client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds)3928client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3929client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds)3930worker1 # [ 38.448178] nix-grpc-daemon[773]: ts=2026-09-20T09:05:02Z level=info event=oidc_jwks provider=mock keys=13931worker1 # [ 38.455273] nix-grpc-daemon[773]: ts=2026-09-20T09:05:02Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:598203932worker2 # [ 38.494002] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=oidc_jwks provider=mock keys=13933worker2 # [ 38.500207] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:547763934worker1 # [ 38.503351] nix-grpc-daemon[773]: ts=2026-09-20T09:05:02Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:598203935worker2 # [ 38.508638] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3936worker1 # [ 38.518344] nix-grpc-daemon[773]: ts=2026-09-20T09:05:02Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3937client: must succeed: rm -r /var/lib/nix-grpc-store3938client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3939worker2 # [ 38.900462] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=denied method=QueryMissing cn=- role=none3940worker2 # [ 39.186361] nix-grpc-daemon[775]: ts=2026-09-20T09:05:02Z level=info event=denied method=QueryMissing cn=stranger role=none3941(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.75 seconds)3942subtest: DAG build is scheduled across workers and lands in the cache3943client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23944worker2 # [ 39.469342] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:547763945client # don't know how to build these paths:3946client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3947worker2 # [ 39.485526] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547763948worker2 # [ 39.548120] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03949worker2 # [ 39.556513] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13950worker2 # [ 39.596879] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547763951worker2 # [ 39.621755] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547763952client # copying 1 paths to 'lb:50051'...3953worker2 # [ 39.646742] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547763954client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3955worker2 # [ 39.674225] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3956worker2 # [ 39.713139] nix-grpc-daemon[775]: ts=2026-09-20T09:05:03Z level=info event=niks3_push_started pid=8513957lb # [ 40.088763] envoy[904]: conn peer=[2001:db8:1::1]:55734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=22053958lb # [ 40.089351] envoy[904]: conn peer=[2001:db8:1::1]:55750 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1013959lb # [ 40.089470] envoy[904]: conn peer=[2001:db8:1::1]:55754 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=143960lb # [ 40.089582] envoy[904]: conn peer=[2001:db8:1::1]:55764 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=363961worker2 # [ 40.256923] nix-daemon[838]: accepted connection from pid 864, user nix-grpc-daemon (trusted)3962worker2 # [ 40.278899] nix-daemon[838]: reaped child process 867, status = succeeded3963worker2 # [ 40.474995] nix-daemon[838]: accepted connection from pid 869, user nix-grpc-daemon (trusted)3964worker2 # [ 40.498155] nix-daemon[838]: reaped child process 872, status = succeeded3965lb # [ 40.507285] niks3-server[1051]: 2026/09/20 09:05:04 INFO Received uploads request method=POST path=/api/pending_closures3966worker2 # [ 40.553038] nix-grpc-daemon[851]: time=2026-09-20T09:05:04.120Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3967worker2 # [ 40.554969] nix-grpc-daemon[851]: time=2026-09-20T09:05:04.121Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3968lb # [ 40.630351] niks3-server[1051]: 2026/09/20 09:05:04 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3969lb # [ 40.647701] niks3-server[1051]: 2026/09/20 09:05:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3970lb # [ 40.663460] niks3-server[1051]: 2026/09/20 09:05:04 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3971lb # [ 40.683448] niks3-server[1051]: 2026/09/20 09:05:04 INFO Signed narinfos id=1 count=13972worker2 # [ 40.691267] nix-grpc-daemon[851]: time=2026-09-20T09:05:04.260Z level=INFO msg="Uploading 1 narinfos"3973lb # [ 40.695798] niks3-server[1051]: 2026/09/20 09:05:04 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3974lb # [ 40.711178] niks3-server[1051]: 2026/09/20 09:05:04 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3975lb # [ 40.726670] niks3-server[1051]: 2026/09/20 09:05:04 INFO Completed upload id=13976worker2 # [ 40.733536] nix-grpc-daemon[851]: time=2026-09-20T09:05:04.303Z level=INFO msg="Upload complete. (691ms)"3977worker2 # [ 40.747983] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=1 paths=1 nar_bytes_in=5043978worker2 # [ 40.776906] nix-grpc-daemon[775]: ts=2026-09-20T09:05:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547763979worker2 # [ 40.786208] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3980worker2 # [ 40.795194] nix-daemon[838]: reaped child process 849, status = succeeded3981client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3982worker2 # [ 40.811479] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3983client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3984client # farm-a> LOG-farm-a-t13985worker2 # [ 41.659140] nix-daemon[838]: reaped child process 876, status = succeeded3986worker2 # [ 41.855820] nix-daemon[838]: accepted connection from pid 891, user nix-grpc-daemon (trusted)3987worker2 # [ 41.876993] nix-daemon[838]: reaped child process 894, status = succeeded3988lb # [ 41.887286] niks3-server[1051]: 2026/09/20 09:05:05 INFO Received uploads request method=POST path=/api/pending_closures3989worker2 # [ 41.918186] nix-grpc-daemon[851]: time=2026-09-20T09:05:05.486Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3990worker2 # [ 41.921314] nix-grpc-daemon[851]: time=2026-09-20T09:05:05.486Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3991lb # [ 41.980117] niks3-server[1051]: 2026/09/20 09:05:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3992lb # [ 41.990396] niks3-server[1051]: 2026/09/20 09:05:05 INFO Signed narinfos id=2 count=13993worker2 # [ 41.994759] nix-grpc-daemon[851]: time=2026-09-20T09:05:05.562Z level=INFO msg="Uploading 1 narinfos"3994lb # [ 42.008681] niks3-server[1051]: 2026/09/20 09:05:05 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3995lb # [ 42.025206] niks3-server[1051]: 2026/09/20 09:05:05 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3996lb # [ 42.041863] niks3-server[1051]: 2026/09/20 09:05:05 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3997lb # [ 42.055893] niks3-server[1051]: 2026/09/20 09:05:05 INFO Completed upload id=23998lb # [ 42.057553] niks3-server[1051]: 2026/09/20 09:05:05 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3999worker2 # [ 42.062338] nix-grpc-daemon[851]: time=2026-09-20T09:05:05.632Z level=INFO msg="Upload complete. (432ms)"4000lb # [ 42.065957] niks3-server[1051]: 2026/09/20 09:05:05 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls4001worker2 # [ 42.097935] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=14002worker2 # [ 42.116384] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=04003worker2 # [ 42.121913] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=14004worker2 # [ 42.126234] nix-daemon[838]: reaped child process 874, status = succeeded4005worker2 # [ 42.144448] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764006worker2 # [ 42.159638] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764007worker2 # [ 42.182195] nix-grpc-daemon[851]: time=2026-09-20T09:05:05.752Z level=INFO msg="All 1 paths already cached"4008client # copying 1 paths to 'lb:50051'...4009worker2 # [ 42.194670] nix-grpc-daemon[775]: ts=2026-09-20T09:05:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547764010client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...4011worker2 # [ 42.220521] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4012worker2 # [ 42.480595] nix-daemon[838]: accepted connection from pid 900, user nix-grpc-daemon (trusted)4013worker2 # [ 42.522719] nix-daemon[838]: reaped child process 903, status = succeeded4014worker2 # [ 42.716185] nix-daemon[838]: accepted connection from pid 905, user nix-grpc-daemon (trusted)4015worker2 # [ 42.735349] nix-daemon[838]: reaped child process 909, status = succeeded4016lb # [ 42.745230] niks3-server[1051]: 2026/09/20 09:05:06 INFO Received uploads request method=POST path=/api/pending_closures4017worker2 # [ 42.761149] nix-grpc-daemon[851]: time=2026-09-20T09:05:06.330Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4018worker2 # [ 42.762819] nix-grpc-daemon[851]: time=2026-09-20T09:05:06.330Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"4019lb # [ 42.769726] niks3-server[1051]: 2026/09/20 09:05:06 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst4020lb # [ 42.776005] niks3-server[1051]: 2026/09/20 09:05:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4021worker2 # [ 42.785544] nix-grpc-daemon[851]: time=2026-09-20T09:05:06.355Z level=INFO msg="Uploading 1 narinfos"4022lb # [ 42.781120] niks3-server[1051]: 2026/09/20 09:05:06 INFO Signed narinfos id=3 count=14023lb # [ 42.784619] niks3-server[1051]: 2026/09/20 09:05:06 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls4024lb # [ 42.791425] niks3-server[1051]: 2026/09/20 09:05:06 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4025lb # [ 42.796880] niks3-server[1051]: 2026/09/20 09:05:06 INFO Completed upload id=34026worker2 # [ 42.803098] nix-grpc-daemon[851]: time=2026-09-20T09:05:06.373Z level=INFO msg="Upload complete. (563ms)"4027lb # [ 42.799345] niks3-server[1051]: 2026/09/20 09:05:06 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo4028worker2 # [ 42.808258] nix-grpc-daemon[775]: ts=2026-09-20T09:05:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=0 paths=1 nar_bytes_in=6244029worker2 # [ 42.819275] nix-grpc-daemon[775]: ts=2026-09-20T09:05:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764030worker2 # [ 42.825421] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4031worker2 # [ 42.829460] nix-daemon[838]: reaped child process 898, status = succeeded4032client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...4033worker2 # [ 42.841970] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4034client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4035client # farm-b> LOG-farm-b-t14036worker2 # [ 44.298443] nix-daemon[838]: reaped child process 913, status = succeeded4037worker2 # [ 44.485148] nix-daemon[838]: accepted connection from pid 928, user nix-grpc-daemon (trusted)4038worker2 # [ 44.505773] nix-daemon[838]: reaped child process 931, status = succeeded4039lb # [ 44.515555] niks3-server[1051]: 2026/09/20 09:05:08 INFO Received uploads request method=POST path=/api/pending_closures4040worker2 # [ 44.535230] nix-grpc-daemon[851]: time=2026-09-20T09:05:08.104Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4041worker2 # [ 44.537113] nix-grpc-daemon[851]: time=2026-09-20T09:05:08.104Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"4042lb # [ 44.565276] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst4043lb # [ 44.576756] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4044lb # [ 44.583144] niks3-server[1051]: 2026/09/20 09:05:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4045worker2 # [ 44.595273] nix-grpc-daemon[851]: time=2026-09-20T09:05:08.164Z level=INFO msg="Uploading 1 narinfos"4046lb # [ 44.591843] niks3-server[1051]: 2026/09/20 09:05:08 INFO Signed narinfos id=4 count=14047lb # [ 44.597594] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls4048lb # [ 44.606305] niks3-server[1051]: 2026/09/20 09:05:08 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4049lb # [ 44.613545] niks3-server[1051]: 2026/09/20 09:05:08 INFO Completed upload id=44050worker2 # [ 44.619713] nix-grpc-daemon[851]: time=2026-09-20T09:05:08.189Z level=INFO msg="Upload complete. (365ms)"4051lb # [ 44.616100] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4052worker2 # [ 44.643085] nix-grpc-daemon[775]: ts=2026-09-20T09:05:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14053worker2 # [ 44.660609] nix-grpc-daemon[775]: ts=2026-09-20T09:05:08Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04054worker2 # [ 44.665900] nix-grpc-daemon[775]: ts=2026-09-20T09:05:08Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=14055worker2 # [ 44.669806] nix-daemon[838]: reaped child process 911, status = succeeded4056worker2 # [ 44.687771] nix-grpc-daemon[775]: ts=2026-09-20T09:05:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764057worker2 # [ 44.709242] nix-grpc-daemon[775]: ts=2026-09-20T09:05:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764058worker2 # [ 44.728936] nix-grpc-daemon[851]: time=2026-09-20T09:05:08.299Z level=INFO msg="All 2 paths already cached"4059client # copying 1 paths to 'lb:50051'...4060client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4061worker2 # [ 44.742243] nix-grpc-daemon[775]: ts=2026-09-20T09:05:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547764062worker2 # [ 44.763130] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4063worker2 # [ 44.989466] nix-daemon[838]: accepted connection from pid 937, user nix-grpc-daemon (trusted)4064worker2 # [ 45.012704] nix-daemon[838]: reaped child process 940, status = succeeded4065worker2 # [ 45.192167] nix-daemon[838]: accepted connection from pid 942, user nix-grpc-daemon (trusted)4066worker2 # [ 45.210211] nix-daemon[838]: reaped child process 945, status = succeeded4067lb # [ 45.216995] niks3-server[1051]: 2026/09/20 09:05:08 INFO Received uploads request method=POST path=/api/pending_closures4068worker2 # [ 45.234582] nix-grpc-daemon[851]: time=2026-09-20T09:05:08.804Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4069worker2 # [ 45.236183] nix-grpc-daemon[851]: time=2026-09-20T09:05:08.804Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4070lb # [ 45.252772] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4071lb # [ 45.270423] niks3-server[1051]: 2026/09/20 09:05:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4072worker2 # [ 45.284263] nix-grpc-daemon[851]: time=2026-09-20T09:05:08.854Z level=INFO msg="Uploading 1 narinfos"4073lb # [ 45.284603] niks3-server[1051]: 2026/09/20 09:05:08 INFO Signed narinfos id=5 count=14074lb # [ 45.287681] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4075lb # [ 45.297351] niks3-server[1051]: 2026/09/20 09:05:08 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4076lb # [ 45.306926] niks3-server[1051]: 2026/09/20 09:05:08 INFO Completed upload id=54077worker2 # [ 45.313157] nix-grpc-daemon[851]: time=2026-09-20T09:05:08.883Z level=INFO msg="Upload complete. (530ms)"4078lb # [ 45.309576] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4079worker2 # [ 45.323235] nix-grpc-daemon[775]: ts=2026-09-20T09:05:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=0 paths=1 nar_bytes_in=7524080worker2 # [ 45.332436] nix-grpc-daemon[775]: ts=2026-09-20T09:05:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764081worker2 # [ 45.346417] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4082worker2 # [ 45.351879] nix-daemon[838]: reaped child process 935, status = succeeded4083client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4084client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4085worker2 # [ 45.367415] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4086client # farm-top> LOG-farm-top-t14087worker2 # [ 46.218485] nix-daemon[838]: reaped child process 949, status = succeeded4088worker2 # [ 46.406573] nix-daemon[838]: accepted connection from pid 965, user nix-grpc-daemon (trusted)4089worker2 # [ 46.427632] nix-daemon[838]: reaped child process 968, status = succeeded4090lb # [ 46.434707] niks3-server[1051]: 2026/09/20 09:05:10 INFO Received uploads request method=POST path=/api/pending_closures4091worker2 # [ 46.452687] nix-grpc-daemon[851]: time=2026-09-20T09:05:10.022Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4092worker2 # [ 46.456085] nix-grpc-daemon[851]: time=2026-09-20T09:05:10.024Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4093lb # [ 46.486573] niks3-server[1051]: 2026/09/20 09:05:10 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4094lb # [ 46.496704] niks3-server[1051]: 2026/09/20 09:05:10 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4095lb # [ 46.505844] niks3-server[1051]: 2026/09/20 09:05:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4096worker2 # [ 46.516524] nix-grpc-daemon[851]: time=2026-09-20T09:05:10.086Z level=INFO msg="Uploading 1 narinfos"4097lb # [ 46.512812] niks3-server[1051]: 2026/09/20 09:05:10 INFO Signed narinfos id=6 count=14098lb # [ 46.519003] niks3-server[1051]: 2026/09/20 09:05:10 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4099lb # [ 46.525673] niks3-server[1051]: 2026/09/20 09:05:10 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4100lb # [ 46.536139] niks3-server[1051]: 2026/09/20 09:05:10 INFO Completed upload id=64101worker2 # [ 46.542727] nix-grpc-daemon[851]: time=2026-09-20T09:05:10.112Z level=INFO msg="Upload complete. (360ms)"4102lb # [ 46.538071] niks3-server[1051]: 2026/09/20 09:05:10 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4103worker2 # [ 46.557346] nix-grpc-daemon[775]: ts=2026-09-20T09:05:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14104worker2 # [ 46.580788] nix-daemon[838]: reaped child process 947, status = succeeded4105client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.40 seconds)4106client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4107client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.27 seconds)4108client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4109client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)4110client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4111client # copying 3 paths...4112client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4113client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4114client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4115client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.36 seconds)4116(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.20 seconds)4117subtest: repeat is answered Cached by the scheduler without building4118worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4119worker1 # finding garbage collector roots...4120worker1 # deleting specified paths...4121worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4122worker1 # deleting unused links...4123worker1 # note: hard linking is currently saving 0.0 KiB4124worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.36 seconds)4125worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4126worker2 # finding garbage collector roots...4127worker2 # deleting specified paths...4128worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4129worker2 # deleting unused links...4130worker2 # note: hard linking is currently saving 0.0 KiB4131worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)4132client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24133worker2 # [ 48.302464] nix-grpc-daemon[775]: ts=2026-09-20T09:05:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:547764134client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4135client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4136worker1 # [ 48.313208] nix-grpc-daemon[773]: ts=2026-09-20T09:05:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598204137worker2 # [ 48.358597] nix-grpc-daemon[775]: ts=2026-09-20T09:05:11Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14138client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.35 seconds)4139client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4140client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.22 seconds)4141lb: must succeed: curl -sf localhost:9901/clusters4142lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4143lb: must succeed: curl -sf localhost:9901/clusters4144lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4145worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4146worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds)4147(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.53 seconds)4148subtest: inputs already in the cache are not sent to the scheduler4149lb: must succeed: curl -sf localhost:9901/clusters4150lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4151lb: must succeed: curl -sf localhost:9901/clusters4152lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4153worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4154worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4155client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24156client # don't know how to build these paths:4157client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4158worker2 # [ 49.398940] nix-grpc-daemon[775]: ts=2026-09-20T09:05:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:547764159worker2 # [ 49.406456] nix-grpc-daemon[775]: ts=2026-09-20T09:05:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764160worker2 # [ 49.414017] nix-grpc-daemon[851]: time=2026-09-20T09:05:12.982Z level=INFO msg="All 2 paths already cached"4161worker2 # [ 49.426650] nix-grpc-daemon[775]: ts=2026-09-20T09:05:12Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04162worker2 # [ 49.433885] nix-grpc-daemon[775]: ts=2026-09-20T09:05:12Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=14163worker2 # [ 49.474421] nix-grpc-daemon[775]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764164worker2 # [ 49.490127] nix-grpc-daemon[775]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764165worker2 # [ 49.505233] nix-grpc-daemon[851]: time=2026-09-20T09:05:13.075Z level=INFO msg="All 2 paths already cached"4166client # copying 1 paths to 'lb:50051'...4167client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4168worker2 # [ 49.515597] nix-grpc-daemon[775]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547764169worker2 # [ 49.529792] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4170worker2 # [ 49.740237] nix-daemon[838]: accepted connection from pid 999, user nix-grpc-daemon (trusted)4171worker2 # [ 49.758572] nix-daemon[838]: reaped child process 1002, status = succeeded4172worker2 # [ 49.929773] nix-daemon[838]: accepted connection from pid 1004, user nix-grpc-daemon (trusted)4173worker2 # [ 49.947234] nix-daemon[838]: reaped child process 1007, status = succeeded4174lb # [ 49.953224] niks3-server[1051]: 2026/09/20 09:05:13 INFO Received uploads request method=POST path=/api/pending_closures4175worker2 # [ 49.969569] nix-grpc-daemon[851]: time=2026-09-20T09:05:13.539Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4176worker2 # [ 49.971071] nix-grpc-daemon[851]: time=2026-09-20T09:05:13.539Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4177lb # [ 49.987683] niks3-server[1051]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4178worker2 # [ 50.013320] nix-grpc-daemon[851]: time=2026-09-20T09:05:13.583Z level=INFO msg="Uploading 1 narinfos"4179lb # [ 50.001137] niks3-server[1051]: 2026/09/20 09:05:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4180lb # [ 50.014176] niks3-server[1051]: 2026/09/20 09:05:13 INFO Signed narinfos id=7 count=14181lb # [ 50.020861] niks3-server[1051]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4182lb # [ 50.029750] niks3-server[1051]: 2026/09/20 09:05:13 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4183lb # [ 50.037632] niks3-server[1051]: 2026/09/20 09:05:13 INFO Completed upload id=74184worker2 # [ 50.043863] nix-grpc-daemon[851]: time=2026-09-20T09:05:13.614Z level=INFO msg="Upload complete. (491ms)"4185lb # [ 50.040743] niks3-server[1051]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4186worker2 # [ 50.055280] nix-grpc-daemon[775]: ts=2026-09-20T09:05:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=0 paths=1 nar_bytes_in=7524187worker2 # [ 50.068664] nix-grpc-daemon[775]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764188worker2 # [ 50.078439] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4189worker2 # [ 50.081578] nix-daemon[838]: reaped child process 997, status = succeeded4190client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4191client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4192worker2 # [ 50.096679] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4193lb # [ 50.093245] envoy[904]: conn peer=[2001:db8:1::1]:55770 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9523 tx=3869 ms=71164194lb # [ 50.098375] envoy[904]: conn peer=[2001:db8:1::1]:47722 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=894195client # farm-top> LOG-farm-top-t1b4196worker2 # [ 51.328258] nix-daemon[838]: reaped child process 1011, status = succeeded4197worker2 # [ 51.492153] nix-daemon[838]: accepted connection from pid 1026, user nix-grpc-daemon (trusted)4198worker2 # [ 51.508965] nix-daemon[838]: reaped child process 1029, status = succeeded4199lb # [ 51.517699] niks3-server[1051]: 2026/09/20 09:05:15 INFO Received uploads request method=POST path=/api/pending_closures4200worker2 # [ 51.536395] nix-grpc-daemon[851]: time=2026-09-20T09:05:15.104Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4201worker2 # [ 51.537897] nix-grpc-daemon[851]: time=2026-09-20T09:05:15.104Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4202lb # [ 51.555116] niks3-server[1051]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4203lb # [ 51.573139] niks3-server[1051]: 2026/09/20 09:05:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4204worker2 # [ 51.585278] nix-grpc-daemon[851]: time=2026-09-20T09:05:15.154Z level=INFO msg="Uploading 1 narinfos"4205lb # [ 51.583700] niks3-server[1051]: 2026/09/20 09:05:15 INFO Signed narinfos id=8 count=14206lb # [ 51.589179] niks3-server[1051]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4207lb # [ 51.594633] niks3-server[1051]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4208worker2 # [ 51.607748] nix-grpc-daemon[851]: time=2026-09-20T09:05:15.177Z level=INFO msg="Upload complete. (300ms)"4209lb # [ 51.602155] niks3-server[1051]: 2026/09/20 09:05:15 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4210lb # [ 51.605096] niks3-server[1051]: 2026/09/20 09:05:15 INFO Completed upload id=84211lb # [ 51.608157] niks3-server[1051]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4212worker2 # [ 51.616948] nix-grpc-daemon[775]: ts=2026-09-20T09:05:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14213worker2 # [ 51.633401] nix-daemon[838]: reaped child process 1009, status = succeeded4214client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.53 seconds)4215client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4216client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds)4217lb: must succeed: curl -sf localhost:9901/clusters4218lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4219lb: must succeed: curl -sf localhost:9901/clusters4220lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4221worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4222worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4223(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.17 seconds)4224subtest: two clients wanting the same drv build it once4225client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4226client # [ 52.181259] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4227client # Running as unit: dedup1.service; invocation ID: a13d22083d074cabbfb17afcbda201864228client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4229client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4230worker1 # [ 52.437751] nix-grpc-daemon[773]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:598204231client # [ 52.439561] nix[883]: don't know how to build these paths:4232client # [ 52.440851] nix[883]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4233worker2 # [ 52.468992] nix-grpc-daemon[775]: ts=2026-09-20T09:05:16Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04234worker2 # [ 52.469447] nix-grpc-daemon[775]: ts=2026-09-20T09:05:16Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14235worker1 # [ 52.474187] nix-grpc-daemon[773]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598204236worker1 # [ 52.494736] nix-grpc-daemon[773]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598204237client # [ 52.506083] nix[883]: copying 1 paths to 'lb:50051'...4238worker1 # [ 52.510215] nix-grpc-daemon[773]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:598204239client # [ 52.508133] nix[883]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4240worker1 # [ 52.527847] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4241worker1 # [ 52.571315] nix-grpc-daemon[773]: ts=2026-09-20T09:05:16Z level=info event=niks3_push_started pid=8584242worker1 # [ 53.017542] nix-daemon[832]: accepted connection from pid 871, user nix-grpc-daemon (trusted)4243worker1 # [ 53.037448] nix-daemon[832]: reaped child process 874, status = succeeded4244worker1 # [ 53.208051] nix-daemon[832]: accepted connection from pid 876, user nix-grpc-daemon (trusted)4245worker1 # [ 53.225120] nix-daemon[832]: reaped child process 879, status = succeeded4246lb # [ 53.242375] niks3-server[1051]: 2026/09/20 09:05:16 INFO Received uploads request method=POST path=/api/pending_closures4247worker1 # [ 53.251314] nix-grpc-daemon[858]: time=2026-09-20T09:05:16.832Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4248worker1 # [ 53.253284] nix-grpc-daemon[858]: time=2026-09-20T09:05:16.833Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4249lb # [ 53.284153] niks3-server[1051]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4250worker1 # [ 53.289464] nix-grpc-daemon[858]: time=2026-09-20T09:05:16.872Z level=INFO msg="Uploading 1 narinfos"4251lb # [ 53.294071] niks3-server[1051]: 2026/09/20 09:05:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4252lb # [ 53.303685] niks3-server[1051]: 2026/09/20 09:05:16 INFO Signed narinfos id=9 count=14253lb # [ 53.312697] niks3-server[1051]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4254client # [ 53.301566] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4255lb # [ 53.325181] niks3-server[1051]: 2026/09/20 09:05:16 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4256client # Running as unit: dedup2.service; invocation ID: 3386e803e06d46cdb78a293747572de34257worker1 # [ 53.326018] nix-grpc-daemon[858]: time=2026-09-20T09:05:16.909Z level=INFO msg="Upload complete. (491ms)"4258lb # [ 53.332638] niks3-server[1051]: 2026/09/20 09:05:16 INFO Completed upload id=94259lb # [ 53.336787] niks3-server[1051]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4260worker1 # [ 53.335496] nix-grpc-daemon[773]: ts=2026-09-20T09:05:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=0 paths=1 nar_bytes_in=4324261client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4262worker1 # [ 53.348088] nix-grpc-daemon[773]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598204263worker1 # [ 53.361332] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4264worker1 # [ 53.365676] nix-daemon[832]: reaped child process 856, status = succeeded4265client # [ 53.373312] nix[883]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4266worker1 # [ 53.384403] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4267worker2 # [ 53.642043] nix-grpc-daemon[775]: ts=2026-09-20T09:05:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:547764268client # [ 53.632367] nix[899]: don't know how to build these paths:4269client # [ 53.633506] nix[899]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4270worker2 # [ 53.661409] nix-grpc-daemon[775]: ts=2026-09-20T09:05:17Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04271client # [ 53.652222] nix[899]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4272worker1 # [ 53.658454] nix-grpc-daemon[773]: ts=2026-09-20T09:05:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598204273client: must succeed: sleep 24274client: (finished: must succeed: sleep 2, in 2.06 seconds)4275??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4276 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394277client: waiting for success: ! systemctl is-active dedup1 dedup24278??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4279 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394280worker1 # [ 57.034477] nix-daemon[832]: reaped child process 886, status = succeeded4281worker1 # [ 57.217387] nix-daemon[832]: accepted connection from pid 912, user nix-grpc-daemon (trusted)4282worker1 # [ 57.235686] nix-daemon[832]: reaped child process 915, status = succeeded4283lb # [ 57.254876] niks3-server[1051]: 2026/09/20 09:05:20 INFO Received uploads request method=POST path=/api/pending_closures4284worker1 # [ 57.261676] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.843Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4285worker1 # [ 57.264144] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.843Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4286lb # [ 57.299282] niks3-server[1051]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4287lb # [ 57.310789] niks3-server[1051]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4288worker1 # [ 57.318551] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.902Z level=INFO msg="Uploading 1 narinfos"4289lb # [ 57.323666] niks3-server[1051]: 2026/09/20 09:05:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4290lb # [ 57.328268] niks3-server[1051]: 2026/09/20 09:05:20 INFO Signed narinfos id=10 count=14291lb # [ 57.331827] niks3-server[1051]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4292lb # [ 57.341571] niks3-server[1051]: 2026/09/20 09:05:20 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4293lb # [ 57.351035] niks3-server[1051]: 2026/09/20 09:05:20 INFO Completed upload id=104294lb # [ 57.354138] niks3-server[1051]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4295worker1 # [ 57.346701] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.930Z level=INFO msg="Upload complete. (348ms)"4296worker1 # [ 57.357308] nix-grpc-daemon[773]: ts=2026-09-20T09:05:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14297worker1 # [ 57.375883] nix-grpc-daemon[773]: ts=2026-09-20T09:05:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14298worker1 # [ 57.382540] nix-daemon[832]: reaped child process 884, status = succeeded4299client # [ 57.395122] systemd[1]: dedup1.service: Deactivated successfully.4300client # [ 57.400983] systemd[1]: dedup1.service: Consumed 159ms CPU time over 5.219s wall clock time, 41.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4301client # [ 57.438931] systemd[1]: dedup2.service: Deactivated successfully.4302client # [ 57.441831] systemd[1]: dedup2.service: Consumed 181ms CPU time over 4.140s wall clock time, 31.1M memory peak, 7.4K incoming IP traffic, 6.3K outgoing IP traffic.4303client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds)4304client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4305client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4306worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4307worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4308worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4309worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4310worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4311worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4312worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4313worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4314(finished: subtest: two clients wanting the same drv build it once, in 6.32 seconds)4315subtest: build hook: nix-daemon with builders = grpc://lb4316client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4317client # [ 58.647134] systemd[1]: Started Nix Daemon.4318client # [ 58.834663] nix-daemon[941]: accepted connection from pid 938, user root (trusted)4319worker1 # [ 59.043801] nix-grpc-daemon[773]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:598204320worker2 # [ 59.061182] nix-grpc-daemon[775]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764321worker2 # [ 59.074865] nix-grpc-daemon[775]: ts=2026-09-20T09:05:22Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04322worker2 # [ 59.081690] nix-grpc-daemon[775]: ts=2026-09-20T09:05:22Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14323worker2 # [ 59.123244] nix-grpc-daemon[775]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764324worker2 # [ 59.139326] nix-grpc-daemon[775]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764325worker2 # [ 59.154774] nix-grpc-daemon[775]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547764326worker2 # [ 59.170405] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4327worker2 # [ 59.383456] nix-daemon[838]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)4328worker2 # [ 59.401361] nix-daemon[838]: reaped child process 1070, status = succeeded4329worker2 # [ 59.577613] nix-daemon[838]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)4330worker2 # [ 59.595167] nix-daemon[838]: reaped child process 1075, status = succeeded4331lb # [ 59.601170] niks3-server[1051]: 2026/09/20 09:05:23 INFO Received uploads request method=POST path=/api/pending_closures4332worker2 # [ 59.616960] nix-grpc-daemon[851]: time=2026-09-20T09:05:23.186Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4333worker2 # [ 59.618428] nix-grpc-daemon[851]: time=2026-09-20T09:05:23.186Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4334lb # [ 59.630143] niks3-server[1051]: 2026/09/20 09:05:23 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4335lb # [ 59.643947] niks3-server[1051]: 2026/09/20 09:05:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4336worker2 # [ 59.655795] nix-grpc-daemon[851]: time=2026-09-20T09:05:23.225Z level=INFO msg="Uploading 1 narinfos"4337lb # [ 59.654503] niks3-server[1051]: 2026/09/20 09:05:23 INFO Signed narinfos id=11 count=14338lb # [ 59.661383] niks3-server[1051]: 2026/09/20 09:05:23 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4339lb # [ 59.672102] niks3-server[1051]: 2026/09/20 09:05:23 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4340lb # [ 59.679126] niks3-server[1051]: 2026/09/20 09:05:23 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4341lb # [ 59.683885] niks3-server[1051]: 2026/09/20 09:05:23 INFO Completed upload id=114342worker2 # [ 59.689773] nix-grpc-daemon[851]: time=2026-09-20T09:05:23.260Z level=INFO msg="Upload complete. (502ms)"4343worker2 # [ 59.698465] nix-grpc-daemon[775]: ts=2026-09-20T09:05:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=0 paths=1 nar_bytes_in=5124344worker2 # [ 59.712163] nix-grpc-daemon[775]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764345worker2 # [ 59.718975] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4346worker2 # [ 59.723921] nix-daemon[838]: reaped child process 1065, status = succeeded4347worker2 # [ 59.737490] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4348lb # [ 60.089701] envoy[904]: conn peer=[2001:db8:1::1]:47736 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1730 ms=22534349lb # [ 60.094739] envoy[904]: conn peer=[2001:db8:1::1]:44014 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1372 ms=49364350lb # [ 60.099690] envoy[904]: conn peer=[2001:db8:1::1]:44020 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1108 ms=38024351worker2 # [ 61.381173] nix-daemon[838]: reaped child process 1079, status = succeeded4352worker2 # [ 61.560748] nix-daemon[838]: accepted connection from pid 1094, user nix-grpc-daemon (trusted)4353worker2 # [ 61.580447] nix-daemon[838]: reaped child process 1097, status = succeeded4354lb # [ 61.586410] niks3-server[1051]: 2026/09/20 09:05:25 INFO Received uploads request method=POST path=/api/pending_closures4355worker2 # [ 61.604411] nix-grpc-daemon[851]: time=2026-09-20T09:05:25.173Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4356worker2 # [ 61.606042] nix-grpc-daemon[851]: time=2026-09-20T09:05:25.173Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4357lb # [ 61.622815] niks3-server[1051]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4358worker2 # [ 61.644791] nix-grpc-daemon[851]: time=2026-09-20T09:05:25.214Z level=INFO msg="Uploading 1 narinfos"4359lb # [ 61.639089] niks3-server[1051]: 2026/09/20 09:05:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4360lb # [ 61.649097] niks3-server[1051]: 2026/09/20 09:05:25 INFO Signed narinfos id=12 count=14361lb # [ 61.651516] niks3-server[1051]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4362lb # [ 61.660154] niks3-server[1051]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4363lb # [ 61.667030] niks3-server[1051]: 2026/09/20 09:05:25 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4364lb # [ 61.670469] niks3-server[1051]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4365lb # [ 61.673740] niks3-server[1051]: 2026/09/20 09:05:25 INFO Completed upload id=124366worker2 # [ 61.679916] nix-grpc-daemon[851]: time=2026-09-20T09:05:25.250Z level=INFO msg="Upload complete. (331ms)"4367worker1 # [ 61.683824] nix-grpc-daemon[773]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:598204368worker2 # [ 61.693123] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14369worker2 # [ 61.709692] nix-daemon[838]: reaped child process 1077, status = succeeded4370worker1 # [ 61.699989] nix-grpc-daemon[773]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4371worker2 # [ 61.756398] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:547764372worker2 # [ 61.764785] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=0 paths=1 nar_bytes_out=1284373worker1 # [ 62.061079] nix-grpc-daemon[773]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:598204374worker1 # [ 62.068856] nix-grpc-daemon[773]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598204375worker1 # [ 62.076429] nix-grpc-daemon[858]: time=2026-09-20T09:05:25.658Z level=INFO msg="All 1 paths already cached"4376worker2 # [ 62.100201] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04377worker2 # [ 62.108962] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14378worker2 # [ 62.115814] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764379worker2 # [ 62.127413] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764380worker2 # [ 62.142404] nix-grpc-daemon[851]: time=2026-09-20T09:05:25.712Z level=INFO msg="All 1 paths already cached"4381worker2 # [ 62.152882] nix-grpc-daemon[775]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547764382worker2 # [ 62.167094] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4383worker2 # [ 62.376939] nix-daemon[838]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)4384worker2 # [ 62.397282] nix-daemon[838]: reaped child process 1106, status = succeeded4385worker2 # [ 62.571254] nix-daemon[838]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)4386worker2 # [ 62.587601] nix-daemon[838]: reaped child process 1111, status = succeeded4387lb # [ 62.598053] niks3-server[1051]: 2026/09/20 09:05:26 INFO Received uploads request method=POST path=/api/pending_closures4388worker2 # [ 62.614027] nix-grpc-daemon[851]: time=2026-09-20T09:05:26.183Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4389worker2 # [ 62.615563] nix-grpc-daemon[851]: time=2026-09-20T09:05:26.183Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4390lb # [ 62.624297] niks3-server[1051]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4391lb # [ 62.640509] niks3-server[1051]: 2026/09/20 09:05:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4392worker2 # [ 62.653114] nix-grpc-daemon[851]: time=2026-09-20T09:05:26.223Z level=INFO msg="Uploading 1 narinfos"4393lb # [ 62.652533] niks3-server[1051]: 2026/09/20 09:05:26 INFO Signed narinfos id=13 count=14394lb # [ 62.658609] niks3-server[1051]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4395lb # [ 62.666202] niks3-server[1051]: 2026/09/20 09:05:26 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4396worker2 # [ 62.678159] nix-grpc-daemon[851]: time=2026-09-20T09:05:26.248Z level=INFO msg="Upload complete. (493ms)"4397lb # [ 62.672820] niks3-server[1051]: 2026/09/20 09:05:26 INFO Completed upload id=134398lb # [ 62.676075] niks3-server[1051]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4399worker2 # [ 62.687062] nix-grpc-daemon[775]: ts=2026-09-20T09:05:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=0 paths=1 nar_bytes_in=6244400worker2 # [ 62.700626] nix-grpc-daemon[775]: ts=2026-09-20T09:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764401worker2 # [ 62.706590] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4402worker2 # [ 62.711521] nix-daemon[838]: reaped child process 1101, status = succeeded4403worker2 # [ 62.725363] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4404worker2 # [ 63.950396] nix-daemon[838]: reaped child process 1115, status = succeeded4405worker2 # [ 64.110661] nix-daemon[838]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)4406worker2 # [ 64.129976] nix-daemon[838]: reaped child process 1133, status = succeeded4407lb # [ 64.137007] niks3-server[1051]: 2026/09/20 09:05:27 INFO Received uploads request method=POST path=/api/pending_closures4408worker2 # [ 64.152415] nix-grpc-daemon[851]: time=2026-09-20T09:05:27.720Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4409worker2 # [ 64.153932] nix-grpc-daemon[851]: time=2026-09-20T09:05:27.720Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4410lb # [ 64.173467] niks3-server[1051]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4411lb # [ 64.184889] niks3-server[1051]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4412worker2 # [ 64.201372] nix-grpc-daemon[851]: time=2026-09-20T09:05:27.771Z level=INFO msg="Uploading 1 narinfos"4413lb # [ 64.196138] niks3-server[1051]: 2026/09/20 09:05:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4414lb # [ 64.199646] niks3-server[1051]: 2026/09/20 09:05:27 INFO Signed narinfos id=14 count=14415lb # [ 64.207193] niks3-server[1051]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4416lb # [ 64.213538] niks3-server[1051]: 2026/09/20 09:05:27 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4417lb # [ 64.218493] niks3-server[1051]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4418lb # [ 64.222080] niks3-server[1051]: 2026/09/20 09:05:27 INFO Completed upload id=144419worker2 # [ 64.228321] nix-grpc-daemon[851]: time=2026-09-20T09:05:27.798Z level=INFO msg="Upload complete. (293ms)"4420worker2 # [ 64.240731] nix-grpc-daemon[775]: ts=2026-09-20T09:05:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14421worker2 # [ 64.253922] nix-grpc-daemon[775]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:547764422worker2 # [ 64.257586] nix-daemon[838]: reaped child process 1113, status = succeeded4423worker1 # [ 64.254521] nix-grpc-daemon[773]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:598204424worker1 # [ 64.267840] nix-grpc-daemon[773]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4425worker1 # [ 64.286850] nix-grpc-daemon[773]: ts=2026-09-20T09:05:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=0 paths=1 nar_bytes_out=1764426worker2 # [ 64.598021] nix-grpc-daemon[775]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:547764427worker1 # [ 64.592120] nix-grpc-daemon[773]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598204428worker1 # [ 64.604661] nix-grpc-daemon[858]: time=2026-09-20T09:05:28.187Z level=INFO msg="All 2 paths already cached"4429worker2 # [ 64.632846] nix-grpc-daemon[775]: ts=2026-09-20T09:05:28Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04430worker2 # [ 64.639828] nix-grpc-daemon[775]: ts=2026-09-20T09:05:28Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14431worker2 # [ 64.678078] nix-grpc-daemon[775]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764432worker2 # [ 64.694333] nix-grpc-daemon[775]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764433worker2 # [ 64.709070] nix-grpc-daemon[851]: time=2026-09-20T09:05:28.279Z level=INFO msg="All 2 paths already cached"4434worker2 # [ 64.718423] nix-grpc-daemon[775]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547764435worker2 # [ 64.732706] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4436worker2 # [ 64.936120] nix-daemon[838]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4437worker2 # [ 64.954838] nix-daemon[838]: reaped child process 1142, status = succeeded4438worker2 # [ 65.127877] nix-daemon[838]: accepted connection from pid 1144, user nix-grpc-daemon (trusted)4439worker2 # [ 65.145207] nix-daemon[838]: reaped child process 1147, status = succeeded4440lb # [ 65.153147] niks3-server[1051]: 2026/09/20 09:05:28 INFO Received uploads request method=POST path=/api/pending_closures4441worker2 # [ 65.167743] nix-grpc-daemon[851]: time=2026-09-20T09:05:28.737Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4442worker2 # [ 65.169432] nix-grpc-daemon[851]: time=2026-09-20T09:05:28.737Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4443lb # [ 65.179741] niks3-server[1051]: 2026/09/20 09:05:28 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4444worker2 # [ 65.200757] nix-grpc-daemon[851]: time=2026-09-20T09:05:28.770Z level=INFO msg="Uploading 1 narinfos"4445lb # [ 65.196182] niks3-server[1051]: 2026/09/20 09:05:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4446lb # [ 65.207106] niks3-server[1051]: 2026/09/20 09:05:28 INFO Signed narinfos id=15 count=14447lb # [ 65.213316] niks3-server[1051]: 2026/09/20 09:05:28 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4448lb # [ 65.220787] niks3-server[1051]: 2026/09/20 09:05:28 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4449worker2 # [ 65.232785] nix-grpc-daemon[851]: time=2026-09-20T09:05:28.803Z level=INFO msg="Upload complete. (482ms)"4450lb # [ 65.227168] niks3-server[1051]: 2026/09/20 09:05:28 INFO Completed upload id=154451lb # [ 65.230435] niks3-server[1051]: 2026/09/20 09:05:28 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4452worker2 # [ 65.240843] nix-grpc-daemon[775]: ts=2026-09-20T09:05:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=0 paths=1 nar_bytes_in=7524453worker2 # [ 65.254906] nix-grpc-daemon[775]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764454worker2 # [ 65.261112] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4455worker2 # [ 65.265881] nix-daemon[838]: reaped child process 1137, status = succeeded4456worker2 # [ 65.279132] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4457worker2 # [ 66.323820] nix-daemon[838]: reaped child process 1151, status = succeeded4458worker2 # [ 66.502405] nix-daemon[838]: accepted connection from pid 1166, user nix-grpc-daemon (trusted)4459worker2 # [ 66.518118] nix-daemon[838]: reaped child process 1169, status = succeeded4460lb # [ 66.528978] niks3-server[1051]: 2026/09/20 09:05:30 INFO Received uploads request method=POST path=/api/pending_closures4461worker2 # [ 66.547474] nix-grpc-daemon[851]: time=2026-09-20T09:05:30.114Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4462worker2 # [ 66.549477] nix-grpc-daemon[851]: time=2026-09-20T09:05:30.114Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4463lb # [ 66.565449] niks3-server[1051]: 2026/09/20 09:05:30 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4464lb # [ 66.577327] niks3-server[1051]: 2026/09/20 09:05:30 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4465lb # [ 66.591744] niks3-server[1051]: 2026/09/20 09:05:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4466worker2 # [ 66.602688] nix-grpc-daemon[851]: time=2026-09-20T09:05:30.172Z level=INFO msg="Uploading 1 narinfos"4467lb # [ 66.601062] niks3-server[1051]: 2026/09/20 09:05:30 INFO Signed narinfos id=16 count=14468lb # [ 66.603545] niks3-server[1051]: 2026/09/20 09:05:30 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4469lb # [ 66.618594] niks3-server[1051]: 2026/09/20 09:05:30 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4470lb # [ 66.624117] niks3-server[1051]: 2026/09/20 09:05:30 INFO Completed upload id=164471worker2 # [ 66.630313] nix-grpc-daemon[851]: time=2026-09-20T09:05:30.200Z level=INFO msg="Upload complete. (340ms)"4472lb # [ 66.626693] niks3-server[1051]: 2026/09/20 09:05:30 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4473worker1 # [ 66.635800] nix-grpc-daemon[773]: ts=2026-09-20T09:05:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:598204474worker2 # [ 66.645006] nix-grpc-daemon[775]: ts=2026-09-20T09:05:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14475worker2 # [ 66.660173] nix-daemon[838]: reaped child process 1149, status = succeeded4476worker1 # [ 66.648569] nix-grpc-daemon[773]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4477worker1 # [ 66.688174] nix-grpc-daemon[773]: ts=2026-09-20T09:05:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:598204478worker1 # [ 66.693972] nix-grpc-daemon[773]: ts=2026-09-20T09:05:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=0 paths=1 nar_bytes_out=2324479client # [ 66.816379] nix-daemon[941]: reaped child process 943, status = succeeded4480client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.41 seconds)4481client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4482client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4483client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4484client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4485client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4486client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4487(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.54 seconds)4488subtest: an input only one worker has still reaches the builder4489client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4490client # this derivation will be built:4491client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4492client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4493client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds)4494client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4495client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4496worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4497worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds)4498worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4499worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4500client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24501client # [ 68.134200] nix-daemon[941]: accepted connection from pid 1024, user root (trusted)4502client # this derivation will be built:4503client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4504worker1 # [ 68.341293] nix-grpc-daemon[773]: ts=2026-09-20T09:05:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:598204505client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4506worker2 # [ 68.361136] nix-grpc-daemon[775]: ts=2026-09-20T09:05:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764507client # copying 1 paths...4508client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4509worker1 # [ 68.367141] nix-grpc-daemon[773]: ts=2026-09-20T09:05:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:598204510worker1 # [ 68.382962] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4511worker1 # [ 68.586526] nix-daemon[832]: accepted connection from pid 938, user nix-grpc-daemon (trusted)4512worker1 # [ 68.606667] nix-daemon[832]: reaped child process 941, status = succeeded4513lb # [ 68.625086] niks3-server[1051]: 2026/09/20 09:05:32 INFO Received uploads request method=POST path=/api/pending_closures4514worker1 # [ 68.630115] nix-grpc-daemon[858]: time=2026-09-20T09:05:32.213Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4515worker1 # [ 68.631952] nix-grpc-daemon[858]: time=2026-09-20T09:05:32.213Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4516lb # [ 68.651292] niks3-server[1051]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4517lb # [ 68.666632] niks3-server[1051]: 2026/09/20 09:05:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4518worker1 # [ 68.668048] nix-grpc-daemon[858]: time=2026-09-20T09:05:32.251Z level=INFO msg="Uploading 1 narinfos"4519lb # [ 68.678750] niks3-server[1051]: 2026/09/20 09:05:32 INFO Signed narinfos id=17 count=14520lb # [ 68.685327] niks3-server[1051]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4521lb # [ 68.695060] niks3-server[1051]: 2026/09/20 09:05:32 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4522lb # [ 68.700538] niks3-server[1051]: 2026/09/20 09:05:32 INFO Completed upload id=174523worker1 # [ 68.695541] nix-grpc-daemon[858]: time=2026-09-20T09:05:32.279Z level=INFO msg="Upload complete. (297ms)"4524lb # [ 68.704354] niks3-server[1051]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4525worker1 # [ 68.708473] nix-grpc-daemon[773]: ts=2026-09-20T09:05:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=0 paths=1 nar_bytes_in=1204526worker1 # [ 68.723496] nix-daemon[832]: reaped child process 936, status = succeeded4527worker2 # [ 68.731826] nix-grpc-daemon[775]: ts=2026-09-20T09:05:32Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04528worker2 # [ 68.738065] nix-grpc-daemon[775]: ts=2026-09-20T09:05:32Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14529worker1 # [ 68.768348] nix-grpc-daemon[773]: ts=2026-09-20T09:05:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598204530worker1 # [ 68.784433] nix-grpc-daemon[773]: ts=2026-09-20T09:05:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598204531client # copying 2 paths to 'lb:50051'...4532worker1 # [ 68.801966] nix-grpc-daemon[773]: ts=2026-09-20T09:05:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:598204533client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4534client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4535worker1 # [ 68.817751] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4536worker1 # [ 69.024256] nix-daemon[832]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4537worker1 # [ 69.044366] nix-daemon[832]: reaped child process 948, status = succeeded4538worker1 # [ 69.220771] nix-daemon[832]: accepted connection from pid 950, user nix-grpc-daemon (trusted)4539worker1 # [ 69.238298] nix-daemon[832]: reaped child process 953, status = succeeded4540lb # [ 69.254655] niks3-server[1051]: 2026/09/20 09:05:32 INFO Received uploads request method=POST path=/api/pending_closures4541lb # [ 69.264684] niks3-server[1051]: 2026/09/20 09:05:32 INFO Received uploads request method=POST path=/api/pending_closures4542worker1 # [ 69.269087] nix-grpc-daemon[858]: time=2026-09-20T09:05:32.852Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4543worker1 # [ 69.270745] nix-grpc-daemon[858]: time=2026-09-20T09:05:32.852Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4544worker1 # [ 69.272664] nix-grpc-daemon[858]: time=2026-09-20T09:05:32.852Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4545lb # [ 69.296621] niks3-server[1051]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4546lb # [ 69.311852] niks3-server[1051]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4547lb # [ 69.326634] niks3-server[1051]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4548lb # [ 69.332161] niks3-server[1051]: 2026/09/20 09:05:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4549lb # [ 69.338398] niks3-server[1051]: 2026/09/20 09:05:32 INFO Signed narinfos id=18 count=14550worker1 # [ 69.334737] nix-grpc-daemon[858]: time=2026-09-20T09:05:32.917Z level=INFO msg="Uploading 3 narinfos"4551lb # [ 69.342139] niks3-server[1051]: 2026/09/20 09:05:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4552lb # [ 69.349665] niks3-server[1051]: 2026/09/20 09:05:32 INFO Signed narinfos id=19 count=24553lb # [ 69.351288] niks3-server[1051]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4554lb # [ 69.359195] niks3-server[1051]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4555lb # [ 69.366522] niks3-server[1051]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4556lb # [ 69.372526] niks3-server[1051]: 2026/09/20 09:05:32 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4557lb # [ 69.376551] niks3-server[1051]: 2026/09/20 09:05:32 INFO Completed upload id=184558lb # [ 69.378726] niks3-server[1051]: 2026/09/20 09:05:32 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4559lb # [ 69.381572] niks3-server[1051]: 2026/09/20 09:05:32 INFO Completed upload id=194560lb # [ 69.383047] niks3-server[1051]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4561worker1 # [ 69.377271] nix-grpc-daemon[858]: time=2026-09-20T09:05:32.960Z level=INFO msg="Upload complete. (540ms)"4562worker1 # [ 69.389254] nix-grpc-daemon[773]: ts=2026-09-20T09:05:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=0 paths=2 nar_bytes_in=9844563worker1 # [ 69.408577] nix-grpc-daemon[773]: ts=2026-09-20T09:05:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598204564worker1 # [ 69.421179] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4565worker1 # [ 69.425399] nix-daemon[832]: reaped child process 943, status = succeeded4566client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4567client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4568worker1 # [ 69.442745] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4569lb # [ 70.092068] envoy[904]: conn peer=[2001:db8:1::1]:44036 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3404 tx=1777 ms=27694570lb # [ 70.092488] envoy[904]: conn peer=[2001:db8:1::1]:57334 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=724571lb # [ 70.092615] envoy[904]: conn peer=[2001:db8:1::1]:57350 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=1873 ms=22834572lb # [ 70.092750] envoy[904]: conn peer=[2001:db8:1::1]:57362 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=954573lb # [ 70.092850] envoy[904]: conn peer=[2001:db8:1::1]:57376 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4330 tx=2238 ms=21644574lb # [ 70.092945] envoy[904]: conn peer=[2001:db8:1::1]:57390 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=684575worker1 # [ 71.092189] nix-daemon[832]: reaped child process 957, status = succeeded4576worker1 # [ 71.281057] nix-daemon[832]: accepted connection from pid 972, user nix-grpc-daemon (trusted)4577worker1 # [ 71.299811] nix-daemon[832]: reaped child process 975, status = succeeded4578lb # [ 71.316640] niks3-server[1051]: 2026/09/20 09:05:34 INFO Received uploads request method=POST path=/api/pending_closures4579worker1 # [ 71.324837] nix-grpc-daemon[858]: time=2026-09-20T09:05:34.907Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4580lb # [ 71.349187] niks3-server[1051]: 2026/09/20 09:05:34 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4581lb # [ 71.356990] niks3-server[1051]: 2026/09/20 09:05:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4582worker1 # [ 71.362495] nix-grpc-daemon[858]: time=2026-09-20T09:05:34.945Z level=INFO msg="Uploading 1 narinfos"4583lb # [ 71.368353] niks3-server[1051]: 2026/09/20 09:05:34 INFO Signed narinfos id=20 count=14584lb # [ 71.371584] niks3-server[1051]: 2026/09/20 09:05:34 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4585lb # [ 71.384314] niks3-server[1051]: 2026/09/20 09:05:34 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4586worker1 # [ 71.386779] nix-grpc-daemon[858]: time=2026-09-20T09:05:34.970Z level=INFO msg="Upload complete. (330ms)"4587lb # [ 71.393424] niks3-server[1051]: 2026/09/20 09:05:34 INFO Completed upload id=204588lb # [ 71.398336] niks3-server[1051]: 2026/09/20 09:05:34 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4589worker1 # [ 71.396929] nix-grpc-daemon[773]: ts=2026-09-20T09:05:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=2 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14590worker1 # [ 71.410598] nix-daemon[832]: reaped child process 955, status = succeeded4591client # copying 1 paths...4592worker1 # [ 71.444598] nix-grpc-daemon[773]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:598204593client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4594worker1 # [ 71.474943] nix-grpc-daemon[773]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:598204595worker1 # [ 71.479973] nix-grpc-daemon[773]: ts=2026-09-20T09:05:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=0 paths=1 nar_bytes_out=1204596client # [ 71.593085] nix-daemon[941]: reaped child process 1027, status = succeeded4597client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.71 seconds)4598client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24599client # [ 71.812883] nix-daemon[941]: accepted connection from pid 1046, user root (trusted)4600client # this derivation will be built:4601client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4602worker1 # [ 72.019516] nix-grpc-daemon[773]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:598204603client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4604worker1 # [ 72.033412] nix-grpc-daemon[773]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598204605worker1 # [ 72.044677] nix-grpc-daemon[858]: time=2026-09-20T09:05:35.628Z level=INFO msg="All 1 paths already cached"4606worker2 # [ 72.075640] nix-grpc-daemon[775]: ts=2026-09-20T09:05:35Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04607worker2 # [ 72.083892] nix-grpc-daemon[775]: ts=2026-09-20T09:05:35Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14608worker2 # [ 72.091618] nix-grpc-daemon[775]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764609worker2 # [ 72.102922] nix-grpc-daemon[775]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764610client # copying 1 paths to 'lb:50051'...4611client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4612worker2 # [ 72.123644] nix-grpc-daemon[775]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547764613worker2 # [ 72.138621] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4614worker2 # [ 72.161292] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5)4615worker2 # [ 72.243842] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 2/5)4616worker2 # [ 72.356618] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 256 ms (attempt 3/5)4617worker2 # [ 72.620349] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 532 ms (attempt 4/5)4618worker2 # [ 73.161719] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4619worker2 # [ 73.171392] nix-grpc-daemon[775]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4620worker2 # [ 73.406335] nix-daemon[838]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4621worker2 # [ 73.425404] nix-daemon[838]: reaped child process 1187, status = succeeded4622worker2 # [ 73.601585] nix-daemon[838]: accepted connection from pid 1189, user nix-grpc-daemon (trusted)4623worker2 # [ 73.618290] nix-daemon[838]: reaped child process 1192, status = succeeded4624lb # [ 73.625720] niks3-server[1051]: 2026/09/20 09:05:37 INFO Received uploads request method=POST path=/api/pending_closures4625worker2 # [ 73.639969] nix-grpc-daemon[851]: time=2026-09-20T09:05:37.209Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4626worker2 # [ 73.641621] nix-grpc-daemon[851]: time=2026-09-20T09:05:37.209Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4627lb # [ 73.650732] niks3-server[1051]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4628lb # [ 73.665858] niks3-server[1051]: 2026/09/20 09:05:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4629worker2 # [ 73.677670] nix-grpc-daemon[851]: time=2026-09-20T09:05:37.247Z level=INFO msg="Uploading 1 narinfos"4630lb # [ 73.679041] niks3-server[1051]: 2026/09/20 09:05:37 INFO Signed narinfos id=21 count=14631lb # [ 73.684746] niks3-server[1051]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4632worker2 # [ 73.699815] nix-grpc-daemon[851]: time=2026-09-20T09:05:37.270Z level=INFO msg="Upload complete. (503ms)"4633lb # [ 73.694459] niks3-server[1051]: 2026/09/20 09:05:37 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4634lb # [ 73.699885] niks3-server[1051]: 2026/09/20 09:05:37 INFO Completed upload id=214635worker2 # [ 73.708278] nix-grpc-daemon[775]: ts=2026-09-20T09:05:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=1 paths=1 nar_bytes_in=5684636lb # [ 73.703691] niks3-server[1051]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4637worker2 # [ 73.717340] nix-grpc-daemon[775]: ts=2026-09-20T09:05:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547764638worker2 # [ 73.728264] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4639worker2 # [ 73.733027] nix-daemon[838]: reaped child process 1178, status = succeeded4640worker2 # [ 73.749660] nix-grpc-daemon[775]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4641worker2 # [ 73.765021] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4642client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4643client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4644worker2 # [ 74.810532] nix-daemon[838]: reaped child process 1197, status = succeeded4645worker2 # [ 74.997997] nix-daemon[838]: accepted connection from pid 1212, user nix-grpc-daemon (trusted)4646worker2 # [ 75.015405] nix-daemon[838]: reaped child process 1215, status = succeeded4647lb # [ 75.021465] niks3-server[1051]: 2026/09/20 09:05:38 INFO Received uploads request method=POST path=/api/pending_closures4648worker2 # [ 75.040417] nix-grpc-daemon[851]: time=2026-09-20T09:05:38.609Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4649lb # [ 75.054334] niks3-server[1051]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4650worker2 # [ 75.071333] nix-grpc-daemon[851]: time=2026-09-20T09:05:38.641Z level=INFO msg="Uploading 1 narinfos"4651lb # [ 75.067879] niks3-server[1051]: 2026/09/20 09:05:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4652lb # [ 75.078815] niks3-server[1051]: 2026/09/20 09:05:38 INFO Signed narinfos id=22 count=14653lb # [ 75.082663] niks3-server[1051]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4654lb # [ 75.091054] niks3-server[1051]: 2026/09/20 09:05:38 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4655lb # [ 75.095768] niks3-server[1051]: 2026/09/20 09:05:38 INFO Completed upload id=224656worker2 # [ 75.101335] nix-grpc-daemon[851]: time=2026-09-20T09:05:38.671Z level=INFO msg="Upload complete. (320ms)"4657lb # [ 75.098619] niks3-server[1051]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4658worker2 # [ 75.110509] nix-grpc-daemon[775]: ts=2026-09-20T09:05:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14659worker2 # [ 75.126319] nix-daemon[838]: reaped child process 1194, status = succeeded4660client # copying 1 paths...4661worker2 # [ 75.159255] nix-grpc-daemon[775]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:547764662client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4663worker2 # [ 75.188126] nix-grpc-daemon[775]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:547764664worker2 # [ 75.194507] nix-grpc-daemon[775]: ts=2026-09-20T09:05:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54776 duration_s=0 paths=1 nar_bytes_out=1204665client # [ 75.310338] nix-daemon[941]: reaped child process 1049, status = succeeded4666client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.71 seconds)4667client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24668client # [ 75.523343] nix-daemon[941]: accepted connection from pid 1068, user root (trusted)4669client # this derivation will be built:4670client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4671worker1 # [ 75.725007] nix-grpc-daemon[773]: ts=2026-09-20T09:05:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:598204672client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4673worker2 # [ 75.743208] nix-grpc-daemon[775]: ts=2026-09-20T09:05:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547764674worker2 # [ 75.752801] nix-grpc-daemon[851]: time=2026-09-20T09:05:39.323Z level=INFO msg="All 1 paths already cached"4675worker2 # [ 75.769257] nix-grpc-daemon[775]: ts=2026-09-20T09:05:39Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04676worker1 # [ 75.761662] nix-grpc-daemon[773]: ts=2026-09-20T09:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598204677worker2 # [ 75.775781] nix-grpc-daemon[775]: ts=2026-09-20T09:05:39Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14678worker1 # [ 75.776999] nix-grpc-daemon[773]: ts=2026-09-20T09:05:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598204679worker1 # [ 75.792369] nix-grpc-daemon[858]: time=2026-09-20T09:05:39.375Z level=INFO msg="All 1 paths already cached"4680client # copying 1 paths to 'lb:50051'...4681client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4682worker1 # [ 75.801943] nix-grpc-daemon[773]: ts=2026-09-20T09:05:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:598204683worker1 # [ 75.816955] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4684worker1 # [ 76.026436] nix-daemon[832]: accepted connection from pid 979, user nix-grpc-daemon (trusted)4685worker1 # [ 76.045707] nix-daemon[832]: reaped child process 982, status = succeeded4686worker1 # [ 76.223178] nix-daemon[832]: accepted connection from pid 984, user nix-grpc-daemon (trusted)4687worker1 # [ 76.240738] nix-daemon[832]: reaped child process 987, status = succeeded4688lb # [ 76.258862] niks3-server[1051]: 2026/09/20 09:05:39 INFO Received uploads request method=POST path=/api/pending_closures4689worker1 # [ 76.263592] nix-grpc-daemon[858]: time=2026-09-20T09:05:39.846Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4690worker1 # [ 76.265260] nix-grpc-daemon[858]: time=2026-09-20T09:05:39.847Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4691lb # [ 76.286901] niks3-server[1051]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4692worker1 # [ 76.303516] nix-grpc-daemon[858]: time=2026-09-20T09:05:39.886Z level=INFO msg="Uploading 1 narinfos"4693lb # [ 76.307675] niks3-server[1051]: 2026/09/20 09:05:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4694lb # [ 76.314436] niks3-server[1051]: 2026/09/20 09:05:39 INFO Signed narinfos id=23 count=14695lb # [ 76.322562] niks3-server[1051]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4696lb # [ 76.334201] niks3-server[1051]: 2026/09/20 09:05:39 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4697worker1 # [ 76.338054] nix-grpc-daemon[858]: time=2026-09-20T09:05:39.921Z level=INFO msg="Upload complete. (504ms)"4698lb # [ 76.343213] niks3-server[1051]: 2026/09/20 09:05:39 INFO Completed upload id=234699lb # [ 76.347739] niks3-server[1051]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4700worker1 # [ 76.348332] nix-grpc-daemon[773]: ts=2026-09-20T09:05:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=0 paths=1 nar_bytes_in=5684701worker1 # [ 76.358736] nix-grpc-daemon[773]: ts=2026-09-20T09:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598204702worker1 # [ 76.366381] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4703worker1 # [ 76.371668] nix-daemon[832]: reaped child process 977, status = succeeded4704client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4705worker1 # [ 76.383576] nix-daemon[832]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4706client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4707worker1 # [ 78.032837] nix-daemon[832]: reaped child process 991, status = succeeded4708worker1 # [ 78.212967] nix-daemon[832]: accepted connection from pid 1006, user nix-grpc-daemon (trusted)4709worker1 # [ 78.232819] nix-daemon[832]: reaped child process 1009, status = succeeded4710lb # [ 78.249780] niks3-server[1051]: 2026/09/20 09:05:41 INFO Received uploads request method=POST path=/api/pending_closures4711worker1 # [ 78.256444] nix-grpc-daemon[858]: time=2026-09-20T09:05:41.838Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4712lb # [ 78.280113] niks3-server[1051]: 2026/09/20 09:05:41 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4713worker1 # [ 78.294466] nix-grpc-daemon[858]: time=2026-09-20T09:05:41.877Z level=INFO msg="Uploading 1 narinfos"4714lb # [ 78.292946] niks3-server[1051]: 2026/09/20 09:05:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4715lb # [ 78.305792] niks3-server[1051]: 2026/09/20 09:05:41 INFO Signed narinfos id=24 count=14716lb # [ 78.312662] niks3-server[1051]: 2026/09/20 09:05:41 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4717lb # [ 78.323058] niks3-server[1051]: 2026/09/20 09:05:41 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4718lb # [ 78.328434] niks3-server[1051]: 2026/09/20 09:05:41 INFO Completed upload id=244719worker1 # [ 78.323098] nix-grpc-daemon[858]: time=2026-09-20T09:05:41.906Z level=INFO msg="Upload complete. (325ms)"4720lb # [ 78.331208] niks3-server[1051]: 2026/09/20 09:05:41 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4721worker1 # [ 78.332999] nix-grpc-daemon[773]: ts=2026-09-20T09:05:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14722worker1 # [ 78.347264] nix-daemon[832]: reaped child process 989, status = succeeded4723client # copying 1 paths...4724worker2 # [ 78.394391] nix-grpc-daemon[775]: ts=2026-09-20T09:05:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:547764725worker2 # [ 78.402957] nix-grpc-daemon[775]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4726client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4727worker1 # [ 78.437160] nix-grpc-daemon[773]: ts=2026-09-20T09:05:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:598204728worker1 # [ 78.444474] nix-grpc-daemon[773]: ts=2026-09-20T09:05:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59820 duration_s=0 paths=1 nar_bytes_out=1204729client # [ 78.522612] nix-daemon[941]: reaped child process 1071, status = succeeded4730client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.22 seconds)4731(finished: subtest: an input only one worker has still reaches the builder, in 11.57 seconds)4732subtest: upload whose reference the worker lacks is completed from the cache4733client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4734client # this derivation will be built:4735client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4736client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4737client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds)4738client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4739client # this derivation will be built:4740client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4741client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4742client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.44 seconds)4743client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4744client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4745worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4746worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4747worker2 # [ 79.959617] systemd[1]: Stopping Nix worker-protocol over gRPC...4748lb # [ 80.094485] envoy[904]: conn peer=[2001:db8:1::1]:57398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4224 tx=1765 ms=31934749lb # [ 80.099521] envoy[904]: conn peer=[2001:db8:1::1]:39136 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=634750lb # [ 80.104341] envoy[904]: conn peer=[2001:db8:1::1]:39142 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1830 ms=32254751lb # [ 80.109087] envoy[904]: conn peer=[2001:db8:1::1]:39150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=724752lb # [ 80.113701] envoy[904]: conn peer=[2001:db8:1::1]:39158 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1915 ms=27364753lb # [ 80.118463] envoy[904]: conn peer=[2001:db8:1::1]:39172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=284754worker2 # [ 80.456947] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=signal_exit4755worker2 # [ 80.525305] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=scheduler_yield4756lb # [ 80.522944] niks3-server[1051]: 2026/09/20 09:05:44 INFO lead: released remote=192.168.1.4:600024757worker1 # [ 80.518637] nix-grpc-daemon[773]: ts=2026-09-20T09:05:44Z level=info event=scheduler_restarting addr=lb:500514758worker2 # [ 80.534505] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:424864759worker2 # [ 80.540439] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=worker_gone addr=192.168.1.3:500514760worker2 # [ 80.545624] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=scheduler_restarting addr=lb:500514761worker2 # [ 80.549728] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:424864762worker2 # [ 80.554116] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=worker_gone addr=192.168.1.4:500514763worker1 # [ 80.718885] nix-grpc-daemon[773]: ts=2026-09-20T09:05:44Z level=info event=scheduler_connected addr=lb:500514764worker1 # [ 80.725674] nix-grpc-daemon[773]: ts=2026-09-20T09:05:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4765worker2 # [ 80.741786] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=scheduler_connected addr=lb:500514766worker2 # [ 80.754474] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4767worker1 # [ 80.926908] nix-grpc-daemon[773]: ts=2026-09-20T09:05:44Z level=info event=scheduler_connected addr=lb:500514768worker1 # [ 80.933504] nix-grpc-daemon[773]: ts=2026-09-20T09:05:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4769worker2 # [ 80.955526] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=scheduler_connected addr=lb:500514770worker2 # [ 80.963159] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4771worker1 # [ 81.134626] nix-grpc-daemon[773]: ts=2026-09-20T09:05:44Z level=info event=scheduler_connected addr=lb:500514772worker1 # [ 81.141610] nix-grpc-daemon[773]: ts=2026-09-20T09:05:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4773worker2 # [ 81.164387] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=scheduler_connected addr=lb:500514774worker2 # [ 81.171922] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4775worker1 # [ 81.342764] nix-grpc-daemon[773]: ts=2026-09-20T09:05:44Z level=info event=scheduler_connected addr=lb:500514776worker1 # [ 81.350152] nix-grpc-daemon[773]: ts=2026-09-20T09:05:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4777worker2 # [ 81.375641] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=scheduler_connected addr=lb:500514778worker2 # [ 81.382159] nix-grpc-daemon[775]: ts=2026-09-20T09:05:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4779worker2 # [ 81.535389] nix-grpc-daemon[775]: ts=2026-09-20T09:05:45Z level=info event=scheduler_restarting4780worker1 # [ 81.553886] nix-grpc-daemon[773]: ts=2026-09-20T09:05:45Z level=info event=scheduler_connected addr=lb:500514781worker2 # [ 81.572535] nix-daemon[838]: reaped child process 841, status = succeeded4782worker1 # [ 81.559381] nix-grpc-daemon[773]: ts=2026-09-20T09:05:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4783worker2 # [ 81.579469] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4784worker2 # [ 81.588573] nix-grpc-daemon[775]: E0000 00:00:1789895145.149332 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4785worker2 # [ 81.617710] nix-grpc-daemon[775]: E0000 00:00:1789895145.149695 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4786worker2 # [ 81.622471] nix-grpc-daemon[775]: ts=2026-09-20T09:05:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4787worker1 # [ 81.760459] nix-grpc-daemon[773]: ts=2026-09-20T09:05:45Z level=info event=scheduler_connected addr=lb:500514788worker2 # [ 81.773565] nix-grpc-daemon[775]: E0000 00:00:1789895145.343665 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4789worker1 # [ 82.484429] nix-grpc-daemon[773]: ts=2026-09-20T09:05:46Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4790worker2 # [ 82.518125] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4791worker2 # [ 82.525612] systemd[1]: Stopped Nix worker-protocol over gRPC.4792worker2 # [ 82.529370] systemd[1]: nix-grpc-daemon.service: Consumed 3.939s CPU time over 1min 2.407s wall clock time, 60.2M memory peak, 94.9K incoming IP traffic, 180.8K outgoing IP traffic.4793worker2 # [ 82.542468] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4794worker2 # [ 82.549949] systemd[1]: Closed Nix worker-protocol over gRPC.4795worker2 # [ 82.551480] systemd[1]: nix-grpc-daemon.socket: Consumed 597us CPU time over 1min 11.088s wall clock time, 256K memory peak, 122.8K incoming IP traffic, 95.7K outgoing IP traffic.4796lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4797lb: must succeed: curl -sf localhost:9901/clusters4798lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4799lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4800client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24801worker1 # [ 82.688711] nix-grpc-daemon[773]: ts=2026-09-20T09:05:46Z level=info event=scheduler_connected addr=lb:500514802worker1 # [ 82.693079] nix-grpc-daemon[773]: ts=2026-09-20T09:05:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4803worker1 # [ 82.889988] nix-grpc-daemon[773]: ts=2026-09-20T09:05:46Z level=info event=scheduler_connected addr=lb:500514804worker1 # [ 82.897300] nix-grpc-daemon[773]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:598204805worker1 # [ 82.903920] nix-grpc-daemon[773]: ts=2026-09-20T09:05:46Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4806client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4807worker1 # [ 82.914066] nix-grpc-daemon[773]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:598204808client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.31 seconds)4809worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4810worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4811worker2 # [ 83.066334] systemd[1]: Listening on Nix worker-protocol over gRPC.4812worker1 # [ 83.098342] nix-grpc-daemon[773]: ts=2026-09-20T09:05:46Z level=info event=scheduler_connected addr=lb:500514813worker1 # [ 83.107401] nix-grpc-daemon[773]: ts=2026-09-20T09:05:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4814worker1 # [ 83.152891] systemd[1]: Stopping Nix worker-protocol over gRPC...4815worker1 # [ 83.307599] nix-grpc-daemon[773]: ts=2026-09-20T09:05:46Z level=info event=scheduler_connected addr=lb:500514816worker2 # [ 83.332980] systemd[1]: Starting Nix worker-protocol over gRPC...4817worker1 # [ 83.446997] nix-grpc-daemon[773]: ts=2026-09-20T09:05:47Z level=info event=signal_exit4818worker2 # [ 83.555054] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4819worker2 # [ 83.558119] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14820worker2 # [ 83.567103] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4821worker2 # [ 83.589691] systemd[1]: Started Nix worker-protocol over gRPC.4822worker1 # [ 83.574536] nix-grpc-daemon[773]: ts=2026-09-20T09:05:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4823worker2 # [ 83.590572] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:47Z level=info event=scheduler_take_over4824lb # [ 83.583672] niks3-server[1051]: 2026/09/20 09:05:47 INFO lead: acquired remote=192.168.1.4:388424825worker2 # [ 83.615777] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:47Z level=info event=scheduler_connected addr=lb:500514826worker2 # [ 83.618010] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04827worker1 # [ 83.777044] nix-grpc-daemon[773]: ts=2026-09-20T09:05:47Z level=info event=scheduler_connected addr=lb:500514828worker2 # [ 83.788900] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04829worker1 # [ 84.589760] nix-grpc-daemon[773]: ts=2026-09-20T09:05:48Z level=info event=scheduler_restarting4830worker2 # [ 84.612794] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:555804831worker2 # [ 84.613110] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:48Z level=info event=worker_gone addr=192.168.1.3:500514832worker1 # [ 84.627181] nix-grpc-daemon[773]: ts=2026-09-20T09:05:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4833worker1 # [ 84.647365] nix-grpc-daemon[773]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4834worker1 # [ 84.651030] nix-grpc-daemon[773]: E0000 00:00:1789895148.230570 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4835worker1 # [ 84.655437] nix-grpc-daemon[773]: E0000 00:00:1789895148.230789 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4836worker1 # [ 84.660523] nix-daemon[832]: reaped child process 834, status = succeeded4837worker1 # [ 86.411018] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4838worker1 # [ 86.416134] systemd[1]: Stopped Nix worker-protocol over gRPC.4839worker1 # [ 86.424848] systemd[1]: nix-grpc-daemon.service: Consumed 2.040s CPU time over 1min 6.321s wall clock time, 51.7M memory peak, 56.7K incoming IP traffic, 99.6K outgoing IP traffic.4840worker1 # [ 86.436881] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4841worker1 # [ 86.441909] systemd[1]: Closed Nix worker-protocol over gRPC.4842worker1 # [ 86.443681] systemd[1]: nix-grpc-daemon.socket: Consumed 561us CPU time over 1min 15.015s wall clock time, 260K memory peak, 94.2K incoming IP traffic, 79.5K outgoing IP traffic.4843lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4844lb: must succeed: curl -sf localhost:9901/clusters4845lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4846lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4847client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24848worker2 # [ 86.790138] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:556084849worker2 # [ 86.805814] nix-daemon[838]: accepted connection from pid 1239, user nix-grpc-daemon (trusted)4850worker2 # [ 86.838463] nix-grpc-daemon[1239]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5)4851worker2 # [ 86.877096] nix-grpc-daemon[1239]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 130 ms (attempt 2/5)4852worker2 # [ 87.007448] nix-grpc-daemon[1239]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 3/5)4853worker2 # [ 87.160329] nix-grpc-daemon[1239]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 167 ms (attempt 4/5)4854worker2 # [ 87.329309] nix-grpc-daemon[1239]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4855client # copying 2 paths...4856client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4857worker2 # [ 87.357360] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:556084858client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4859worker2 # [ 87.379364] nix-daemon[838]: accepted connection from pid 1239, user nix-grpc-daemon (trusted)4860worker2 # [ 87.410000] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:50Z level=info event=niks3_push_started pid=12954861worker2 # [ 87.798643] nix-daemon[838]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)4862worker2 # [ 87.817361] nix-daemon[838]: reaped child process 1311, status = succeeded4863lb # [ 87.825919] niks3-server[1051]: 2026/09/20 09:05:51 INFO Received uploads request method=POST path=/api/pending_closures4864lb # [ 87.835050] niks3-server[1051]: 2026/09/20 09:05:51 INFO Received uploads request method=POST path=/api/pending_closures4865worker2 # [ 87.851069] nix-grpc-daemon[1295]: time=2026-09-20T09:05:51.420Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4866worker2 # [ 87.856454] nix-grpc-daemon[1295]: time=2026-09-20T09:05:51.423Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4867worker2 # [ 87.858692] nix-grpc-daemon[1295]: time=2026-09-20T09:05:51.423Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4868lb # [ 87.884670] niks3-server[1051]: 2026/09/20 09:05:51 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4869lb # [ 87.905527] niks3-server[1051]: 2026/09/20 09:05:51 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4870lb # [ 87.916933] niks3-server[1051]: 2026/09/20 09:05:51 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4871lb # [ 87.924401] niks3-server[1051]: 2026/09/20 09:05:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4872lb # [ 87.931307] niks3-server[1051]: 2026/09/20 09:05:51 INFO Signed narinfos id=25 count=14873worker2 # [ 87.939856] nix-grpc-daemon[1295]: time=2026-09-20T09:05:51.507Z level=INFO msg="Uploading 3 narinfos"4874lb # [ 87.936443] niks3-server[1051]: 2026/09/20 09:05:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4875lb # [ 87.939591] niks3-server[1051]: 2026/09/20 09:05:51 INFO Signed narinfos id=26 count=24876lb # [ 87.948902] niks3-server[1051]: 2026/09/20 09:05:51 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4877lb # [ 87.965188] niks3-server[1051]: 2026/09/20 09:05:51 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4878lb # [ 87.973419] niks3-server[1051]: 2026/09/20 09:05:51 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4879lb # [ 87.981743] niks3-server[1051]: 2026/09/20 09:05:51 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4880worker2 # [ 87.993116] nix-grpc-daemon[1295]: time=2026-09-20T09:05:51.563Z level=INFO msg="Upload complete. (364ms)"4881lb # [ 87.988292] niks3-server[1051]: 2026/09/20 09:05:51 INFO Completed upload id=254882lb # [ 87.993311] niks3-server[1051]: 2026/09/20 09:05:51 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4883lb # [ 87.997052] niks3-server[1051]: 2026/09/20 09:05:51 INFO Completed upload id=264884worker2 # [ 88.005317] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=0 paths=2 nar_bytes_in=3124885worker2 # [ 88.022361] nix-grpc-daemon[1295]: time=2026-09-20T09:05:51.569Z level=WARN msg="Failed to register uploaded object" key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo error="server returned 404: object is not pending upload\n"4886worker2 # [ 88.030313] nix-daemon[838]: reaped child process 1293, status = succeeded4887client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.50 seconds)4888worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4889worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4890worker1 # [ 88.161206] systemd[1]: Listening on Nix worker-protocol over gRPC.4891worker1 # [ 88.170253] systemd[1]: Starting Nix worker-protocol over gRPC...4892worker1 # [ 88.373092] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4893worker1 # [ 88.375672] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14894worker1 # [ 88.386378] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4895worker1 # [ 88.391487] systemd[1]: Started Nix worker-protocol over gRPC.4896lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4897lb: must succeed: curl -sf localhost:9901/clusters4898worker1 # [ 88.437573] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500514899worker2 # [ 88.453335] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04900lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4901lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)4902(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.97 seconds)4903subtest: scheduler down: the other node takes the lock and keeps it4904lb: must succeed: curl -sf localhost:9901/clusters4905lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4906lb: must succeed: curl -sf localhost:9901/clusters4907lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4908lb: must succeed: curl -sf localhost:9901/clusters4909lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4910lb: must succeed: curl -sf localhost:9901/clusters4911lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4912worker2 # [ 88.791460] systemd[1]: Stopping Nix worker-protocol over gRPC...4913worker2 # [ 89.577886] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=signal_exit4914worker2 # [ 89.789064] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=scheduler_yield4915lb # [ 89.785332] niks3-server[1051]: 2026/09/20 09:05:53 INFO lead: released remote=192.168.1.4:388424916worker1 # [ 89.783843] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:53Z level=info event=scheduler_restarting addr=lb:500514917worker2 # [ 89.799804] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:555804918worker2 # [ 89.807474] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=worker_gone addr=192.168.1.3:500514919worker2 # [ 89.811767] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=scheduler_restarting addr=lb:500514920worker2 # [ 89.815823] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:555804921worker2 # [ 89.820562] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=worker_gone addr=192.168.1.4:500514922worker1 # [ 89.983817] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500514923worker1 # [ 89.994784] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4924worker2 # [ 90.007212] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500514925worker2 # [ 90.027084] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4926lb # [ 90.097438] envoy[904]: conn peer=[2001:db8:1::4]:38016 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10930 tx=3232 ms=611164927lb # [ 90.102568] envoy[904]: conn peer=[2001:db8:1::1]:49832 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=334928lb # [ 90.107324] envoy[904]: conn peer=[2001:db8:1::3]:40886 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=11389 tx=3108 ms=641414929lb # [ 90.112476] envoy[904]: conn peer=[2001:db8:1::1]:49846 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1009 tx=305 ms=12314930worker1 # [ 90.195877] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500514931worker1 # [ 90.203049] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4932worker2 # [ 90.233739] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500514933worker2 # [ 90.240719] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4934worker1 # [ 90.404064] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500514935worker1 # [ 90.410553] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4936worker2 # [ 90.441683] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:54Z level=info event=scheduler_connected addr=lb:500514937worker2 # [ 90.448138] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4938worker1 # [ 90.611561] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:54Z level=info event=scheduler_connected addr=lb:500514939worker1 # [ 90.618192] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4940worker2 # [ 90.657614] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:54Z level=info event=scheduler_connected addr=lb:500514941worker2 # [ 90.661735] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4942worker2 # [ 90.794109] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:54Z level=info event=scheduler_restarting4943worker2 # [ 90.823922] nix-daemon[838]: reaped child process 1288, status = succeeded4944worker1 # [ 90.821110] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:54Z level=info event=scheduler_connected addr=lb:500514945worker1 # [ 90.827237] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4946worker2 # [ 90.877094] nix-grpc-daemon[1239]: ts=2026-09-20T09:05:54Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4947worker1 # [ 91.028328] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:54Z level=info event=scheduler_connected addr=lb:500514948worker2 # [ 91.041171] nix-grpc-daemon[1239]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4949worker2 # [ 91.045849] nix-grpc-daemon[1239]: E0000 00:00:1789895154.611222 1282 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4950worker1 # [ 91.567954] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4951worker2 # [ 91.601913] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4952worker2 # [ 91.610214] systemd[1]: Stopped Nix worker-protocol over gRPC.4953worker2 # [ 91.615306] systemd[1]: nix-grpc-daemon.service: Consumed 505ms CPU time over 8.266s wall clock time, 33.6M memory peak, 17.7K incoming IP traffic, 21.9K outgoing IP traffic.4954worker2 # [ 91.629498] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4955worker2 # [ 91.631646] systemd[1]: Closed Nix worker-protocol over gRPC.4956worker2 # [ 91.635432] systemd[1]: nix-grpc-daemon.socket: Consumed 770us CPU time over 8.569s wall clock time, 256K memory peak, 27.4K incoming IP traffic, 23.7K outgoing IP traffic.4957worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4958worker1 # [ 91.769139] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500514959worker1 # [ 91.776360] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4960worker1 # [ 91.978786] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500514961worker1 # [ 91.983941] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4962worker1 # [ 92.184802] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500514963worker1 # [ 92.191513] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4964worker1 # [ 92.392543] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500514965worker1 # [ 92.397692] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4966worker1 # [ 92.598464] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500514967worker1 # [ 92.604980] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4968worker1 # [ 92.805671] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500514969worker1 # [ 92.808947] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4970worker1 # [ 93.012084] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500514971worker1 # [ 93.017030] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4972worker1 # [ 93.217783] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500514973worker1 # [ 93.222970] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4974worker1 # [ 93.397232] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:56Z level=info event=scheduler_take_over4975lb # [ 93.402672] niks3-server[1051]: 2026/09/20 09:05:57 INFO lead: acquired remote=192.168.1.3:446644976worker1 # [ 93.424080] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:57Z level=info event=scheduler_connected addr=lb:500514977worker1 # [ 93.429505] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04978worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.26 seconds)4979worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4980worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)4981client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24982worker1 # [ 94.207936] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:488144983worker1 # [ 94.222831] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)4984client # don't know how to build these paths:4985client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4986worker1 # [ 94.244312] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488144987worker1 # [ 94.263412] nix-grpc-daemon[1032]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 1/5)4988worker1 # [ 94.272248] nix-grpc-daemon[1032]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 2/5)4989worker1 # [ 94.324336] nix-grpc-daemon[1032]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 364 ms (attempt 3/5)4990worker1 # [ 94.695886] nix-grpc-daemon[1032]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 404 ms (attempt 4/5)4991worker1 # [ 95.108290] nix-grpc-daemon[1032]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4992worker1 # [ 95.141935] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:58Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04993worker1 # [ 95.149098] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:58Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14994worker1 # [ 95.190525] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488144995worker1 # [ 95.206041] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488144996client # copying 1 paths to 'lb:50051'...4997worker1 # [ 95.221146] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488144998client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4999worker1 # [ 95.240086] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5000worker1 # [ 95.268795] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:58Z level=info event=niks3_push_started pid=11135001worker1 # [ 95.669261] nix-daemon[832]: accepted connection from pid 1126, user nix-grpc-daemon (trusted)5002worker1 # [ 95.691549] nix-daemon[832]: reaped child process 1129, status = succeeded5003worker1 # [ 95.872730] nix-daemon[832]: accepted connection from pid 1131, user nix-grpc-daemon (trusted)5004worker1 # [ 95.892802] nix-daemon[832]: reaped child process 1134, status = succeeded5005lb # [ 95.910415] niks3-server[1051]: 2026/09/20 09:05:59 INFO Received uploads request method=POST path=/api/pending_closures5006worker1 # [ 95.916452] nix-grpc-daemon[1113]: time=2026-09-20T09:05:59.498Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5007worker1 # [ 95.917954] nix-grpc-daemon[1113]: time=2026-09-20T09:05:59.499Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5008lb # [ 95.948716] niks3-server[1051]: 2026/09/20 09:05:59 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5009worker1 # [ 95.958306] nix-grpc-daemon[1113]: time=2026-09-20T09:05:59.541Z level=INFO msg="Uploading 1 narinfos"5010lb # [ 95.962008] niks3-server[1051]: 2026/09/20 09:05:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5011lb # [ 95.973740] niks3-server[1051]: 2026/09/20 09:05:59 INFO Signed narinfos id=27 count=15012lb # [ 95.980120] niks3-server[1051]: 2026/09/20 09:05:59 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5013lb # [ 95.990437] niks3-server[1051]: 2026/09/20 09:05:59 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5014worker1 # [ 95.992622] nix-grpc-daemon[1113]: time=2026-09-20T09:05:59.576Z level=INFO msg="Upload complete. (494ms)"5015lb # [ 95.999032] niks3-server[1051]: 2026/09/20 09:05:59 INFO Completed upload id=275016lb # [ 96.002809] niks3-server[1051]: 2026/09/20 09:05:59 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5017worker1 # [ 96.000138] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48814 duration_s=0 paths=1 nar_bytes_in=5205018worker1 # [ 96.016351] nix-grpc-daemon[1032]: ts=2026-09-20T09:05:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488145019worker1 # [ 96.022482] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5020worker1 # [ 96.027530] nix-daemon[832]: reaped child process 1111, status = succeeded5021client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5022worker1 # [ 96.039152] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5023client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5024client # farm-a> LOG-farm-a-on-standby5025worker1 # [ 97.285407] nix-daemon[832]: reaped child process 1138, status = succeeded5026worker1 # [ 97.481097] nix-daemon[832]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)5027worker1 # [ 97.498642] nix-daemon[832]: reaped child process 1156, status = succeeded5028lb # [ 97.517688] niks3-server[1051]: 2026/09/20 09:06:01 INFO Received uploads request method=POST path=/api/pending_closures5029worker1 # [ 97.524414] nix-grpc-daemon[1113]: time=2026-09-20T09:06:01.106Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5030worker1 # [ 97.525949] nix-grpc-daemon[1113]: time=2026-09-20T09:06:01.106Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5031lb # [ 97.556616] niks3-server[1051]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5032lb # [ 97.569446] niks3-server[1051]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5033worker1 # [ 97.583266] nix-grpc-daemon[1113]: time=2026-09-20T09:06:01.165Z level=INFO msg="Uploading 1 narinfos"5034lb # [ 97.586522] niks3-server[1051]: 2026/09/20 09:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5035lb # [ 97.597586] niks3-server[1051]: 2026/09/20 09:06:01 INFO Signed narinfos id=28 count=15036lb # [ 97.603586] niks3-server[1051]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5037lb # [ 97.613434] niks3-server[1051]: 2026/09/20 09:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5038lb # [ 97.621187] niks3-server[1051]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5039lb # [ 97.626721] niks3-server[1051]: 2026/09/20 09:06:01 INFO Completed upload id=285040worker1 # [ 97.621130] nix-grpc-daemon[1113]: time=2026-09-20T09:06:01.204Z level=INFO msg="Upload complete. (367ms)"5041worker1 # [ 97.645802] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48814 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15042worker1 # [ 97.661592] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:01Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05043worker1 # [ 97.665514] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:01Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15044worker1 # [ 97.669292] nix-daemon[832]: reaped child process 1136, status = succeeded5045worker1 # [ 97.691918] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488145046worker1 # [ 97.708162] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488145047worker1 # [ 97.722536] nix-grpc-daemon[1113]: time=2026-09-20T09:06:01.306Z level=INFO msg="All 1 paths already cached"5048client # copying 1 paths to 'lb:50051'...5049worker1 # [ 97.731524] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488145050client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5051worker1 # [ 97.750262] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5052worker1 # [ 97.953646] nix-daemon[832]: accepted connection from pid 1162, user nix-grpc-daemon (trusted)5053worker1 # [ 97.974362] nix-daemon[832]: reaped child process 1165, status = succeeded5054worker1 # [ 98.158110] nix-daemon[832]: accepted connection from pid 1167, user nix-grpc-daemon (trusted)5055worker1 # [ 98.175899] nix-daemon[832]: reaped child process 1170, status = succeeded5056lb # [ 98.192380] niks3-server[1051]: 2026/09/20 09:06:01 INFO Received uploads request method=POST path=/api/pending_closures5057worker1 # [ 98.197320] nix-grpc-daemon[1113]: time=2026-09-20T09:06:01.780Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5058worker1 # [ 98.198869] nix-grpc-daemon[1113]: time=2026-09-20T09:06:01.780Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5059lb # [ 98.219636] niks3-server[1051]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5060worker1 # [ 98.234373] nix-grpc-daemon[1113]: time=2026-09-20T09:06:01.817Z level=INFO msg="Uploading 1 narinfos"5061lb # [ 98.233281] niks3-server[1051]: 2026/09/20 09:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5062lb # [ 98.246148] niks3-server[1051]: 2026/09/20 09:06:01 INFO Signed narinfos id=29 count=15063lb # [ 98.252312] niks3-server[1051]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5064lb # [ 98.263778] niks3-server[1051]: 2026/09/20 09:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5065lb # [ 98.267899] niks3-server[1051]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5066worker1 # [ 98.267779] nix-grpc-daemon[1113]: time=2026-09-20T09:06:01.851Z level=INFO msg="Upload complete. (499ms)"5067lb # [ 98.273380] niks3-server[1051]: 2026/09/20 09:06:01 INFO Completed upload id=295068worker1 # [ 98.275480] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48814 duration_s=0 paths=1 nar_bytes_in=6405069worker1 # [ 98.284690] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488145070worker1 # [ 98.295558] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5071worker1 # [ 98.300893] nix-daemon[832]: reaped child process 1160, status = succeeded5072client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5073client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5074worker1 # [ 98.313049] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5075client # farm-b> LOG-farm-b-on-standby5076worker1 # [ 99.761995] nix-daemon[832]: reaped child process 1174, status = succeeded5077worker1 # [ 99.945736] nix-daemon[832]: accepted connection from pid 1189, user nix-grpc-daemon (trusted)5078worker1 # [ 99.963180] nix-daemon[832]: reaped child process 1192, status = succeeded5079lb # [ 99.981409] niks3-server[1051]: 2026/09/20 09:06:03 INFO Received uploads request method=POST path=/api/pending_closures5080worker1 # [ 99.989701] nix-grpc-daemon[1113]: time=2026-09-20T09:06:03.572Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5081worker1 # [ 99.991313] nix-grpc-daemon[1113]: time=2026-09-20T09:06:03.572Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5082lb # [ 100.018392] niks3-server[1051]: 2026/09/20 09:06:03 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5083lb # [ 100.030638] niks3-server[1051]: 2026/09/20 09:06:03 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5084worker1 # [ 100.036848] nix-grpc-daemon[1113]: time=2026-09-20T09:06:03.620Z level=INFO msg="Uploading 1 narinfos"5085lb # [ 100.043475] niks3-server[1051]: 2026/09/20 09:06:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5086lb # [ 100.051084] niks3-server[1051]: 2026/09/20 09:06:03 INFO Signed narinfos id=30 count=15087lb # [ 100.054141] niks3-server[1051]: 2026/09/20 09:06:03 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5088lb # [ 100.061105] niks3-server[1051]: 2026/09/20 09:06:03 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5089lb # [ 100.065680] niks3-server[1051]: 2026/09/20 09:06:03 INFO Completed upload id=305090worker1 # [ 100.060736] nix-grpc-daemon[1113]: time=2026-09-20T09:06:03.644Z level=INFO msg="Upload complete. (336ms)"5091lb # [ 100.067651] niks3-server[1051]: 2026/09/20 09:06:03 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5092worker1 # [ 100.080891] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48814 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15093worker1 # [ 100.092445] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:03Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05094lb # [ 100.098184] envoy[904]: conn peer=[2001:db8:1::4]:41806 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1003 tx=339 ms=72515095worker1 # [ 100.095853] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:03Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15096worker1 # [ 100.100882] nix-daemon[832]: reaped child process 1172, status = succeeded5097worker1 # [ 100.121203] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488145098worker1 # [ 100.136261] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488145099worker1 # [ 100.150611] nix-grpc-daemon[1113]: time=2026-09-20T09:06:03.734Z level=INFO msg="All 2 paths already cached"5100client # copying 1 paths to 'lb:50051'...5101client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5102worker1 # [ 100.161056] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488145103worker1 # [ 100.175470] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5104worker1 # [ 100.370971] nix-daemon[832]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)5105worker1 # [ 100.390616] nix-daemon[832]: reaped child process 1201, status = succeeded5106worker1 # [ 100.564052] nix-daemon[832]: accepted connection from pid 1203, user nix-grpc-daemon (trusted)5107worker1 # [ 100.580475] nix-daemon[832]: reaped child process 1206, status = succeeded5108lb # [ 100.598173] niks3-server[1051]: 2026/09/20 09:06:04 INFO Received uploads request method=POST path=/api/pending_closures5109worker1 # [ 100.602260] nix-grpc-daemon[1113]: time=2026-09-20T09:06:04.185Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5110worker1 # [ 100.604227] nix-grpc-daemon[1113]: time=2026-09-20T09:06:04.185Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5111lb # [ 100.623337] niks3-server[1051]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5112lb # [ 100.638689] niks3-server[1051]: 2026/09/20 09:06:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5113worker1 # [ 100.640903] nix-grpc-daemon[1113]: time=2026-09-20T09:06:04.224Z level=INFO msg="Uploading 1 narinfos"5114lb # [ 100.654209] niks3-server[1051]: 2026/09/20 09:06:04 INFO Signed narinfos id=31 count=15115lb # [ 100.659612] niks3-server[1051]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5116lb # [ 100.668273] niks3-server[1051]: 2026/09/20 09:06:04 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5117worker1 # [ 100.668120] nix-grpc-daemon[1113]: time=2026-09-20T09:06:04.251Z level=INFO msg="Upload complete. (476ms)"5118lb # [ 100.673124] niks3-server[1051]: 2026/09/20 09:06:04 INFO Completed upload id=315119lb # [ 100.676226] niks3-server[1051]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5120worker1 # [ 100.676174] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48814 duration_s=0 paths=1 nar_bytes_in=7685121worker1 # [ 100.688399] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488145122worker1 # [ 100.694678] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5123worker1 # [ 100.699328] nix-daemon[832]: reaped child process 1196, status = succeeded5124client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5125client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5126worker1 # [ 100.712880] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5127worker1 # [ 101.934005] nix-daemon[832]: reaped child process 1210, status = succeeded5128client # farm-top> LOG-farm-top-on-standby5129worker1 # [ 102.092168] nix-daemon[832]: accepted connection from pid 1225, user nix-grpc-daemon (trusted)5130worker1 # [ 102.111888] nix-daemon[832]: reaped child process 1228, status = succeeded5131lb # [ 102.129881] niks3-server[1051]: 2026/09/20 09:06:05 INFO Received uploads request method=POST path=/api/pending_closures5132worker1 # [ 102.138920] nix-grpc-daemon[1113]: time=2026-09-20T09:06:05.720Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5133worker1 # [ 102.140571] nix-grpc-daemon[1113]: time=2026-09-20T09:06:05.720Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5134lb # [ 102.158596] niks3-server[1051]: 2026/09/20 09:06:05 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5135lb # [ 102.174657] niks3-server[1051]: 2026/09/20 09:06:05 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5136lb # [ 102.192211] niks3-server[1051]: 2026/09/20 09:06:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5137worker1 # [ 102.192814] nix-grpc-daemon[1113]: time=2026-09-20T09:06:05.776Z level=INFO msg="Uploading 1 narinfos"5138lb # [ 102.200760] niks3-server[1051]: 2026/09/20 09:06:05 INFO Signed narinfos id=32 count=15139lb # [ 102.203040] niks3-server[1051]: 2026/09/20 09:06:05 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5140lb # [ 102.213032] niks3-server[1051]: 2026/09/20 09:06:05 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5141lb # [ 102.219865] niks3-server[1051]: 2026/09/20 09:06:05 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5142lb # [ 102.223880] niks3-server[1051]: 2026/09/20 09:06:05 INFO Completed upload id=325143worker1 # [ 102.219241] nix-grpc-daemon[1113]: time=2026-09-20T09:06:05.802Z level=INFO msg="Upload complete. (296ms)"5144worker1 # [ 102.233066] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48814 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15145worker1 # [ 102.244835] nix-daemon[832]: reaped child process 1208, status = succeeded5146client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.33 seconds)5147client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5148client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds)5149worker2 # [ 102.609124] systemd[1]: Listening on Nix worker-protocol over gRPC.5150worker2 # [ 102.616623] systemd[1]: Starting Nix worker-protocol over gRPC...5151worker2 # [ 102.815451] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5152worker2 # [ 102.817937] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15153worker2 # [ 102.825297] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5154worker2 # [ 102.827005] systemd[1]: Started Nix worker-protocol over gRPC.5155lb: must succeed: curl -sf localhost:9901/clusters5156worker2 # [ 102.871716] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:06Z level=info event=scheduler_connected addr=lb:500515157worker1 # [ 102.863412] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05158lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5159worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5160worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5161lb: must succeed: curl -sf localhost:9901/clusters5162lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5163lb: must succeed: curl -sf localhost:9901/clusters5164lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5165worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5166worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5167(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.71 seconds)5168subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5169client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5170client # [ 103.294353] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5171client # Running as unit: rs.service; invocation ID: 659e30f4a4a0438a9cdf74f13368e80b5172client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds)5173worker2 # [ 103.543359] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:537325174worker2 # [ 103.554985] nix-daemon[838]: accepted connection from pid 1332, user nix-grpc-daemon (trusted)5175client # [ 103.558119] nix[1172]: don't know how to build these paths:5176client # [ 103.559384] nix[1172]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5177worker1 # [ 103.579522] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:07Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05178worker1 # [ 103.579831] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:07Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15179worker1 # [ 103.624561] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488145180worker1 # [ 103.639229] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488145181client # [ 103.645006] nix[1172]: copying 1 paths to 'lb:50051'...5182client # [ 103.649575] nix[1172]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5183worker1 # [ 103.657123] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488145184worker1 # [ 103.672925] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5185worker1 # [ 103.872485] nix-daemon[832]: accepted connection from pid 1243, user nix-grpc-daemon (trusted)5186worker1 # [ 103.891657] nix-daemon[832]: reaped child process 1246, status = succeeded5187worker1 # [ 104.062568] nix-daemon[832]: accepted connection from pid 1248, user nix-grpc-daemon (trusted)5188worker1 # [ 104.081658] nix-daemon[832]: reaped child process 1251, status = succeeded5189lb # [ 104.102173] niks3-server[1051]: 2026/09/20 09:06:07 INFO Received uploads request method=POST path=/api/pending_closures5190worker1 # [ 104.106185] nix-grpc-daemon[1113]: time=2026-09-20T09:06:07.689Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5191worker1 # [ 104.107702] nix-grpc-daemon[1113]: time=2026-09-20T09:06:07.689Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5192lb # [ 104.128562] niks3-server[1051]: 2026/09/20 09:06:07 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5193lb # [ 104.142243] niks3-server[1051]: 2026/09/20 09:06:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5194worker1 # [ 104.143780] nix-grpc-daemon[1113]: time=2026-09-20T09:06:07.727Z level=INFO msg="Uploading 1 narinfos"5195lb # [ 104.153218] niks3-server[1051]: 2026/09/20 09:06:07 INFO Signed narinfos id=33 count=15196lb # [ 104.159427] niks3-server[1051]: 2026/09/20 09:06:07 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5197lb # [ 104.166386] niks3-server[1051]: 2026/09/20 09:06:07 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5198lb # [ 104.172139] niks3-server[1051]: 2026/09/20 09:06:07 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5199lb # [ 104.177315] niks3-server[1051]: 2026/09/20 09:06:07 INFO Completed upload id=335200worker1 # [ 104.172863] nix-grpc-daemon[1113]: time=2026-09-20T09:06:07.756Z level=INFO msg="Upload complete. (484ms)"5201worker1 # [ 104.180725] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48814 duration_s=0 paths=1 nar_bytes_in=4165202worker1 # [ 104.188637] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488145203worker1 # [ 104.199318] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5204worker1 # [ 104.203674] nix-daemon[832]: reaped child process 1241, status = succeeded5205client # [ 104.206393] nix[1172]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5206worker1 # [ 104.216246] nix-daemon[832]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5207lb: must succeed: curl -sf localhost:9901/clusters5208lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5209lb: must succeed: curl -sf localhost:9901/clusters5210lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5211lb: must succeed: curl -sf localhost:9901/clusters5212lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5213lb: must succeed: curl -sf localhost:9901/clusters5214lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5215worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5216worker2 # [ 106.281488] systemd-journald[275]: Received client request to rotate journal, rotating.5217worker2 # [ 106.307617] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/55a2bcc8360449e994ad2769f53ae7f6.5218worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5219worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5220worker1 # [ 106.345997] systemd[1]: Stopping Nix worker-protocol over gRPC...5221worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5222??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5223 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735224client: must succeed: sleep 5.05225worker1 # [ 106.396998] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:09Z level=info event=draining5226lb # [ 110.097019] envoy[904]: conn peer=[2001:db8:1::1]:51630 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9623 tx=3878 ms=80415227client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5228worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5229worker1 # [ 111.874781] nix-daemon[832]: reaped child process 1255, status = succeeded5230worker1 # [ 112.058906] nix-daemon[832]: accepted connection from pid 1295, user nix-grpc-daemon (trusted)5231worker1 # [ 112.076956] nix-daemon[832]: reaped child process 1298, status = succeeded5232lb # [ 112.093382] niks3-server[1051]: 2026/09/20 09:06:15 INFO Received uploads request method=POST path=/api/pending_closures5233worker1 # [ 112.100454] nix-grpc-daemon[1113]: time=2026-09-20T09:06:15.683Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5234worker1 # [ 112.102164] nix-grpc-daemon[1113]: time=2026-09-20T09:06:15.683Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5235lb # [ 112.130054] niks3-server[1051]: 2026/09/20 09:06:15 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5236lb # [ 112.147306] niks3-server[1051]: 2026/09/20 09:06:15 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5237worker1 # [ 112.165871] nix-grpc-daemon[1113]: time=2026-09-20T09:06:15.749Z level=INFO msg="Uploading 1 narinfos"5238lb # [ 112.160993] niks3-server[1051]: 2026/09/20 09:06:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5239lb # [ 112.176331] niks3-server[1051]: 2026/09/20 09:06:15 INFO Signed narinfos id=34 count=15240lb # [ 112.178820] niks3-server[1051]: 2026/09/20 09:06:15 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5241lb # [ 112.186819] niks3-server[1051]: 2026/09/20 09:06:15 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5242lb # [ 112.194506] niks3-server[1051]: 2026/09/20 09:06:15 INFO Completed upload id=345243lb # [ 112.199380] niks3-server[1051]: 2026/09/20 09:06:15 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5244worker1 # [ 112.187597] nix-grpc-daemon[1113]: time=2026-09-20T09:06:15.771Z level=INFO msg="Upload complete. (350ms)"5245worker1 # [ 112.205276] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48814 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15246worker1 # [ 112.221794] nix-daemon[832]: reaped child process 1253, status = succeeded5247client # [ 112.238904] systemd[1]: rs.service: Deactivated successfully.5248client # [ 112.244241] systemd[1]: rs.service: Consumed 149ms CPU time over 8.948s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5249worker1 # [ 112.398217] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:15Z level=info event=signal_exit5250worker1 # [ 112.617751] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=scheduler_yield5251lb # [ 112.624239] niks3-server[1051]: 2026/09/20 09:06:16 INFO lead: released remote=192.168.1.3:446645252worker1 # [ 112.625271] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=scheduler_restarting addr=lb:500515253worker2 # [ 112.637262] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:16Z level=info event=scheduler_restarting addr=lb:500515254worker1 # [ 112.631227] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:465985255worker1 # [ 112.636517] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=worker_gone addr=192.168.1.3:500515256worker1 # [ 112.640536] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:465985257worker1 # [ 112.644968] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=worker_gone addr=192.168.1.4:500515258worker1 # [ 112.826528] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=scheduler_connected addr=lb:500515259worker2 # [ 112.838131] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:16Z level=info event=scheduler_connected addr=lb:500515260lb # [ 112.835049] niks3-server[1051]: 2026/09/20 09:06:16 INFO lead: acquired remote=192.168.1.4:475785261worker2 # [ 112.844291] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:16Z level=info event=scheduler_take_over5262worker2 # [ 112.855860] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05263worker1 # [ 112.851252] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5264worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.14 seconds)5265client: waiting for success: ! systemctl is-active rs5266client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5267client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5268client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5269client: must fail: journalctl -u rs | grep -q 'reconnecting'5270client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5271lb: must succeed: curl -sf localhost:9901/clusters5272worker1 # [ 113.052340] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=scheduler_connected addr=lb:500515273worker1 # [ 113.059246] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5274lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5275worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5276worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5277worker1 # [ 113.261626] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:16Z level=info event=scheduler_connected addr=lb:500515278worker2 # [ 113.273784] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=0 running=05279worker1 # [ 113.623284] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:17Z level=info event=scheduler_restarting5280worker2 # [ 113.644639] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:17Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:586245281worker2 # [ 113.649281] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:17Z level=info event=worker_gone addr=192.168.1.3:500515282worker1 # [ 113.660452] nix-grpc-daemon[1032]: ts=2026-09-20T09:06:17Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5283worker1 # [ 113.678698] nix-daemon[832]: reaped child process 1104, status = succeeded5284lb: must succeed: curl -sf localhost:9901/clusters5285lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5286worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5287worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5288worker1 # [ 114.458743] nix-grpc-daemon[1032]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5289worker1 # [ 114.463294] nix-grpc-daemon[1032]: E0000 00:00:1789895178.040905 1075 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5290worker1 # [ 114.469763] nix-grpc-daemon[1032]: E0000 00:00:1789895178.041171 1075 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5291worker1 # [ 115.061120] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5292worker1 # [ 115.068462] systemd[1]: Stopped Nix worker-protocol over gRPC.5293worker1 # [ 115.071044] systemd[1]: nix-grpc-daemon.service: Consumed 1.870s CPU time over 26.896s wall clock time, 36.4M memory peak, 45.8K incoming IP traffic, 84.6K outgoing IP traffic.5294worker1 # [ 115.091257] systemd[1]: Starting Nix worker-protocol over gRPC...5295worker1 # [ 115.289990] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5296worker1 # [ 115.292468] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15297worker1 # [ 115.299957] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5298worker1 # [ 115.305678] systemd[1]: Started Nix worker-protocol over gRPC.5299worker1 # [ 115.336257] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:18Z level=info event=scheduler_connected addr=lb:500515300worker2 # [ 115.350224] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05301lb: must succeed: curl -sf localhost:9901/clusters5302lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5303worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5304worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5305(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.31 seconds)5306subtest: scheduler restart mid-build: build finishes, no double build5307client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5308client # [ 115.603245] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5309client # Running as unit: mid.service; invocation ID: d643ec6250434bc5bfd574eb13b9598e5310client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5311worker2 # [ 115.856518] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:537325312client # [ 115.847951] nix[1208]: don't know how to build these paths:5313client # [ 115.849189] nix[1208]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5314worker2 # [ 115.875272] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:19Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05315worker2 # [ 115.881906] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:19Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15316worker2 # [ 115.922278] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537325317worker2 # [ 115.939652] nix-grpc-daemon[1332]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 1/5)5318worker2 # [ 116.038362] nix-grpc-daemon[1332]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 2/5)5319worker2 # [ 116.101824] nix-grpc-daemon[1332]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 251 ms (attempt 3/5)5320worker2 # [ 116.361458] nix-grpc-daemon[1332]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 577 ms (attempt 4/5)5321worker2 # [ 116.938546] nix-grpc-daemon[1332]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5322worker2 # [ 116.962415] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:537325323client # [ 116.956925] nix[1208]: copying 1 paths to 'lb:50051'...5324worker2 # [ 116.972597] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:537325325client # [ 116.957172] nix[1208]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5326worker2 # [ 116.989552] nix-daemon[838]: accepted connection from pid 1332, user nix-grpc-daemon (trusted)5327worker2 # [ 117.014479] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:20Z level=info event=niks3_push_started pid=14595328worker2 # [ 117.388059] nix-daemon[838]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)5329worker2 # [ 117.405634] nix-daemon[838]: reaped child process 1475, status = succeeded5330worker2 # [ 117.582743] nix-daemon[838]: accepted connection from pid 1477, user nix-grpc-daemon (trusted)5331worker2 # [ 117.599582] nix-daemon[838]: reaped child process 1480, status = succeeded5332lb # [ 117.605255] niks3-server[1051]: 2026/09/20 09:06:21 INFO Received uploads request method=POST path=/api/pending_closures5333worker2 # [ 117.621713] nix-grpc-daemon[1459]: time=2026-09-20T09:06:21.191Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5334worker2 # [ 117.624812] nix-grpc-daemon[1459]: time=2026-09-20T09:06:21.193Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5335lb # [ 117.647784] niks3-server[1051]: 2026/09/20 09:06:21 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5336worker2 # [ 117.663749] nix-grpc-daemon[1459]: time=2026-09-20T09:06:21.233Z level=INFO msg="Uploading 1 narinfos"5337lb # [ 117.660175] niks3-server[1051]: 2026/09/20 09:06:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5338lb # [ 117.670959] niks3-server[1051]: 2026/09/20 09:06:21 INFO Signed narinfos id=35 count=15339lb # [ 117.680010] niks3-server[1051]: 2026/09/20 09:06:21 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5340lb # [ 117.683240] niks3-server[1051]: 2026/09/20 09:06:21 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5341worker2 # [ 117.695664] nix-grpc-daemon[1459]: time=2026-09-20T09:06:21.265Z level=INFO msg="Upload complete. (483ms)"5342lb # [ 117.695311] niks3-server[1051]: 2026/09/20 09:06:21 INFO Completed upload id=355343worker2 # [ 117.705268] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53732 duration_s=0 paths=1 nar_bytes_in=4245344worker2 # [ 117.714571] nix-grpc-daemon[1332]: ts=2026-09-20T09:06:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:537325345worker2 # [ 117.717597] nix-grpc-daemon[1459]: time=2026-09-20T09:06:21.279Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n"5346worker2 # [ 117.726538] nix-daemon[838]: accepted connection from pid 1332, user nix-grpc-daemon (trusted)5347worker2 # [ 117.729316] nix-daemon[838]: reaped child process 1457, status = succeeded5348worker2 # [ 117.737877] nix-daemon[838]: accepted connection from pid 1332, user nix-grpc-daemon (trusted)5349client # [ 117.719870] nix[1208]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5350lb: must succeed: curl -sf localhost:9901/clusters5351lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5352lb: must succeed: curl -sf localhost:9901/clusters5353lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5354worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5355worker2 # [ 119.698788] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1332 (nix-grpc-daemon) on client request.5356worker2 # [ 119.701317] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5357lb # [ 119.697240] niks3-server[1051]: 2026/09/20 09:06:23 INFO lead: released remote=192.168.1.4:475785358client # [ 119.684740] nix[1208]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5359worker1 # [ 119.690777] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5360client # [ 119.690985] nix[1208]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5361worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5362client: must succeed: sleep 5.05363worker2 # [ 119.737686] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5364worker2 # [ 119.739198] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5365worker2 # [ 119.746449] systemd[1]: nix-grpc-daemon.service: Consumed 536ms CPU time over 17.118s wall clock time, 33.7M memory peak, 13.6K incoming IP traffic, 21K outgoing IP traffic.5366worker2 # [ 119.753421] nix-daemon[838]: reaped child process 1390, status = succeeded5367worker2 # [ 119.755131] nix-daemon[838]: reaped child process 1482, status = succeeded5368worker2 # [ 119.764416] nix-daemon[1484]: unexpected Nix daemon error: error: interrupted by the user5369worker2 # [ 119.769270] nix-daemon[838]: reaped child process 1484, status = failed with exit code 15370worker2 # [ 119.881234] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5371worker2 # [ 119.892998] systemd[1]: Starting Nix worker-protocol over gRPC...5372worker1 # [ 119.891182] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500515373worker2 # [ 120.098440] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5374worker2 # [ 120.100835] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15375lb # [ 120.097749] envoy[904]: conn peer=[2001:db8:1::1]:40558 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1350 ms=86865376worker2 # [ 120.108070] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5377worker2 # [ 120.109826] systemd[1]: Started Nix worker-protocol over gRPC.5378lb # [ 120.102835] envoy[904]: conn peer=[2001:db8:1::3]:55778 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3770 tx=1240 ms=252125379lb # [ 120.107926] envoy[904]: conn peer=[2001:db8:1::4]:53596 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=656 tx=311 ms=168375380worker2 # [ 120.129484] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:23Z level=info event=scheduler_take_over5381lb # [ 120.123040] niks3-server[1051]: 2026/09/20 09:06:23 INFO lead: acquired remote=192.168.1.4:420125382worker2 # [ 120.141262] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05383worker2 # [ 120.156165] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500515384worker2 # [ 120.157968] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05385worker2 # [ 120.209547] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:23Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05386worker2 # [ 120.212811] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:23Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15387worker1 # [ 120.257991] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369505388worker1 # [ 120.272343] nix-daemon[832]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5389worker1 # [ 120.296748] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 1/5)5390worker1 # [ 120.371568] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 2/5)5391worker1 # [ 120.522269] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 250 ms (attempt 3/5)5392worker1 # [ 120.781045] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 431 ms (attempt 4/5)5393worker1 # [ 121.220182] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5394worker1 # [ 121.241457] nix-grpc-daemon[1305]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5395worker1 # [ 121.270107] nix-daemon[832]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5396client # [ 121.281407] nix[1208]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5397worker1 # [ 121.293160] nix-daemon[832]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5398client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5399client: waiting for success: ! systemctl is-active mid5400worker1 # [ 125.124783] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:28Z level=info event=niks3_push_started pid=14065401worker1 # [ 125.157826] nix-daemon[832]: reaped child process 1382, status = succeeded5402worker1 # [ 125.519730] nix-daemon[832]: accepted connection from pid 1419, user nix-grpc-daemon (trusted)5403worker1 # [ 125.540139] nix-daemon[832]: reaped child process 1422, status = succeeded5404lb # [ 125.558420] niks3-server[1051]: 2026/09/20 09:06:29 INFO Received uploads request method=POST path=/api/pending_closures5405worker1 # [ 125.566872] nix-grpc-daemon[1406]: time=2026-09-20T09:06:29.147Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5406worker1 # [ 125.570026] nix-grpc-daemon[1406]: time=2026-09-20T09:06:29.147Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5407lb # [ 125.607965] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5408lb # [ 125.620345] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5409lb # [ 125.631033] niks3-server[1051]: 2026/09/20 09:06:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5410lb # [ 125.643360] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5411lb # [ 125.656211] niks3-server[1051]: 2026/09/20 09:06:29 INFO Signed narinfos id=36 count=15412worker1 # [ 125.652156] nix-grpc-daemon[1406]: time=2026-09-20T09:06:29.235Z level=INFO msg="Uploading 1 narinfos"5413lb # [ 125.669151] niks3-server[1051]: 2026/09/20 09:06:29 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5414lb # [ 125.680827] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5415lb # [ 125.690381] niks3-server[1051]: 2026/09/20 09:06:29 INFO Completed upload id=365416worker1 # [ 125.686303] nix-grpc-daemon[1406]: time=2026-09-20T09:06:29.269Z level=INFO msg="Upload complete. (337ms)"5417worker1 # [ 125.700504] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36950 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15418worker1 # [ 125.718133] nix-daemon[832]: reaped child process 1380, status = succeeded5419client # [ 125.734289] systemd[1]: mid.service: Deactivated successfully.5420client # [ 125.738446] systemd[1]: mid.service: Consumed 165ms CPU time over 10.135s wall clock time, 37M memory peak, 9.7K incoming IP traffic, 10.6K outgoing IP traffic.5421client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5422client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5423client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5424(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.74 seconds)5425subtest: interrupting the client stops the build on the worker5426client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5427client # [ 126.313681] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5428client # Running as unit: intr.service; invocation ID: 06fd3d8b3a08413c8ff6d2f117a8cc235429client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds)5430worker1 # [ 126.542434] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:369505431client # [ 126.544453] nix[1244]: don't know how to build these paths:5432client # [ 126.545406] nix[1244]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5433worker2 # [ 126.575512] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:30Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05434worker2 # [ 126.575848] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:30Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15435worker2 # [ 126.633848] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552425436worker2 # [ 126.648634] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5437worker2 # [ 126.671494] nix-grpc-daemon[1520]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5)5438worker2 # [ 126.723881] nix-grpc-daemon[1520]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 106 ms (attempt 2/5)5439worker2 # [ 126.830481] nix-grpc-daemon[1520]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 347 ms (attempt 3/5)5440worker2 # [ 127.177992] nix-grpc-daemon[1520]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 544 ms (attempt 4/5)5441worker2 # [ 127.723900] nix-grpc-daemon[1520]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5442worker2 # [ 127.746732] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552425443client # [ 127.745494] nix[1244]: copying 1 paths to 'lb:50051'...5444worker2 # [ 127.763025] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552425445client # [ 127.749187] nix[1244]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5446worker2 # [ 127.782386] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5447worker2 # [ 127.810899] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:31Z level=info event=niks3_push_started pid=15965448worker2 # [ 128.197067] nix-daemon[838]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5449worker2 # [ 128.215115] nix-daemon[838]: reaped child process 1612, status = succeeded5450worker2 # [ 128.389654] nix-daemon[838]: accepted connection from pid 1614, user nix-grpc-daemon (trusted)5451worker2 # [ 128.406888] nix-daemon[838]: reaped child process 1617, status = succeeded5452lb # [ 128.413265] niks3-server[1051]: 2026/09/20 09:06:32 INFO Received uploads request method=POST path=/api/pending_closures5453worker2 # [ 128.432456] nix-grpc-daemon[1596]: time=2026-09-20T09:06:32.001Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5454worker2 # [ 128.433911] nix-grpc-daemon[1596]: time=2026-09-20T09:06:32.001Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5455lb # [ 128.454122] niks3-server[1051]: 2026/09/20 09:06:32 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5456worker2 # [ 128.473630] nix-grpc-daemon[1596]: time=2026-09-20T09:06:32.043Z level=INFO msg="Uploading 1 narinfos"5457lb # [ 128.466749] niks3-server[1051]: 2026/09/20 09:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5458lb # [ 128.475729] niks3-server[1051]: 2026/09/20 09:06:32 INFO Signed narinfos id=37 count=15459lb # [ 128.485411] niks3-server[1051]: 2026/09/20 09:06:32 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5460lb # [ 128.500191] niks3-server[1051]: 2026/09/20 09:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5461lb # [ 128.509228] niks3-server[1051]: 2026/09/20 09:06:32 INFO Completed upload id=375462worker2 # [ 128.515447] nix-grpc-daemon[1596]: time=2026-09-20T09:06:32.085Z level=INFO msg="Upload complete. (493ms)"5463lb # [ 128.512643] niks3-server[1051]: 2026/09/20 09:06:32 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5464worker2 # [ 128.524289] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=0 paths=1 nar_bytes_in=4245465worker2 # [ 128.540489] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552425466worker2 # [ 128.547184] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5467worker2 # [ 128.553390] nix-daemon[838]: reaped child process 1594, status = succeeded5468client # [ 128.546692] nix[1244]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5469worker2 # [ 128.568178] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5470client: must succeed: systemctl kill -s INT intr5471client # [ 130.032901] systemd[1]: intr.service: Sent signal SIGINT to main process 1244 (nix) on client request.5472worker2 # [ 130.059656] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:33Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5473client # [ 130.041959] nix[1244]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5474client # [ 130.049182] nix[1244]: error: interrupted by the user5475client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5476client # [ 130.080719] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5477client # [ 130.085457] systemd[1]: intr.service: Failed with result 'exit-code'.5478client # [ 130.087762] systemd[1]: intr.service: Consumed 144ms CPU time over 3.770s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5479lb # [ 130.098160] envoy[904]: conn peer=[2001:db8:1::1]:41670 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3854 tx=1657 ms=98675480lb # [ 130.103651] envoy[904]: conn peer=[2001:db8:1::1]:40316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=756 ms=35295481worker2 # [ 130.208242] nix-daemon[1621]: unexpected Nix daemon error: error: interrupted by the user5482worker2 # [ 130.220099] nix-daemon[838]: reaped child process 1619, status = succeeded5483worker2 # [ 130.223586] nix-daemon[838]: reaped child process 1621, status = failed with exit code 15484(finished: subtest: interrupting the client stops the build on the worker, in 3.93 seconds)5485subtest: a deploy mid-build drains: the build finishes, the new generation takes over5486client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5487client # [ 130.278175] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5488client # Running as unit: sw.service; invocation ID: 3feabbe103f24009b46fe480c507fda05489client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5490worker2 # [ 130.535229] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552425491client # [ 130.525166] nix[1264]: don't know how to build these paths:5492client # [ 130.526930] nix[1264]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5493worker2 # [ 130.553398] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:34Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05494worker2 # [ 130.559100] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:34Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15495worker1 # [ 130.589275] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369505496worker1 # [ 130.606395] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:369505497client # [ 130.612123] nix[1264]: copying 1 paths to 'lb:50051'...5498client # [ 130.617409] nix[1264]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5499worker1 # [ 130.623691] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:369505500worker1 # [ 130.638963] nix-daemon[832]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5501worker1 # [ 130.844410] nix-daemon[832]: accepted connection from pid 1450, user nix-grpc-daemon (trusted)5502worker1 # [ 130.863748] nix-daemon[832]: reaped child process 1453, status = succeeded5503worker1 # [ 131.039763] nix-daemon[832]: accepted connection from pid 1455, user nix-grpc-daemon (trusted)5504worker1 # [ 131.057134] nix-daemon[832]: reaped child process 1458, status = succeeded5505lb # [ 131.077836] niks3-server[1051]: 2026/09/20 09:06:34 INFO Received uploads request method=POST path=/api/pending_closures5506worker1 # [ 131.082976] nix-grpc-daemon[1406]: time=2026-09-20T09:06:34.665Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5507worker1 # [ 131.084676] nix-grpc-daemon[1406]: time=2026-09-20T09:06:34.665Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5508lb # [ 131.107218] niks3-server[1051]: 2026/09/20 09:06:34 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5509worker1 # [ 131.116850] nix-grpc-daemon[1406]: time=2026-09-20T09:06:34.700Z level=INFO msg="Uploading 1 narinfos"5510lb # [ 131.121715] niks3-server[1051]: 2026/09/20 09:06:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5511lb # [ 131.134273] niks3-server[1051]: 2026/09/20 09:06:34 INFO Signed narinfos id=38 count=15512lb # [ 131.139440] niks3-server[1051]: 2026/09/20 09:06:34 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5513lb # [ 131.149329] niks3-server[1051]: 2026/09/20 09:06:34 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5514worker1 # [ 131.149141] nix-grpc-daemon[1406]: time=2026-09-20T09:06:34.732Z level=INFO msg="Upload complete. (493ms)"5515lb # [ 131.154195] niks3-server[1051]: 2026/09/20 09:06:34 INFO Completed upload id=385516lb # [ 131.157209] niks3-server[1051]: 2026/09/20 09:06:34 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5517worker1 # [ 131.156176] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36950 duration_s=0 paths=1 nar_bytes_in=4165518worker1 # [ 131.166879] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369505519worker1 # [ 131.178865] nix-daemon[832]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5520worker1 # [ 131.184625] nix-daemon[832]: reaped child process 1448, status = succeeded5521client # [ 131.187785] nix[1264]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5522worker1 # [ 131.198040] nix-daemon[832]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5523worker1: must succeed: systemctl reload nix-grpc-daemon.service5524worker1 # [ 132.991789] systemd[1]: Reloading Nix worker-protocol over gRPC...5525worker1 # [ 133.048660] systemd[1]: Reloaded Nix worker-protocol over gRPC.5526worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5527worker1: must succeed: pgrep -f 'read -t [9]0 x'5528worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5529client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25530worker1 # [ 133.311941] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:36Z level=info event=draining5531client # don't know how to build these paths:5532client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5533worker2 # [ 133.367980] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552425534worker2 # [ 133.375500] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552425535worker2 # [ 133.404255] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:36Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05536worker2 # [ 133.410178] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:36Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15537worker2 # [ 133.453831] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552425538worker2 # [ 133.469681] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552425539client # copying 1 paths to 'lb:50051'...5540worker2 # [ 133.485590] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552425541client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5542worker2 # [ 133.509682] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5543worker2 # [ 133.713356] nix-daemon[838]: accepted connection from pid 1671, user nix-grpc-daemon (trusted)5544worker2 # [ 133.733057] nix-daemon[838]: reaped child process 1674, status = succeeded5545worker2 # [ 133.909159] nix-daemon[838]: accepted connection from pid 1676, user nix-grpc-daemon (trusted)5546worker2 # [ 133.926908] nix-daemon[838]: reaped child process 1679, status = succeeded5547lb # [ 133.932793] niks3-server[1051]: 2026/09/20 09:06:37 INFO Received uploads request method=POST path=/api/pending_closures5548worker2 # [ 133.950630] nix-grpc-daemon[1596]: time=2026-09-20T09:06:37.520Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5549worker2 # [ 133.952202] nix-grpc-daemon[1596]: time=2026-09-20T09:06:37.520Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5550lb # [ 133.962479] niks3-server[1051]: 2026/09/20 09:06:37 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5551lb # [ 133.980281] niks3-server[1051]: 2026/09/20 09:06:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5552worker2 # [ 133.991867] nix-grpc-daemon[1596]: time=2026-09-20T09:06:37.561Z level=INFO msg="Uploading 1 narinfos"5553lb # [ 133.989118] niks3-server[1051]: 2026/09/20 09:06:37 INFO Signed narinfos id=39 count=15554lb # [ 133.997112] niks3-server[1051]: 2026/09/20 09:06:37 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5555worker2 # [ 134.013333] nix-grpc-daemon[1596]: time=2026-09-20T09:06:37.583Z level=INFO msg="Upload complete. (486ms)"5556lb # [ 134.007609] niks3-server[1051]: 2026/09/20 09:06:37 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5557lb # [ 134.014622] niks3-server[1051]: 2026/09/20 09:06:37 INFO Completed upload id=395558lb # [ 134.019000] niks3-server[1051]: 2026/09/20 09:06:37 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5559worker2 # [ 134.020267] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=0 paths=1 nar_bytes_in=5285560worker2 # [ 134.035738] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552425561worker2 # [ 134.042375] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5562worker2 # [ 134.047105] nix-daemon[838]: reaped child process 1669, status = succeeded5563client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5564client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5565worker2 # [ 134.060895] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5566client # farm-a> LOG-farm-a-during-drain5567worker2 # [ 135.510174] nix-daemon[838]: reaped child process 1683, status = succeeded5568worker2 # [ 135.692802] nix-daemon[838]: accepted connection from pid 1698, user nix-grpc-daemon (trusted)5569worker2 # [ 135.710940] nix-daemon[838]: reaped child process 1701, status = succeeded5570lb # [ 135.717803] niks3-server[1051]: 2026/09/20 09:06:39 INFO Received uploads request method=POST path=/api/pending_closures5571worker2 # [ 135.736436] nix-grpc-daemon[1596]: time=2026-09-20T09:06:39.303Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5572worker2 # [ 135.738038] nix-grpc-daemon[1596]: time=2026-09-20T09:06:39.303Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5573lb # [ 135.755845] niks3-server[1051]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5574lb # [ 135.767519] niks3-server[1051]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5575lb # [ 135.779170] niks3-server[1051]: 2026/09/20 09:06:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5576lb # [ 135.785669] niks3-server[1051]: 2026/09/20 09:06:39 INFO Signed narinfos id=40 count=15577worker2 # [ 135.791803] nix-grpc-daemon[1596]: time=2026-09-20T09:06:39.360Z level=INFO msg="Uploading 1 narinfos"5578lb # [ 135.790761] niks3-server[1051]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5579lb # [ 135.800285] niks3-server[1051]: 2026/09/20 09:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5580lb # [ 135.809728] niks3-server[1051]: 2026/09/20 09:06:39 INFO Completed upload id=405581worker2 # [ 135.815962] nix-grpc-daemon[1596]: time=2026-09-20T09:06:39.386Z level=INFO msg="Upload complete. (339ms)"5582lb # [ 135.812713] niks3-server[1051]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5583worker2 # [ 135.829363] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15584worker2 # [ 135.848477] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:39Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05585worker2 # [ 135.852922] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:39Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15586worker2 # [ 135.857826] nix-daemon[838]: reaped child process 1681, status = succeeded5587worker2 # [ 135.893429] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552425588worker2 # [ 135.907870] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552425589worker2 # [ 135.923206] nix-grpc-daemon[1596]: time=2026-09-20T09:06:39.493Z level=INFO msg="All 1 paths already cached"5590client # copying 1 paths to 'lb:50051'...5591worker2 # [ 135.933388] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552425592client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5593worker2 # [ 135.956519] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5594worker2 # [ 136.161112] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)5595worker2 # [ 136.180456] nix-daemon[838]: reaped child process 1710, status = succeeded5596worker2 # [ 136.348799] nix-daemon[838]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)5597worker2 # [ 136.367749] nix-daemon[838]: reaped child process 1715, status = succeeded5598lb # [ 136.372578] niks3-server[1051]: 2026/09/20 09:06:39 INFO Received uploads request method=POST path=/api/pending_closures5599worker2 # [ 136.387924] nix-grpc-daemon[1596]: time=2026-09-20T09:06:39.957Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5600worker2 # [ 136.389664] nix-grpc-daemon[1596]: time=2026-09-20T09:06:39.957Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5601lb # [ 136.399040] niks3-server[1051]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5602worker2 # [ 136.419886] nix-grpc-daemon[1596]: time=2026-09-20T09:06:39.989Z level=INFO msg="Uploading 1 narinfos"5603lb # [ 136.414492] niks3-server[1051]: 2026/09/20 09:06:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5604lb # [ 136.426010] niks3-server[1051]: 2026/09/20 09:06:40 INFO Signed narinfos id=41 count=15605lb # [ 136.434754] niks3-server[1051]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5606worker2 # [ 136.448126] nix-grpc-daemon[1596]: time=2026-09-20T09:06:40.018Z level=INFO msg="Upload complete. (474ms)"5607lb # [ 136.440948] niks3-server[1051]: 2026/09/20 09:06:40 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5608lb # [ 136.449768] niks3-server[1051]: 2026/09/20 09:06:40 INFO Completed upload id=415609worker2 # [ 136.454610] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=0 paths=1 nar_bytes_in=6405610lb # [ 136.452379] niks3-server[1051]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5611worker2 # [ 136.466727] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552425612worker2 # [ 136.472105] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5613worker2 # [ 136.476913] nix-daemon[838]: reaped child process 1705, status = succeeded5614client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5615client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5616worker2 # [ 136.489894] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5617client # farm-b> LOG-farm-b-during-drain5618worker2 # [ 138.139064] nix-daemon[838]: reaped child process 1719, status = succeeded5619worker2 # [ 138.328617] nix-daemon[838]: accepted connection from pid 1734, user nix-grpc-daemon (trusted)5620worker2 # [ 138.345814] nix-daemon[838]: reaped child process 1737, status = succeeded5621lb # [ 138.353487] niks3-server[1051]: 2026/09/20 09:06:41 INFO Received uploads request method=POST path=/api/pending_closures5622worker2 # [ 138.366038] nix-grpc-daemon[1596]: time=2026-09-20T09:06:41.935Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5623worker2 # [ 138.367546] nix-grpc-daemon[1596]: time=2026-09-20T09:06:41.935Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5624lb # [ 138.373429] niks3-server[1051]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5625lb # [ 138.379034] niks3-server[1051]: 2026/09/20 09:06:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5626worker2 # [ 138.385469] nix-grpc-daemon[1596]: time=2026-09-20T09:06:41.955Z level=INFO msg="Uploading 1 narinfos"5627lb # [ 138.384733] niks3-server[1051]: 2026/09/20 09:06:41 INFO Signed narinfos id=42 count=15628lb # [ 138.385972] niks3-server[1051]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5629lb # [ 138.394105] niks3-server[1051]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5630worker2 # [ 138.399925] nix-grpc-daemon[1596]: time=2026-09-20T09:06:41.970Z level=INFO msg="Upload complete. (299ms)"5631lb # [ 138.396027] niks3-server[1051]: 2026/09/20 09:06:41 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5632lb # [ 138.398981] niks3-server[1051]: 2026/09/20 09:06:41 INFO Completed upload id=425633lb # [ 138.400370] niks3-server[1051]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5634worker2 # [ 138.408353] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15635worker2 # [ 138.420857] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:41Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05636worker2 # [ 138.423636] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:41Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15637worker2 # [ 138.426771] nix-daemon[838]: reaped child process 1717, status = succeeded5638worker2 # [ 138.465995] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552425639worker2 # [ 138.479616] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552425640worker2 # [ 138.493089] nix-grpc-daemon[1596]: time=2026-09-20T09:06:42.063Z level=INFO msg="All 2 paths already cached"5641client # copying 1 paths to 'lb:50051'...5642client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5643worker2 # [ 138.503041] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552425644worker2 # [ 138.521323] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5645worker2 # [ 138.720950] nix-daemon[838]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)5646worker2 # [ 138.739325] nix-daemon[838]: reaped child process 1746, status = succeeded5647worker2 # [ 138.911129] nix-daemon[838]: accepted connection from pid 1748, user nix-grpc-daemon (trusted)5648worker2 # [ 138.928466] nix-daemon[838]: reaped child process 1751, status = succeeded5649lb # [ 138.933613] niks3-server[1051]: 2026/09/20 09:06:42 INFO Received uploads request method=POST path=/api/pending_closures5650worker2 # [ 138.948692] nix-grpc-daemon[1596]: time=2026-09-20T09:06:42.518Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5651worker2 # [ 138.950235] nix-grpc-daemon[1596]: time=2026-09-20T09:06:42.518Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5652lb # [ 138.960913] niks3-server[1051]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5653worker2 # [ 138.979399] nix-grpc-daemon[1596]: time=2026-09-20T09:06:42.549Z level=INFO msg="Uploading 1 narinfos"5654lb # [ 138.977394] niks3-server[1051]: 2026/09/20 09:06:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5655lb # [ 138.987393] niks3-server[1051]: 2026/09/20 09:06:42 INFO Signed narinfos id=43 count=15656lb # [ 138.993843] niks3-server[1051]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5657lb # [ 139.003605] niks3-server[1051]: 2026/09/20 09:06:42 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5658worker2 # [ 139.014682] nix-grpc-daemon[1596]: time=2026-09-20T09:06:42.584Z level=INFO msg="Upload complete. (478ms)"5659lb # [ 139.009500] niks3-server[1051]: 2026/09/20 09:06:42 INFO Completed upload id=435660lb # [ 139.013856] niks3-server[1051]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5661worker2 # [ 139.027571] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=0 paths=1 nar_bytes_in=7685662worker2 # [ 139.031976] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552425663worker2 # [ 139.035089] nix-daemon[838]: reaped child process 1741, status = succeeded5664worker2 # [ 139.041912] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5665client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5666client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5667worker2 # [ 139.055201] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5668client # farm-top> LOG-farm-top-during-drain5669worker2 # [ 140.092240] nix-daemon[838]: reaped child process 1755, status = succeeded5670worker2 # [ 140.257659] nix-daemon[838]: accepted connection from pid 1770, user nix-grpc-daemon (trusted)5671worker2 # [ 140.276367] nix-daemon[838]: reaped child process 1773, status = succeeded5672lb # [ 140.285066] niks3-server[1051]: 2026/09/20 09:06:43 INFO Received uploads request method=POST path=/api/pending_closures5673worker2 # [ 140.303025] nix-grpc-daemon[1596]: time=2026-09-20T09:06:43.871Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5674worker2 # [ 140.304673] nix-grpc-daemon[1596]: time=2026-09-20T09:06:43.871Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5675lb # [ 140.318619] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5676lb # [ 140.334756] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5677lb # [ 140.343943] niks3-server[1051]: 2026/09/20 09:06:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5678worker2 # [ 140.355082] nix-grpc-daemon[1596]: time=2026-09-20T09:06:43.924Z level=INFO msg="Uploading 1 narinfos"5679lb # [ 140.352160] niks3-server[1051]: 2026/09/20 09:06:43 INFO Signed narinfos id=44 count=15680lb # [ 140.354468] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5681lb # [ 140.364560] niks3-server[1051]: 2026/09/20 09:06:43 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5682lb # [ 140.371728] niks3-server[1051]: 2026/09/20 09:06:43 INFO Completed upload id=445683lb # [ 140.374857] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5684worker2 # [ 140.377938] nix-grpc-daemon[1596]: time=2026-09-20T09:06:43.948Z level=INFO msg="Upload complete. (312ms)"5685worker2 # [ 140.392729] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15686worker2 # [ 140.404752] nix-daemon[838]: reaped child process 1753, status = succeeded5687client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.32 seconds)5688client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5689client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5690worker1: must succeed: pkill -f 'read -t [9]0 x'5691worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5692client: waiting for success: ! systemctl is-active sw5693worker1 # [ 140.833510] nix-daemon[832]: reaped child process 1462, status = succeeded5694worker1 # [ 141.003226] nix-daemon[832]: accepted connection from pid 1502, user nix-grpc-daemon (trusted)5695worker1 # [ 141.020314] nix-daemon[832]: reaped child process 1505, status = succeeded5696lb # [ 141.036115] niks3-server[1051]: 2026/09/20 09:06:44 INFO Received uploads request method=POST path=/api/pending_closures5697worker1 # [ 141.041941] nix-grpc-daemon[1406]: time=2026-09-20T09:06:44.624Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5698worker1 # [ 141.043463] nix-grpc-daemon[1406]: time=2026-09-20T09:06:44.624Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5699lb # [ 141.066814] niks3-server[1051]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5700lb # [ 141.079541] niks3-server[1051]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5701lb # [ 141.092118] niks3-server[1051]: 2026/09/20 09:06:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5702worker1 # [ 141.094092] nix-grpc-daemon[1406]: time=2026-09-20T09:06:44.676Z level=INFO msg="Uploading 1 narinfos"5703lb # [ 141.101879] niks3-server[1051]: 2026/09/20 09:06:44 INFO Signed narinfos id=45 count=15704lb # [ 141.106604] niks3-server[1051]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5705lb # [ 141.111934] niks3-server[1051]: 2026/09/20 09:06:44 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5706lb # [ 141.118323] niks3-server[1051]: 2026/09/20 09:06:44 INFO Completed upload id=455707worker1 # [ 141.113889] nix-grpc-daemon[1406]: time=2026-09-20T09:06:44.697Z level=INFO msg="Upload complete. (298ms)"5708lb # [ 141.120676] niks3-server[1051]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5709worker1 # [ 141.124956] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36950 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15710worker1 # [ 141.141278] nix-daemon[832]: reaped child process 1460, status = succeeded5711client # [ 141.159019] systemd[1]: sw.service: Deactivated successfully.5712client # [ 141.163646] systemd[1]: sw.service: Consumed 156ms CPU time over 10.884s wall clock time, 37.2M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5713worker1 # [ 141.313761] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:44Z level=info event=signal_exit5714client: (finished: waiting for success: ! systemctl is-active sw, in 1.11 seconds)5715client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5716client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5717worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5718worker1 # [ 142.537372] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:46Z level=info event=scheduler_restarting5719worker2 # [ 142.548713] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:586545720worker2 # [ 142.549013] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:46Z level=info event=worker_gone addr=192.168.1.3:500515721worker1 # [ 142.562513] nix-grpc-daemon[1305]: ts=2026-09-20T09:06:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5722worker1 # [ 142.587635] nix-daemon[832]: reaped child process 1374, status = succeeded5723worker1 # [ 143.137774] nix-grpc-daemon[1305]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5724worker1 # [ 143.138137] nix-grpc-daemon[1305]: E0000 00:00:1789895206.721206 1348 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5725worker1 # [ 143.149866] nix-grpc-daemon[1305]: E0000 00:00:1789895206.733353 1348 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5726worker1 # [ 143.363514] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5727worker1 # [ 143.368674] systemd[1]: nix-grpc-daemon.service: Consumed 860ms CPU time over 28.268s wall clock time, 33.2M memory peak, 20.6K incoming IP traffic, 26.9K outgoing IP traffic.5728worker1 # [ 143.387276] systemd[1]: Starting Nix worker-protocol over gRPC...5729worker1 # [ 143.588154] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5730worker1 # [ 143.590611] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15731worker1 # [ 143.598287] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5732worker1 # [ 143.599982] systemd[1]: Started Nix worker-protocol over gRPC.5733worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.73 seconds)5734lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5735lb: must succeed: curl -sf localhost:9901/clusters5736worker1 # [ 143.647047] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:47Z level=info event=scheduler_connected addr=lb:500515737worker2 # [ 143.661765] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05738lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5739lb: must succeed: curl -sf localhost:9901/clusters5740lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5741lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5742lb: must succeed: curl -sf localhost:9901/clusters5743lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5744worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5745worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5746(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.74 seconds)5747subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5748client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15749worker2 # [ 145.211988] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552425750worker2 # [ 145.218595] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552425751worker2 # [ 145.264147] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:48Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05752worker2 # [ 145.270098] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:48Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15753worker2 # [ 145.276146] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:48Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05754worker2 # [ 145.281316] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:48Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05755worker1 # [ 145.305246] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085756worker1 # [ 145.320941] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5757worker1 # [ 145.344844] nix-grpc-daemon[1519]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5)5758worker1 # [ 145.431434] nix-grpc-daemon[1519]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5)5759worker1 # [ 145.579253] nix-grpc-daemon[1519]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 386 ms (attempt 3/5)5760worker1 # [ 145.973176] nix-grpc-daemon[1519]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 180 ms (attempt 4/5)5761worker1 # [ 146.153971] nix-grpc-daemon[1519]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5762worker1 # [ 146.175697] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413085763worker1 # [ 146.191906] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413085764worker1 # [ 146.206274] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5765worker1 # [ 146.240144] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:49Z level=info event=niks3_push_started pid=15755766worker1 # [ 146.627229] nix-daemon[832]: accepted connection from pid 1588, user nix-grpc-daemon (trusted)5767worker1 # [ 146.644657] nix-daemon[832]: reaped child process 1591, status = succeeded5768worker1 # [ 146.824902] nix-daemon[832]: accepted connection from pid 1593, user nix-grpc-daemon (trusted)5769worker1 # [ 146.842799] nix-daemon[832]: reaped child process 1596, status = succeeded5770lb # [ 146.859708] niks3-server[1051]: 2026/09/20 09:06:50 INFO Received uploads request method=POST path=/api/pending_closures5771worker1 # [ 146.866121] nix-grpc-daemon[1575]: time=2026-09-20T09:06:50.448Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5772worker1 # [ 146.867609] nix-grpc-daemon[1575]: time=2026-09-20T09:06:50.448Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5773lb # [ 146.895508] niks3-server[1051]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5774worker1 # [ 146.903299] nix-grpc-daemon[1575]: time=2026-09-20T09:06:50.486Z level=INFO msg="Uploading 1 narinfos"5775lb # [ 146.907309] niks3-server[1051]: 2026/09/20 09:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5776lb # [ 146.916520] niks3-server[1051]: 2026/09/20 09:06:50 INFO Signed narinfos id=46 count=15777lb # [ 146.927155] niks3-server[1051]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5778lb # [ 146.935490] niks3-server[1051]: 2026/09/20 09:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5779worker1 # [ 146.936112] nix-grpc-daemon[1575]: time=2026-09-20T09:06:50.519Z level=INFO msg="Upload complete. (481ms)"5780lb # [ 146.942819] niks3-server[1051]: 2026/09/20 09:06:50 INFO Completed upload id=465781lb # [ 146.946165] niks3-server[1051]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5782worker1 # [ 146.944737] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=0 paths=1 nar_bytes_in=5125783worker1 # [ 146.959009] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085784worker1 # [ 146.964970] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5785worker1 # [ 146.969504] nix-daemon[832]: reaped child process 1573, status = succeeded5786worker1 # [ 146.983272] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5787worker1 # [ 148.604977] nix-daemon[832]: reaped child process 1600, status = succeeded5788worker1 # [ 148.766404] nix-daemon[832]: accepted connection from pid 1615, user nix-grpc-daemon (trusted)5789worker1 # [ 148.785041] nix-daemon[832]: reaped child process 1618, status = succeeded5790lb # [ 148.806116] niks3-server[1051]: 2026/09/20 09:06:52 INFO Received uploads request method=POST path=/api/pending_closures5791worker1 # [ 148.811337] nix-grpc-daemon[1575]: time=2026-09-20T09:06:52.392Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5792worker1 # [ 148.814693] nix-grpc-daemon[1575]: time=2026-09-20T09:06:52.392Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5793lb # [ 148.841649] niks3-server[1051]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5794lb # [ 148.858780] niks3-server[1051]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5795lb # [ 148.866435] niks3-server[1051]: 2026/09/20 09:06:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5796worker1 # [ 148.868833] nix-grpc-daemon[1575]: time=2026-09-20T09:06:52.451Z level=INFO msg="Uploading 1 narinfos"5797lb # [ 148.872447] niks3-server[1051]: 2026/09/20 09:06:52 INFO Signed narinfos id=47 count=15798lb # [ 148.878895] niks3-server[1051]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5799lb # [ 148.888489] niks3-server[1051]: 2026/09/20 09:06:52 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5800lb # [ 148.896873] niks3-server[1051]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5801lb # [ 148.902010] niks3-server[1051]: 2026/09/20 09:06:52 INFO Completed upload id=475802worker1 # [ 148.897186] nix-grpc-daemon[1575]: time=2026-09-20T09:06:52.480Z level=INFO msg="Upload complete. (303ms)"5803worker2 # [ 148.915295] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:52Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15804worker2 # [ 148.928784] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:52Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05805worker1 # [ 148.909035] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15806worker1 # [ 148.924819] nix-daemon[832]: reaped child process 1598, status = succeeded5807worker1 # [ 148.960211] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085808worker1 # [ 148.975415] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413085809worker1 # [ 148.989789] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413085810worker1 # [ 149.004151] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5811worker1 # [ 149.208157] nix-daemon[832]: accepted connection from pid 1622, user nix-grpc-daemon (trusted)5812worker1 # [ 149.225119] nix-daemon[832]: reaped child process 1625, status = succeeded5813worker1 # [ 149.402110] nix-daemon[832]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5814worker1 # [ 149.419235] nix-daemon[832]: reaped child process 1630, status = succeeded5815lb # [ 149.434961] niks3-server[1051]: 2026/09/20 09:06:53 INFO Received uploads request method=POST path=/api/pending_closures5816worker1 # [ 149.439438] nix-grpc-daemon[1575]: time=2026-09-20T09:06:53.022Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5817worker1 # [ 149.441136] nix-grpc-daemon[1575]: time=2026-09-20T09:06:53.022Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5818lb # [ 149.463398] niks3-server[1051]: 2026/09/20 09:06:53 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5819worker1 # [ 149.468877] nix-grpc-daemon[1575]: time=2026-09-20T09:06:53.052Z level=INFO msg="Uploading 1 narinfos"5820lb # [ 149.478897] niks3-server[1051]: 2026/09/20 09:06:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5821lb # [ 149.488295] niks3-server[1051]: 2026/09/20 09:06:53 INFO Signed narinfos id=48 count=15822lb # [ 149.491761] niks3-server[1051]: 2026/09/20 09:06:53 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5823lb # [ 149.499427] niks3-server[1051]: 2026/09/20 09:06:53 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5824lb # [ 149.504798] niks3-server[1051]: 2026/09/20 09:06:53 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5825lb # [ 149.510043] niks3-server[1051]: 2026/09/20 09:06:53 INFO Completed upload id=485826worker1 # [ 149.505322] nix-grpc-daemon[1575]: time=2026-09-20T09:06:53.088Z level=INFO msg="Upload complete. (484ms)"5827worker1 # [ 149.512830] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=0 paths=1 nar_bytes_in=5125828worker1 # [ 149.525712] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085829worker1 # [ 149.531379] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5830worker1 # [ 149.535792] nix-daemon[832]: reaped child process 1620, status = succeeded5831worker1 # [ 149.548204] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5832lb # [ 150.094718] envoy[904]: conn peer=[2001:db8:1::1]:58766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9599 tx=3874 ms=70425833lb # [ 150.099798] envoy[904]: conn peer=[2001:db8:1::1]:40324 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1333 ms=106125834lb # [ 150.104878] envoy[904]: conn peer=[2001:db8:1::3]:36626 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=272175835worker1 # [ 151.193124] nix-daemon[832]: reaped child process 1634, status = succeeded5836worker1 # [ 151.370384] nix-daemon[832]: accepted connection from pid 1649, user nix-grpc-daemon (trusted)5837worker1 # [ 151.391402] nix-daemon[832]: reaped child process 1652, status = succeeded5838lb # [ 151.410864] niks3-server[1051]: 2026/09/20 09:06:55 INFO Received uploads request method=POST path=/api/pending_closures5839worker1 # [ 151.416973] nix-grpc-daemon[1575]: time=2026-09-20T09:06:55.000Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5840worker1 # [ 151.419205] nix-grpc-daemon[1575]: time=2026-09-20T09:06:55.002Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5841lb # [ 151.445269] niks3-server[1051]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5842worker1 # [ 151.455201] nix-grpc-daemon[1575]: time=2026-09-20T09:06:55.038Z level=INFO msg="Uploading 1 narinfos"5843lb # [ 151.460369] niks3-server[1051]: 2026/09/20 09:06:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5844lb # [ 151.469219] niks3-server[1051]: 2026/09/20 09:06:55 INFO Signed narinfos id=49 count=15845lb # [ 151.477434] niks3-server[1051]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5846lb # [ 151.487310] niks3-server[1051]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5847lb # [ 151.491529] niks3-server[1051]: 2026/09/20 09:06:55 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5848lb # [ 151.496619] niks3-server[1051]: 2026/09/20 09:06:55 INFO Completed upload id=495849worker1 # [ 151.491583] nix-grpc-daemon[1575]: time=2026-09-20T09:06:55.075Z level=INFO msg="Upload complete. (331ms)"5850lb # [ 151.500188] niks3-server[1051]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5851worker1 # [ 151.501073] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15852worker2 # [ 151.513348] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:55Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15853worker2 # [ 151.526223] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:55Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05854worker1 # [ 151.518924] nix-daemon[832]: reaped child process 1632, status = succeeded5855worker1 # [ 151.556000] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085856worker1 # [ 151.571959] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413085857worker1 # [ 151.586913] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413085858worker1 # [ 151.600871] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5859worker1 # [ 151.805565] nix-daemon[832]: accepted connection from pid 1656, user nix-grpc-daemon (trusted)5860worker1 # [ 151.823358] nix-daemon[832]: reaped child process 1659, status = succeeded5861worker1 # [ 152.008585] nix-daemon[832]: accepted connection from pid 1661, user nix-grpc-daemon (trusted)5862worker1 # [ 152.025539] nix-daemon[832]: reaped child process 1664, status = succeeded5863lb # [ 152.042903] niks3-server[1051]: 2026/09/20 09:06:55 INFO Received uploads request method=POST path=/api/pending_closures5864worker1 # [ 152.047467] nix-grpc-daemon[1575]: time=2026-09-20T09:06:55.630Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5865worker1 # [ 152.049156] nix-grpc-daemon[1575]: time=2026-09-20T09:06:55.630Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5866lb # [ 152.068513] niks3-server[1051]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5867lb # [ 152.082666] niks3-server[1051]: 2026/09/20 09:06:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5868worker1 # [ 152.083607] nix-grpc-daemon[1575]: time=2026-09-20T09:06:55.667Z level=INFO msg="Uploading 1 narinfos"5869lb # [ 152.092623] niks3-server[1051]: 2026/09/20 09:06:55 INFO Signed narinfos id=50 count=15870lb # [ 152.095457] niks3-server[1051]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5871worker1 # [ 152.102729] nix-grpc-daemon[1575]: time=2026-09-20T09:06:55.686Z level=INFO msg="Upload complete. (485ms)"5872lb # [ 152.107741] niks3-server[1051]: 2026/09/20 09:06:55 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5873lb # [ 152.112811] niks3-server[1051]: 2026/09/20 09:06:55 INFO Completed upload id=505874worker1 # [ 152.108134] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=0 paths=1 nar_bytes_in=5125875lb # [ 152.115640] niks3-server[1051]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5876worker1 # [ 152.117064] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085877worker1 # [ 152.127958] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5878worker1 # [ 152.132605] nix-daemon[832]: reaped child process 1654, status = succeeded5879worker1 # [ 152.142901] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5880worker1 # [ 152.966527] nix-daemon[832]: reaped child process 1668, status = succeeded5881worker1 # [ 153.125605] nix-daemon[832]: accepted connection from pid 1683, user nix-grpc-daemon (trusted)5882worker1 # [ 153.145223] nix-daemon[832]: reaped child process 1686, status = succeeded5883lb # [ 153.163019] niks3-server[1051]: 2026/09/20 09:06:56 INFO Received uploads request method=POST path=/api/pending_closures5884worker1 # [ 153.169414] nix-grpc-daemon[1575]: time=2026-09-20T09:06:56.751Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5885worker1 # [ 153.171124] nix-grpc-daemon[1575]: time=2026-09-20T09:06:56.751Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5886lb # [ 153.192282] niks3-server[1051]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5887lb # [ 153.214154] niks3-server[1051]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5888lb # [ 153.228600] niks3-server[1051]: 2026/09/20 09:06:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5889worker1 # [ 153.231953] nix-grpc-daemon[1575]: time=2026-09-20T09:06:56.815Z level=INFO msg="Uploading 1 narinfos"5890lb # [ 153.236358] niks3-server[1051]: 2026/09/20 09:06:56 INFO Signed narinfos id=51 count=15891lb # [ 153.242763] niks3-server[1051]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5892lb # [ 153.257712] niks3-server[1051]: 2026/09/20 09:06:56 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5893lb # [ 153.264352] niks3-server[1051]: 2026/09/20 09:06:56 INFO Completed upload id=515894worker1 # [ 153.259191] nix-grpc-daemon[1575]: time=2026-09-20T09:06:56.842Z level=INFO msg="Upload complete. (305ms)"5895lb # [ 153.267520] niks3-server[1051]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5896worker2 # [ 153.280956] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:56Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15897worker1 # [ 153.273109] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15898worker2 # [ 153.294180] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:56Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05899worker1 # [ 153.289652] nix-daemon[832]: reaped child process 1666, status = succeeded5900worker1 # [ 153.324315] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085901worker1 # [ 153.339929] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413085902worker1 # [ 153.353804] nix-grpc-daemon[1575]: time=2026-09-20T09:06:56.937Z level=INFO msg="All 1 paths already cached"5903worker1 # [ 153.362655] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413085904worker1 # [ 153.377761] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5905worker1 # [ 153.586876] nix-daemon[832]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)5906worker1 # [ 153.604706] nix-daemon[832]: reaped child process 1693, status = succeeded5907worker1 # [ 153.779014] nix-daemon[832]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)5908worker1 # [ 153.796639] nix-daemon[832]: reaped child process 1698, status = succeeded5909lb # [ 153.812537] niks3-server[1051]: 2026/09/20 09:06:57 INFO Received uploads request method=POST path=/api/pending_closures5910worker1 # [ 153.817575] nix-grpc-daemon[1575]: time=2026-09-20T09:06:57.400Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5911worker1 # [ 153.819310] nix-grpc-daemon[1575]: time=2026-09-20T09:06:57.401Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5912lb # [ 153.841194] niks3-server[1051]: 2026/09/20 09:06:57 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5913lb # [ 153.855586] niks3-server[1051]: 2026/09/20 09:06:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5914worker1 # [ 153.857208] nix-grpc-daemon[1575]: time=2026-09-20T09:06:57.440Z level=INFO msg="Uploading 1 narinfos"5915lb # [ 153.868783] niks3-server[1051]: 2026/09/20 09:06:57 INFO Signed narinfos id=52 count=15916lb # [ 153.876254] niks3-server[1051]: 2026/09/20 09:06:57 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5917worker1 # [ 153.881465] nix-grpc-daemon[1575]: time=2026-09-20T09:06:57.465Z level=INFO msg="Upload complete. (484ms)"5918lb # [ 153.886982] niks3-server[1051]: 2026/09/20 09:06:57 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5919lb # [ 153.893265] niks3-server[1051]: 2026/09/20 09:06:57 INFO Completed upload id=525920worker1 # [ 153.888119] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=0 paths=1 nar_bytes_in=6245921lb # [ 153.897146] niks3-server[1051]: 2026/09/20 09:06:57 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5922worker1 # [ 153.901092] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085923worker1 # [ 153.907141] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5924worker1 # [ 153.912007] nix-daemon[832]: reaped child process 1688, status = succeeded5925worker1 # [ 153.923174] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5926worker1 # [ 154.758096] nix-daemon[832]: reaped child process 1702, status = succeeded5927worker1 # [ 154.920488] nix-daemon[832]: accepted connection from pid 1717, user nix-grpc-daemon (trusted)5928worker1 # [ 154.939853] nix-daemon[832]: reaped child process 1720, status = succeeded5929lb # [ 154.956698] niks3-server[1051]: 2026/09/20 09:06:58 INFO Received uploads request method=POST path=/api/pending_closures5930worker1 # [ 154.964432] nix-grpc-daemon[1575]: time=2026-09-20T09:06:58.545Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5931worker1 # [ 154.965895] nix-grpc-daemon[1575]: time=2026-09-20T09:06:58.545Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5932lb # [ 154.994443] niks3-server[1051]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5933lb # [ 155.006623] niks3-server[1051]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5934lb # [ 155.018849] niks3-server[1051]: 2026/09/20 09:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5935worker1 # [ 155.020361] nix-grpc-daemon[1575]: time=2026-09-20T09:06:58.603Z level=INFO msg="Uploading 1 narinfos"5936lb # [ 155.027694] niks3-server[1051]: 2026/09/20 09:06:58 INFO Signed narinfos id=53 count=15937lb # [ 155.032813] niks3-server[1051]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5938lb # [ 155.040630] niks3-server[1051]: 2026/09/20 09:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5939lb # [ 155.046903] niks3-server[1051]: 2026/09/20 09:06:58 INFO Completed upload id=535940worker1 # [ 155.041858] nix-grpc-daemon[1575]: time=2026-09-20T09:06:58.625Z level=INFO msg="Upload complete. (306ms)"5941lb # [ 155.049458] niks3-server[1051]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5942worker2 # [ 155.061891] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:58Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15943worker1 # [ 155.053036] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15944worker2 # [ 155.074215] nix-grpc-daemon[1520]: ts=2026-09-20T09:06:58Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05945worker1 # [ 155.072960] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085946worker1 # [ 155.080523] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413085947worker1 # [ 155.085733] nix-daemon[832]: reaped child process 1700, status = succeeded5948worker1 # [ 155.089177] nix-grpc-daemon[1575]: time=2026-09-20T09:06:58.672Z level=INFO msg="All 1 paths already cached"5949worker1 # [ 155.096955] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413085950worker1 # [ 155.107752] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5951worker1 # [ 155.294696] nix-daemon[832]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5952worker1 # [ 155.313580] nix-daemon[832]: reaped child process 1727, status = succeeded5953worker1 # [ 155.488230] nix-daemon[832]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)5954worker1 # [ 155.504303] nix-daemon[832]: reaped child process 1732, status = succeeded5955lb # [ 155.522867] niks3-server[1051]: 2026/09/20 09:06:59 INFO Received uploads request method=POST path=/api/pending_closures5956worker1 # [ 155.527075] nix-grpc-daemon[1575]: time=2026-09-20T09:06:59.110Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5957worker1 # [ 155.528776] nix-grpc-daemon[1575]: time=2026-09-20T09:06:59.110Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5958lb # [ 155.548669] niks3-server[1051]: 2026/09/20 09:06:59 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5959worker1 # [ 155.557708] nix-grpc-daemon[1575]: time=2026-09-20T09:06:59.141Z level=INFO msg="Uploading 1 narinfos"5960lb # [ 155.563941] niks3-server[1051]: 2026/09/20 09:06:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5961lb # [ 155.573261] niks3-server[1051]: 2026/09/20 09:06:59 INFO Signed narinfos id=54 count=15962lb # [ 155.583385] niks3-server[1051]: 2026/09/20 09:06:59 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5963lb # [ 155.592343] niks3-server[1051]: 2026/09/20 09:06:59 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5964worker1 # [ 155.591597] nix-grpc-daemon[1575]: time=2026-09-20T09:06:59.175Z level=INFO msg="Upload complete. (471ms)"5965lb # [ 155.596604] niks3-server[1051]: 2026/09/20 09:06:59 INFO Completed upload id=545966worker1 # [ 155.598365] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=0 paths=1 nar_bytes_in=6245967worker1 # [ 155.611163] nix-grpc-daemon[1519]: ts=2026-09-20T09:06:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085968worker1 # [ 155.614582] nix-grpc-daemon[1575]: time=2026-09-20T09:06:59.186Z level=WARN msg="Failed to register uploaded object" key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo error="server returned 404: object is not pending upload\n"5969worker1 # [ 155.624148] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5970worker1 # [ 155.626659] nix-daemon[832]: reaped child process 1722, status = succeeded5971worker1 # [ 155.639389] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5972worker1 # [ 156.680557] nix-daemon[832]: reaped child process 1736, status = succeeded5973worker1 # [ 156.865320] nix-daemon[832]: accepted connection from pid 1751, user nix-grpc-daemon (trusted)5974worker1 # [ 156.882831] nix-daemon[832]: reaped child process 1754, status = succeeded5975lb # [ 156.901943] niks3-server[1051]: 2026/09/20 09:07:00 INFO Received uploads request method=POST path=/api/pending_closures5976worker1 # [ 156.912913] nix-grpc-daemon[1575]: time=2026-09-20T09:07:00.494Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5977worker1 # [ 156.915482] nix-grpc-daemon[1575]: time=2026-09-20T09:07:00.494Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5978lb # [ 156.964216] niks3-server[1051]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5979worker1 # [ 156.974261] nix-grpc-daemon[1575]: time=2026-09-20T09:07:00.557Z level=INFO msg="Uploading 1 narinfos"5980lb # [ 156.979990] niks3-server[1051]: 2026/09/20 09:07:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5981lb # [ 156.987803] niks3-server[1051]: 2026/09/20 09:07:00 INFO Signed narinfos id=55 count=15982lb # [ 156.991687] niks3-server[1051]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5983lb # [ 156.998053] niks3-server[1051]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5984worker1 # [ 156.998764] nix-grpc-daemon[1575]: time=2026-09-20T09:07:00.582Z level=INFO msg="Upload complete. (349ms)"5985lb # [ 157.004332] niks3-server[1051]: 2026/09/20 09:07:00 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5986lb # [ 157.007675] niks3-server[1051]: 2026/09/20 09:07:00 INFO Completed upload id=555987lb # [ 157.011343] niks3-server[1051]: 2026/09/20 09:07:00 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5988worker2 # [ 157.019262] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:00Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15989worker1 # [ 157.013263] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15990worker2 # [ 157.032786] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:00Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05991worker1 # [ 157.031897] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413085992worker1 # [ 157.039331] nix-daemon[832]: reaped child process 1734, status = succeeded5993worker1 # [ 157.048269] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413085994worker1 # [ 157.062953] nix-grpc-daemon[1575]: time=2026-09-20T09:07:00.646Z level=INFO msg="All 1 paths already cached"5995worker1 # [ 157.072128] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413085996worker1 # [ 157.086218] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)5997worker1 # [ 157.285862] nix-daemon[832]: accepted connection from pid 1758, user nix-grpc-daemon (trusted)5998worker1 # [ 157.304961] nix-daemon[832]: reaped child process 1761, status = succeeded5999worker1 # [ 157.487118] nix-daemon[832]: accepted connection from pid 1763, user nix-grpc-daemon (trusted)6000worker1 # [ 157.505336] nix-daemon[832]: reaped child process 1766, status = succeeded6001lb # [ 157.523306] niks3-server[1051]: 2026/09/20 09:07:01 INFO Received uploads request method=POST path=/api/pending_closures6002worker1 # [ 157.530239] nix-grpc-daemon[1575]: time=2026-09-20T09:07:01.113Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6003worker1 # [ 157.531758] nix-grpc-daemon[1575]: time=2026-09-20T09:07:01.113Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6004lb # [ 157.553688] niks3-server[1051]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6005lb # [ 157.570733] niks3-server[1051]: 2026/09/20 09:07:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6006worker1 # [ 157.576589] nix-grpc-daemon[1575]: time=2026-09-20T09:07:01.160Z level=INFO msg="Uploading 1 narinfos"6007lb # [ 157.583408] niks3-server[1051]: 2026/09/20 09:07:01 INFO Signed narinfos id=56 count=16008lb # [ 157.589000] niks3-server[1051]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6009lb # [ 157.596877] niks3-server[1051]: 2026/09/20 09:07:01 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6010lb # [ 157.605229] niks3-server[1051]: 2026/09/20 09:07:01 INFO Completed upload id=566011worker1 # [ 157.600744] nix-grpc-daemon[1575]: time=2026-09-20T09:07:01.184Z level=INFO msg="Upload complete. (497ms)"6012lb # [ 157.607350] niks3-server[1051]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6013worker1 # [ 157.607862] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=0 paths=1 nar_bytes_in=6246014worker1 # [ 157.622740] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413086015worker1 # [ 157.629314] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6016worker1 # [ 157.634684] nix-daemon[832]: reaped child process 1756, status = succeeded6017worker1 # [ 157.648197] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6018worker1 # [ 159.295385] nix-daemon[832]: reaped child process 1770, status = succeeded6019worker1 # [ 159.484333] nix-daemon[832]: accepted connection from pid 1785, user nix-grpc-daemon (trusted)6020worker1 # [ 159.502391] nix-daemon[832]: reaped child process 1788, status = succeeded6021lb # [ 159.521994] niks3-server[1051]: 2026/09/20 09:07:03 INFO Received uploads request method=POST path=/api/pending_closures6022worker1 # [ 159.526949] nix-grpc-daemon[1575]: time=2026-09-20T09:07:03.109Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6023worker1 # [ 159.528706] nix-grpc-daemon[1575]: time=2026-09-20T09:07:03.109Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6024lb # [ 159.557509] niks3-server[1051]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6025lb # [ 159.570158] niks3-server[1051]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6026lb # [ 159.581073] niks3-server[1051]: 2026/09/20 09:07:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6027worker1 # [ 159.582941] nix-grpc-daemon[1575]: time=2026-09-20T09:07:03.166Z level=INFO msg="Uploading 1 narinfos"6028lb # [ 159.587150] niks3-server[1051]: 2026/09/20 09:07:03 INFO Signed narinfos id=57 count=16029lb # [ 159.591529] niks3-server[1051]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6030lb # [ 159.602425] niks3-server[1051]: 2026/09/20 09:07:03 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6031lb # [ 159.611183] niks3-server[1051]: 2026/09/20 09:07:03 INFO Completed upload id=576032worker1 # [ 159.606256] nix-grpc-daemon[1575]: time=2026-09-20T09:07:03.189Z level=INFO msg="Upload complete. (346ms)"6033lb # [ 159.614328] niks3-server[1051]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6034worker2 # [ 159.627547] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:03Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16035worker1 # [ 159.621300] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16036worker2 # [ 159.641083] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:03Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06037worker1 # [ 159.640404] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413086038worker1 # [ 159.646739] nix-daemon[832]: reaped child process 1768, status = succeeded6039worker1 # [ 159.654689] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413086040worker1 # [ 159.667003] nix-grpc-daemon[1575]: time=2026-09-20T09:07:03.250Z level=INFO msg="All 2 paths already cached"6041worker1 # [ 159.675760] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413086042worker1 # [ 159.688260] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6043worker1 # [ 159.888191] nix-daemon[832]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)6044worker1 # [ 159.907864] nix-daemon[832]: reaped child process 1795, status = succeeded6045worker1 # [ 160.085454] nix-daemon[832]: accepted connection from pid 1797, user nix-grpc-daemon (trusted)6046worker1 # [ 160.103992] nix-daemon[832]: reaped child process 1800, status = succeeded6047lb # [ 160.119753] niks3-server[1051]: 2026/09/20 09:07:03 INFO Received uploads request method=POST path=/api/pending_closures6048worker1 # [ 160.124807] nix-grpc-daemon[1575]: time=2026-09-20T09:07:03.708Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6049worker1 # [ 160.126313] nix-grpc-daemon[1575]: time=2026-09-20T09:07:03.708Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6050worker1 # [ 160.157584] nix-grpc-daemon[1575]: time=2026-09-20T09:07:03.740Z level=INFO msg="Uploading 1 narinfos"6051lb # [ 160.152846] niks3-server[1051]: 2026/09/20 09:07:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6052lb # [ 160.166096] niks3-server[1051]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6053lb # [ 160.177345] niks3-server[1051]: 2026/09/20 09:07:03 INFO Signed narinfos id=58 count=16054lb # [ 160.186918] niks3-server[1051]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6055lb # [ 160.191030] niks3-server[1051]: 2026/09/20 09:07:03 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6056worker1 # [ 160.191985] nix-grpc-daemon[1575]: time=2026-09-20T09:07:03.775Z level=INFO msg="Upload complete. (488ms)"6057lb # [ 160.197354] niks3-server[1051]: 2026/09/20 09:07:03 INFO Completed upload id=586058lb # [ 160.200088] niks3-server[1051]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6059worker1 # [ 160.200386] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=0 paths=1 nar_bytes_in=7526060worker1 # [ 160.208795] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413086061worker1 # [ 160.219044] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6062worker1 # [ 160.223892] nix-daemon[832]: reaped child process 1790, status = succeeded6063worker1 # [ 160.235552] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6064worker1 # [ 161.282445] nix-daemon[832]: reaped child process 1804, status = succeeded6065worker1 # [ 161.463082] nix-daemon[832]: accepted connection from pid 1819, user nix-grpc-daemon (trusted)6066worker1 # [ 161.480515] nix-daemon[832]: reaped child process 1822, status = succeeded6067lb # [ 161.501634] niks3-server[1051]: 2026/09/20 09:07:05 INFO Received uploads request method=POST path=/api/pending_closures6068worker1 # [ 161.507646] nix-grpc-daemon[1575]: time=2026-09-20T09:07:05.089Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6069worker1 # [ 161.511431] nix-grpc-daemon[1575]: time=2026-09-20T09:07:05.089Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6070lb # [ 161.543789] niks3-server[1051]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6071lb # [ 161.555496] niks3-server[1051]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6072worker1 # [ 161.557914] nix-grpc-daemon[1575]: time=2026-09-20T09:07:05.141Z level=INFO msg="Uploading 1 narinfos"6073lb # [ 161.565337] niks3-server[1051]: 2026/09/20 09:07:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6074lb # [ 161.576848] niks3-server[1051]: 2026/09/20 09:07:05 INFO Signed narinfos id=59 count=16075lb # [ 161.579748] niks3-server[1051]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6076lb # [ 161.587434] niks3-server[1051]: 2026/09/20 09:07:05 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6077lb # [ 161.594533] niks3-server[1051]: 2026/09/20 09:07:05 INFO Completed upload id=596078worker1 # [ 161.590152] nix-grpc-daemon[1575]: time=2026-09-20T09:07:05.173Z level=INFO msg="Upload complete. (341ms)"6079lb # [ 161.597092] niks3-server[1051]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6080worker2 # [ 161.609199] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:05Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16081worker1 # [ 161.601281] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16082worker1 # [ 161.621808] nix-daemon[832]: reaped child process 1802, status = succeeded6083worker1 # [ 161.651954] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413086084worker1 # [ 161.667359] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413086085worker1 # [ 161.681971] nix-grpc-daemon[1575]: time=2026-09-20T09:07:05.265Z level=INFO msg="All 2 paths already cached"6086worker1 # [ 161.691011] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413086087worker1 # [ 161.704866] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6088worker1 # [ 161.904910] nix-daemon[832]: accepted connection from pid 1826, user nix-grpc-daemon (trusted)6089worker1 # [ 161.925198] nix-daemon[832]: reaped child process 1829, status = succeeded6090worker1 # [ 162.099920] nix-daemon[832]: accepted connection from pid 1831, user nix-grpc-daemon (trusted)6091worker1 # [ 162.118621] nix-daemon[832]: reaped child process 1834, status = succeeded6092lb # [ 162.134905] niks3-server[1051]: 2026/09/20 09:07:05 INFO Received uploads request method=POST path=/api/pending_closures6093worker1 # [ 162.140568] nix-grpc-daemon[1575]: time=2026-09-20T09:07:05.723Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6094worker1 # [ 162.142123] nix-grpc-daemon[1575]: time=2026-09-20T09:07:05.723Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6095lb # [ 162.162823] niks3-server[1051]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6096worker1 # [ 162.178422] nix-grpc-daemon[1575]: time=2026-09-20T09:07:05.761Z level=INFO msg="Uploading 1 narinfos"6097lb # [ 162.176150] niks3-server[1051]: 2026/09/20 09:07:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6098lb # [ 162.188136] niks3-server[1051]: 2026/09/20 09:07:05 INFO Signed narinfos id=60 count=16099lb # [ 162.190763] niks3-server[1051]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6100lb # [ 162.199650] niks3-server[1051]: 2026/09/20 09:07:05 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6101lb # [ 162.205968] niks3-server[1051]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6102lb # [ 162.209890] niks3-server[1051]: 2026/09/20 09:07:05 INFO Completed upload id=606103worker1 # [ 162.205448] nix-grpc-daemon[1575]: time=2026-09-20T09:07:05.789Z level=INFO msg="Upload complete. (484ms)"6104worker1 # [ 162.212789] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=0 paths=1 nar_bytes_in=7526105worker1 # [ 162.224895] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413086106worker1 # [ 162.230292] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6107worker1 # [ 162.234558] nix-daemon[832]: reaped child process 1824, status = succeeded6108worker1 # [ 162.245058] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6109worker1 # [ 163.090290] nix-daemon[832]: reaped child process 1838, status = succeeded6110worker1 # [ 163.276367] nix-daemon[832]: accepted connection from pid 1853, user nix-grpc-daemon (trusted)6111worker1 # [ 163.292454] nix-daemon[832]: reaped child process 1856, status = succeeded6112lb # [ 163.314058] niks3-server[1051]: 2026/09/20 09:07:06 INFO Received uploads request method=POST path=/api/pending_closures6113worker1 # [ 163.319030] nix-grpc-daemon[1575]: time=2026-09-20T09:07:06.901Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6114worker1 # [ 163.320543] nix-grpc-daemon[1575]: time=2026-09-20T09:07:06.901Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6115lb # [ 163.349074] niks3-server[1051]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6116worker1 # [ 163.359205] nix-grpc-daemon[1575]: time=2026-09-20T09:07:06.942Z level=INFO msg="Uploading 1 narinfos"6117lb # [ 163.364622] niks3-server[1051]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6118lb # [ 163.375227] niks3-server[1051]: 2026/09/20 09:07:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6119lb # [ 163.380879] niks3-server[1051]: 2026/09/20 09:07:06 INFO Signed narinfos id=61 count=16120lb # [ 163.388056] niks3-server[1051]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6121worker1 # [ 163.383122] nix-grpc-daemon[1575]: time=2026-09-20T09:07:06.966Z level=INFO msg="Upload complete. (326ms)"6122lb # [ 163.391505] niks3-server[1051]: 2026/09/20 09:07:06 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6123lb # [ 163.395749] niks3-server[1051]: 2026/09/20 09:07:06 INFO Completed upload id=616124lb # [ 163.398397] niks3-server[1051]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6125worker1 # [ 163.392913] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16126worker2 # [ 163.404354] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:06Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16127worker1 # [ 163.409490] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413086128worker1 # [ 163.415882] nix-daemon[832]: reaped child process 1836, status = succeeded6129worker1 # [ 163.423978] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413086130worker1 # [ 163.432742] nix-grpc-daemon[1575]: time=2026-09-20T09:07:07.016Z level=INFO msg="All 2 paths already cached"6131worker1 # [ 163.439938] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413086132worker1 # [ 163.450141] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6133worker1 # [ 163.634256] nix-daemon[832]: accepted connection from pid 1860, user nix-grpc-daemon (trusted)6134worker1 # [ 163.653067] nix-daemon[832]: reaped child process 1863, status = succeeded6135worker1 # [ 163.828798] nix-daemon[832]: accepted connection from pid 1865, user nix-grpc-daemon (trusted)6136worker1 # [ 163.846340] nix-daemon[832]: reaped child process 1868, status = succeeded6137lb # [ 163.862192] niks3-server[1051]: 2026/09/20 09:07:07 INFO Received uploads request method=POST path=/api/pending_closures6138worker1 # [ 163.867459] nix-grpc-daemon[1575]: time=2026-09-20T09:07:07.450Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6139worker1 # [ 163.869071] nix-grpc-daemon[1575]: time=2026-09-20T09:07:07.450Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6140lb # [ 163.892764] niks3-server[1051]: 2026/09/20 09:07:07 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6141lb # [ 163.908765] niks3-server[1051]: 2026/09/20 09:07:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6142worker1 # [ 163.910246] nix-grpc-daemon[1575]: time=2026-09-20T09:07:07.493Z level=INFO msg="Uploading 1 narinfos"6143lb # [ 163.921248] niks3-server[1051]: 2026/09/20 09:07:07 INFO Signed narinfos id=62 count=16144lb # [ 163.927734] niks3-server[1051]: 2026/09/20 09:07:07 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6145lb # [ 163.941385] niks3-server[1051]: 2026/09/20 09:07:07 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6146lb # [ 163.946933] niks3-server[1051]: 2026/09/20 09:07:07 INFO Completed upload id=626147worker1 # [ 163.942454] nix-grpc-daemon[1575]: time=2026-09-20T09:07:07.526Z level=INFO msg="Upload complete. (479ms)"6148lb # [ 163.950002] niks3-server[1051]: 2026/09/20 09:07:07 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6149worker1 # [ 163.953283] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=0 paths=1 nar_bytes_in=7526150worker1 # [ 163.967287] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413086151worker1 # [ 163.976172] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6152worker1 # [ 163.978932] nix-daemon[832]: reaped child process 1858, status = succeeded6153worker1 # [ 163.993231] nix-daemon[832]: accepted connection from pid 1519, user nix-grpc-daemon (trusted)6154worker1 # [ 165.238449] nix-daemon[832]: reaped child process 1872, status = succeeded6155worker1 # [ 165.416150] nix-daemon[832]: accepted connection from pid 1887, user nix-grpc-daemon (trusted)6156worker1 # [ 165.436214] nix-daemon[832]: reaped child process 1890, status = succeeded6157lb # [ 165.453414] niks3-server[1051]: 2026/09/20 09:07:09 INFO Received uploads request method=POST path=/api/pending_closures6158worker1 # [ 165.460423] nix-grpc-daemon[1575]: time=2026-09-20T09:07:09.043Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6159worker1 # [ 165.461954] nix-grpc-daemon[1575]: time=2026-09-20T09:07:09.043Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6160lb # [ 165.490730] niks3-server[1051]: 2026/09/20 09:07:09 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6161lb # [ 165.508059] niks3-server[1051]: 2026/09/20 09:07:09 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6162lb # [ 165.517950] niks3-server[1051]: 2026/09/20 09:07:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6163worker1 # [ 165.518099] nix-grpc-daemon[1575]: time=2026-09-20T09:07:09.101Z level=INFO msg="Uploading 1 narinfos"6164lb # [ 165.526191] niks3-server[1051]: 2026/09/20 09:07:09 INFO Signed narinfos id=63 count=16165lb # [ 165.532106] niks3-server[1051]: 2026/09/20 09:07:09 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6166lb # [ 165.539194] niks3-server[1051]: 2026/09/20 09:07:09 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6167lb # [ 165.546915] niks3-server[1051]: 2026/09/20 09:07:09 INFO Completed upload id=636168worker1 # [ 165.541852] nix-grpc-daemon[1575]: time=2026-09-20T09:07:09.125Z level=INFO msg="Upload complete. (337ms)"6169lb # [ 165.550020] niks3-server[1051]: 2026/09/20 09:07:09 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6170worker1 # [ 165.553231] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41308 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16171worker1 # [ 165.570741] nix-daemon[832]: reaped child process 1870, status = succeeded6172client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.68 seconds)6173worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6174worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.08 seconds)6175client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16176worker1 # [ 165.954692] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:413086177worker2 # [ 165.970585] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552426178worker2 # [ 165.996313] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:09Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06179lb # [ 170.097730] envoy[904]: conn peer=[2001:db8:1::1]:36812 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27144 tx=10692 ms=203716180client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.31 seconds)6181(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.08 seconds)6182subtest: low disk drains a worker and builds go to the other6183worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6184worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.16 seconds)6185worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6186worker1 # [ 197.634699] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:41Z level=info event=unhealthy reason=min_free6187worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6188client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26189client # don't know how to build these paths:6190client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6191worker1 # [ 198.554943] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:413086192worker2 # [ 198.574039] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552426193worker2 # [ 198.599285] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:42Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06194worker2 # [ 198.606067] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:42Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16195worker2 # [ 198.646248] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552426196worker2 # [ 198.661668] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552426197client # copying 1 paths to 'lb:50051'...6198worker2 # [ 198.677290] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552426199client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6200worker2 # [ 198.695445] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6201worker2 # [ 198.910245] nix-daemon[838]: accepted connection from pid 1800, user nix-grpc-daemon (trusted)6202worker2 # [ 198.927530] nix-daemon[838]: reaped child process 1803, status = succeeded6203worker2 # [ 199.105185] nix-daemon[838]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6204worker2 # [ 199.122192] nix-daemon[838]: reaped child process 1808, status = succeeded6205lb # [ 199.128156] niks3-server[1051]: 2026/09/20 09:07:42 INFO Received uploads request method=POST path=/api/pending_closures6206worker2 # [ 199.145819] nix-grpc-daemon[1596]: time=2026-09-20T09:07:42.715Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6207worker2 # [ 199.147303] nix-grpc-daemon[1596]: time=2026-09-20T09:07:42.715Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6208lb # [ 199.161313] niks3-server[1051]: 2026/09/20 09:07:42 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6209worker2 # [ 199.187379] nix-grpc-daemon[1596]: time=2026-09-20T09:07:42.757Z level=INFO msg="Uploading 1 narinfos"6210lb # [ 199.175972] niks3-server[1051]: 2026/09/20 09:07:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6211lb # [ 199.187204] niks3-server[1051]: 2026/09/20 09:07:42 INFO Signed narinfos id=64 count=16212lb # [ 199.192836] niks3-server[1051]: 2026/09/20 09:07:42 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6213lb # [ 199.201617] niks3-server[1051]: 2026/09/20 09:07:42 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6214lb # [ 199.205784] niks3-server[1051]: 2026/09/20 09:07:42 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6215worker2 # [ 199.211757] nix-grpc-daemon[1596]: time=2026-09-20T09:07:42.782Z level=INFO msg="Upload complete. (498ms)"6216lb # [ 199.208803] niks3-server[1051]: 2026/09/20 09:07:42 INFO Completed upload id=646217worker2 # [ 199.221054] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=0 paths=1 nar_bytes_in=5126218worker2 # [ 199.228903] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552426219worker2 # [ 199.238955] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6220worker2 # [ 199.243332] nix-daemon[838]: reaped child process 1798, status = succeeded6221worker2 # [ 199.253343] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6222client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6223client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6224lb # [ 200.098686] envoy[904]: conn peer=[2001:db8:1::1]:38642 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300506225client # farm-a> LOG-farm-a-drain6226worker2 # [ 200.301205] nix-daemon[838]: reaped child process 1812, status = succeeded6227worker2 # [ 200.476121] nix-daemon[838]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)6228worker2 # [ 200.491745] nix-daemon[838]: reaped child process 1830, status = succeeded6229lb # [ 200.501283] niks3-server[1051]: 2026/09/20 09:07:44 INFO Received uploads request method=POST path=/api/pending_closures6230worker2 # [ 200.523634] nix-grpc-daemon[1596]: time=2026-09-20T09:07:44.091Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6231worker2 # [ 200.525239] nix-grpc-daemon[1596]: time=2026-09-20T09:07:44.091Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6232lb # [ 200.543349] niks3-server[1051]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6233lb # [ 200.553992] niks3-server[1051]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6234lb # [ 200.570822] niks3-server[1051]: 2026/09/20 09:07:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6235worker2 # [ 200.581625] nix-grpc-daemon[1596]: time=2026-09-20T09:07:44.151Z level=INFO msg="Uploading 1 narinfos"6236lb # [ 200.577498] niks3-server[1051]: 2026/09/20 09:07:44 INFO Signed narinfos id=65 count=16237lb # [ 200.585106] niks3-server[1051]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6238lb # [ 200.594641] niks3-server[1051]: 2026/09/20 09:07:44 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6239worker2 # [ 200.606194] nix-grpc-daemon[1596]: time=2026-09-20T09:07:44.176Z level=INFO msg="Upload complete. (341ms)"6240lb # [ 200.600611] niks3-server[1051]: 2026/09/20 09:07:44 INFO Completed upload id=656241lb # [ 200.604523] niks3-server[1051]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6242worker2 # [ 200.617941] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16243worker2 # [ 200.629106] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:44Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06244worker2 # [ 200.634818] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:44Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16245worker2 # [ 200.638685] nix-daemon[838]: reaped child process 1810, status = succeeded6246worker2 # [ 200.676903] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552426247worker2 # [ 200.688225] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552426248worker2 # [ 200.698891] nix-grpc-daemon[1596]: time=2026-09-20T09:07:44.269Z level=INFO msg="All 1 paths already cached"6249client # copying 1 paths to 'lb:50051'...6250worker2 # [ 200.707750] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552426251client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6252worker2 # [ 200.724664] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6253worker2 # [ 200.920179] nix-daemon[838]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6254worker2 # [ 200.939725] nix-daemon[838]: reaped child process 1839, status = succeeded6255worker2 # [ 201.109976] nix-daemon[838]: accepted connection from pid 1841, user nix-grpc-daemon (trusted)6256worker2 # [ 201.126436] nix-daemon[838]: reaped child process 1844, status = succeeded6257lb # [ 201.131437] niks3-server[1051]: 2026/09/20 09:07:44 INFO Received uploads request method=POST path=/api/pending_closures6258worker2 # [ 201.146308] nix-grpc-daemon[1596]: time=2026-09-20T09:07:44.716Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6259worker2 # [ 201.147770] nix-grpc-daemon[1596]: time=2026-09-20T09:07:44.716Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6260lb # [ 201.155201] niks3-server[1051]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6261lb # [ 201.170881] niks3-server[1051]: 2026/09/20 09:07:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6262worker2 # [ 201.183738] nix-grpc-daemon[1596]: time=2026-09-20T09:07:44.753Z level=INFO msg="Uploading 1 narinfos"6263lb # [ 201.183873] niks3-server[1051]: 2026/09/20 09:07:44 INFO Signed narinfos id=66 count=16264lb # [ 201.190885] niks3-server[1051]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6265worker2 # [ 201.206392] nix-grpc-daemon[1596]: time=2026-09-20T09:07:44.776Z level=INFO msg="Upload complete. (466ms)"6266lb # [ 201.201032] niks3-server[1051]: 2026/09/20 09:07:44 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6267worker2 # [ 201.212234] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=0 paths=1 nar_bytes_in=6326268lb # [ 201.207288] niks3-server[1051]: 2026/09/20 09:07:44 INFO Completed upload id=666269lb # [ 201.211311] niks3-server[1051]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6270worker2 # [ 201.222453] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552426271worker2 # [ 201.228364] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6272worker2 # [ 201.233081] nix-daemon[838]: reaped child process 1834, status = succeeded6273worker2 # [ 201.241960] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6274client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6275client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6276client # farm-b> LOG-farm-b-drain6277worker2 # [ 202.079389] nix-daemon[838]: reaped child process 1848, status = succeeded6278worker2 # [ 202.258544] nix-daemon[838]: accepted connection from pid 1863, user nix-grpc-daemon (trusted)6279worker2 # [ 202.274060] nix-daemon[838]: reaped child process 1866, status = succeeded6280lb # [ 202.285008] niks3-server[1051]: 2026/09/20 09:07:45 INFO Received uploads request method=POST path=/api/pending_closures6281worker2 # [ 202.300475] nix-grpc-daemon[1596]: time=2026-09-20T09:07:45.870Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6282worker2 # [ 202.301950] nix-grpc-daemon[1596]: time=2026-09-20T09:07:45.870Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6283lb # [ 202.320273] niks3-server[1051]: 2026/09/20 09:07:45 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6284worker2 # [ 202.345027] nix-grpc-daemon[1596]: time=2026-09-20T09:07:45.915Z level=INFO msg="Uploading 1 narinfos"6285lb # [ 202.339597] niks3-server[1051]: 2026/09/20 09:07:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6286lb # [ 202.349369] niks3-server[1051]: 2026/09/20 09:07:45 INFO Signed narinfos id=67 count=16287lb # [ 202.356197] niks3-server[1051]: 2026/09/20 09:07:45 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6288lb # [ 202.361899] niks3-server[1051]: 2026/09/20 09:07:45 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6289lb # [ 202.369998] niks3-server[1051]: 2026/09/20 09:07:45 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6290worker2 # [ 202.380266] nix-grpc-daemon[1596]: time=2026-09-20T09:07:45.950Z level=INFO msg="Upload complete. (328ms)"6291lb # [ 202.374871] niks3-server[1051]: 2026/09/20 09:07:45 INFO Completed upload id=676292lb # [ 202.379024] niks3-server[1051]: 2026/09/20 09:07:45 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6293worker2 # [ 202.388576] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16294worker2 # [ 202.399244] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:45Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06295worker2 # [ 202.402981] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:45Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16296worker2 # [ 202.407149] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552426297worker2 # [ 202.411140] nix-daemon[838]: reaped child process 1846, status = succeeded6298worker2 # [ 202.414221] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552426299worker2 # [ 202.423393] nix-grpc-daemon[1596]: time=2026-09-20T09:07:45.993Z level=INFO msg="All 2 paths already cached"6300client # copying 1 paths to 'lb:50051'...6301worker2 # [ 202.430900] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552426302client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6303worker2 # [ 202.438004] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6304worker2 # [ 202.618206] nix-daemon[838]: accepted connection from pid 1872, user nix-grpc-daemon (trusted)6305worker2 # [ 202.637779] nix-daemon[838]: reaped child process 1875, status = succeeded6306worker2 # [ 202.810720] nix-daemon[838]: accepted connection from pid 1877, user nix-grpc-daemon (trusted)6307worker2 # [ 202.827554] nix-daemon[838]: reaped child process 1880, status = succeeded6308lb # [ 202.832821] niks3-server[1051]: 2026/09/20 09:07:46 INFO Received uploads request method=POST path=/api/pending_closures6309worker2 # [ 202.847554] nix-grpc-daemon[1596]: time=2026-09-20T09:07:46.417Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6310worker2 # [ 202.849234] nix-grpc-daemon[1596]: time=2026-09-20T09:07:46.417Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6311lb # [ 202.856888] niks3-server[1051]: 2026/09/20 09:07:46 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6312worker2 # [ 202.878291] nix-grpc-daemon[1596]: time=2026-09-20T09:07:46.448Z level=INFO msg="Uploading 1 narinfos"6313lb # [ 202.872077] niks3-server[1051]: 2026/09/20 09:07:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6314lb # [ 202.884384] niks3-server[1051]: 2026/09/20 09:07:46 INFO Signed narinfos id=68 count=16315lb # [ 202.887446] niks3-server[1051]: 2026/09/20 09:07:46 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6316lb # [ 202.897315] niks3-server[1051]: 2026/09/20 09:07:46 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6317worker2 # [ 202.910377] nix-grpc-daemon[1596]: time=2026-09-20T09:07:46.480Z level=INFO msg="Upload complete. (461ms)"6318lb # [ 202.905185] niks3-server[1051]: 2026/09/20 09:07:46 INFO Completed upload id=686319lb # [ 202.908938] niks3-server[1051]: 2026/09/20 09:07:46 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6320worker2 # [ 202.916230] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=0 paths=1 nar_bytes_in=7606321worker2 # [ 202.928708] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552426322worker2 # [ 202.931860] nix-daemon[838]: reaped child process 1870, status = succeeded6323worker2 # [ 202.939646] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6324client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6325worker2 # [ 202.950996] nix-daemon[838]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6326client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6327client # farm-top> LOG-farm-top-drain6328worker2 # [ 204.172235] nix-daemon[838]: reaped child process 1884, status = succeeded6329worker2 # [ 204.326853] nix-daemon[838]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)6330worker2 # [ 204.344500] nix-daemon[838]: reaped child process 1902, status = succeeded6331lb # [ 204.353614] niks3-server[1051]: 2026/09/20 09:07:47 INFO Received uploads request method=POST path=/api/pending_closures6332worker2 # [ 204.371200] nix-grpc-daemon[1596]: time=2026-09-20T09:07:47.939Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6333worker2 # [ 204.372753] nix-grpc-daemon[1596]: time=2026-09-20T09:07:47.939Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6334lb # [ 204.391317] niks3-server[1051]: 2026/09/20 09:07:47 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6335worker2 # [ 204.408972] nix-grpc-daemon[1596]: time=2026-09-20T09:07:47.979Z level=INFO msg="Uploading 1 narinfos"6336lb # [ 204.406946] niks3-server[1051]: 2026/09/20 09:07:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6337lb # [ 204.416258] niks3-server[1051]: 2026/09/20 09:07:48 INFO Signed narinfos id=69 count=16338lb # [ 204.423626] niks3-server[1051]: 2026/09/20 09:07:48 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6339worker2 # [ 204.434739] nix-grpc-daemon[1596]: time=2026-09-20T09:07:48.004Z level=INFO msg="Upload complete. (272ms)"6340lb # [ 204.429092] niks3-server[1051]: 2026/09/20 09:07:48 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6341lb # [ 204.431879] niks3-server[1051]: 2026/09/20 09:07:48 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6342lb # [ 204.435897] niks3-server[1051]: 2026/09/20 09:07:48 INFO Completed upload id=696343lb # [ 204.437749] niks3-server[1051]: 2026/09/20 09:07:48 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6344worker2 # [ 204.442755] nix-grpc-daemon[1520]: ts=2026-09-20T09:07:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55242 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16345worker2 # [ 204.455806] nix-daemon[838]: reaped child process 1882, status = succeeded6346client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.21 seconds)6347client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6348client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds)6349worker1: must succeed: rm /nix/.rw-store/fill6350worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6351worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6352worker1 # [ 205.644901] nix-grpc-daemon[1519]: ts=2026-09-20T09:07:49Z level=info event=healthy reason=min_free6353worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6354(finished: subtest: low disk drains a worker and builds go to the other, in 10.10 seconds)6355(finished: run the VM test script, in 207.11 seconds)6356test script finished in 207.38s6357cleanup6358kill QemuMachine (pid 49)6359client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6360kill QemuMachine (pid 51)6361lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6362kill QemuMachine (pid 50)6363worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6364kill QemuMachine (pid 52)6365worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6366(finished: cleanup, in 1.08 seconds)6367additionally exposed symbols:6368 client, lb, worker1, worker2,6369 vlan1,6370 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh