container-test-run-flakelet-relay
checks.x86_64-linux.nixos-test
· build #51
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Initializing machine ID from random generator.6Test will time out and terminate in 3600.0 seconds7run the VM test script8start all VMs9client: systemd-nspawn running (pid 53)10relay: systemd-nspawn running (pid 54)11agent: systemd-nspawn running (pid 52)12client: Waiting for journal at /build/vm-state-client/var/log/journal...13agent: Waiting for journal at /build/vm-state-agent/var/log/journal...14relay: Waiting for journal at /build/vm-state-relay/var/log/journal...15(finished: start all VMs, in 0.00 seconds)16relay: waiting for unit flakelet-relay.service17nixos-nspawn(relay): TAP vde-tap1 not found; container will be isolated from VDE18nixos-nspawn(relay): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.19nixos-nspawn(agent): TAP vde-tap1 not found; container will be isolated from VDE20nixos-nspawn(agent): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.21nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE22nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.23Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.24Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.25Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.26░ Spawning container agent on /build/vm-state-agent.27░ Spawning container client on /build/vm-state-client.28░ Spawning container relay on /build/vm-state-relay.29client # No journal files were found.30client # No journal boot entry found for the specified boot (+0).31agent # No journal files were found.32relay # No journal files were found.33agent # No journal boot entry found for the specified boot (+0).34relay # No journal boot entry found for the specified boot (+0).35client # [266509.301950] client systemd-journald[57]: Journal started36agent # [266509.301528] agent systemd-journald[57]: Journal started37relay # [266509.301533] relay systemd-journald[57]: Journal started38agent # [266509.301630] agent systemd-journald[57]: Runtime Journal (/run/log/journal/72309d020cff46a5b4a82f47f27dad4e) is 8M, max 4G, 3.9G free.39relay # [266509.301630] relay systemd-journald[57]: Runtime Journal (/run/log/journal/b43552b37b514d999b49f3ce04cf022c) is 8M, max 4G, 3.9G free.40agent # [266509.313490] agent systemd[1]: Finished Apply Kernel Variables.41relay # [266509.313675] relay systemd[1]: Finished Apply Kernel Variables.42agent # [266509.326470] agent systemd[1]: Finished Create Static Device Nodes in /dev gracefully.43relay # [266509.326546] relay systemd[1]: Finished Create Static Device Nodes in /dev gracefully.44agent # [266509.341839] agent systemd[1]: Starting Flush Journal to Persistent Storage...45relay # [266509.341788] relay systemd[1]: Starting Flush Journal to Persistent Storage...46agent # [266509.342545] agent systemd[1]: Starting Create Static Device Nodes in /dev...47relay # [266509.342611] relay systemd[1]: Starting Create Static Device Nodes in /dev...48agent # [266509.381073] agent systemd-journald[57]: Time spent on flushing to /var/log/journal/72309d020cff46a5b4a82f47f27dad4e is 1.521ms for 6 entries.49relay # [266509.381076] relay systemd-journald[57]: Time spent on flushing to /var/log/journal/b43552b37b514d999b49f3ce04cf022c is 1.508ms for 6 entries.50relay # [266509.381076] relay systemd-journald[57]: System Journal (/var/log/journal/b43552b37b514d999b49f3ce04cf022c) is 512B, max 4G, 3.9G free.51agent # [266509.381073] agent systemd-journald[57]: System Journal (/var/log/journal/72309d020cff46a5b4a82f47f27dad4e) is 512B, max 4G, 3.9G free.52agent # [266509.390118] agent systemd[1]: Finished Create Static Device Nodes in /dev.53agent # [266509.390963] agent systemd[1]: Reached target Preparation for Local File Systems.54agent # [266509.391118] agent systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys55client # [266509.301997] client systemd-journald[57]: Runtime Journal (/run/log/journal/46a56523384747e1aa27da343fce1c4e) is 8M, max 4G, 3.9G free.56relay # [266509.389937] relay systemd[1]: Finished Flush Journal to Persistent Storage.57client # [266509.313323] client systemd[1]: Finished Apply Kernel Variables.58relay # [266509.390557] relay systemd[1]: Finished Create Static Device Nodes in /dev.59client # [266509.326059] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully.60agent # [266509.406455] agent systemd[1]: Finished Flush Journal to Persistent Storage.61client # [266509.340653] client systemd[1]: Starting Flush Journal to Persistent Storage...62agent # [266509.452719] agent systemd[1]: Finished Firewall.63client # [266509.341417] client systemd[1]: Starting Create Static Device Nodes in /dev...64relay # [266509.391838] relay systemd[1]: Reached target Preparation for Local File Systems.65client # [266509.380282] client systemd-journald[57]: Time spent on flushing to /var/log/journal/46a56523384747e1aa27da343fce1c4e is 1.549ms for 6 entries.66relay # [266509.391977] relay systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys67client # [266509.380282] client systemd-journald[57]: System Journal (/var/log/journal/46a56523384747e1aa27da343fce1c4e) is 512B, max 4G, 3.9G free.68relay # [266509.466919] relay systemd[1]: Finished Firewall.69client # [266509.389275] client systemd[1]: Finished Create Static Device Nodes in /dev.70client # [266509.390074] client systemd[1]: Reached target Preparation for Local File Systems.71client # [266509.390249] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys72client # [266509.406328] client systemd[1]: Finished Flush Journal to Persistent Storage.73client # [266509.452888] client systemd[1]: Finished Firewall.74relay # [266510.301100] relay systemd[1]: Mounting /run/wrappers...75relay # [266510.358554] relay systemd[1]: Mounted /run/wrappers.76relay # [266510.359652] relay systemd[1]: Reached target Local File Systems.77relay # [266510.360889] relay systemd[1]: Listening on Boot Loader Control Service Socket.78relay # [266510.362219] relay systemd[1]: Starting Create SUID/SGID Wrappers...79relay # [266510.362265] relay systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container80relay # [266510.363623] relay systemd[1]: Starting Save Transient machine-id to Disk...81relay # [266510.364803] relay systemd[1]: Starting Create System Files and Directories...82relay # [266510.383467] relay systemd-tmpfiles[169]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted83relay # [266510.383924] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal failed: Operation not permitted84relay # [266510.384258] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal/b43552b37b514d999b49f3ce04cf022c failed: Operation not permitted85relay # [266510.384517] relay suid-sgid-wrappers-start[176]: chmod: changing permissions of '/run/wrappers/wrappers.jIUUxxgTO5/chsh': Operation not permitted86relay # [266510.384616] relay systemd-tmpfiles[169]: fchmod() of /run/log/journal failed: Operation not permitted87agent # [266510.327666] agent systemd[1]: Mounting /run/wrappers...88agent # [266510.360517] agent systemd[1]: Mounted /run/wrappers.89agent # [266510.361624] agent systemd[1]: Reached target Local File Systems.90agent # [266510.362965] agent systemd[1]: Listening on Boot Loader Control Service Socket.91agent # [266510.364289] agent systemd[1]: Starting Create SUID/SGID Wrappers...92agent # [266510.364337] agent systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container93agent # [266510.365536] agent systemd[1]: Starting Save Transient machine-id to Disk...94agent # [266510.366604] agent systemd[1]: Starting Create System Files and Directories...95agent # [266510.385804] agent systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted96agent # [266510.386240] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted97agent # [266510.386568] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal/72309d020cff46a5b4a82f47f27dad4e failed: Operation not permitted98agent # [266510.386910] agent systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted99client # [266510.327756] client systemd[1]: Mounting /run/wrappers...100client # [266510.363752] client systemd[1]: Mounted /run/wrappers.101client # [266510.364949] client systemd[1]: Reached target Local File Systems.102client # [266510.366353] client systemd[1]: Listening on Boot Loader Control Service Socket.103client # [266510.367457] client systemd[1]: Starting Create SUID/SGID Wrappers...104client # [266510.367504] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container105client # [266510.368547] client systemd[1]: Starting Save Transient machine-id to Disk...106client # [266510.369681] client systemd[1]: Starting Create System Files and Directories...107client # [266510.388326] client systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted108client # [266510.388733] client systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted109client # [266510.388813] client suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.c0kk9f30Je/chsh': Operation not permitted110client # [266510.389073] client systemd-tmpfiles[161]: fchmod() of /var/log/journal/46a56523384747e1aa27da343fce1c4e failed: Operation not permitted111client # [266510.389396] client systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted112agent # [266510.387392] agent suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.Fh3qU7zqc7/chsh': Operation not permitted113agent # [266510.393348] agent systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE114agent # [266510.393387] agent systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'.115agent # [266510.393444] agent systemd[1]: Failed to start Create SUID/SGID Wrappers.116agent # [266510.393914] agent systemd[1]: Finished Create System Files and Directories.117agent # [266510.408768] agent systemd[1]: Starting Rebuild Journal Catalog...118agent # [266510.436822] agent systemd[1]: Starting Record System Boot/Shutdown in UTMP...119agent # [266510.449843] agent systemd[1]: Finished Record System Boot/Shutdown in UTMP.120agent # [266510.453052] agent systemd[1]: Finished Rebuild Journal Catalog.121agent # [266510.454203] agent systemd[1]: Starting Update is Completed...122agent # [266510.463158] agent systemd[1]: Finished Update is Completed.123agent # [266510.463255] agent systemd[1]: Reached target System Initialization.124agent # [266510.463344] agent systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container125agent # [266510.463409] agent systemd[1]: Started Daily Cleanup of Temporary Directories.126agent # [266510.463423] agent systemd[1]: Reached target Timer Units.127agent # [266510.463531] agent systemd[1]: Listening on D-Bus System Message Bus Socket.128agent # [266510.463737] agent systemd[1]: Listening on Nix Daemon Socket.129agent # [266510.463829] agent systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.130agent # [266510.463844] agent systemd[1]: Reached target Socket Units.131agent # [266510.463872] agent systemd[1]: Reached target Basic System.132agent # [266510.465291] agent systemd[1]: Starting Re-link flakelet services at boot...133agent # [266510.466517] agent systemd[1]: Starting Import lastlog data into lastlog2 database...134agent # [266510.467839] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)...135agent # [266510.468685] agent systemd[1]: Starting resolvconf update...136agent # [266510.486649] agent systemd[1]: Finished Re-link flakelet services at boot.137agent # [266510.494092] agent systemd[1]: Starting Reconcile flakelet services with the host configuration...138agent # [266510.498956] agent systemd[1]: Finished Import lastlog data into lastlog2 database.139agent # [266510.505009] agent systemd[1]: Finished Reconcile flakelet services with the host configuration.140client # [266510.396384] client systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE141client # [266510.396423] client systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'.142client # [266510.396487] client systemd[1]: Failed to start Create SUID/SGID Wrappers.143client # [266510.397035] client systemd[1]: Finished Create System Files and Directories.144client # [266510.436566] client systemd[1]: Starting Rebuild Journal Catalog...145client # [266510.437415] client systemd[1]: Starting Record System Boot/Shutdown in UTMP...146client # [266510.450121] client systemd[1]: Finished Record System Boot/Shutdown in UTMP.147client # [266510.456391] client systemd[1]: Finished Rebuild Journal Catalog.148client # [266510.457256] client systemd[1]: Starting Update is Completed...149client # [266510.469651] client systemd[1]: Finished Update is Completed.150client # [266510.469808] client systemd[1]: Reached target System Initialization.151client # [266510.469874] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container152client # [266510.469905] client systemd[1]: Started Daily Cleanup of Temporary Directories.153client # [266510.469918] client systemd[1]: Reached target Timer Units.154client # [266510.470034] client systemd[1]: Listening on D-Bus System Message Bus Socket.155client # [266510.470250] client systemd[1]: Listening on Nix Daemon Socket.156client # [266510.470347] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.157client # [266510.470362] client systemd[1]: Reached target Socket Units.158client # [266510.470388] client systemd[1]: Reached target Basic System.159client # [266510.471604] client systemd[1]: Starting Import lastlog data into lastlog2 database...160client # [266510.472477] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...161client # [266510.473299] client systemd[1]: Starting resolvconf update...162client # [266510.610552] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully.163relay # [266510.390174] relay systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE164relay # [266510.390271] relay systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'.165relay # [266510.390504] relay systemd[1]: Failed to start Create SUID/SGID Wrappers.166relay # [266510.390964] relay systemd[1]: Finished Create System Files and Directories.167relay # [266510.406091] relay systemd[1]: Starting Rebuild Journal Catalog...168relay # [266510.407514] relay systemd[1]: Starting Record System Boot/Shutdown in UTMP...169relay # [266510.448466] relay systemd[1]: Finished Record System Boot/Shutdown in UTMP.170relay # [266510.453711] relay systemd[1]: Finished Rebuild Journal Catalog.171relay # [266510.454665] relay systemd[1]: Starting Update is Completed...172relay # [266510.463925] relay systemd[1]: Finished Update is Completed.173relay # [266510.464038] relay systemd[1]: Reached target System Initialization.174relay # [266510.464131] relay systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container175relay # [266510.464174] relay systemd[1]: Started Daily Cleanup of Temporary Directories.176relay # [266510.464194] relay systemd[1]: Reached target Timer Units.177relay # [266510.464316] relay systemd[1]: Listening on D-Bus System Message Bus Socket.178relay # [266510.464569] relay systemd[1]: Listening on Nix Daemon Socket.179relay # [266510.464718] relay systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.180relay # [266510.464736] relay systemd[1]: Reached target Socket Units.181relay # [266510.464776] relay systemd[1]: Reached target Basic System.182relay # [266510.466880] relay systemd[1]: Started device-mock.service.183relay # [266510.468887] relay systemd[1]: Starting Re-link flakelet services at boot...184relay # [266510.470459] relay systemd[1]: Starting Import lastlog data into lastlog2 database...185relay # [266510.472266] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)...186relay # [266510.473357] relay systemd[1]: Starting resolvconf update...187relay # [266510.613161] relay systemd[1]: etc-machine\x2did.mount: Deactivated successfully.188client # [266510.611847] client systemd[1]: Finished Save Transient machine-id to Disk.189client # [266510.612550] client systemd[1]: lastlog2-import.service: Failed to spawn executor: No such file or directory190client # [266510.612618] client systemd[1]: lastlog2-import.service: Failed to spawn 'start-post' task: No such file or directory191client # [266510.612681] client systemd[1]: lastlog2-import.service: Failed with result 'resources'.192client # [266510.612758] client systemd[1]: Failed to start Import lastlog data into lastlog2 database.193client # [266510.640523] client systemd[1]: nscd.service: Deactivated successfully.194client # [266510.640781] client systemd[1]: Stopped Name Service Cache Daemon (nsncd).195client # [266510.644751] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...196client # [266510.653493] client systemd[1]: Finished resolvconf update.197client # [266510.653764] client systemd[1]: Reached target Preparation for Network.198client # [266510.655366] client systemd[1]: Starting Address configuration of eth1...199client # [266510.656611] client systemd[1]: Starting Extra networking commands....200client # [266510.675446] client network-addresses-eth1-start[236]: adding address 192.168.1.2/24... done201client # [266510.678681] client network-addresses-eth1-start[236]: adding address 2001:db8:1::2/64... done202client # [266510.685141] client systemd[1]: Finished Address configuration of eth1.203client # [266510.755327] client systemd[1]: nscd.service: Deactivated successfully.204client # [266510.755572] client systemd[1]: Stopped Name Service Cache Daemon (nsncd).205client # [266510.758342] client systemd[1]: Finished Extra networking commands..206client # [266510.759711] client systemd[1]: Reached target Network.207client # [266510.761670] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...208agent # [266510.596584] agent systemd[1]: etc-machine\x2did.mount: Deactivated successfully.209agent # [266510.597463] agent systemd[1]: Finished Save Transient machine-id to Disk.210agent # [266510.597642] agent systemd[1]: nscd.service: Deactivated successfully.211agent # [266510.597739] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd).212agent # [266510.599386] agent systemd[1]: Finished resolvconf update.213agent # [266510.601199] agent systemd[1]: Reached target Preparation for Network.214agent # [266510.602310] agent systemd[1]: Starting Address configuration of eth1...215agent # [266510.603162] agent systemd[1]: Starting Extra networking commands....216agent # [266510.603975] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)...217agent # [266510.650597] agent network-addresses-eth1-start[240]: adding address 192.168.1.1/24... done218agent # [266510.654035] agent network-addresses-eth1-start[240]: adding address 2001:db8:1::1/64... done219agent # [266510.658411] agent systemd[1]: Finished Address configuration of eth1.220agent # [266510.724173] agent systemd[1]: Finished Extra networking commands..221agent # [266510.724255] agent systemd[1]: Reached target Network.222agent # [266510.725332] agent systemd[1]: Starting Update flakelet service app...223agent # [266510.726216] agent systemd[1]: Starting Update flakelet service flakelet-agent...224agent # [266510.726961] agent systemd[1]: Starting Update flakelet service other...225agent # [266510.730759] agent systemd[1]: nscd.service: Deactivated successfully.226agent # [266510.730927] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd).227agent # [266510.733250] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)...228agent # [266510.746433] agent flakelet[305]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1229agent # [266510.746862] agent flakelet[306]: flakelet-agent: using prebuilt artifact /nix/store/1nhs2b511syk1335xh7xlax4c6x8cq2q-flakelet-flakelet-agent230agent # [266510.747069] agent flakelet[307]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1231agent # [266510.747424] agent flakelet[305]: app: activating generation 1232agent # [266510.747514] agent flakelet[306]: flakelet-agent: activating generation 1233agent # [266510.747613] agent flakelet[307]: other: activating generation 1234agent # [266510.753480] agent systemd[1]: Reload requested from client PID 314 ('systemctl') (unit flakelet-other.service)...235agent # [266510.753512] agent systemd[1]: Reloading...236relay # [266510.615262] relay systemd[1]: Finished Save Transient machine-id to Disk.237relay # [266510.634406] relay systemd[1]: Finished Re-link flakelet services at boot.238relay # [266510.635312] relay systemd[1]: lastlog2-import.service: Failed to spawn executor: No such file or directory239relay # [266510.635369] relay systemd[1]: lastlog2-import.service: Failed to spawn 'start-post' task: No such file or directory240relay # [266510.635450] relay systemd[1]: lastlog2-import.service: Failed with result 'resources'.241relay # [266510.635560] relay systemd[1]: Failed to start Import lastlog data into lastlog2 database.242relay # [266510.644992] relay systemd[1]: Starting Reconcile flakelet services with the host configuration...243relay # [266510.657993] relay systemd[1]: Finished Reconcile flakelet services with the host configuration.244relay # [266510.669409] relay systemd[1]: Finished resolvconf update.245relay # [266510.669706] relay systemd[1]: Reached target Preparation for Network.246relay # [266510.671338] relay systemd[1]: Starting Address configuration of eth1...247relay # [266510.672802] relay systemd[1]: Starting Extra networking commands....248relay # [266510.688162] relay network-addresses-eth1-start[244]: adding address 192.168.1.3/24... done249relay # [266510.699170] relay network-addresses-eth1-start[244]: adding address 2001:db8:1::3/64... done250relay # [266510.706380] relay systemd[1]: Finished Address configuration of eth1.251relay # [266510.721103] relay systemd[1]: nscd.service: Deactivated successfully.252relay # [266510.721361] relay systemd[1]: Stopped Name Service Cache Daemon (nsncd).253relay # [266510.727166] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)...254relay # [266510.755133] relay systemd[1]: Finished Extra networking commands..255relay # [266510.755440] relay systemd[1]: Reached target Network.256relay # [266510.757832] relay systemd[1]: Starting Dnsmasq Daemon...257relay # [266510.759974] relay systemd[1]: Starting Nginx Web Server...258relay # [266510.761739] relay systemd[1]: Starting Update flakelet service flakelet-relay...259relay # [266510.772628] relay flakelet[309]: flakelet-relay: using prebuilt artifact /nix/store/gih4mm0c2qcal5x8gxp0nv82hkajj9nk-flakelet-flakelet-relay260relay # [266510.773351] relay flakelet[309]: flakelet-relay: activating generation 1261relay # [266510.778508] relay systemd[1]: Reload requested from client PID 313 ('systemctl') (unit flakelet-flakelet-relay.service)...262relay # [266510.778591] relay systemd[1]: Reloading...263agent # [266511.097475] agent nsncd[310]: Oct 29 11:57:07.142 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"264agent # [266511.231079] agent systemd[1]: Reloading finished in 477 ms.265relay # [266511.138867] relay nsncd[292]: Oct 29 11:57:07.183 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"266relay # [266511.221311] relay systemd[1]: Reloading finished in 441 ms.267relay # [266511.350091] relay systemd[1]: Started Name Service Cache Daemon (nsncd).268relay # [266511.351063] relay systemd[1]: Reached target Host and Network Name Lookups.269relay # [266511.351146] relay systemd[1]: Reached target User and Group Name Lookups.270relay # [266511.352561] relay systemd[1]: Starting User Login Management...271relay # [266511.353500] relay systemd[1]: Starting Permit User Sessions...272relay # [266511.370780] relay systemd[1]: Reload requested from client PID 355 ('systemctl') (unit flakelet-flakelet-relay.service)...273relay # [266511.370844] relay systemd[1]: Reloading...274client # [266511.114991] client systemd[1]: Started Name Service Cache Daemon (nsncd).275client # [266511.115102] client systemd[1]: Reached target Host and Network Name Lookups.276client # [266511.115273] client nsncd[301]: Oct 29 11:57:07.159 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"277client # [266511.115161] client systemd[1]: Reached target User and Group Name Lookups.278client # [266511.116776] client systemd[1]: Starting User Login Management...279client # [266511.117627] client systemd[1]: Starting Permit User Sessions...280client # [266511.148464] client systemd[1]: Finished Permit User Sessions.281client # [266511.149554] client systemd[1]: Started Console Getty.282client # [266511.149580] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0283client # [266511.149593] client systemd[1]: Reached target Login Prompts.284agent # [266511.353886] agent systemd[1]: Started Name Service Cache Daemon (nsncd).285agent # [266511.354452] agent systemd[1]: Reload requested from client PID 313 ('systemctl') (unit flakelet-app.service)...286agent # [266511.354501] agent systemd[1]: Reloading...287agent # [266511.731444] agent systemd[1]: Reloading finished in 376 ms.288relay # [266511.404581] relay dnsmasq-pre-start[370]: dnsmasq: syntax check OK.289relay # [266511.739230] relay systemd[1]: Reloading finished in 367 ms.290agent # [266511.895545] agent systemd[1]: Reload requested from client PID 312 ('systemctl') (unit flakelet-flakelet-agent.service)...291agent # [266511.895614] agent systemd[1]: Reloading...292relay # [266511.868353] relay systemd[1]: Finished Permit User Sessions.293relay # [266511.892852] relay systemd[1]: Started Console Getty.294relay # [266511.892921] relay systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0295relay # [266511.892985] relay systemd[1]: Reached target Login Prompts.296relay # [266511.896677] relay systemd[1]: Starting flakelet-relay...297agent # [266512.244490] agent systemd[1]: Reloading finished in 348 ms.298agent # [266512.316452] agent systemd[1]: Reached target Host and Network Name Lookups.299agent # [266512.316609] agent systemd[1]: Reached target User and Group Name Lookups.300agent # [266512.317930] agent systemd[1]: Starting User Login Management...301agent # [266512.318951] agent systemd[1]: Starting Permit User Sessions...302agent # [266512.322594] agent systemd[1]: Reload requested from client PID 405 ('systemctl') (unit flakelet-other.service)...303agent # [266512.322623] agent systemd[1]: Reloading...304relay # [266512.373856] relay nginx-pre-start[400]: nginx: the configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf syntax is ok305relay # [266512.374613] relay nginx-pre-start[400]: nginx: configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf test is successful306relay # [266512.404995] relay systemd[1]: Started Nginx Web Server.307relay # [266512.515823] relay systemd[1]: Starting D-Bus System Message Bus...308client # [266512.550533] client systemd-logind[313]: New seat seat0.309client # [266512.551923] client systemd[1]: Starting D-Bus System Message Bus...310client # [266512.551999] client systemd[1]: Started User Login Management.311client # [266512.553007] client systemd[1]: Starting linger-users.service...312client # [266512.586381] client systemd[1]: linger-users.service: Deactivated successfully.313client # [266512.586612] client systemd[1]: Finished linger-users.service.314client # [266512.586776] client systemd[1]: Reached target Multi-User System.315agent # [266512.736722] agent systemd[1]: Reloading finished in 413 ms.316agent # [266512.804739] agent systemd[1]: Finished Permit User Sessions.317agent # [266512.811886] agent systemd[1]: Started Console Getty.318agent # [266512.811977] agent systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0319agent # [266512.812111] agent systemd[1]: Reached target Login Prompts.320agent # [266512.813127] agent systemd[1]: Reload requested from client PID 408 ('systemctl') (unit flakelet-app.service)...321agent # [266512.813153] agent systemd[1]: Reloading...322relay # [266512.824321] relay systemd-logind[352]: New seat seat0.323relay # [266512.824670] relay systemd[1]: Started User Login Management.324relay # [266512.827285] relay systemd[1]: Starting linger-users.service...325relay # [266512.862490] relay systemd[1]: linger-users.service: Deactivated successfully.326relay # [266512.862841] relay systemd[1]: Finished linger-users.service.327client # [266513.070072] client dbus-broker-launch[323]: Looking up NSS user entry for 'systemd-timesync'...328client # [266513.071468] client dbus-broker-launch[323]: NSS returned no entry for 'systemd-timesync'329client # [266513.071505] client dbus-broker-launch[323]: Invalid user-name in /nix/store/7i7ah92glbvx09djgdsd1bfaw9z9dglx-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"330client # [266513.072376] client systemd[1]: Started D-Bus System Message Bus.331client # [266513.072739] client systemd[1]: Startup finished in 4.236s.332client # [266513.081187] client dbus-broker-launch[323]: Ready333agent # [266513.171259] agent systemd[1]: Reloading finished in 357 ms.334agent # [266513.251316] agent systemd[1]: Reload requested from client PID 444 ('systemctl') (unit flakelet-flakelet-agent.service)...335agent # [266513.251361] agent systemd[1]: Reloading...336relay # [266513.093247] relay dbus-broker-launch[406]: Looking up NSS user entry for 'systemd-timesync'...337relay # [266513.094430] relay dbus-broker-launch[406]: NSS returned no entry for 'systemd-timesync'338relay # [266513.094430] relay dbus-broker-launch[406]: Invalid user-name in /nix/store/d6qla8vgy057drw03ps2mdgny56bml50-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"339relay # [266513.095340] relay systemd[1]: Started D-Bus System Message Bus.340relay # [266513.101576] relay dbus-broker-launch[406]: Ready341relay # [266513.104837] relay systemd[1]: Started Dnsmasq Daemon.342relay # [266513.107017] relay dnsmasq[392]: started, version 2.93 cachesize 150343relay # [266513.107025] relay dnsmasq[392]: compile time options: IPv6 GNU-getopt DBus no-UBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP conntrack ipset nftset auth DNSSEC loop-detect inotify dumpfile344relay # [266513.107032] relay dnsmasq[392]: DBus support enabled: connected to system bus345relay # [266513.107048] relay dnsmasq[392]: no upstream servers configured - please set them from DBus346relay # [266513.107235] relay dnsmasq[392]: read /etc/hosts - 9 names347agent # [266513.602743] agent systemd[1]: Reloading finished in 351 ms.348agent # [266513.680431] agent systemd-logind[406]: New seat seat0.349agent # [266513.681824] agent systemd[1]: Started User Login Management.350agent # [266513.687707] agent systemd[1]: Starting D-Bus System Message Bus...351agent # [266513.688727] agent systemd[1]: Starting linger-users.service...352agent # [266513.689701] agent systemd[1]: Starting other v1...353agent # [266513.691917] agent systemd[1]: Starting flakelet-agent...354agent # [266513.722948] agent systemd[1]: Starting app v1...355agent # [266513.762253] agent systemd[1]: Started app v1.356agent # [266513.762489] agent systemd[1]: Started other v1.357agent # [266513.762885] agent systemd[1]: linger-users.service: Deactivated successfully.358agent # [266513.763093] agent systemd[1]: Finished linger-users.service.359agent # [266513.769336] agent flakelet[307]: other: updated to generation 1360agent # [266513.769839] agent flakelet[305]: app: updated to generation 1361agent # [266513.771258] agent systemd[1]: Finished Update flakelet service app.362agent # [266513.771579] agent systemd[1]: Finished Update flakelet service other.363agent # [266513.795295] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:09.839883Z","level":"INFO","message":"local change","flakelet":"app","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"}364agent # [266513.795574] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:09.840203Z","level":"INFO","message":"local change","flakelet":"other","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"}365agent # [266513.795760] agent systemd[1]: Started flakelet-agent.366agent # [266513.798965] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:09.843635Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}367agent # [266513.800955] agent flakelet[306]: flakelet-agent: updated to generation 1368agent # [266513.803317] agent systemd[1]: Finished Update flakelet service flakelet-agent.369agent # [266513.803449] agent systemd[1]: Reached target flakelet managed services.370agent # [266513.803492] agent systemd[1]: Reached target Multi-User System.371agent # [266513.819854] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:09.864538Z","level":"INFO","message":"local change","flakelet":"flakelet-agent","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"}372relay # [266513.924979] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:09.969454Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"}373relay # [266513.925804] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:09.970166Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"}374relay # [266513.925696] relay systemd[1]: Started flakelet-relay.375relay # [266513.936297] relay systemd[1]: Starting health for flakelet-relay...376relay: (finished: waiting for unit flakelet-relay.service, in 6.16 seconds)377relay: waiting for unit nginx.service378relay: (finished: waiting for unit nginx.service, in 0.01 seconds)379agent: waiting for unit flakelet.target380agent: (finished: waiting for unit flakelet.target, in 0.02 seconds)381agent: waiting for unit flakelet-agent.service382agent # [266514.152986] agent dbus-broker-launch[502]: Looking up NSS user entry for 'systemd-timesync'...383agent # [266514.154640] agent dbus-broker-launch[502]: NSS returned no entry for 'systemd-timesync'384agent # [266514.154640] agent dbus-broker-launch[502]: Invalid user-name in /nix/store/8mp15gfn2m81r8005nnkppky8976lhbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"385agent # [266514.155232] agent systemd[1]: Started D-Bus System Message Bus.386agent # [266514.155663] agent systemd[1]: Startup finished in 5.318s.387agent # [266514.161677] agent dbus-broker-launch[502]: Ready388agent: (finished: waiting for unit flakelet-agent.service, in 0.02 seconds)389client: waiting for unit multi-user.target390client: (finished: waiting for unit multi-user.target, in 0.02 seconds)391relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1'392relay # [266514.215190] relay systemd[1]: flakelet-relay-health.service: Deactivated successfully.393relay # [266514.215522] relay systemd[1]: Finished health for flakelet-relay.394relay # [266514.224086] relay flakelet[309]: flakelet-relay: updated to generation 1395relay # [266514.226987] relay systemd[1]: Finished Update flakelet service flakelet-relay.396relay # [266514.227531] relay systemd[1]: Reached target flakelet managed services.397relay # [266514.227706] relay systemd[1]: Reached target Multi-User System.398relay # [266514.227917] relay systemd[1]: Startup finished in 5.391s.399agent # [266515.819116] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:11.863688Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}400relay # [266515.819606] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:11.864148Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(1), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}401relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 2.06 seconds)402agent: must succeed: systemctl is-active app.service other.service403agent: (finished: must succeed: systemctl is-active app.service other.service, in 0.01 seconds)404subtest: deploy with client certificate, relay found via SRV405agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json406agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds)407client: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1408agent # [266516.641077] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:12.685605Z","level":"INFO","message":"start","id":"9174261a7ca12bb099b29a2c9f06baec","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}409agent # [266516.641849] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:12.686531Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"9174261a7ca12bb099b29a2c9f06baec\"]","target":"flakelet_relay::agent::jobs"}410agent # [266516.680019] agent systemd[1]: Starting flakelet update app (via relay)...411agent # [266516.712050] agent systemd[1]: Started flakelet update app (via relay).412agent # [266516.715910] agent flakelet[926]: app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2413agent # [266516.716617] agent flakelet[926]: app: activating generation 2414agent # [266516.736220] agent systemd[1]: Stopping app v1...415agent # [266516.737899] agent systemd[1]: app.service: Deactivated successfully.416agent # [266516.738180] agent systemd[1]: Stopped app v1.417agent # [266516.755074] agent systemd[1]: Reload requested from client PID 933 ('systemctl') (unit flakelet-relay-job-app.service)...418agent # [266516.755144] agent systemd[1]: Reloading...419relay # [266516.640415] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:12.685029Z","level":"INFO","message":"deploy accepted","job":"50ea80e95251de560f183c73b9c6f54d","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}420agent # [266517.098871] agent systemd[1]: Reloading finished in 343 ms.421agent # [266517.190938] agent systemd[1]: Reload requested from client PID 963 ('systemctl') (unit flakelet-relay-job-app.service)...422agent # [266517.190981] agent systemd[1]: Reloading...423agent # [266517.525748] agent systemd[1]: Reloading finished in 334 ms.424agent # [266517.603118] agent systemd[1]: Reload requested from client PID 992 ('systemctl') (unit flakelet-relay-job-app.service)...425agent # [266517.603159] agent systemd[1]: Reloading...426agent # [266517.935147] agent systemd[1]: Reloading finished in 331 ms.427agent # [266518.022188] agent systemd[1]: Reload requested from client PID 1027 ('systemctl') (unit flakelet-relay-job-app.service)...428agent # [266518.022224] agent systemd[1]: Reloading...429agent # [266518.357080] agent systemd[1]: Reloading finished in 334 ms.430agent # [266518.436192] agent systemd[1]: Starting app v2...431agent # [266518.468033] agent systemd[1]: Started app v2.432agent # [266518.473892] agent flakelet[926]: app: updated to generation 2433agent # [266518.475859] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.434client: (finished: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1, in 2.94 seconds)435agent: must succeed: systemctl show app.service -p Description | grep -q 'app v2'436agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v2', in 0.02 seconds)437agent: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2'438agent: (finished: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2', in 0.01 seconds)439agent: must succeed: flakelet status --json app | jq -c '.[0].changed.by'440agent: (finished: must succeed: flakelet status --json app | jq -c '.[0].changed.by', in 0.03 seconds)441(finished: subtest: deploy with client certificate, relay found via SRV, in 3.02 seconds)442subtest: deploy with OIDC token, sub principal443agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json444agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)445client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)446client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.07 seconds)447client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTMzNSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkzMjc1MDM1LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1TlRSTkhIQzZGNVNBPT09IiwibmJmIjoxNzkzMjc1MDM1LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.ReHQV5VTOzlHBEkMpSXhaPJcZTgwzGXSjcWsPuoyag8OUot5arBowQjMdAHd9CPl5CtQpazS5k-9z40C9k2GAQ' push --relay https://relay:7443 deploy agent/app 2>&1448agent # [266519.555386] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:15.599982Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(2)","target":"flakelet_relay::agent::jobs"}449agent # [266519.738819] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:15.783428Z","level":"INFO","message":"start","id":"ae312609b1506ea227b2e7686ddbb285","flakelet":"app","rule":"ci","relay":"relay","caller_name":"\"repo:github:example/app:ref:refs/heads/main\"","target":"flakelet_relay::agent::conn"}450agent # [266519.739464] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:15.784146Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"ae312609b1506ea227b2e7686ddbb285\"]","target":"flakelet_relay::agent::jobs"}451agent # [266519.780347] agent systemd[1]: Starting flakelet update app (via relay)...452relay # [266519.556815] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:15.601407Z","level":"INFO","message":"deploy finished","job":"50ea80e95251de560f183c73b9c6f54d","ok":true,"target":"flakelet_relay::relay::api"}453relay # [266519.738339] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:15.782980Z","level":"INFO","message":"deploy accepted","job":"5ec916933aeecdcdaae4c3bb47984aee","caller":"repo:github:example/app:ref:refs/heads/main","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}454agent # [266519.818095] agent systemd[1]: Started flakelet update app (via relay).455agent # [266519.819904] agent flakelet[1092]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1456agent # [266519.820555] agent flakelet[1092]: app: activating generation 3457agent # [266519.835044] agent systemd[1]: Stopping app v2...458agent # [266519.835493] agent systemd[1]: app.service: Deactivated successfully.459agent # [266519.835758] agent systemd[1]: Stopped app v2.460agent # [266519.852847] agent systemd[1]: Reload requested from client PID 1103 ('systemctl') (unit flakelet-relay-job-app.service)...461agent # [266519.852919] agent systemd[1]: Reloading...462agent # [266520.196801] agent systemd[1]: Reloading finished in 343 ms.463agent # [266520.271012] agent systemd[1]: Reload requested from client PID 1133 ('systemctl') (unit flakelet-relay-job-app.service)...464agent # [266520.271054] agent systemd[1]: Reloading...465agent # [266520.607058] agent systemd[1]: Reloading finished in 335 ms.466agent # [266520.692429] agent systemd[1]: Reload requested from client PID 1162 ('systemctl') (unit flakelet-relay-job-app.service)...467agent # [266520.692474] agent systemd[1]: Reloading...468agent # [266521.029423] agent systemd[1]: Reloading finished in 336 ms.469agent # [266521.109121] agent systemd[1]: Reload requested from client PID 1193 ('systemctl') (unit flakelet-relay-job-app.service)...470agent # [266521.109161] agent systemd[1]: Reloading...471agent # [266521.443058] agent systemd[1]: Reloading finished in 333 ms.472agent # [266521.522930] agent systemd[1]: Starting app v1...473agent # [266521.553236] agent systemd[1]: Started app v1.474agent # [266521.558206] agent flakelet[1092]: app: updated to generation 3475agent # [266521.560131] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.476client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTMzNSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkzMjc1MDM1LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1TlRSTkhIQzZGNVNBPT09IiwibmJmIjoxNzkzMjc1MDM1LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.ReHQV5VTOzlHBEkMpSXhaPJcZTgwzGXSjcWsPuoyag8OUot5arBowQjMdAHd9CPl5CtQpazS5k-9z40C9k2GAQ' push --relay https://relay:7443 deploy agent/app 2>&1, in 2.94 seconds)477(finished: subtest: deploy with OIDC token, sub principal, in 3.03 seconds)478subtest: policy denies uncovered target479client: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTMzNSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkzMjc1MDM1LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1TlRSTkhIQzZGNVNBPT09IiwibmJmIjoxNzkzMjc1MDM1LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.ReHQV5VTOzlHBEkMpSXhaPJcZTgwzGXSjcWsPuoyag8OUot5arBowQjMdAHd9CPl5CtQpazS5k-9z40C9k2GAQ' push --relay https://relay:7443 deploy agent/other 2>&1480client: (finished: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTMzNSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkzMjc1MDM1LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1TlRSTkhIQzZGNVNBPT09IiwibmJmIjoxNzkzMjc1MDM1LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.ReHQV5VTOzlHBEkMpSXhaPJcZTgwzGXSjcWsPuoyag8OUot5arBowQjMdAHd9CPl5CtQpazS5k-9z40C9k2GAQ' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.02 seconds)481(finished: subtest: policy denies uncovered target, in 0.02 seconds)482subtest: claim principal from groups, unchanged counts as success483client: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)484client: (finished: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.06 seconds)485client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTMzOCwiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc5MzI3NTAzOCwiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiNEtRMkNEUUhEUjdYTz09PSIsIm5iZiI6MTc5MzI3NTAzOCwic3ViIjoic29tZW9uZSJ9.I3iQXLrIce_bPoxn3HT3RW2D9IGLyZ5drY5mh08qOIvq7QOsDIT3zpXRIJ7Rp7jZfzwabNFoKXV6w4_MaDX5AQ' push --relay https://relay:7443 deploy agent/other 2>&1486agent # [266522.644482] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:18.689081Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}487agent # [266522.750433] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:18.795055Z","level":"INFO","message":"start","id":"845543a824ff5d68687449a791632cb4","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"someone\"","target":"flakelet_relay::agent::conn"}488agent # [266522.750788] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:18.795478Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"845543a824ff5d68687449a791632cb4\"]","target":"flakelet_relay::agent::jobs"}489agent # [266522.792199] agent systemd[1]: Starting flakelet update other (via relay)...490agent # [266522.829130] agent systemd[1]: Started flakelet update other (via relay).491agent # [266522.834099] agent flakelet[1247]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1492agent # [266522.834747] agent flakelet[1247]: other: up to date493agent # [266522.837440] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.494relay # [266522.645972] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:18.690567Z","level":"INFO","message":"deploy finished","job":"5ec916933aeecdcdaae4c3bb47984aee","ok":true,"target":"flakelet_relay::relay::api"}495relay # [266522.749938] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:18.794597Z","level":"INFO","message":"deploy accepted","job":"0734a9033982f394a05bfa5be748ef8e","caller":"someone","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}496client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTMzOCwiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc5MzI3NTAzOCwiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiNEtRMkNEUUhEUjdYTz09PSIsIm5iZiI6MTc5MzI3NTAzOCwic3ViIjoic29tZW9uZSJ9.I3iQXLrIce_bPoxn3HT3RW2D9IGLyZ5drY5mh08qOIvq7QOsDIT3zpXRIJ7Rp7jZfzwabNFoKXV6w4_MaDX5AQ' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.65 seconds)497(finished: subtest: claim principal from groups, unchanged counts as success, in 0.71 seconds)498subtest: push login via device flow, cached token used afterwards499client: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1500agent # [266523.376070] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:19.420602Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}501relay # [266523.377606] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:19.422237Z","level":"INFO","message":"deploy finished","job":"0734a9033982f394a05bfa5be748ef8e","ok":true,"target":"flakelet_relay::relay::api"}502relay # [266523.399055] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [29/Oct/2026 11:57:19] "POST /device HTTP/1.1" 200 -503relay # [266524.404816] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [29/Oct/2026 11:57:20] "POST /token HTTP/1.1" 400 -504client: (finished: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1, in 2.08 seconds)505client: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600506client: (finished: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600, in 0.01 seconds)507client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1508agent # [266525.485637] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:21.530245Z","level":"INFO","message":"start","id":"9b9dadc77bf75d22165c0197cefcb702","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"}509agent # [266525.486621] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:21.530766Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"9b9dadc77bf75d22165c0197cefcb702\"]","target":"flakelet_relay::agent::jobs"}510agent # [266525.526510] agent systemd[1]: Starting flakelet update other (via relay)...511agent # [266525.559133] agent systemd[1]: Started flakelet update other (via relay).512agent # [266525.563890] agent flakelet[1271]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1513agent # [266525.564517] agent flakelet[1271]: other: up to date514agent # [266525.565841] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.515relay # [266525.455815] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [29/Oct/2026 11:57:21] "POST /token HTTP/1.1" 200 -516relay # [266525.485356] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:21.530027Z","level":"INFO","message":"deploy accepted","job":"9df1d52ac275472ad4cdb63f4111fe4d","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}517client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 0.64 seconds)518client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1519agent # [266526.102796] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:22.147371Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}520agent # [266526.124057] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:22.168725Z","level":"INFO","message":"start","id":"8fc38fe3c0153f8fe990231e3eda8d40","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"}521agent # [266526.124455] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:22.169139Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"8fc38fe3c0153f8fe990231e3eda8d40\"]","target":"flakelet_relay::agent::jobs"}522agent # [266526.162252] agent systemd[1]: Starting flakelet update other (via relay)...523agent # [266526.190050] agent systemd[1]: Started flakelet update other (via relay).524agent # [266526.195031] agent flakelet[1295]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1525agent # [266526.195672] agent flakelet[1295]: other: up to date526agent # [266526.198291] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.527relay # [266526.104587] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:22.149186Z","level":"INFO","message":"deploy finished","job":"9df1d52ac275472ad4cdb63f4111fe4d","ok":true,"target":"flakelet_relay::relay::api"}528relay # [266526.123787] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:22.168439Z","level":"INFO","message":"deploy accepted","job":"0306e7d24c64b919e9a288cd03d176b9","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}529client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 0.64 seconds)530(finished: subtest: push login via device flow, cached token used afterwards, in 3.36 seconds)531subtest: waves: failing first wave skips the second532agent: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json533agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)534client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1535agent # [266526.738438] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:22.783020Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}536agent # [266526.776566] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:22.821224Z","level":"INFO","message":"start","id":"6c9bfeb00a727f5e268e07d8848d18d1","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}537agent # [266526.776985] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:22.821671Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"6c9bfeb00a727f5e268e07d8848d18d1\"]","target":"flakelet_relay::agent::jobs"}538agent # [266526.817238] agent systemd[1]: Starting flakelet update app (via relay)...539agent # [266526.844081] agent systemd[1]: Started flakelet update app (via relay).540agent # [266526.849851] agent flakelet[1318]: app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken541agent # [266526.850635] agent flakelet[1318]: app: activating generation 4542agent # [266526.867912] agent systemd[1]: Stopping app v1...543agent # [266526.869865] agent systemd[1]: app.service: Deactivated successfully.544agent # [266526.870217] agent systemd[1]: Stopped app v1.545agent # [266526.887932] agent systemd[1]: Reload requested from client PID 1325 ('systemctl') (unit flakelet-relay-job-app.service)...546agent # [266526.888017] agent systemd[1]: Reloading...547relay # [266526.740051] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:22.784652Z","level":"INFO","message":"deploy finished","job":"0306e7d24c64b919e9a288cd03d176b9","ok":true,"target":"flakelet_relay::relay::api"}548relay # [266526.776304] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:22.820927Z","level":"INFO","message":"deploy accepted","job":"733bc1b00170ad2efb3cd8d01ded8090","caller":"admin@example.org","targets":"[\"agent/app\", \"agent/other\"]","target":"flakelet_relay::relay::api"}549agent # [266527.229630] agent systemd[1]: Reloading finished in 340 ms.550agent # [266527.311351] agent systemd[1]: Reload requested from client PID 1355 ('systemctl') (unit flakelet-relay-job-app.service)...551agent # [266527.311392] agent systemd[1]: Reloading...552agent # [266527.646073] agent systemd[1]: Reloading finished in 334 ms.553agent # [266527.728577] agent systemd[1]: Reload requested from client PID 1384 ('systemctl') (unit flakelet-relay-job-app.service)...554agent # [266527.728623] agent systemd[1]: Reloading...555agent # [266528.064718] agent systemd[1]: Reloading finished in 335 ms.556agent # [266528.152227] agent systemd[1]: Reload requested from client PID 1418 ('systemctl') (unit flakelet-relay-job-app.service)...557agent # [266528.152271] agent systemd[1]: Reloading...558agent # [266528.485589] agent systemd[1]: Reloading finished in 332 ms.559agent # [266528.571051] agent systemd[1]: Starting app broken...560agent # [266528.600497] agent (nonexistent)[1449]: app.service: Unable to locate executable '/nonexistent': No such file or directory561agent # [266528.600523] agent (nonexistent)[1449]: app.service: Failed at step EXEC spawning /nonexistent: No such file or directory562agent # [266528.602231] agent systemd[1]: app.service: Main process exited, code=exited, status=203/EXEC563agent # [266528.602344] agent systemd[1]: app.service: Failed with result 'exit-code'.564agent # [266528.602704] agent systemd[1]: Failed to start app broken.565agent # [266528.634011] agent systemd[1]: Reload requested from client PID 1455 ('systemctl') (unit flakelet-relay-job-app.service)...566agent # [266528.634053] agent systemd[1]: Reloading...567agent # [266528.975098] agent systemd[1]: Reloading finished in 340 ms.568agent # [266529.063579] agent systemd[1]: Reload requested from client PID 1485 ('systemctl') (unit flakelet-relay-job-app.service)...569agent # [266529.063622] agent systemd[1]: Reloading...570agent # [266529.399807] agent systemd[1]: Reloading finished in 335 ms.571agent # [266529.478488] agent systemd[1]: Reload requested from client PID 1515 ('systemctl') (unit flakelet-relay-job-app.service)...572agent # [266529.478534] agent systemd[1]: Reloading...573agent # [266529.816267] agent systemd[1]: Reloading finished in 337 ms.574agent # [266529.911030] agent systemd[1]: Reload requested from client PID 1548 ('systemctl') (unit flakelet-relay-job-app.service)...575agent # [266529.911075] agent systemd[1]: Reloading...576agent # [266530.246354] agent systemd[1]: Reloading finished in 334 ms.577agent # [266530.328678] agent systemd[1]: Starting app v1...578agent # [266530.357187] agent systemd[1]: Started app v1.579agent # [266530.358646] agent flakelet[1318]: app: deploy failed, rolled back: systemctl start app.service failed:580agent # [266530.358646] agent flakelet[1318]: failed units: app.service. See journalctl -u app.service581agent # [266530.361302] agent systemd[1]: flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE582agent # [266530.361408] agent systemd[1]: flakelet-relay-job-app.service: Failed with result 'exit-code'.583client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1, in 4.28 seconds)584agent: must succeed: systemctl show app.service -p Description | grep -q 'app v1'585agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v1', in 0.02 seconds)586(finished: subtest: waves: failing first wave skips the second, in 4.31 seconds)587subtest: host patterns expand on the relay588agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json589agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)590client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/app' 2>&1591relay # [266531.028395] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:27.072979Z","level":"INFO","message":"deploy finished","job":"733bc1b00170ad2efb3cd8d01ded8090","ok":false,"target":"flakelet_relay::relay::api"}592relay # [266531.086886] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:27.131499Z","level":"INFO","message":"deploy accepted","job":"10cb86246319e38dae37b758dd6f62c3","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}593agent # [266531.026747] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:27.071342Z","level":"INFO","message":"update finished","flakelet":"app","status":"RolledBack","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}594agent # [266531.087277] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:27.131878Z","level":"INFO","message":"start","id":"a6e99b4ce23f5e90a5a44ac7fb37bd73","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}595agent # [266531.087841] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:27.132521Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"a6e99b4ce23f5e90a5a44ac7fb37bd73\"]","target":"flakelet_relay::agent::jobs"}596agent # [266531.126633] agent systemd[1]: Starting flakelet update app (via relay)...597agent # [266531.160988] agent systemd[1]: Started flakelet update app (via relay).598agent # [266531.165501] agent flakelet[1605]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1599agent # [266531.166141] agent flakelet[1605]: app: up to date600agent # [266531.168682] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.601client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/app' 2>&1, in 0.64 seconds)602client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '*/app' 2>&1603agent # [266531.707252] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:27.751831Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}604agent # [266531.733794] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:27.778442Z","level":"INFO","message":"start","id":"74c496f324faaa0f93995301188512f1","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}605agent # [266531.734184] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:27.778871Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"74c496f324faaa0f93995301188512f1\"]","target":"flakelet_relay::agent::jobs"}606agent # [266531.774313] agent systemd[1]: Starting flakelet update app (via relay)...607agent # [266531.805162] agent systemd[1]: Started flakelet update app (via relay).608agent # [266531.810064] agent flakelet[1625]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1609agent # [266531.810690] agent flakelet[1625]: app: up to date610agent # [266531.813895] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.611relay # [266531.708695] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:27.753279Z","level":"INFO","message":"deploy finished","job":"10cb86246319e38dae37b758dd6f62c3","ok":true,"target":"flakelet_relay::relay::api"}612relay # [266531.733470] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:27.778140Z","level":"INFO","message":"deploy accepted","job":"0e8b7b48a24812aa4569eac0cc8d0709","caller":"admin@example.org","targets":"[\"agent/app\", \"ghost/app\"]","target":"flakelet_relay::relay::api"}613client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '*/app' 2>&1, in 0.65 seconds)614client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave '*/app' 2>&1615agent # [266532.355958] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:28.400542Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}616agent # [266532.382609] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:28.427219Z","level":"INFO","message":"start","id":"e371e825438d2c03c50a38849b90887f","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}617agent # [266532.382976] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:28.427661Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"e371e825438d2c03c50a38849b90887f\"]","target":"flakelet_relay::agent::jobs"}618agent # [266532.422046] agent systemd[1]: Starting flakelet update app (via relay)...619agent # [266532.452137] agent systemd[1]: Started flakelet update app (via relay).620agent # [266532.457213] agent flakelet[1649]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1621agent # [266532.457827] agent flakelet[1649]: app: up to date622agent # [266532.460087] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.623relay # [266532.357978] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:28.402565Z","level":"INFO","message":"deploy finished","job":"0e8b7b48a24812aa4569eac0cc8d0709","ok":false,"target":"flakelet_relay::relay::api"}624relay # [266532.382178] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:28.426846Z","level":"INFO","message":"deploy accepted","job":"aaf9b0009e77d5015493de02d0bac9bb","caller":"admin@example.org","targets":"[\"agent/app\", \"ghost/app\"]","target":"flakelet_relay::relay::api"}625client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave '*/app' 2>&1, in 0.64 seconds)626client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/nope' 2>&1627client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/nope' 2>&1, in 0.02 seconds)628(finished: subtest: host patterns expand on the relay, in 1.97 seconds)629subtest: detach returns once the job is accepted630agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json631agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)632client: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1633client: (finished: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1, in 0.02 seconds)634agent: waiting for success: systemctl is-active flakelet-relay-job-app.service635relay # [266532.999196] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:29.043804Z","level":"INFO","message":"deploy finished","job":"aaf9b0009e77d5015493de02d0bac9bb","ok":false,"target":"flakelet_relay::relay::api"}636relay # [266533.055658] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:29.100275Z","level":"INFO","message":"deploy accepted","job":"491840c6c9e2630c684986c027f9f755","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}637agent # [266532.997440] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:29.042044Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}638agent # [266533.055980] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:29.100613Z","level":"INFO","message":"start","id":"731f3f00480a52479d6b84b094ade9b3","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}639agent # [266533.056303] agent flakelet-agent[505]: {"timestamp":"2026-10-29T11:57:29.100997Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"731f3f00480a52479d6b84b094ade9b3\"]","target":"flakelet_relay::agent::jobs"}640agent # [266533.095814] agent systemd[1]: Starting flakelet update app (via relay)...641agent # [266533.132282] agent systemd[1]: Started flakelet update app (via relay).642agent # [266533.137179] agent flakelet[1673]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2643agent # [266533.137934] agent flakelet[1673]: app: activating generation 4644agent # [266533.152620] agent systemd[1]: Stopping app v1...645agent # [266533.153052] agent systemd[1]: app.service: Deactivated successfully.646agent # [266533.153335] agent systemd[1]: Stopped app v1.647agent # [266533.172094] agent systemd[1]: Reload requested from client PID 1680 ('systemctl') (unit flakelet-relay-job-app.service)...648agent # [266533.172168] agent systemd[1]: Reloading...649agent # [266533.519907] agent systemd[1]: Reloading finished in 347 ms.650agent # [266533.608728] agent systemd[1]: Reload requested from client PID 1710 ('systemctl') (unit flakelet-relay-job-app.service)...651agent # [266533.608772] agent systemd[1]: Reloading...652agent # [266533.940134] agent systemd[1]: Reloading finished in 330 ms.653agent # [266534.023375] agent systemd[1]: Reload requested from client PID 1742 ('systemctl') (unit flakelet-relay-job-app.service)...654agent # [266534.023412] agent systemd[1]: Reloading...655agent: (finished: waiting for success: systemctl is-active flakelet-relay-job-app.service, in 1.37 seconds)656??? Warning (UserWarning): wait_until_fails(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.657 File "/nix/store/f3vbkhcnzmgjphqaarrzgjdpzrb02va5-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39658agent: waiting for failure: systemctl is-active flakelet-relay-job-app.service659??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.660 File "/nix/store/f3vbkhcnzmgjphqaarrzgjdpzrb02va5-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39661agent # [266534.354885] agent systemd[1]: Reloading finished in 331 ms.662agent # [266534.439402] agent systemd[1]: Reload requested from client PID 1775 ('systemctl') (unit flakelet-relay-job-app.service)...663agent # [266534.439439] agent systemd[1]: Reloading...664agent # [266534.774931] agent systemd[1]: Reloading finished in 335 ms.665agent # [266534.849846] agent systemd[1]: Starting app slow2...666agent # [266540.919219] agent systemd[1]: Started app slow2.667agent # [266540.929652] agent flakelet[1673]: app: updated to generation 4668agent # [266540.932220] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.669agent: (finished: waiting for failure: systemctl is-active flakelet-relay-job-app.service, in 7.51 seconds)670(finished: subtest: detach returns once the job is accepted, in 8.92 seconds)671subtest: unknown host is final, missing agent is retried, agents listing672client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1673client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1, in 0.02 seconds)674agent: must succeed: systemctl stop flakelet-agent675agent: (finished: must succeed: systemctl stop flakelet-agent, in 0.08 seconds)676relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0'677relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0', in 0.02 seconds)678client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 &679client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 &, in 0.01 seconds)680client: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out681agent # [266541.973903] agent systemd[1]: Stopping flakelet-agent...682agent # [266542.007557] agent systemd[1]: flakelet-agent.service: Deactivated successfully.683agent # [266542.007982] agent systemd[1]: Stopped flakelet-agent.684agent # [266542.008455] agent systemd[1]: flakelet-agent.service: Consumed 1.817s CPU time over 28.315s wall clock time.685relay # [266541.974080] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:38.018685Z","level":"INFO","message":"agent disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","host":"agent","target":"flakelet_relay::relay::agent_conn"}686client: (finished: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out, in 1.02 seconds)687agent: must succeed: systemctl start flakelet-agent688agent: (finished: must succeed: systemctl start flakelet-agent, in 0.10 seconds)689??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.690 File "/nix/store/f3vbkhcnzmgjphqaarrzgjdpzrb02va5-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39691client: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out692agent # [266543.101906] agent systemd[1]: Starting flakelet-agent...693agent # [266543.156975] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:39.201609Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"731f3f00480a52479d6b84b094ade9b3\"]","target":"flakelet_relay::agent::jobs"}694agent # [266543.186908] agent systemd[1]: Started flakelet-agent.695agent # [266543.194015] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:39.238688Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}696relay # [266543.194118] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:39.238736Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(4), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}697agent # [266543.704633] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:39.749222Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(4)","target":"flakelet_relay::agent::jobs"}698agent # [266545.085733] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:41.130310Z","level":"INFO","message":"start","id":"d5dbba536267baa250b4e006e739f4d4","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}699agent # [266545.086760] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:41.131135Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"d5dbba536267baa250b4e006e739f4d4\"]","target":"flakelet_relay::agent::jobs"}700agent # [266545.123530] agent systemd[1]: Starting flakelet update other (via relay)...701agent # [266545.150940] agent systemd[1]: Started flakelet update other (via relay).702agent # [266545.155855] agent flakelet[2258]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1703agent # [266545.156516] agent flakelet[2258]: other: up to date704agent # [266545.157160] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.705relay # [266545.085295] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:41.129883Z","level":"INFO","message":"deploy accepted","job":"0a52aa9cb748b9fe8a2335f490a6eaf9","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}706agent # [266545.701223] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:41.745812Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}707relay # [266545.702692] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:41.747300Z","level":"INFO","message":"deploy finished","job":"0a52aa9cb748b9fe8a2335f490a6eaf9","ok":true,"target":"flakelet_relay::relay::api"}708client: (finished: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out, in 3.04 seconds)709client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents710client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents, in 0.02 seconds)711client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)712client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.06 seconds)713client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTM2MiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkzMjc1MDYyLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJMRUVLQ0JMNkRERk9VPT09IiwibmJmIjoxNzkzMjc1MDYyLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.fVGWM_VYOTwQTlDaefO7-mgJgX5NSVRNdRsNz3E68NwfG1etsv8abCARvnPT0CmzwBDUs3H9_nfTuH1WIntJDg' push --relay https://relay:7443 agents714client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTM2MiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkzMjc1MDYyLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJMRUVLQ0JMNkRERk9VPT09IiwibmJmIjoxNzkzMjc1MDYyLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.fVGWM_VYOTwQTlDaefO7-mgJgX5NSVRNdRsNz3E68NwfG1etsv8abCARvnPT0CmzwBDUs3H9_nfTuH1WIntJDg' push --relay https://relay:7443 agents, in 0.02 seconds)715(finished: subtest: unknown host is final, missing agent is retried, agents listing, in 4.39 seconds)716subtest: out-of-band flakelet update reaches the relay without reconnect717agent: must succeed: flakelet status --json app | jq '.[0].generation'718agent: (finished: must succeed: flakelet status --json app | jq '.[0].generation', in 0.03 seconds)719agent: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true720agent: (finished: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true, in 0.01 seconds)721agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json722agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)723agent: must succeed: flakelet update app724app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2725app: activating generation 5726agent # [266546.420247] agent systemd[1]: Stopping app slow2...727agent # [266546.422107] agent systemd[1]: app.service: Deactivated successfully.728agent # [266546.422453] agent systemd[1]: Stopped app slow2.729agent # [266546.439517] agent systemd[1]: Reload requested from client PID 2292 ('systemctl')...730agent # [266546.439588] agent systemd[1]: Reloading...731agent # [266546.785971] agent systemd[1]: Reloading finished in 345 ms.732agent # [266546.870477] agent systemd[1]: Reload requested from client PID 2321 ('systemctl')...733agent # [266546.870521] agent systemd[1]: Reloading...734agent # [266547.203159] agent systemd[1]: Reloading finished in 332 ms.735agent # [266547.281549] agent systemd[1]: Reload requested from client PID 2352 ('systemctl')...736agent # [266547.281591] agent systemd[1]: Reloading...737agent # [266547.612471] agent systemd[1]: Reloading finished in 330 ms.738agent # [266547.698418] agent systemd[1]: Reload requested from client PID 2382 ('systemctl')...739agent # [266547.698459] agent systemd[1]: Reloading...740agent: (finished: must succeed: flakelet update app, in 1.75 seconds)741client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@5'742agent # [266548.028996] agent systemd[1]: Reloading finished in 330 ms.743agent # [266548.106250] agent systemd[1]: Starting app v2...744agent # [266548.136120] agent systemd[1]: Started app v2.745agent # [266549.208685] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:45.253278Z","level":"INFO","message":"local change","flakelet":"app","generation":5,"by":"root (shell)","target":"flakelet_relay::agent::jobs"}746client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@5', in 2.06 seconds)747agent: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true748agent: (finished: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true, in 0.01 seconds)749client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-5-750client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-5-, in 0.02 seconds)751client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-752client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-, in 0.02 seconds)753agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json754agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)755agent: must succeed: flakelet update app756app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1757app: activating generation 6758agent # [266550.303823] agent systemd[1]: Stopping app v2...759agent # [266550.304569] agent systemd[1]: app.service: Deactivated successfully.760agent # [266550.304704] agent systemd[1]: Stopped app v2.761agent # [266550.315989] agent systemd[1]: Reload requested from client PID 2428 ('systemctl')...762agent # [266550.316036] agent systemd[1]: Reloading...763agent # [266550.651857] agent systemd[1]: Reloading finished in 335 ms.764agent # [266550.722596] agent systemd[1]: Reload requested from client PID 2457 ('systemctl')...765agent # [266550.722637] agent systemd[1]: Reloading...766agent # [266551.052974] agent systemd[1]: Reloading finished in 329 ms.767agent # [266551.131266] agent systemd[1]: Reload requested from client PID 2485 ('systemctl')...768agent # [266551.131308] agent systemd[1]: Reloading...769agent # [266551.463274] agent systemd[1]: Reloading finished in 331 ms.770agent # [266551.544918] agent systemd[1]: Reload requested from client PID 2517 ('systemctl')...771agent # [266551.544961] agent systemd[1]: Reloading...772agent: (finished: must succeed: flakelet update app, in 1.72 seconds)773client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@6'774agent # [266551.875599] agent systemd[1]: Reloading finished in 330 ms.775agent # [266551.949808] agent systemd[1]: Starting app v1...776agent # [266551.987113] agent systemd[1]: Started app v1.777agent # [266553.209929] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:49.254524Z","level":"INFO","message":"local change","flakelet":"app","generation":6,"by":"root (shell)","target":"flakelet_relay::agent::jobs"}778client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@6', in 2.07 seconds)779(finished: subtest: out-of-band flakelet update reaches the relay without reconnect, in 7.73 seconds)780subtest: certificate not listed under agents cannot connect as agent781client: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent782client: (finished: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent, in 0.03 seconds)783(finished: subtest: certificate not listed under agents cannot connect as agent, in 0.03 seconds)784subtest: metrics785relay: must succeed: curl -sf http://127.0.0.1:7400/metrics786relay: (finished: must succeed: curl -sf http://127.0.0.1:7400/metrics, in 0.02 seconds)787(finished: subtest: metrics, in 0.02 seconds)788subtest: agent link drop mid-run replays missed lines once789agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json790agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds)791agent: must succeed: date +%s792agent: (finished: must succeed: date +%s, in 0.01 seconds)793client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 &794client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 &, in 0.01 seconds)795agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1793275070 | grep -q 'app-slow'796agent # [266554.157782] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:50.202383Z","level":"INFO","message":"start","id":"a1c4a2de0c5c246d614c4f47fffcf736","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}797agent # [266554.158237] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:50.202912Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"a1c4a2de0c5c246d614c4f47fffcf736\"]","target":"flakelet_relay::agent::jobs"}798agent # [266554.192036] agent systemd[1]: Starting flakelet update app (via relay)...799agent # [266554.222246] agent systemd[1]: Started flakelet update app (via relay).800agent # [266554.227415] agent flakelet[2567]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow801agent # [266554.228124] agent flakelet[2567]: app: activating generation 7802agent # [266554.239179] agent systemd[1]: Stopping app v1...803agent # [266554.239400] agent systemd[1]: app.service: Deactivated successfully.804agent # [266554.239530] agent systemd[1]: Stopped app v1.805agent # [266554.252386] agent systemd[1]: Reload requested from client PID 2574 ('systemctl') (unit flakelet-relay-job-app.service)...806agent # [266554.252422] agent systemd[1]: Reloading...807relay # [266554.091660] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:50.136246Z","level":"INFO","message":"agent rejected: no agents entry matches","principals":"[\"x509:dns:mallory\"]","target":"flakelet_relay::relay::agent_conn"}808relay # [266554.157378] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:50.201981Z","level":"INFO","message":"deploy accepted","job":"9bba4b27c17ab8bd69eaf2cbaab6e313","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}809agent # [266554.585642] agent systemd[1]: Reloading finished in 332 ms.810agent # [266554.685252] agent systemd[1]: Reload requested from client PID 2604 ('systemctl') (unit flakelet-relay-job-app.service)...811agent # [266554.685294] agent systemd[1]: Reloading...812agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1793275070 | grep -q 'app-slow', in 1.03 seconds)813agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done814agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done, in 0.02 seconds)815relay: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done816relay: (finished: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done, in 0.10 seconds)817agent: must succeed: ss -K dport = 7443818agent # [266555.015732] agent systemd[1]: Reloading finished in 330 ms.819agent # [266555.094031] agent systemd[1]: Reload requested from client PID 2633 ('systemctl') (unit flakelet-relay-job-app.service)...820agent # [266555.094073] agent systemd[1]: Reloading...821agent: (finished: must succeed: ss -K dport = 7443, in 0.03 seconds)822agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1793275070 | grep -q 'updated to generation'823relay # [266555.291102] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:57:51.335636Z","level":"INFO","message":"agent disconnected: IO error: Software caused connection abort (os error 103)","host":"agent","target":"flakelet_relay::relay::agent_conn"}824agent # [266555.322180] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:51.366599Z","level":"INFO","message":"disconnected: IO error: Software caused connection abort (os error 103)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}825agent # [266555.431399] agent systemd[1]: Reloading finished in 336 ms.826agent # [266555.511494] agent systemd[1]: Reload requested from client PID 2681 ('systemctl') (unit flakelet-relay-job-app.service)...827agent # [266555.511537] agent systemd[1]: Reloading...828agent # [266555.841620] agent systemd[1]: Reloading finished in 329 ms.829agent # [266555.915672] agent systemd[1]: Starting app slow...830agent # [266556.324940] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:52.369565Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}831agent # [266558.327531] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:54.372160Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}832agent # [266561.987159] agent systemd[1]: Started app slow.833agent # [266561.996879] agent flakelet[2567]: app: updated to generation 7834agent # [266561.999422] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.835agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1793275070 | grep -q 'updated to generation', in 7.11 seconds)836agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done837agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done, in 0.02 seconds)838client: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out839agent # [266562.330212] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:58.374817Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}840agent # [266563.094107] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:57:59.138753Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(7)","target":"flakelet_relay::agent::jobs"}841client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out, in 8.09 seconds)842client: must succeed: cat /tmp/slow.out843client: (finished: must succeed: cat /tmp/slow.out, in 0.01 seconds)844(finished: subtest: agent link drop mid-run replays missed lines once, in 16.45 seconds)845subtest: agent restart mid-run reattaches to the unit846agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json847agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)848client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 &849client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 &, in 0.01 seconds)850agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2'851relay # [266570.334281] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:58:06.378898Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}852agent # [266570.334194] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:58:06.378798Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}853relay # [266570.336078] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:58:06.380691Z","level":"INFO","message":"deploy finished","job":"9bba4b27c17ab8bd69eaf2cbaab6e313","ok":true,"target":"flakelet_relay::relay::api"}854agent # [266570.335417] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:58:06.380100Z","level":"INFO","message":"start","id":"a1c4a2de0c5c246d614c4f47fffcf736","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}855relay # [266570.595968] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:58:06.640393Z","level":"INFO","message":"deploy accepted","job":"259b463dff0a6c16cb92d5a6405e826e","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}856agent # [266570.596425] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:58:06.640914Z","level":"INFO","message":"start","id":"a45d894b47eba56a30d0f26d522e4dda","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}857agent # [266570.596932] agent flakelet-agent[1845]: {"timestamp":"2026-10-29T11:58:06.641612Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"a45d894b47eba56a30d0f26d522e4dda\"]","target":"flakelet_relay::agent::jobs"}858agent # [266570.635509] agent systemd[1]: Starting flakelet update app (via relay)...859agent # [266570.666021] agent systemd[1]: Started flakelet update app (via relay).860agent # [266570.669692] agent flakelet[2803]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2861agent # [266570.670318] agent flakelet[2803]: app: activating generation 8862agent # [266570.690659] agent systemd[1]: Stopping app slow...863agent # [266570.691300] agent systemd[1]: app.service: Deactivated successfully.864agent # [266570.691610] agent systemd[1]: Stopped app slow.865agent # [266570.708815] agent systemd[1]: Reload requested from client PID 2810 ('systemctl') (unit flakelet-relay-job-app.service)...866agent # [266570.708894] agent systemd[1]: Reloading...867agent # [266571.055606] agent systemd[1]: Reloading finished in 345 ms.868agent # [266571.148867] agent systemd[1]: Reload requested from client PID 2840 ('systemctl') (unit flakelet-relay-job-app.service)...869agent # [266571.148912] agent systemd[1]: Reloading...870agent # [266571.482255] agent systemd[1]: Reloading finished in 332 ms.871agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2', in 1.03 seconds)872agent: must succeed: systemctl restart flakelet-agent873agent # [266571.561824] agent systemd[1]: Reload requested from client PID 2872 ('systemctl') (unit flakelet-relay-job-app.service)...874agent # [266571.561871] agent systemd[1]: Reloading...875agent # [266571.896655] agent systemd[1]: Reloading finished in 334 ms.876agent # [266571.983340] agent systemd[1]: Stopping flakelet-agent...877agent # [266571.991622] agent systemd[1]: Reload requested from client PID 2908 ('systemctl') (unit flakelet-relay-job-app.service)...878agent # [266571.991656] agent systemd[1]: Reloading...879relay # [266571.983788] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:58:08.028413Z","level":"INFO","message":"agent disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","host":"agent","target":"flakelet_relay::relay::agent_conn"}880agent: (finished: must succeed: systemctl restart flakelet-agent, in 0.90 seconds)881agent: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)"882agent: (finished: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)", in 0.01 seconds)883client: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out884agent # [266572.330541] agent systemd[1]: Reloading finished in 338 ms.885agent # [266572.406725] agent systemd[1]: flakelet-agent.service: Deactivated successfully.886agent # [266572.406934] agent systemd[1]: Stopped flakelet-agent.887agent # [266572.406949] agent systemd[1]: flakelet-agent.service: Consumed 1.246s CPU time over 29.304s wall clock time.888agent # [266572.425516] agent systemd[1]: Starting app slow2...889agent # [266572.426317] agent systemd[1]: Starting flakelet-agent...890agent # [266572.487467] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:08.532131Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"a45d894b47eba56a30d0f26d522e4dda\"]","target":"flakelet_relay::agent::jobs"}891agent # [266572.511659] agent systemd[1]: Started flakelet-agent.892agent # [266572.518484] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:08.563170Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}893agent # [266572.519658] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:08.564353Z","level":"INFO","message":"start","id":"a45d894b47eba56a30d0f26d522e4dda","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}894relay # [266572.518601] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:58:08.563220Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}895agent # [266578.499098] agent systemd[1]: Started app slow2.896agent # [266578.508483] agent flakelet[2803]: app: updated to generation 8897agent # [266578.512047] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.898agent # [266579.080425] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:15.125056Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(8)","target":"flakelet_relay::agent::jobs"}899relay # [266579.082221] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:58:15.126834Z","level":"INFO","message":"deploy finished","job":"259b463dff0a6c16cb92d5a6405e826e","ok":true,"target":"flakelet_relay::relay::api"}900client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out, in 7.08 seconds)901client: must succeed: cat /tmp/restart.out902client: (finished: must succeed: cat /tmp/restart.out, in 0.01 seconds)903agent: must succeed: systemctl is-active app.service904agent: (finished: must succeed: systemctl is-active app.service, in 0.01 seconds)905(finished: subtest: agent restart mid-run reattaches to the unit, in 9.07 seconds)906subtest: relay restart mid-run, push resumes via /v1/jobs907agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json908agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds)909agent: must succeed: date +%s910agent: (finished: must succeed: date +%s, in 0.01 seconds)911client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 &912client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 &, in 0.01 seconds)913agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1793275095 | grep -q 'app-slow'914agent # [266579.672236] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:15.716852Z","level":"INFO","message":"start","id":"7da99991fbf28290212d38e8f1ca9457","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}915agent # [266579.672887] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:15.717568Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"7da99991fbf28290212d38e8f1ca9457\"]","target":"flakelet_relay::agent::jobs"}916agent # [266579.712112] agent systemd[1]: Starting flakelet update app (via relay)...917agent # [266579.745111] agent systemd[1]: Started flakelet update app (via relay).918agent # [266579.749543] agent flakelet[3385]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow919agent # [266579.750174] agent flakelet[3385]: app: activating generation 9920agent # [266579.770507] agent systemd[1]: Stopping app slow2...921agent # [266579.771093] agent systemd[1]: app.service: Deactivated successfully.922agent # [266579.771404] agent systemd[1]: Stopped app slow2.923agent # [266579.788636] agent systemd[1]: Reload requested from client PID 3392 ('systemctl') (unit flakelet-relay-job-app.service)...924agent # [266579.788717] agent systemd[1]: Reloading...925relay # [266579.671795] relay flakelet-relay[398]: {"timestamp":"2026-10-29T11:58:15.716411Z","level":"INFO","message":"deploy accepted","job":"afdc82f903930c4d580fa788e4b73123","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}926agent # [266580.135724] agent systemd[1]: Reloading finished in 346 ms.927agent # [266580.226839] agent systemd[1]: Reload requested from client PID 3422 ('systemctl') (unit flakelet-relay-job-app.service)...928agent # [266580.226887] agent systemd[1]: Reloading...929agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1793275095 | grep -q 'app-slow', in 1.03 seconds)930relay: must succeed: systemctl restart flakelet-relay931agent # [266580.562362] agent systemd[1]: Reloading finished in 335 ms.932agent # [266580.642315] agent systemd[1]: Reload requested from client PID 3454 ('systemctl') (unit flakelet-relay-job-app.service)...933agent # [266580.642355] agent systemd[1]: Reloading...934agent # [266580.702866] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:16.747495Z","level":"INFO","message":"disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}935relay # [266580.702264] relay systemd[1]: Stopping flakelet-relay...936relay # [266580.739440] relay systemd[1]: flakelet-relay.service: Deactivated successfully.937relay # [266580.739727] relay systemd[1]: Stopped flakelet-relay.938relay # [266580.739753] relay systemd[1]: flakelet-relay.service: Consumed 2.749s CPU time over 1min 8.842s wall clock time.939relay # [266580.757137] relay systemd[1]: Starting flakelet-relay...940agent # [266580.992399] agent systemd[1]: Reloading finished in 349 ms.941agent # [266581.093758] agent systemd[1]: Reload requested from client PID 3489 ('systemctl') (unit flakelet-relay-job-app.service)...942agent # [266581.093807] agent systemd[1]: Reloading...943agent # [266581.434770] agent systemd[1]: Reloading finished in 340 ms.944agent # [266581.519799] agent systemd[1]: Starting app slow...945agent # [266581.705608] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:17.750080Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}946relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.49 seconds)947client: waiting for success: grep -q '» ok' /tmp/resume.out948relay # [266582.182396] relay flakelet-relay[930]: {"timestamp":"2026-10-29T11:58:18.227050Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"}949relay # [266582.182858] relay flakelet-relay[930]: {"timestamp":"2026-10-29T11:58:18.227456Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"}950relay # [266582.183094] relay systemd[1]: Started flakelet-relay.951agent # [266583.717552] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:19.762161Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}952relay # [266583.718350] relay flakelet-relay[930]: {"timestamp":"2026-10-29T11:58:19.762939Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(8), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}953agent # [266587.593091] agent systemd[1]: Started app slow.954agent # [266587.602329] agent flakelet[3385]: app: updated to generation 9955agent # [266587.605867] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.956relay # [266587.723569] relay flakelet-relay[930]: {"timestamp":"2026-10-29T11:58:23.768200Z","level":"INFO","message":"job reattached","job":"afdc82f903930c4d580fa788e4b73123","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}957agent # [266588.679903] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:24.724551Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(9)","target":"flakelet_relay::agent::jobs"}958client: (finished: waiting for success: grep -q '» ok' /tmp/resume.out, in 7.09 seconds)959client: must succeed: cat /tmp/resume.out960client: (finished: must succeed: cat /tmp/resume.out, in 0.01 seconds)961(finished: subtest: relay restart mid-run, push resumes via /v1/jobs, in 9.65 seconds)962subtest: job history comes from the agents and survives a relay restart963client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1964agent # [266589.303788] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:25.348409Z","level":"INFO","message":"start","id":"5be20c693e5c0b60e3f85779794dfb86","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}965agent # [266589.304239] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:25.348919Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5be20c693e5c0b60e3f85779794dfb86\"]","target":"flakelet_relay::agent::jobs"}966agent # [266589.339173] agent systemd[1]: Starting flakelet update other (via relay)...967agent # [266589.372853] agent systemd[1]: Started flakelet update other (via relay).968agent # [266589.378027] agent flakelet[3563]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1969agent # [266589.378685] agent flakelet[3563]: other: up to date970agent # [266589.379243] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.971relay # [266589.303363] relay flakelet-relay[930]: {"timestamp":"2026-10-29T11:58:25.348008Z","level":"INFO","message":"deploy accepted","job":"188b06c4636b65849b3ba8daac22dc7c","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}972client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1, in 0.64 seconds)973relay: must succeed: systemctl restart flakelet-relay974agent # [266589.918027] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:25.962634Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}975agent # [266589.933951] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:25.978615Z","level":"INFO","message":"disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}976relay # [266589.919657] relay flakelet-relay[930]: {"timestamp":"2026-10-29T11:58:25.964244Z","level":"INFO","message":"deploy finished","job":"188b06c4636b65849b3ba8daac22dc7c","ok":true,"target":"flakelet_relay::relay::api"}977relay # [266589.933384] relay systemd[1]: Stopping flakelet-relay...978relay # [266589.969039] relay systemd[1]: flakelet-relay.service: Deactivated successfully.979relay # [266589.969335] relay systemd[1]: Stopped flakelet-relay.980relay # [266589.969357] relay systemd[1]: flakelet-relay.service: Consumed 1.893s CPU time over 9.211s wall clock time.981relay # [266589.986890] relay systemd[1]: Starting flakelet-relay...982agent # [266590.937266] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:26.981869Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}983relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.45 seconds)984relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1'985relay # [266591.372942] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:27.417553Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"}986relay # [266591.373741] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:27.418048Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"}987relay # [266591.373451] relay systemd[1]: Started flakelet-relay.988agent # [266592.951762] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:28.996351Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}989relay # [266592.951891] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:28.996495Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(9), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}990relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 2.06 seconds)991client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs992client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs, in 0.02 seconds)993client: must succeed: echo '{"groups": [], "repository": "example/app"}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)994client: (finished: must succeed: echo '{"groups": [], "repository": "example/app"}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.06 seconds)995client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTQwOSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkzMjc1MTA5LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJYNEM0Nk5aU05CS1QyPT09IiwibmJmIjoxNzkzMjc1MTA5LCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.4uM-fk6Ikor2rXMq0VLaoJGKXaI1mbkDCIN5AuZHNRT1Daq3QD9hUSdjHb8zYnNkKHZW6wofdINIsY_lBa5AAw' push --relay https://relay:7443 deploy --id hist2 agent/app996» job 6a239dbf87cfec796e49404c351d787f via relay 0.1.0 (agents: agent 0.1.0)997» wave 0998agent/app | Starting flakelet update app (via relay)...999agent/app | Started flakelet update app (via relay).1000relay # [266593.535292] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:29.579945Z","level":"INFO","message":"deploy accepted","job":"6a239dbf87cfec796e49404c351d787f","caller":"example/app","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}1001agent # [266593.535800] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:29.580430Z","level":"INFO","message":"start","id":"dce6faec8455f85321e72ee634888126","flakelet":"app","rule":"ci","relay":"relay","caller_name":"\"example/app\"","target":"flakelet_relay::agent::conn"}1002agent # [266593.536599] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:29.581281Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"dce6faec8455f85321e72ee634888126\"]","target":"flakelet_relay::agent::jobs"}1003agent # [266593.568817] agent systemd[1]: Starting flakelet update app (via relay)...1004agent # [266593.603549] agent systemd[1]: Started flakelet update app (via relay).1005agent # [266593.609052] agent flakelet[3591]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow1006agent/appagent # [266593.609681] agent flakelet[3591]: app: up to date1007 | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow1008agent/appagent # [266593.610435] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.1009 | app: up to date1010agent/app | flakelet-relay-job-app.service: Deactivated successfully.1011» agent/app: unchanged (generation 9)1012» ok1013client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTQwOSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkzMjc1MTA5LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJYNEM0Nk5aU05CS1QyPT09IiwibmJmIjoxNzkzMjc1MTA5LCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.4uM-fk6Ikor2rXMq0VLaoJGKXaI1mbkDCIN5AuZHNRT1Daq3QD9hUSdjHb8zYnNkKHZW6wofdINIsY_lBa5AAw' push --relay https://relay:7443 deploy --id hist2 agent/app, in 0.63 seconds)1014client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTQwOSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkzMjc1MTA5LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJYNEM0Nk5aU05CS1QyPT09IiwibmJmIjoxNzkzMjc1MTA5LCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.4uM-fk6Ikor2rXMq0VLaoJGKXaI1mbkDCIN5AuZHNRT1Daq3QD9hUSdjHb8zYnNkKHZW6wofdINIsY_lBa5AAw' push --relay https://relay:7443 jobs1015client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MzI3NTQwOSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkzMjc1MTA5LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJYNEM0Nk5aU05CS1QyPT09IiwibmJmIjoxNzkzMjc1MTA5LCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.4uM-fk6Ikor2rXMq0VLaoJGKXaI1mbkDCIN5AuZHNRT1Daq3QD9hUSdjHb8zYnNkKHZW6wofdINIsY_lBa5AAw' push --relay https://relay:7443 jobs, in 0.02 seconds)1016(finished: subtest: job history comes from the agents and survives a relay restart, in 4.89 seconds)1017subtest: dashboard login via authorization code flow1018client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login'1019client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login', in 0.02 seconds)1020client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login1021client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login, in 0.09 seconds)1022client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs1023client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs, in 0.02 seconds)1024client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist11025client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist1, in 0.02 seconds)1026client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true1027client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true, in 0.02 seconds)1028client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 4031029client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 403, in 0.02 seconds)1030client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other'1031client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other', in 0.02 seconds)1032client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/9edaf7aee415527a98aa8353d394db00/events || true1033relay # [266594.148732] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:30.193339Z","level":"INFO","message":"deploy finished","job":"6a239dbf87cfec796e49404c351d787f","ok":true,"target":"flakelet_relay::relay::api"}1034relay # [266594.229789] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [29/Oct/2026 11:58:30] "GET /authorize?response_type=code&client_id=dashboard&redirect_uri=https%3A%2F%2Frelay%3A7443%2Fui%2Fcallback&scope=openid%20profile%20email%20groups&state=P1jUIg97f9yfNuhmcqQX-sFNFxWXN6VqdCs7k6EHv88&code_challenge=-oKHuGbZGbj_H9K-Bnt1650APakNlZqA2TdEqZ5pRw8&code_challenge_method=S256 HTTP/1.1" 302 -1035relay # [266594.281898] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [29/Oct/2026 11:58:30] "POST /token HTTP/1.1" 200 -1036relay # [266594.283137] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:30.327802Z","level":"INFO","message":"login","name":"dev@example.org","principals":"[\"oidc:mock:someone\", \"oidc:mock:groups:wheel\"]","target":"flakelet_relay::relay::login"}1037relay # [266594.349683] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:30.394334Z","level":"INFO","message":"job reattached","job":"188b06c4636b65849b3ba8daac22dc7c","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1038relay # [266594.392058] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:30.436731Z","level":"INFO","message":"deploy accepted","job":"b9f05ac31fd4c66dba40eb647d5e5db3","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1039relay # [266594.413617] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:30.458251Z","level":"INFO","message":"job reattached","job":"b9f05ac31fd4c66dba40eb647d5e5db3","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1040agent # [266594.146836] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:30.191489Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(9)","target":"flakelet_relay::agent::jobs"}1041agent # [266594.392363] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:30.436983Z","level":"INFO","message":"start","id":"b44e35fe0537259d074149f514c59069","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"}1042agent # [266594.392888] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:30.437577Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"b44e35fe0537259d074149f514c59069\"]","target":"flakelet_relay::agent::jobs"}1043agent # [266594.425660] agent systemd[1]: Starting flakelet update other (via relay)...1044agent # [266594.462995] agent systemd[1]: Started flakelet update other (via relay).1045agent # [266594.467803] agent flakelet[3611]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v11046agent # [266594.468372] agent flakelet[3611]: other: up to date1047agent # [266594.470668] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.1048client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/9edaf7aee415527a98aa8353d394db00/events || true, in 0.62 seconds)1049client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/9edaf7aee415527a98aa8353d394db001050client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/9edaf7aee415527a98aa8353d394db00, in 0.02 seconds)1051client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js1052client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js, in 0.02 seconds)1053client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth'1054client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth', in 0.02 seconds)1055client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other1056client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other, in 0.02 seconds)1057client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected'1058client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected', in 0.02 seconds)1059client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=9edaf7aee415527a98aa8353d394db00' | grep -q 4001060client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=9edaf7aee415527a98aa8353d394db00' | grep -q 400, in 0.02 seconds)1061client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 &1062client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 &, in 0.01 seconds)1063client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other1064» job 38796a7ba508eadfe82a1cd5def000bc via relay 0.1.0 (agents: agent 0.1.0)1065» wave 01066agent/other | Starting flakelet update other (via relay)...1067agent/other | Started flakelet update other (via relay).1068agent/other | other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v11069agent/other | other: up to date1070agent # [266595.007919] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:31.052504Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}1071agent # [266595.163904] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:31.208515Z","level":"INFO","message":"start","id":"5e317fc57863c2a7c03ebe1bdacd1356","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}1072agent # [266595.164689] agent flakelet-agent[2940]: {"timestamp":"2026-10-29T11:58:31.209242Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5e317fc57863c2a7c03ebe1bdacd1356\"]","target":"flakelet_relay::agent::jobs"}1073agent # [266595.204381] agent systemd[1]: Starting flakelet update other (via relay)...1074agent/otheragent # [266595.242040] agent systemd[1]: Started flakelet update other (via relay).1075 | flakelet-relay-job-other.service: Deactivated successfully.1076agent # [266595.247053] agent flakelet[3635]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v11077agent # [266595.247610] agent flakelet[3635]: other: up to date1078agent # [266595.248824] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.1079relay # [266595.163511] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:31.208126Z","level":"INFO","message":"deploy accepted","job":"38796a7ba508eadfe82a1cd5def000bc","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1080» agent/other: unchanged (generation 1)1081» ok1082client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other, in 0.64 seconds)1083client: waiting for success: grep -q live1 /tmp/ev.out1084client: (finished: waiting for success: grep -q live1 /tmp/ev.out, in 0.01 seconds)1085client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout1086client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout, in 0.02 seconds)1087client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 3031088client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 303, in 0.02 seconds)1089(finished: subtest: dashboard login via authorization code flow, in 1.67 seconds)1090(finished: run the VM test script, in 87.56 seconds)1091test script finished in 87.59s1092cleanup1093kill NspawnMachine (pid 52)1094kill NspawnMachine (pid 53)1095Container agent terminated by signal KILL.1096relay # [266595.787539] relay flakelet-relay[1320]: {"timestamp":"2026-10-29T11:58:31.832134Z","level":"INFO","message":"deploy finished","job":"38796a7ba508eadfe82a1cd5def000bc","ok":true,"target":"flakelet_relay::relay::api"}1097kill NspawnMachine (pid 54)1098Container client terminated by signal KILL.1099Container relay terminated by signal KILL.1100(finished: cleanup, in 0.39 seconds)1101additionally exposed symbols:1102 agent, client, relay,1103 vlan1,1104 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh1105» job 50ea80e95251de560f183c73b9c6f54d via relay 0.1.0 (agents: agent 0.1.0)1106» wave 01107agent/app | Starting flakelet update app (via relay)...1108agent/app | Started flakelet update app (via relay).1109agent/app | app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v21110agent/app | app: activating generation 21111agent/app | app: updated to generation 21112agent/app | flakelet-relay-job-app.service: Deactivated successfully.1113» agent/app: updated (generation 2)1114» ok11151116» job 733bc1b00170ad2efb3cd8d01ded8090 via relay 0.1.0 (agents: agent 0.1.0)1117» wave 01118agent/app | Starting flakelet update app (via relay)...1119agent/app | Started flakelet update app (via relay).1120agent/app | app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken1121agent/app | app: activating generation 41122agent/app | app: deploy failed, rolled back: systemctl start app.service failed:1123agent/app | failed units: app.service. See journalctl -u app.service1124agent/app | flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE1125agent/app | flakelet-relay-job-app.service: Failed with result 'exit-code'.1126» agent/app: rolled-back (generation 3)1127agent/app │ Starting app v1...1128agent/app │ Started app v1.1129agent/app │ Stopping app v1...1130agent/app │ app.service: Deactivated successfully.1131agent/app │ Stopped app v1.1132agent/app │ Starting app v2...1133agent/app │ Started app v2.1134agent/app │ Stopping app v2...1135agent/app │ app.service: Deactivated successfully.1136agent/app │ Stopped app v2.1137agent/app │ Starting app v1...1138agent/app │ Started app v1.1139agent/app │ Stopping app v1...1140agent/app │ app.service: Deactivated successfully.1141agent/app │ Stopped app v1.1142agent/app │ Starting app broken...1143agent/app │ app.service: Unable to locate executable '/nonexistent': No such file or directory1144agent/app │ app.service: Failed at step EXEC spawning /nonexistent: No such file or directory1145agent/app │ app.service: Main process exited, code=exited, status=203/EXEC1146agent/app │ app.service: Failed with result 'exit-code'.1147agent/app │ Failed to start app broken.1148agent/app │ Starting app v1...1149agent/app │ Started app v1.1150» skipped: agent/other1151» failed11521153» job 9bba4b27c17ab8bd69eaf2cbaab6e313 via relay 0.1.0 (agents: agent 0.1.0)1154» wave 01155agent/app | Starting flakelet update app (via relay)...1156agent/app | Started flakelet update app (via relay).1157agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow1158agent/app | app: activating generation 71159agent/app | app: updated to generation 71160agent/app | flakelet-relay-job-app.service: Deactivated successfully.1161» agent/app: updated (generation 7)1162» ok11631164» job 259b463dff0a6c16cb92d5a6405e826e via relay 0.1.0 (agents: agent 0.1.0)1165» wave 01166agent/app | Starting flakelet update app (via relay)...1167agent/app | Started flakelet update app (via relay).1168agent/app | app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow21169agent/app | app: activating generation 81170agent/app | app: updated to generation 81171agent/app | flakelet-relay-job-app.service: Deactivated successfully.1172» agent/app: updated (generation 8)1173» ok11741175» job afdc82f903930c4d580fa788e4b73123 via relay 0.1.0 (agents: agent 0.1.0)1176» wave 01177agent/app | Starting flakelet update app (via relay)...1178agent/app | Started flakelet update app (via relay).1179agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow1180agent/app | app: activating generation 91181flakelet-push: stream: error reading a body from connection, resuming job 8330accfb3967d9e796ca8bdb6e64fe71182flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 1s1183flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 2s1184flakelet-push: https://relay:7443: 404 Not Found: unknown_job: no connected agent knows this job, retrying in 4s1185» job afdc82f903930c4d580fa788e4b73123 via relay 0.1.0 (agents: agent 0.1.0)1186» wave 01187agent/app | app: updated to generation 91188agent/app | flakelet-relay-job-app.service: Deactivated successfully.1189» agent/app: updated (generation 9)1190» ok119111921793275105 hist1 admin@example.org agent/other:unchanged11931793275095 8330accfb3967d9e796ca8bdb6e64fe7 admin@example.org agent/app:updated11941793275086 c09b4eac27d7416debc0cefee9d4c0de admin@example.org agent/app:updated11951793275070 2a080914182527c2217269e4923cd691 admin@example.org agent/app:updated11961793275068 local-app-6-1793275068 root (shell) agent/app:updated11971793275064 local-app-5-1793275064 root (shell) agent/app:updated11981793275061 e854cf45ada1e090f43dafd4b365c24d admin@example.org agent/other:unchanged11991793275049 5e83aa0e8872a598d412b97f0f181ed8 admin@example.org agent/app:updated12001793275048 960f4973ee6baa0081981b5314a74482 admin@example.org agent/app:unchanged12011793275047 b2c1ef352e2dd768da4488c4f9063f9b admin@example.org agent/app:unchanged12021793275047 e8f02c7956c6522ad435e8a1a0ecb60b admin@example.org agent/app:unchanged12031793275042 5c105440926a0eb31e9213fe085b2d9d admin@example.org agent/app:rolled-back12041793275042 f5f731de551daf3665deee9141d858c7 dev@example.org agent/other:unchanged12051793275041 072b8ea377bcc792d60bfe58dd62947c dev@example.org agent/other:unchanged12061793275038 c45f843718385f8846673619ba465334 someone agent/other:unchanged12071793275035 c638370ac7f2c94854b2cdc0334289f8 repo:github:example/app:ref:refs/heads/main agent/app:updated12081793275032 8c74b2b402eb2da8e6ab8948e90aa206 admin@example.org agent/app:updated12091793275029 local-app-1-1793275029 host activation agent/app:updated12101793275029 local-flakelet-agent-1-1793275029 host activation agent/flakelet-agent:updated12111793275029 local-other-1-1793275029 host activation agent/other:updated1212