container-test-run-flakelet-relay
checks.x86_64-linux.nixos-test
· build #50
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Initializing machine ID from random generator.6Test will time out and terminate in 3600.0 seconds7run the VM test script8start all VMs9client: systemd-nspawn running (pid 52)10agent: systemd-nspawn running (pid 53)11client: Waiting for journal at /build/vm-state-client/var/log/journal...12relay: systemd-nspawn running (pid 54)13agent: Waiting for journal at /build/vm-state-agent/var/log/journal...14relay: Waiting for journal at /build/vm-state-relay/var/log/journal...15(finished: start all VMs, in 0.00 seconds)16relay: waiting for unit flakelet-relay.service17nixos-nspawn(relay): TAP vde-tap1 not found; container will be isolated from VDE18nixos-nspawn(relay): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.19nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE20nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.21nixos-nspawn(agent): TAP vde-tap1 not found; container will be isolated from VDE22nixos-nspawn(agent): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.23Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.24Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.25Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.26░ Spawning container agent on /build/vm-state-agent.27░ Spawning container client on /build/vm-state-client.28░ Spawning container relay on /build/vm-state-relay.29relay # No journal files were found.30client # No journal files were found.31relay # No journal boot entry found for the specified boot (+0).32client # No journal boot entry found for the specified boot (+0).33agent # No journal files were found.34agent # No journal boot entry found for the specified boot (+0).35client # [700390.235494] client systemd-journald[57]: Journal started36client # [700390.235611] client systemd-journald[57]: Runtime Journal (/run/log/journal/60263719190e4c11bf27140e4d7d05ec) is 8M, max 4G, 3.9G free.37client # [700390.251314] client systemd[1]: Finished Apply Kernel Variables.38client # [700390.267559] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully.39client # [700390.286114] client systemd[1]: Starting Flush Journal to Persistent Storage...40client # [700390.287401] client systemd[1]: Starting Create Static Device Nodes in /dev...41client # [700390.318168] client systemd-journald[57]: Time spent on flushing to /var/log/journal/60263719190e4c11bf27140e4d7d05ec is 1.824ms for 6 entries.42client # [700390.318168] client systemd-journald[57]: System Journal (/var/log/journal/60263719190e4c11bf27140e4d7d05ec) is 512B, max 4G, 3.9G free.43client # [700390.328203] client systemd[1]: Finished Create Static Device Nodes in /dev.44client # [700390.329193] client systemd[1]: Reached target Preparation for Local File Systems.45client # [700390.329346] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys46client # [700390.347247] client systemd[1]: Finished Flush Journal to Persistent Storage.47client # [700390.405784] client systemd[1]: Finished Firewall.48agent # [700390.239220] agent systemd-journald[57]: Journal started49relay # [700390.236135] relay systemd-journald[57]: Journal started50agent # [700390.239273] agent systemd-journald[57]: Runtime Journal (/run/log/journal/1de2fe6976b04121845c0febd4faa84a) is 8M, max 4G, 3.9G free.51relay # [700390.236183] relay systemd-journald[57]: Runtime Journal (/run/log/journal/d10137ea47c04e17a451aee45f0a3554) is 8M, max 4G, 3.9G free.52agent # [700390.250772] agent systemd[1]: Finished Apply Kernel Variables.53relay # [700390.250687] relay systemd[1]: Finished Apply Kernel Variables.54agent # [700390.265563] agent systemd[1]: Finished Create Static Device Nodes in /dev gracefully.55relay # [700390.264865] relay systemd[1]: Finished Create Static Device Nodes in /dev gracefully.56agent # [700390.282746] agent systemd[1]: Starting Flush Journal to Persistent Storage...57relay # [700390.285234] relay systemd[1]: Starting Flush Journal to Persistent Storage...58agent # [700390.283730] agent systemd[1]: Starting Create Static Device Nodes in /dev...59relay # [700390.286433] relay systemd[1]: Starting Create Static Device Nodes in /dev...60agent # [700390.317328] agent systemd-journald[57]: Time spent on flushing to /var/log/journal/1de2fe6976b04121845c0febd4faa84a is 2.125ms for 6 entries.61relay # [700390.317315] relay systemd-journald[57]: Time spent on flushing to /var/log/journal/d10137ea47c04e17a451aee45f0a3554 is 3.177ms for 6 entries.62agent # [700390.317328] agent systemd-journald[57]: System Journal (/var/log/journal/1de2fe6976b04121845c0febd4faa84a) is 512B, max 4G, 3.9G free.63relay # [700390.317315] relay systemd-journald[57]: System Journal (/var/log/journal/d10137ea47c04e17a451aee45f0a3554) is 512B, max 4G, 3.9G free.64agent # [700390.327212] agent systemd[1]: Finished Create Static Device Nodes in /dev.65relay # [700390.326533] relay systemd[1]: Finished Create Static Device Nodes in /dev.66agent # [700390.328139] agent systemd[1]: Reached target Preparation for Local File Systems.67relay # [700390.327636] relay systemd[1]: Reached target Preparation for Local File Systems.68agent # [700390.328282] agent systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys69relay # [700390.327845] relay systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys70agent # [700390.344209] agent systemd[1]: Finished Flush Journal to Persistent Storage.71relay # [700390.352172] relay systemd[1]: Finished Flush Journal to Persistent Storage.72agent # [700390.411104] agent systemd[1]: Finished Firewall.73relay # [700390.419755] relay systemd[1]: Finished Firewall.74client # [700391.233853] client systemd[1]: Mounting /run/wrappers...75client # [700391.281900] client systemd[1]: Mounted /run/wrappers.76client # [700391.282822] client systemd[1]: Reached target Local File Systems.77client # [700391.283724] client systemd[1]: Listening on Boot Loader Control Service Socket.78client # [700391.284742] client systemd[1]: Starting Create SUID/SGID Wrappers...79client # [700391.284773] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container80client # [700391.285853] client systemd[1]: Starting Save Transient machine-id to Disk...81client # [700391.286658] client systemd[1]: Starting Create System Files and Directories...82client # [700391.308036] client systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted83client # [700391.308531] client systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted84client # [700391.308850] client systemd-tmpfiles[161]: fchmod() of /var/log/journal/60263719190e4c11bf27140e4d7d05ec failed: Operation not permitted85client # [700391.309213] client systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted86relay # [700391.235790] relay systemd[1]: Mounting /run/wrappers...87relay # [700391.293855] relay systemd[1]: Mounted /run/wrappers.88relay # [700391.294951] relay systemd[1]: Reached target Local File Systems.89relay # [700391.295878] relay systemd[1]: Listening on Boot Loader Control Service Socket.90relay # [700391.297662] relay systemd[1]: Starting Create SUID/SGID Wrappers...91relay # [700391.297698] relay systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container92relay # [700391.298727] relay systemd[1]: Starting Save Transient machine-id to Disk...93relay # [700391.300255] relay systemd[1]: Starting Create System Files and Directories...94relay # [700391.322575] relay systemd-tmpfiles[169]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted95relay # [700391.323062] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal failed: Operation not permitted96relay # [700391.323452] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal/d10137ea47c04e17a451aee45f0a3554 failed: Operation not permitted97relay # [700391.323818] relay systemd-tmpfiles[169]: fchmod() of /run/log/journal failed: Operation not permitted98agent # [700391.261830] agent systemd[1]: Mounting /run/wrappers...99agent # [700391.300625] agent systemd[1]: Mounted /run/wrappers.100agent # [700391.301944] agent systemd[1]: Reached target Local File Systems.101agent # [700391.303324] agent systemd[1]: Listening on Boot Loader Control Service Socket.102agent # [700391.304783] agent systemd[1]: Starting Create SUID/SGID Wrappers...103agent # [700391.304837] agent systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container104agent # [700391.305983] agent systemd[1]: Starting Save Transient machine-id to Disk...105agent # [700391.306998] agent systemd[1]: Starting Create System Files and Directories...106agent # [700391.327329] agent systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted107agent # [700391.327782] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted108agent # [700391.328151] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal/1de2fe6976b04121845c0febd4faa84a failed: Operation not permitted109agent # [700391.328529] agent systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted110client # [700391.311587] client suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.a3TROpLTqP/chsh': Operation not permitted111client # [700391.312212] client systemd[1]: Finished Create System Files and Directories.112client # [700391.325456] client systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE113client # [700391.325703] client systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'.114client # [700391.325848] client systemd[1]: Failed to start Create SUID/SGID Wrappers.115client # [700391.327969] client systemd[1]: Starting Rebuild Journal Catalog...116client # [700391.328836] client systemd[1]: Starting Record System Boot/Shutdown in UTMP...117client # [700391.345109] client systemd[1]: Finished Record System Boot/Shutdown in UTMP.118client # [700391.351912] client systemd[1]: Finished Rebuild Journal Catalog.119client # [700391.353497] client systemd[1]: Starting Update is Completed...120client # [700391.368162] client systemd[1]: Finished Update is Completed.121client # [700391.368286] client systemd[1]: Reached target System Initialization.122client # [700391.368398] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container123client # [700391.368495] client systemd[1]: Started Daily Cleanup of Temporary Directories.124client # [700391.368521] client systemd[1]: Reached target Timer Units.125client # [700391.368648] client systemd[1]: Listening on D-Bus System Message Bus Socket.126client # [700391.368876] client systemd[1]: Listening on Nix Daemon Socket.127client # [700391.368986] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.128client # [700391.369018] client systemd[1]: Reached target Socket Units.129client # [700391.369045] client systemd[1]: Reached target Basic System.130client # [700391.370917] client systemd[1]: Starting Import lastlog data into lastlog2 database...131client # [700391.372268] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...132client # [700391.373280] client systemd[1]: Starting resolvconf update...133client # [700391.394848] client systemd[1]: Finished Import lastlog data into lastlog2 database.134client # [700391.460586] client systemd[1]: Finished resolvconf update.135client # [700391.460760] client systemd[1]: Reached target Preparation for Network.136client # [700391.462136] client systemd[1]: Starting Address configuration of eth1...137client # [700391.463102] client systemd[1]: Starting Extra networking commands....138client # [700391.483795] client network-addresses-eth1-start[232]: adding address 192.168.1.2/24... done139relay # [700391.324778] relay suid-sgid-wrappers-start[176]: chmod: changing permissions of '/run/wrappers/wrappers.3OV9YVMWxK/chsh': Operation not permitted140relay # [700391.325554] relay systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE141relay # [700391.326483] relay systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'.142relay # [700391.326632] relay systemd[1]: Failed to start Create SUID/SGID Wrappers.143relay # [700391.327238] relay systemd[1]: Finished Create System Files and Directories.144relay # [700391.342297] relay systemd[1]: Starting Rebuild Journal Catalog...145relay # [700391.343067] relay systemd[1]: Starting Record System Boot/Shutdown in UTMP...146relay # [700391.357867] relay systemd[1]: Finished Record System Boot/Shutdown in UTMP.147relay # [700391.365470] relay systemd[1]: Finished Rebuild Journal Catalog.148relay # [700391.366498] relay systemd[1]: Starting Update is Completed...149relay # [700391.379960] relay systemd[1]: Finished Update is Completed.150relay # [700391.380099] relay systemd[1]: Reached target System Initialization.151relay # [700391.380200] relay systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container152relay # [700391.380238] relay systemd[1]: Started Daily Cleanup of Temporary Directories.153relay # [700391.380255] relay systemd[1]: Reached target Timer Units.154relay # [700391.380379] relay systemd[1]: Listening on D-Bus System Message Bus Socket.155relay # [700391.380586] relay systemd[1]: Listening on Nix Daemon Socket.156relay # [700391.380697] relay systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.157relay # [700391.380715] relay systemd[1]: Reached target Socket Units.158relay # [700391.380748] relay systemd[1]: Reached target Basic System.159relay # [700391.382119] relay systemd[1]: Started device-mock.service.160relay # [700391.383238] relay systemd[1]: Starting Re-link flakelet services at boot...161relay # [700391.383921] relay systemd[1]: Starting Import lastlog data into lastlog2 database...162relay # [700391.384894] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)...163relay # [700391.385577] relay systemd[1]: Starting resolvconf update...164relay # [700391.399119] relay systemd[1]: Finished Re-link flakelet services at boot.165relay # [700391.401086] relay systemd[1]: Starting Reconcile flakelet services with the host configuration...166relay # [700391.409487] relay systemd[1]: Finished Import lastlog data into lastlog2 database.167relay # [700391.414947] relay systemd[1]: Finished Reconcile flakelet services with the host configuration.168relay # [700391.470344] relay systemd[1]: Finished resolvconf update.169relay # [700391.471252] relay systemd[1]: Reached target Preparation for Network.170relay # [700391.472418] relay systemd[1]: Starting Address configuration of eth1...171relay # [700391.473452] relay systemd[1]: Starting Extra networking commands....172agent # [700391.332141] agent suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.Rxv6ArievP/chsh': Operation not permitted173agent # [700391.334724] agent systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE174agent # [700391.334767] agent systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'.175agent # [700391.334849] agent systemd[1]: Failed to start Create SUID/SGID Wrappers.176agent # [700391.335430] agent systemd[1]: Finished Create System Files and Directories.177agent # [700391.351811] agent systemd[1]: Starting Rebuild Journal Catalog...178agent # [700391.352572] agent systemd[1]: Starting Record System Boot/Shutdown in UTMP...179agent # [700391.365887] agent systemd[1]: Finished Record System Boot/Shutdown in UTMP.180agent # [700391.372359] agent systemd[1]: Finished Rebuild Journal Catalog.181agent # [700391.373763] agent systemd[1]: Starting Update is Completed...182agent # [700391.386138] agent systemd[1]: Finished Update is Completed.183agent # [700391.386251] agent systemd[1]: Reached target System Initialization.184agent # [700391.387333] agent systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container185agent # [700391.387366] agent systemd[1]: Started Daily Cleanup of Temporary Directories.186agent # [700391.387383] agent systemd[1]: Reached target Timer Units.187agent # [700391.387498] agent systemd[1]: Listening on D-Bus System Message Bus Socket.188agent # [700391.387679] agent systemd[1]: Listening on Nix Daemon Socket.189agent # [700391.387790] agent systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.190agent # [700391.387803] agent systemd[1]: Reached target Socket Units.191agent # [700391.387832] agent systemd[1]: Reached target Basic System.192agent # [700391.389351] agent systemd[1]: Starting Re-link flakelet services at boot...193agent # [700391.390238] agent systemd[1]: Starting Import lastlog data into lastlog2 database...194agent # [700391.391046] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)...195agent # [700391.391777] agent systemd[1]: Starting resolvconf update...196agent # [700391.405888] agent systemd[1]: Finished Re-link flakelet services at boot.197agent # [700391.406901] agent systemd[1]: Starting Reconcile flakelet services with the host configuration...198agent # [700391.414874] agent systemd[1]: Finished Import lastlog data into lastlog2 database.199agent # [700391.420568] agent systemd[1]: Finished Reconcile flakelet services with the host configuration.200agent # [700391.481096] agent systemd[1]: Finished resolvconf update.201agent # [700391.481294] agent systemd[1]: Reached target Preparation for Network.202agent # [700391.482413] agent systemd[1]: Starting Address configuration of eth1...203agent # [700391.483337] agent systemd[1]: Starting Extra networking commands....204agent # [700391.492640] agent systemd[1]: nscd.service: Deactivated successfully.205agent # [700391.493422] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd).206agent # [700391.501032] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)...207relay # [700391.499985] relay network-addresses-eth1-start[245]: adding address 192.168.1.3/24... done208relay # [700391.506590] relay systemd[1]: nscd.service: Deactivated successfully.209relay # [700391.507373] relay systemd[1]: Stopped Name Service Cache Daemon (nsncd).210relay # [700391.510518] relay network-addresses-eth1-start[245]: adding address 2001:db8:1::3/64... done211relay # [700391.513338] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)...212relay # [700391.524302] relay systemd[1]: Finished Address configuration of eth1.213relay # [700391.637362] relay systemd[1]: etc-machine\x2did.mount: Deactivated successfully.214relay # [700391.647695] relay systemd[1]: Finished Save Transient machine-id to Disk.215relay # [700391.647929] relay systemd[1]: Finished Extra networking commands..216relay # [700391.649363] relay systemd[1]: Reached target Network.217relay # [700391.651114] relay systemd[1]: Starting Dnsmasq Daemon...218relay # [700391.652275] relay systemd[1]: Starting Nginx Web Server...219relay # [700391.653238] relay systemd[1]: Starting Update flakelet service flakelet-relay...220relay # [700391.689999] relay flakelet[311]: flakelet-relay: using prebuilt artifact /nix/store/y3gnbrl1fryd5dds2nvy2yaq1gd1p6d7-flakelet-flakelet-relay221relay # [700391.690980] relay flakelet[311]: flakelet-relay: activating generation 1222relay # [700391.695927] relay systemd[1]: Reload requested from client PID 316 ('systemctl') (unit flakelet-flakelet-relay.service)...223relay # [700391.695980] relay systemd[1]: Reloading...224agent # [700391.524043] agent network-addresses-eth1-start[236]: adding address 192.168.1.1/24... done225agent # [700391.532890] agent network-addresses-eth1-start[236]: adding address 2001:db8:1::1/64... done226agent # [700391.540142] agent systemd[1]: Finished Address configuration of eth1.227agent # [700391.587106] agent systemd[1]: Finished Extra networking commands..228agent # [700391.647442] agent systemd[1]: etc-machine\x2did.mount: Deactivated successfully.229agent # [700391.648564] agent systemd[1]: Finished Save Transient machine-id to Disk.230agent # [700391.649099] agent systemd[1]: nscd.service: Deactivated successfully.231agent # [700391.649318] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd).232agent # [700391.654449] agent systemd[1]: Reached target Network.233agent # [700391.656156] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)...234agent # [700391.681847] agent systemd[1]: Starting Update flakelet service app...235agent # [700391.683331] agent systemd[1]: Starting Update flakelet service flakelet-agent...236agent # [700391.684506] agent systemd[1]: Starting Update flakelet service other...237agent # [700391.695252] agent flakelet[308]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1238agent # [700391.695917] agent flakelet[308]: app: activating generation 1239agent # [700391.696790] agent flakelet[310]: flakelet-agent: using prebuilt artifact /nix/store/vz76x5rfl6mkhhwkjdbnnwlmnjvn913r-flakelet-flakelet-agent240agent # [700391.697542] agent flakelet[310]: flakelet-agent: activating generation 1241agent # [700391.699260] agent flakelet[311]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1242agent # [700391.699917] agent flakelet[311]: other: activating generation 1243agent # [700391.702308] agent systemd[1]: Reload requested from client PID 312 ('systemctl') (unit flakelet-app.service)...244agent # [700391.702372] agent systemd[1]: Reloading...245client # [700391.487495] client network-addresses-eth1-start[232]: adding address 2001:db8:1::2/64... done246client # [700391.498366] client systemd[1]: Finished Address configuration of eth1.247client # [700391.525984] client systemd[1]: nscd.service: Deactivated successfully.248client # [700391.526910] client systemd[1]: Stopped Name Service Cache Daemon (nsncd).249client # [700391.532229] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...250client # [700391.652358] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully.251client # [700391.653934] client systemd[1]: Finished Save Transient machine-id to Disk.252client # [700391.683238] client systemd[1]: Finished Extra networking commands..253client # [700391.683480] client systemd[1]: Reached target Network.254client # [700391.684838] client systemd[1]: nscd.service: Deactivated successfully.255client # [700391.685050] client systemd[1]: Stopped Name Service Cache Daemon (nsncd).256client # [700391.689603] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...257relay # [700392.000075] relay nsncd[264]: Oct 22 11:56:24.810 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"258relay # [700392.144027] relay systemd[1]: Reloading finished in 447 ms.259client # [700392.041595] client nsncd[303]: Oct 22 11:56:24.852 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"260client # [700392.041826] client systemd[1]: Started Name Service Cache Daemon (nsncd).261client # [700392.041931] client systemd[1]: Reached target Host and Network Name Lookups.262client # [700392.042206] client systemd[1]: Reached target User and Group Name Lookups.263client # [700392.048190] client systemd[1]: Starting User Login Management...264client # [700392.052481] client systemd[1]: Starting Permit User Sessions...265client # [700392.085627] client systemd[1]: Finished Permit User Sessions.266client # [700392.087945] client systemd[1]: Started Console Getty.267client # [700392.088022] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0268client # [700392.088056] client systemd[1]: Reached target Login Prompts.269agent # [700392.064187] agent nsncd[307]: Oct 22 11:56:24.874 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"270agent # [700392.142577] agent systemd[1]: Reloading finished in 439 ms.271agent # [700392.284681] agent systemd[1]: Started Name Service Cache Daemon (nsncd).272agent # [700392.285850] agent systemd[1]: Reload requested from client PID 313 ('systemctl') (unit flakelet-flakelet-agent.service)...273agent # [700392.285896] agent systemd[1]: Reloading...274relay # [700392.281989] relay systemd[1]: Started Name Service Cache Daemon (nsncd).275relay # [700392.283303] relay systemd[1]: Reached target Host and Network Name Lookups.276relay # [700392.283423] relay systemd[1]: Reached target User and Group Name Lookups.277relay # [700392.284696] relay systemd[1]: Starting User Login Management...278relay # [700392.285739] relay systemd[1]: Starting Permit User Sessions...279relay # [700392.298701] relay systemd[1]: Reload requested from client PID 357 ('systemctl') (unit flakelet-flakelet-relay.service)...280relay # [700392.298744] relay systemd[1]: Reloading...281relay # [700392.461622] relay dnsmasq-pre-start[393]: dnsmasq: syntax check OK.282relay # [700392.700929] relay systemd[1]: Reloading finished in 401 ms.283relay # [700392.815654] relay systemd[1]: Finished Permit User Sessions.284relay # [700392.840993] relay systemd[1]: Started Console Getty.285relay # [700392.841093] relay systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0286relay # [700392.841125] relay systemd[1]: Reached target Login Prompts.287relay # [700392.847959] relay systemd[1]: Starting flakelet-relay...288agent # [700392.687795] agent systemd[1]: Reloading finished in 401 ms.289agent # [700392.817131] agent systemd[1]: Reload requested from client PID 314 ('systemctl') (unit flakelet-other.service)...290agent # [700392.817175] agent systemd[1]: Reloading...291agent # [700393.217329] agent systemd[1]: Reloading finished in 399 ms.292agent # [700393.293941] agent systemd[1]: Reached target Host and Network Name Lookups.293agent # [700393.294043] agent systemd[1]: Reached target User and Group Name Lookups.294agent # [700393.295765] agent systemd[1]: Starting User Login Management...295agent # [700393.297284] agent systemd[1]: Starting Permit User Sessions...296agent # [700393.302250] agent systemd[1]: Reload requested from client PID 405 ('systemctl') (unit flakelet-app.service)...297agent # [700393.302281] agent systemd[1]: Reloading...298client # [700393.585280] client systemd-logind[313]: New seat seat0.299client # [700393.586674] client systemd[1]: Starting D-Bus System Message Bus...300client # [700393.586784] client systemd[1]: Started User Login Management.301client # [700393.587763] client systemd[1]: Starting linger-users.service...302client # [700393.635247] client systemd[1]: linger-users.service: Deactivated successfully.303client # [700393.635606] client systemd[1]: Finished linger-users.service.304client # [700393.635982] client systemd[1]: Reached target Multi-User System.305relay # [700393.591333] relay systemd[1]: Starting D-Bus System Message Bus...306relay # [700393.686641] relay nginx-pre-start[403]: nginx: the configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf syntax is ok307relay # [700393.687175] relay nginx-pre-start[403]: nginx: configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf test is successful308relay # [700393.706820] relay systemd[1]: Started Nginx Web Server.309agent # [700393.715307] agent systemd[1]: Reloading finished in 412 ms.310agent # [700393.796709] agent systemd[1]: Finished Permit User Sessions.311agent # [700393.798024] agent systemd[1]: Reload requested from client PID 407 ('systemctl') (unit flakelet-flakelet-agent.service)...312agent # [700393.798072] agent systemd[1]: Reloading...313relay # [700394.173593] relay systemd-logind[354]: New seat seat0.314relay # [700394.174013] relay systemd[1]: Started User Login Management.315relay # [700394.176281] relay systemd[1]: Starting linger-users.service...316relay # [700394.216267] relay systemd[1]: linger-users.service: Deactivated successfully.317relay # [700394.216969] relay systemd[1]: Finished linger-users.service.318relay # [700394.258513] relay dbus-broker-launch[402]: Looking up NSS user entry for 'systemd-timesync'...319relay # [700394.259429] relay dbus-broker-launch[402]: NSS returned no entry for 'systemd-timesync'320relay # [700394.259429] relay dbus-broker-launch[402]: Invalid user-name in /nix/store/d6qla8vgy057drw03ps2mdgny56bml50-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"321relay # [700394.261289] relay systemd[1]: Started D-Bus System Message Bus.322relay # [700394.266532] relay dbus-broker-launch[402]: Ready323relay # [700394.269039] relay systemd[1]: Started Dnsmasq Daemon.324relay # [700394.271424] relay dnsmasq[394]: started, version 2.93 cachesize 150325relay # [700394.271433] relay dnsmasq[394]: compile time options: IPv6 GNU-getopt DBus no-UBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP conntrack ipset nftset auth DNSSEC loop-detect inotify dumpfile326relay # [700394.271440] relay dnsmasq[394]: DBus support enabled: connected to system bus327relay # [700394.271456] relay dnsmasq[394]: no upstream servers configured - please set them from DBus328relay # [700394.271654] relay dnsmasq[394]: read /etc/hosts - 9 names329agent # [700394.167162] agent systemd[1]: Reloading finished in 368 ms.330agent # [700394.271735] agent systemd[1]: Started Console Getty.331agent # [700394.271882] agent systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0332agent # [700394.272063] agent systemd[1]: Reached target Login Prompts.333agent # [700394.274487] agent systemd[1]: Reload requested from client PID 410 ('systemctl') (unit flakelet-other.service)...334agent # [700394.274535] agent systemd[1]: Reloading...335client # [700394.235363] client dbus-broker-launch[325]: Looking up NSS user entry for 'systemd-timesync'...336client # [700394.237138] client dbus-broker-launch[325]: NSS returned no entry for 'systemd-timesync'337client # [700394.237138] client dbus-broker-launch[325]: Invalid user-name in /nix/store/8w2iy6ppcnz5rh85pl49lll2sd0qdm3l-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"338client # [700394.238195] client systemd[1]: Started D-Bus System Message Bus.339client # [700394.238749] client systemd[1]: Startup finished in 4.467s.340client # [700394.250804] client dbus-broker-launch[325]: Ready341agent # [700394.634546] agent systemd[1]: Reloading finished in 359 ms.342agent # [700394.768185] agent systemd[1]: Starting app v1...343agent # [700394.769310] agent systemd[1]: Starting flakelet-agent...344agent # [700394.773084] agent systemd[1]: Starting other v1...345agent # [700394.828456] agent systemd[1]: Started app v1.346agent # [700394.828692] agent systemd[1]: Started other v1.347agent # [700394.836137] agent flakelet[311]: other: updated to generation 1348agent # [700394.836513] agent flakelet[308]: app: updated to generation 1349agent # [700394.838362] agent systemd[1]: Finished Update flakelet service app.350agent # [700394.838750] agent systemd[1]: Finished Update flakelet service other.351agent # [700394.872568] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:27.682912Z","level":"INFO","message":"local change","flakelet":"app","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"}352agent # [700394.872933] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:27.683311Z","level":"INFO","message":"local change","flakelet":"other","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"}353agent # [700394.873187] agent systemd[1]: Started flakelet-agent.354agent # [700394.877520] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:27.687978Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}355agent # [700394.879229] agent flakelet[310]: flakelet-agent: updated to generation 1356agent # [700394.881351] agent systemd[1]: Finished Update flakelet service flakelet-agent.357agent # [700394.881519] agent systemd[1]: Reached target flakelet managed services.358agent # [700394.904302] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:27.714717Z","level":"INFO","message":"local change","flakelet":"flakelet-agent","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"}359agent # [700394.982183] agent systemd-logind[408]: New seat seat0.360agent # [700394.982500] agent systemd[1]: Started User Login Management.361agent # [700394.983997] agent systemd[1]: Starting D-Bus System Message Bus...362agent # [700394.985268] agent systemd[1]: Starting linger-users.service...363agent # [700395.021038] agent systemd[1]: linger-users.service: Deactivated successfully.364agent # [700395.021265] agent systemd[1]: Finished linger-users.service.365agent # [700395.021452] agent systemd[1]: Reached target Multi-User System.366relay # [700395.256787] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:28.067017Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"}367relay # [700395.257784] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:28.067910Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"}368relay # [700395.257552] relay systemd[1]: Started flakelet-relay.369relay # [700395.265086] relay systemd[1]: Starting health for flakelet-relay...370agent # [700395.489848] agent dbus-broker-launch[905]: Looking up NSS user entry for 'systemd-timesync'...371agent # [700395.491271] agent dbus-broker-launch[905]: NSS returned no entry for 'systemd-timesync'372agent # [700395.491271] agent dbus-broker-launch[905]: Invalid user-name in /nix/store/8mp15gfn2m81r8005nnkppky8976lhbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"373agent # [700395.491903] agent systemd[1]: Started D-Bus System Message Bus.374agent # [700395.492570] agent systemd[1]: Startup finished in 5.721s.375agent # [700395.497885] agent dbus-broker-launch[905]: Ready376relay: (finished: waiting for unit flakelet-relay.service, in 6.67 seconds)377relay: waiting for unit nginx.service378relay: (finished: waiting for unit nginx.service, in 0.02 seconds)379agent: waiting for unit flakelet.target380agent: (finished: waiting for unit flakelet.target, in 0.01 seconds)381agent: waiting for unit flakelet-agent.service382agent: (finished: waiting for unit flakelet-agent.service, in 0.01 seconds)383client: waiting for unit multi-user.target384client: (finished: waiting for unit multi-user.target, in 0.02 seconds)385relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1'386relay # [700395.583733] relay systemd[1]: flakelet-relay-health.service: Deactivated successfully.387relay # [700395.584169] relay systemd[1]: Finished health for flakelet-relay.388relay # [700395.593154] relay flakelet[311]: flakelet-relay: updated to generation 1389relay # [700395.596027] relay systemd[1]: Finished Update flakelet service flakelet-relay.390relay # [700395.596614] relay systemd[1]: Reached target flakelet managed services.391relay # [700395.596801] relay systemd[1]: Reached target Multi-User System.392relay # [700395.597043] relay systemd[1]: Startup finished in 5.826s.393relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 1.04 seconds)394agent: must succeed: systemctl is-active app.service other.service395agent: (finished: must succeed: systemctl is-active app.service other.service, in 0.01 seconds)396subtest: deploy with client certificate, relay found via SRV397agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json398agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)399client: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1400relay # [700396.893310] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:29.703719Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(1), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}401relay # [700396.998655] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:29.809099Z","level":"INFO","message":"deploy accepted","job":"e8d51949ef825f3ca944f3a69969b8f7","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}402agent # [700396.893099] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:29.703435Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}403agent # [700396.999516] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:29.809950Z","level":"INFO","message":"start","id":"9ae9007640ce9f5b8644ed234165bddd","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}404agent # [700397.000214] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:29.810677Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"9ae9007640ce9f5b8644ed234165bddd\"]","target":"flakelet_relay::agent::jobs"}405agent # [700397.041289] agent systemd[1]: Starting flakelet update app (via relay)...406agent # [700397.085329] agent systemd[1]: Started flakelet update app (via relay).407agent # [700397.090094] agent flakelet[927]: app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2408agent # [700397.090894] agent flakelet[927]: app: activating generation 2409agent # [700397.103217] agent systemd[1]: Stopping app v1...410agent # [700397.103997] agent systemd[1]: app.service: Deactivated successfully.411agent # [700397.104183] agent systemd[1]: Stopped app v1.412agent # [700397.115921] agent systemd[1]: Reload requested from client PID 934 ('systemctl') (unit flakelet-relay-job-app.service)...413agent # [700397.115959] agent systemd[1]: Reloading...414agent # [700397.480898] agent systemd[1]: Reloading finished in 364 ms.415agent # [700397.575116] agent systemd[1]: Reload requested from client PID 964 ('systemctl') (unit flakelet-relay-job-app.service)...416agent # [700397.575166] agent systemd[1]: Reloading...417agent # [700397.949478] agent systemd[1]: Reloading finished in 373 ms.418agent # [700398.034443] agent systemd[1]: Reload requested from client PID 993 ('systemctl') (unit flakelet-relay-job-app.service)...419agent # [700398.034492] agent systemd[1]: Reloading...420agent # [700398.396495] agent systemd[1]: Reloading finished in 361 ms.421agent # [700398.492807] agent systemd[1]: Reload requested from client PID 1024 ('systemctl') (unit flakelet-relay-job-app.service)...422agent # [700398.492848] agent systemd[1]: Reloading...423agent # [700398.842652] agent systemd[1]: Reloading finished in 349 ms.424agent # [700398.939526] agent systemd[1]: Starting app v2...425agent # [700398.976282] agent systemd[1]: Started app v2.426agent # [700398.982923] agent flakelet[927]: app: updated to generation 2427agent # [700398.985450] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.428client: (finished: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1, in 3.05 seconds)429agent: must succeed: systemctl show app.service -p Description | grep -q 'app v2'430agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v2', in 0.02 seconds)431agent: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2'432agent: (finished: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2', in 0.01 seconds)433agent: must succeed: flakelet status --json app | jq -c '.[0].changed.by'434agent: (finished: must succeed: flakelet status --json app | jq -c '.[0].changed.by', in 0.02 seconds)435(finished: subtest: deploy with client certificate, relay found via SRV, in 3.11 seconds)436subtest: deploy with OIDC token, sub principal437agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json438agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)439client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)440client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.08 seconds)441client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDQ5MiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkyNjcwMTkyLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJYWVlDUk1PNVRaWFBFPT09IiwibmJmIjoxNzkyNjcwMTkyLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.bWzbZVtnKM-WUQRnrCyiKFSa3eIxRh5Yf6_yl_h_fLPXlNwNr5ylqJWAKBbSoQL8cw6G7OjhQq7LWbiNfA3QCg' push --relay https://relay:7443 deploy agent/app 2>&1442agent # [700400.014602] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:32.825053Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(2)","target":"flakelet_relay::agent::jobs"}443agent # [700400.197344] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:33.007789Z","level":"INFO","message":"start","id":"23526698a253a83873deafa066920266","flakelet":"app","rule":"ci","relay":"relay","caller_name":"\"repo:github:example/app:ref:refs/heads/main\"","target":"flakelet_relay::agent::conn"}444agent # [700400.197655] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:33.008134Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"23526698a253a83873deafa066920266\"]","target":"flakelet_relay::agent::jobs"}445agent # [700400.233913] agent systemd[1]: Starting flakelet update app (via relay)...446agent # [700400.261039] agent systemd[1]: Started flakelet update app (via relay).447relay # [700400.017204] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:32.827614Z","level":"INFO","message":"deploy finished","job":"e8d51949ef825f3ca944f3a69969b8f7","ok":true,"target":"flakelet_relay::relay::api"}448relay # [700400.196926] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:33.007346Z","level":"INFO","message":"deploy accepted","job":"8d6d9635f2dbc59a21375afd7cfafe03","caller":"repo:github:example/app:ref:refs/heads/main","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}449agent # [700400.265594] agent flakelet[1093]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1450agent # [700400.266310] agent flakelet[1093]: app: activating generation 3451agent # [700400.276785] agent systemd[1]: Stopping app v2...452agent # [700400.277548] agent systemd[1]: app.service: Deactivated successfully.453agent # [700400.277699] agent systemd[1]: Stopped app v2.454agent # [700400.290253] agent systemd[1]: Reload requested from client PID 1100 ('systemctl') (unit flakelet-relay-job-app.service)...455agent # [700400.290296] agent systemd[1]: Reloading...456agent # [700400.644514] agent systemd[1]: Reloading finished in 353 ms.457agent # [700400.736907] agent systemd[1]: Reload requested from client PID 1130 ('systemctl') (unit flakelet-relay-job-app.service)...458agent # [700400.736948] agent systemd[1]: Reloading...459agent # [700401.090708] agent systemd[1]: Reloading finished in 353 ms.460agent # [700401.162833] agent systemd[1]: Reload requested from client PID 1161 ('systemctl') (unit flakelet-relay-job-app.service)...461agent # [700401.162870] agent systemd[1]: Reloading...462agent # [700401.522359] agent systemd[1]: Reloading finished in 359 ms.463agent # [700401.616149] agent systemd[1]: Reload requested from client PID 1194 ('systemctl') (unit flakelet-relay-job-app.service)...464agent # [700401.616188] agent systemd[1]: Reloading...465agent # [700401.967397] agent systemd[1]: Reloading finished in 350 ms.466agent # [700402.045838] agent systemd[1]: Starting app v1...467agent # [700402.089562] agent systemd[1]: Started app v1.468agent # [700402.095850] agent flakelet[1093]: app: updated to generation 3469agent # [700402.097973] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.470client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDQ5MiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkyNjcwMTkyLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJYWVlDUk1PNVRaWFBFPT09IiwibmJmIjoxNzkyNjcwMTkyLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.bWzbZVtnKM-WUQRnrCyiKFSa3eIxRh5Yf6_yl_h_fLPXlNwNr5ylqJWAKBbSoQL8cw6G7OjhQq7LWbiNfA3QCg' push --relay https://relay:7443 deploy agent/app 2>&1, in 3.00 seconds)471(finished: subtest: deploy with OIDC token, sub principal, in 3.09 seconds)472subtest: policy denies uncovered target473client: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDQ5MiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkyNjcwMTkyLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJYWVlDUk1PNVRaWFBFPT09IiwibmJmIjoxNzkyNjcwMTkyLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.bWzbZVtnKM-WUQRnrCyiKFSa3eIxRh5Yf6_yl_h_fLPXlNwNr5ylqJWAKBbSoQL8cw6G7OjhQq7LWbiNfA3QCg' push --relay https://relay:7443 deploy agent/other 2>&1474client: (finished: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDQ5MiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkyNjcwMTkyLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJYWVlDUk1PNVRaWFBFPT09IiwibmJmIjoxNzkyNjcwMTkyLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.bWzbZVtnKM-WUQRnrCyiKFSa3eIxRh5Yf6_yl_h_fLPXlNwNr5ylqJWAKBbSoQL8cw6G7OjhQq7LWbiNfA3QCg' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.02 seconds)475(finished: subtest: policy denies uncovered target, in 0.02 seconds)476subtest: claim principal from groups, unchanged counts as success477client: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)478client: (finished: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.06 seconds)479client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDQ5NiwiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc5MjY3MDE5NiwiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiWENNS0I3QkpRSFlNVT09PSIsIm5iZiI6MTc5MjY3MDE5Niwic3ViIjoic29tZW9uZSJ9.9kbPRkzbBg6gImaywc5cDeANVwinnFgOqcCCj0rccEKQGk_Q0M6k9-kuV7WVJBbTRZUmqlDgJjNoXKOi2l19Aw' push --relay https://relay:7443 deploy agent/other 2>&1480relay # [700403.159409] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:35.969782Z","level":"INFO","message":"deploy finished","job":"8d6d9635f2dbc59a21375afd7cfafe03","ok":true,"target":"flakelet_relay::relay::api"}481relay # [700403.262171] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:36.072592Z","level":"INFO","message":"deploy accepted","job":"0d3e4137afec5de2d43ba4a829af1232","caller":"someone","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}482agent # [700403.157802] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:35.968240Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}483agent # [700403.262495] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:36.072940Z","level":"INFO","message":"start","id":"3c293b5e89b4147e4bcaf9222d89fba7","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"someone\"","target":"flakelet_relay::agent::conn"}484agent # [700403.262912] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:36.073390Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"3c293b5e89b4147e4bcaf9222d89fba7\"]","target":"flakelet_relay::agent::jobs"}485agent # [700403.301623] agent systemd[1]: Starting flakelet update other (via relay)...486agent # [700403.331276] agent systemd[1]: Started flakelet update other (via relay).487agent # [700403.336267] agent flakelet[1248]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1488agent # [700403.336870] agent flakelet[1248]: other: up to date489agent # [700403.337911] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.490client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDQ5NiwiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc5MjY3MDE5NiwiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiWENNS0I3QkpRSFlNVT09PSIsIm5iZiI6MTc5MjY3MDE5Niwic3ViIjoic29tZW9uZSJ9.9kbPRkzbBg6gImaywc5cDeANVwinnFgOqcCCj0rccEKQGk_Q0M6k9-kuV7WVJBbTRZUmqlDgJjNoXKOi2l19Aw' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.63 seconds)491(finished: subtest: claim principal from groups, unchanged counts as success, in 0.69 seconds)492subtest: push login via device flow, cached token used afterwards493client: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1494relay # [700403.870419] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:36.680835Z","level":"INFO","message":"deploy finished","job":"0d3e4137afec5de2d43ba4a829af1232","ok":true,"target":"flakelet_relay::relay::api"}495relay # [700403.895808] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [22/Oct/2026 11:56:36] "POST /device HTTP/1.1" 200 -496agent # [700403.868903] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:36.679337Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}497relay # [700404.901920] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [22/Oct/2026 11:56:37] "POST /token HTTP/1.1" 400 -498client: (finished: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1, in 2.09 seconds)499client: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600500client: (finished: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600, in 0.01 seconds)501client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1502relay # [700405.957743] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [22/Oct/2026 11:56:38] "POST /token HTTP/1.1" 200 -503relay # [700405.986921] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:38.797357Z","level":"INFO","message":"deploy accepted","job":"614c4008de12c03b5eed7a4be31f644d","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}504agent # [700405.987287] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:38.797714Z","level":"INFO","message":"start","id":"b8fe7542d84b8e47c93a55ec1157c05d","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"}505agent # [700405.987876] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:38.798339Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"b8fe7542d84b8e47c93a55ec1157c05d\"]","target":"flakelet_relay::agent::jobs"}506agent # [700406.019925] agent systemd[1]: Starting flakelet update other (via relay)...507agent # [700406.054015] agent systemd[1]: Started flakelet update other (via relay).508agent # [700406.060876] agent flakelet[1272]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1509agent # [700406.061821] agent flakelet[1272]: other: up to date510agent # [700406.063849] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.511client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 1.63 seconds)512client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1513relay # [700407.599892] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:40.410290Z","level":"INFO","message":"deploy finished","job":"614c4008de12c03b5eed7a4be31f644d","ok":true,"target":"flakelet_relay::relay::api"}514relay # [700407.624945] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:40.435388Z","level":"INFO","message":"deploy accepted","job":"4bc3b13d368674c9471ab6669cdaf071","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}515agent # [700407.598571] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:40.408956Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}516agent # [700407.625194] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:40.435644Z","level":"INFO","message":"start","id":"85b5e074245f67926f074c7b5af04182","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"}517agent # [700407.625665] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:40.436136Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"85b5e074245f67926f074c7b5af04182\"]","target":"flakelet_relay::agent::jobs"}518agent # [700407.652866] agent systemd[1]: Starting flakelet update other (via relay)...519agent # [700407.704733] agent systemd[1]: Started flakelet update other (via relay).520agent # [700407.709488] agent flakelet[1297]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1521agent # [700407.710153] agent flakelet[1297]: other: up to date522agent # [700407.712220] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.523client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 0.64 seconds)524(finished: subtest: push login via device flow, cached token used afterwards, in 4.38 seconds)525subtest: waves: failing first wave skips the second526agent: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json527agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)528client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1529relay # [700408.245367] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:41.055741Z","level":"INFO","message":"deploy finished","job":"4bc3b13d368674c9471ab6669cdaf071","ok":true,"target":"flakelet_relay::relay::api"}530relay # [700408.282780] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:41.093176Z","level":"INFO","message":"deploy accepted","job":"37c8542e118152521f57c0024956a39e","caller":"admin@example.org","targets":"[\"agent/app\", \"agent/other\"]","target":"flakelet_relay::relay::api"}531agent # [700408.244152] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:41.054545Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}532agent # [700408.283098] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:41.093501Z","level":"INFO","message":"start","id":"26b8820952aabf013bd261690477a433","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}533agent # [700408.283571] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:41.094038Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"26b8820952aabf013bd261690477a433\"]","target":"flakelet_relay::agent::jobs"}534agent # [700408.320344] agent systemd[1]: Starting flakelet update app (via relay)...535agent # [700408.363748] agent systemd[1]: Started flakelet update app (via relay).536agent # [700408.370406] agent flakelet[1320]: app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken537agent # [700408.371719] agent flakelet[1320]: app: activating generation 4538agent # [700408.385373] agent systemd[1]: Stopping app v1...539agent # [700408.387084] agent systemd[1]: app.service: Deactivated successfully.540agent # [700408.387379] agent systemd[1]: Stopped app v1.541agent # [700408.400898] agent systemd[1]: Reload requested from client PID 1327 ('systemctl') (unit flakelet-relay-job-app.service)...542agent # [700408.400951] agent systemd[1]: Reloading...543agent # [700408.772852] agent systemd[1]: Reloading finished in 371 ms.544agent # [700408.860709] agent systemd[1]: Reload requested from client PID 1357 ('systemctl') (unit flakelet-relay-job-app.service)...545agent # [700408.860754] agent systemd[1]: Reloading...546agent # [700409.221374] agent systemd[1]: Reloading finished in 360 ms.547agent # [700409.305551] agent systemd[1]: Reload requested from client PID 1388 ('systemctl') (unit flakelet-relay-job-app.service)...548agent # [700409.305592] agent systemd[1]: Reloading...549agent # [700409.652870] agent systemd[1]: Reloading finished in 346 ms.550agent # [700409.764039] agent systemd[1]: Reload requested from client PID 1421 ('systemctl') (unit flakelet-relay-job-app.service)...551agent # [700409.764083] agent systemd[1]: Reloading...552agent # [700410.115519] agent systemd[1]: Reloading finished in 351 ms.553agent # [700410.238202] agent systemd[1]: Starting app broken...554agent # [700410.274058] agent (nonexistent)[1451]: app.service: Unable to locate executable '/nonexistent': No such file or directory555agent # [700410.274087] agent (nonexistent)[1451]: app.service: Failed at step EXEC spawning /nonexistent: No such file or directory556agent # [700410.276290] agent systemd[1]: app.service: Main process exited, code=exited, status=203/EXEC557agent # [700410.276413] agent systemd[1]: app.service: Failed with result 'exit-code'.558agent # [700410.276787] agent systemd[1]: Failed to start app broken.559agent # [700410.305286] agent systemd[1]: Reload requested from client PID 1457 ('systemctl') (unit flakelet-relay-job-app.service)...560agent # [700410.305332] agent systemd[1]: Reloading...561agent # [700410.667876] agent systemd[1]: Reloading finished in 362 ms.562agent # [700410.758248] agent systemd[1]: Reload requested from client PID 1487 ('systemctl') (unit flakelet-relay-job-app.service)...563agent # [700410.758293] agent systemd[1]: Reloading...564agent # [700411.115766] agent systemd[1]: Reloading finished in 356 ms.565agent # [700411.239301] agent systemd[1]: Reload requested from client PID 1519 ('systemctl') (unit flakelet-relay-job-app.service)...566agent # [700411.239348] agent systemd[1]: Reloading...567agent # [700411.598180] agent systemd[1]: Reloading finished in 358 ms.568agent # [700411.685379] agent systemd[1]: Reload requested from client PID 1551 ('systemctl') (unit flakelet-relay-job-app.service)...569agent # [700411.685420] agent systemd[1]: Reloading...570agent # [700412.043950] agent systemd[1]: Reloading finished in 358 ms.571agent # [700412.138747] agent systemd[1]: Starting app v1...572agent # [700412.177397] agent systemd[1]: Started app v1.573agent # [700412.178634] agent flakelet[1320]: app: deploy failed, rolled back: systemctl start app.service failed:574agent # [700412.178634] agent flakelet[1320]: failed units: app.service. See journalctl -u app.service575agent # [700412.180922] agent systemd[1]: flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE576agent # [700412.181037] agent systemd[1]: flakelet-relay-job-app.service: Failed with result 'exit-code'.577client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1, in 4.52 seconds)578agent: must succeed: systemctl show app.service -p Description | grep -q 'app v1'579agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v1', in 0.02 seconds)580(finished: subtest: waves: failing first wave skips the second, in 4.55 seconds)581subtest: host patterns expand on the relay582agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json583agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)584client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/app' 2>&1585agent # [700412.778581] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:45.588951Z","level":"INFO","message":"update finished","flakelet":"app","status":"RolledBack","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}586agent # [700412.838392] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:45.648792Z","level":"INFO","message":"start","id":"02a15bcec0398a2d0af76edbb3167cbe","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}587agent # [700412.838790] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:45.649259Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"02a15bcec0398a2d0af76edbb3167cbe\"]","target":"flakelet_relay::agent::jobs"}588agent # [700412.865664] agent systemd[1]: Starting flakelet update app (via relay)...589agent # [700412.897687] agent systemd[1]: Started flakelet update app (via relay).590agent # [700412.903107] agent flakelet[1607]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1591agent # [700412.903717] agent flakelet[1607]: app: up to date592agent # [700412.904250] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.593relay # [700412.780366] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:45.590782Z","level":"INFO","message":"deploy finished","job":"37c8542e118152521f57c0024956a39e","ok":false,"target":"flakelet_relay::relay::api"}594relay # [700412.837912] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:45.648354Z","level":"INFO","message":"deploy accepted","job":"e93307b75f116e5ad4faeecb830e0b48","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}595client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/app' 2>&1, in 1.63 seconds)596client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '*/app' 2>&1597relay # [700414.445264] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:47.255645Z","level":"INFO","message":"deploy finished","job":"e93307b75f116e5ad4faeecb830e0b48","ok":true,"target":"flakelet_relay::relay::api"}598relay # [700414.468024] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:47.278469Z","level":"INFO","message":"deploy accepted","job":"a707c244a902bbd1200986c03e8c43ec","caller":"admin@example.org","targets":"[\"agent/app\", \"ghost/app\"]","target":"flakelet_relay::relay::api"}599agent # [700414.444066] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:47.254447Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}600agent # [700414.468384] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:47.278818Z","level":"INFO","message":"start","id":"d54f3cfb8f7dc0a9da2b80914f519e06","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}601agent # [700414.468797] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:47.279270Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"d54f3cfb8f7dc0a9da2b80914f519e06\"]","target":"flakelet_relay::agent::jobs"}602agent # [700414.504268] agent systemd[1]: Starting flakelet update app (via relay)...603agent # [700414.566236] agent systemd[1]: Started flakelet update app (via relay).604agent # [700414.570671] agent flakelet[1632]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1605agent # [700414.571263] agent flakelet[1632]: app: up to date606agent # [700414.574079] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.607client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '*/app' 2>&1, in 0.66 seconds)608client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave '*/app' 2>&1609relay # [700415.107059] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:47.917414Z","level":"INFO","message":"deploy finished","job":"a707c244a902bbd1200986c03e8c43ec","ok":false,"target":"flakelet_relay::relay::api"}610relay # [700415.130371] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:47.940818Z","level":"INFO","message":"deploy accepted","job":"9095b93a3bc32a5053805bfd3ea965d2","caller":"admin@example.org","targets":"[\"agent/app\", \"ghost/app\"]","target":"flakelet_relay::relay::api"}611agent # [700415.105829] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:47.916176Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}612agent # [700415.130640] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:47.941079Z","level":"INFO","message":"start","id":"9b48d8b848fa414be6ea5103d064a322","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}613agent # [700415.130952] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:47.941425Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"9b48d8b848fa414be6ea5103d064a322\"]","target":"flakelet_relay::agent::jobs"}614agent # [700415.157739] agent systemd[1]: Starting flakelet update app (via relay)...615agent # [700415.186765] agent systemd[1]: Started flakelet update app (via relay).616agent # [700415.192842] agent flakelet[1656]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1617agent # [700415.193441] agent flakelet[1656]: app: up to date618agent # [700415.194718] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.619client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave '*/app' 2>&1, in 1.64 seconds)620client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/nope' 2>&1621client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/nope' 2>&1, in 0.02 seconds)622(finished: subtest: host patterns expand on the relay, in 3.97 seconds)623subtest: detach returns once the job is accepted624agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json625agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)626client: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1627client: (finished: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1, in 0.02 seconds)628agent: waiting for success: systemctl is-active flakelet-relay-job-app.service629relay # [700416.743290] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:49.553701Z","level":"INFO","message":"deploy finished","job":"9095b93a3bc32a5053805bfd3ea965d2","ok":false,"target":"flakelet_relay::relay::api"}630relay # [700416.804704] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:49.615108Z","level":"INFO","message":"deploy accepted","job":"42b023e70da7e5e11840f148b495f286","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}631agent # [700416.742251] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:49.552654Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}632agent # [700416.805120] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:49.615433Z","level":"INFO","message":"start","id":"d32551ff7be29cae7f9d4755bd403a21","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}633agent # [700416.805428] agent flakelet-agent[504]: {"timestamp":"2026-10-22T11:56:49.615906Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"d32551ff7be29cae7f9d4755bd403a21\"]","target":"flakelet_relay::agent::jobs"}634agent # [700416.848322] agent systemd[1]: Starting flakelet update app (via relay)...635agent # [700416.895755] agent systemd[1]: Started flakelet update app (via relay).636agent # [700416.900358] agent flakelet[1681]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2637agent # [700416.901173] agent flakelet[1681]: app: activating generation 4638agent # [700416.914166] agent systemd[1]: Stopping app v1...639agent # [700416.916087] agent systemd[1]: app.service: Deactivated successfully.640agent # [700416.916493] agent systemd[1]: Stopped app v1.641agent # [700416.933881] agent systemd[1]: Reload requested from client PID 1692 ('systemctl') (unit flakelet-relay-job-app.service)...642agent # [700416.933959] agent systemd[1]: Reloading...643agent # [700417.301441] agent systemd[1]: Reloading finished in 366 ms.644agent # [700417.392478] agent systemd[1]: Reload requested from client PID 1722 ('systemctl') (unit flakelet-relay-job-app.service)...645agent # [700417.392528] agent systemd[1]: Reloading...646agent # [700417.753478] agent systemd[1]: Reloading finished in 360 ms.647agent: (finished: waiting for success: systemctl is-active flakelet-relay-job-app.service, in 1.03 seconds)648??? Warning (UserWarning): wait_until_fails(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.649 File "/nix/store/f3vbkhcnzmgjphqaarrzgjdpzrb02va5-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39650agent: waiting for failure: systemctl is-active flakelet-relay-job-app.service651??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.652 File "/nix/store/f3vbkhcnzmgjphqaarrzgjdpzrb02va5-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39653agent # [700417.841237] agent systemd[1]: Reload requested from client PID 1752 ('systemctl') (unit flakelet-relay-job-app.service)...654agent # [700417.841280] agent systemd[1]: Reloading...655agent # [700418.192414] agent systemd[1]: Reloading finished in 350 ms.656agent # [700418.285641] agent systemd[1]: Reload requested from client PID 1784 ('systemctl') (unit flakelet-relay-job-app.service)...657agent # [700418.285678] agent systemd[1]: Reloading...658agent # [700418.642066] agent systemd[1]: Reloading finished in 356 ms.659agent # [700418.738213] agent systemd[1]: Starting app slow2...660agent # [700424.838955] agent systemd[1]: Started app slow2.661agent # [700424.848123] agent flakelet[1681]: app: updated to generation 4662agent # [700424.851859] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.663agent: (finished: waiting for failure: systemctl is-active flakelet-relay-job-app.service, in 7.53 seconds)664(finished: subtest: detach returns once the job is accepted, in 8.60 seconds)665subtest: unknown host is final, missing agent is retried, agents listing666client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1667client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1, in 0.02 seconds)668agent: must succeed: systemctl stop flakelet-agent669agent: (finished: must succeed: systemctl stop flakelet-agent, in 0.08 seconds)670relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0'671relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0', in 0.02 seconds)672client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 &673client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 &, in 0.01 seconds)674client: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out675relay # [700425.405735] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:58.216152Z","level":"INFO","message":"agent disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","host":"agent","target":"flakelet_relay::relay::agent_conn"}676agent # [700425.405511] agent systemd[1]: Stopping flakelet-agent...677agent # [700425.447763] agent systemd[1]: flakelet-agent.service: Deactivated successfully.678agent # [700425.448080] agent systemd[1]: Stopped flakelet-agent.679agent # [700425.448440] agent systemd[1]: flakelet-agent.service: Consumed 1.352s CPU time over 30.678s wall clock time.680client: (finished: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out, in 1.02 seconds)681agent: must succeed: systemctl start flakelet-agent682agent: (finished: must succeed: systemctl start flakelet-agent, in 0.11 seconds)683??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.684 File "/nix/store/f3vbkhcnzmgjphqaarrzgjdpzrb02va5-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39685client: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out686relay # [700426.642996] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:56:59.453391Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(4), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}687agent # [700426.535622] agent systemd[1]: Starting flakelet-agent...688agent # [700426.609085] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:56:59.419525Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"d32551ff7be29cae7f9d4755bd403a21\"]","target":"flakelet_relay::agent::jobs"}689agent # [700426.629940] agent systemd[1]: Started flakelet-agent.690agent # [700426.642863] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:56:59.453298Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}691agent # [700427.148730] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:56:59.959160Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(4)","target":"flakelet_relay::agent::jobs"}692relay # [700428.518738] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:01.329149Z","level":"INFO","message":"deploy accepted","job":"3b39aef617f23402ac82a4b12c14b072","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}693agent # [700428.519128] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:01.329479Z","level":"INFO","message":"start","id":"f3a68652511b27c7acf142eedf29f67a","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}694agent # [700428.519673] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:01.329965Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"f3a68652511b27c7acf142eedf29f67a\"]","target":"flakelet_relay::agent::jobs"}695agent # [700428.554664] agent systemd[1]: Starting flakelet update other (via relay)...696agent # [700428.596189] agent systemd[1]: Started flakelet update other (via relay).697agent # [700428.601231] agent flakelet[2266]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1698agent # [700428.601893] agent flakelet[2266]: other: up to date699agent # [700428.603192] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.700relay # [700429.137751] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:01.948154Z","level":"INFO","message":"deploy finished","job":"3b39aef617f23402ac82a4b12c14b072","ok":true,"target":"flakelet_relay::relay::api"}701agent # [700429.136291] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:01.946678Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}702client: (finished: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out, in 3.04 seconds)703client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents704client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents, in 0.02 seconds)705client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)706client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.08 seconds)707client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDUyMiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkyNjcwMjIyLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJGUFZOQjZERzNURFhFPT09IiwibmJmIjoxNzkyNjcwMjIyLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.2MNDW1yB38Sf3KZG8m3-cPplLggWrLPSxsO5iACx381PmZ1GA2Kq-bGtEYOQu489RUhVtOhn2O0DfdEK2J9TCg' push --relay https://relay:7443 agents708client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDUyMiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkyNjcwMjIyLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJGUFZOQjZERzNURFhFPT09IiwibmJmIjoxNzkyNjcwMjIyLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.2MNDW1yB38Sf3KZG8m3-cPplLggWrLPSxsO5iACx381PmZ1GA2Kq-bGtEYOQu489RUhVtOhn2O0DfdEK2J9TCg' push --relay https://relay:7443 agents, in 0.02 seconds)709(finished: subtest: unknown host is final, missing agent is retried, agents listing, in 4.42 seconds)710subtest: out-of-band flakelet update reaches the relay without reconnect711agent: must succeed: flakelet status --json app | jq '.[0].generation'712agent: (finished: must succeed: flakelet status --json app | jq '.[0].generation', in 0.03 seconds)713agent: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true714agent: (finished: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true, in 0.01 seconds)715agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json716agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)717agent: must succeed: flakelet update app718app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2719app: activating generation 5720agent # [700429.883269] agent systemd[1]: Stopping app slow2...721agent # [700429.886274] agent systemd[1]: app.service: Deactivated successfully.722agent # [700429.886574] agent systemd[1]: Stopped app slow2.723agent # [700429.901426] agent systemd[1]: Reload requested from client PID 2300 ('systemctl')...724agent # [700429.901482] agent systemd[1]: Reloading...725agent # [700430.279914] agent systemd[1]: Reloading finished in 377 ms.726agent # [700430.371131] agent systemd[1]: Reload requested from client PID 2329 ('systemctl')...727agent # [700430.371177] agent systemd[1]: Reloading...728agent # [700430.736104] agent systemd[1]: Reloading finished in 364 ms.729agent # [700430.817245] agent systemd[1]: Reload requested from client PID 2359 ('systemctl')...730agent # [700430.817287] agent systemd[1]: Reloading...731agent # [700431.174310] agent systemd[1]: Reloading finished in 356 ms.732agent # [700431.269571] agent systemd[1]: Reload requested from client PID 2390 ('systemctl')...733agent # [700431.269614] agent systemd[1]: Reloading...734agent: (finished: must succeed: flakelet update app, in 1.90 seconds)735client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@5'736agent # [700431.632338] agent systemd[1]: Reloading finished in 362 ms.737agent # [700431.718317] agent systemd[1]: Starting app v2...738agent # [700431.749079] agent systemd[1]: Started app v2.739client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@5', in 1.04 seconds)740agent: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true741agent: (finished: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true, in 0.01 seconds)742client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-5-743client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-5-, in 0.02 seconds)744client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-745client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-, in 0.02 seconds)746agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json747agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)748agent: must succeed: flakelet update app749app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1750app: activating generation 6751agent # [700432.651349] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:05.461732Z","level":"INFO","message":"local change","flakelet":"app","generation":5,"by":"root (shell)","target":"flakelet_relay::agent::jobs"}752agent # [700432.888851] agent systemd[1]: Stopping app v2...753agent # [700432.890084] agent systemd[1]: app.service: Deactivated successfully.754agent # [700432.890247] agent systemd[1]: Stopped app v2.755agent # [700432.900983] agent systemd[1]: Reload requested from client PID 2436 ('systemctl')...756agent # [700432.901034] agent systemd[1]: Reloading...757agent # [700433.260622] agent systemd[1]: Reloading finished in 359 ms.758agent # [700433.351666] agent systemd[1]: Reload requested from client PID 2465 ('systemctl')...759agent # [700433.351709] agent systemd[1]: Reloading...760agent # [700433.710687] agent systemd[1]: Reloading finished in 358 ms.761agent # [700433.803180] agent systemd[1]: Reload requested from client PID 2493 ('systemctl')...762agent # [700433.803223] agent systemd[1]: Reloading...763agent # [700434.159847] agent systemd[1]: Reloading finished in 356 ms.764agent # [700434.253303] agent systemd[1]: Reload requested from client PID 2522 ('systemctl')...765agent # [700434.253345] agent systemd[1]: Reloading...766agent: (finished: must succeed: flakelet update app, in 1.88 seconds)767client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@6'768agent # [700434.601422] agent systemd[1]: Reloading finished in 347 ms.769agent # [700434.691070] agent systemd[1]: Starting app v1...770agent # [700434.733271] agent systemd[1]: Started app v1.771client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@6', in 2.07 seconds)772(finished: subtest: out-of-band flakelet update reaches the relay without reconnect, in 7.01 seconds)773subtest: certificate not listed under agents cannot connect as agent774client: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent775client: (finished: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent, in 0.03 seconds)776(finished: subtest: certificate not listed under agents cannot connect as agent, in 0.03 seconds)777subtest: metrics778relay: must succeed: curl -sf http://127.0.0.1:7400/metrics779relay: (finished: must succeed: curl -sf http://127.0.0.1:7400/metrics, in 0.02 seconds)780(finished: subtest: metrics, in 0.02 seconds)781subtest: agent link drop mid-run replays missed lines once782agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json783agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)784agent: must succeed: date +%s785agent: (finished: must succeed: date +%s, in 0.01 seconds)786client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 &787client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 &, in 0.01 seconds)788agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1792670229 | grep -q 'app-slow'789agent # [700436.656580] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:09.466903Z","level":"INFO","message":"local change","flakelet":"app","generation":6,"by":"root (shell)","target":"flakelet_relay::agent::jobs"}790agent # [700436.901739] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:09.712144Z","level":"INFO","message":"start","id":"69957f71855dc78f98eafeb982369701","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}791agent # [700436.902251] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:09.712712Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"69957f71855dc78f98eafeb982369701\"]","target":"flakelet_relay::agent::jobs"}792relay # [700436.839509] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:09.649331Z","level":"INFO","message":"agent rejected: no agents entry matches","principals":"[\"x509:dns:mallory\"]","target":"flakelet_relay::relay::agent_conn"}793relay # [700436.901412] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:09.711798Z","level":"INFO","message":"deploy accepted","job":"1a06bb7f9046289c791f4e7e645d1d1b","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}794agent # [700436.939548] agent systemd[1]: Starting flakelet update app (via relay)...795agent # [700436.983115] agent systemd[1]: Started flakelet update app (via relay).796agent # [700436.988146] agent flakelet[2575]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow797agent # [700436.988895] agent flakelet[2575]: app: activating generation 7798agent # [700437.012024] agent systemd[1]: Stopping app v1...799agent # [700437.012517] agent systemd[1]: app.service: Deactivated successfully.800agent # [700437.012823] agent systemd[1]: Stopped app v1.801agent # [700437.042530] agent systemd[1]: Reload requested from client PID 2582 ('systemctl') (unit flakelet-relay-job-app.service)...802agent # [700437.042578] agent systemd[1]: Reloading...803agent # [700437.400619] agent systemd[1]: Reloading finished in 357 ms.804agent # [700437.489802] agent systemd[1]: Reload requested from client PID 2612 ('systemctl') (unit flakelet-relay-job-app.service)...805agent # [700437.489842] agent systemd[1]: Reloading...806agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1792670229 | grep -q 'app-slow', in 1.02 seconds)807agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done808agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done, in 0.02 seconds)809relay: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done810relay: (finished: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done, in 0.07 seconds)811agent: must succeed: ss -K dport = 7443812agent: (finished: must succeed: ss -K dport = 7443, in 0.03 seconds)813agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1792670229 | grep -q 'updated to generation'814relay # [700437.996120] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:10.806402Z","level":"INFO","message":"agent disconnected: IO error: Software caused connection abort (os error 103)","host":"agent","target":"flakelet_relay::relay::agent_conn"}815agent # [700437.851795] agent systemd[1]: Reloading finished in 361 ms.816agent # [700437.935987] agent systemd[1]: Reload requested from client PID 2650 ('systemctl') (unit flakelet-relay-job-app.service)...817agent # [700437.936046] agent systemd[1]: Reloading...818agent # [700438.029405] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:10.839814Z","level":"INFO","message":"disconnected: IO error: Software caused connection abort (os error 103)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}819agent # [700438.290309] agent systemd[1]: Reloading finished in 353 ms.820agent # [700438.374952] agent systemd[1]: Reload requested from client PID 2686 ('systemctl') (unit flakelet-relay-job-app.service)...821agent # [700438.374993] agent systemd[1]: Reloading...822agent # [700438.726438] agent systemd[1]: Reloading finished in 351 ms.823agent # [700438.803628] agent systemd[1]: Starting app slow...824agent # [700439.033368] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:11.843801Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}825agent # [700441.036558] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:13.846952Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}826agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1792670229 | grep -q 'updated to generation', in 7.11 seconds)827agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done828agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done, in 0.02 seconds)829client: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out830agent # [700444.886265] agent systemd[1]: Started app slow.831agent # [700444.894679] agent flakelet[2575]: app: updated to generation 7832agent # [700444.897104] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.833agent # [700445.039530] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:17.849930Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}834agent # [700445.945449] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:18.755852Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(7)","target":"flakelet_relay::agent::jobs"}835client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out, in 8.10 seconds)836client: must succeed: cat /tmp/slow.out837client: (finished: must succeed: cat /tmp/slow.out, in 0.01 seconds)838(finished: subtest: agent link drop mid-run replays missed lines once, in 16.41 seconds)839subtest: agent restart mid-run reattaches to the unit840agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json841agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds)842client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 &843client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 &, in 0.01 seconds)844agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2'845relay # [700453.044721] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:25.855137Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}846agent # [700453.044607] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:25.855033Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}847relay # [700453.046263] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:25.856724Z","level":"INFO","message":"deploy finished","job":"1a06bb7f9046289c791f4e7e645d1d1b","ok":true,"target":"flakelet_relay::relay::api"}848agent # [700453.045867] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:25.856337Z","level":"INFO","message":"start","id":"69957f71855dc78f98eafeb982369701","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}849relay # [700453.311343] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:26.121625Z","level":"INFO","message":"deploy accepted","job":"aa3311622a8d379f9a61962bb489a198","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}850agent # [700453.311685] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:26.121994Z","level":"INFO","message":"start","id":"dde07ed8a3551238758055b8fd3c308b","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}851agent # [700453.312268] agent flakelet-agent[1853]: {"timestamp":"2026-10-22T11:57:26.122730Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"dde07ed8a3551238758055b8fd3c308b\"]","target":"flakelet_relay::agent::jobs"}852agent # [700453.351451] agent systemd[1]: Starting flakelet update app (via relay)...853agent # [700453.391376] agent systemd[1]: Started flakelet update app (via relay).854agent # [700453.396563] agent flakelet[2811]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2855agent # [700453.397407] agent flakelet[2811]: app: activating generation 8856agent # [700453.413911] agent systemd[1]: Stopping app slow...857agent # [700453.415064] agent systemd[1]: app.service: Deactivated successfully.858agent # [700453.415302] agent systemd[1]: Stopped app slow.859agent # [700453.430279] agent systemd[1]: Reload requested from client PID 2818 ('systemctl') (unit flakelet-relay-job-app.service)...860agent # [700453.430336] agent systemd[1]: Reloading...861agent # [700453.800914] agent systemd[1]: Reloading finished in 370 ms.862agent # [700453.891105] agent systemd[1]: Reload requested from client PID 2848 ('systemctl') (unit flakelet-relay-job-app.service)...863agent # [700453.891151] agent systemd[1]: Reloading...864agent # [700454.253955] agent systemd[1]: Reloading finished in 362 ms.865agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2', in 1.03 seconds)866agent: must succeed: systemctl restart flakelet-agent867agent # [700454.343343] agent systemd[1]: Stopping flakelet-agent...868agent # [700454.346642] agent systemd[1]: Reload requested from client PID 2881 ('systemctl') (unit flakelet-relay-job-app.service)...869agent # [700454.346696] agent systemd[1]: Reloading...870relay # [700454.343706] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:27.154128Z","level":"INFO","message":"agent disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","host":"agent","target":"flakelet_relay::relay::agent_conn"}871agent # [700454.726093] agent systemd[1]: Reloading finished in 378 ms.872agent # [700454.815552] agent systemd[1]: flakelet-agent.service: Deactivated successfully.873agent # [700454.815778] agent systemd[1]: Stopped flakelet-agent.874agent # [700454.835739] agent systemd[1]: Starting flakelet-agent...875agent # [700454.839871] agent systemd[1]: Reload requested from client PID 2912 ('systemctl') (unit flakelet-relay-job-app.service)...876agent # [700454.839914] agent systemd[1]: Reloading...877agent # [700454.913800] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:27.724196Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"dde07ed8a3551238758055b8fd3c308b\"]","target":"flakelet_relay::agent::jobs"}878agent: (finished: must succeed: systemctl restart flakelet-agent, in 1.01 seconds)879agent: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)"880agent: (finished: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)", in 0.02 seconds)881client: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out882agent # [700455.205107] agent systemd[1]: Reloading finished in 364 ms.883agent # [700455.324914] agent systemd[1]: Starting app slow2...884agent # [700455.334224] agent systemd[1]: Started flakelet-agent.885agent # [700455.343691] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:28.154134Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}886agent # [700455.344898] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:28.155369Z","level":"INFO","message":"start","id":"dde07ed8a3551238758055b8fd3c308b","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}887relay # [700455.343788] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:28.154210Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}888agent # [700461.410426] agent systemd[1]: Started app slow2.889agent # [700461.417539] agent flakelet[2811]: app: updated to generation 8890agent # [700461.420376] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.891relay # [700462.906882] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:35.717316Z","level":"INFO","message":"deploy finished","job":"aa3311622a8d379f9a61962bb489a198","ok":true,"target":"flakelet_relay::relay::api"}892agent # [700462.905716] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:35.716138Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(8)","target":"flakelet_relay::agent::jobs"}893client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out, in 8.10 seconds)894client: must succeed: cat /tmp/restart.out895client: (finished: must succeed: cat /tmp/restart.out, in 0.01 seconds)896agent: must succeed: systemctl is-active app.service897agent: (finished: must succeed: systemctl is-active app.service, in 0.01 seconds)898(finished: subtest: agent restart mid-run reattaches to the unit, in 10.20 seconds)899subtest: relay restart mid-run, push resumes via /v1/jobs900agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json901agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)902agent: must succeed: date +%s903agent: (finished: must succeed: date +%s, in 0.01 seconds)904client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 &905client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 &, in 0.01 seconds)906agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1792670256 | grep -q 'app-slow'907relay # [700463.516398] relay flakelet-relay[400]: {"timestamp":"2026-10-22T11:57:36.326839Z","level":"INFO","message":"deploy accepted","job":"3cd5a5bd749cfb6cb4336cf02d6732f8","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}908agent # [700463.516818] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:36.327247Z","level":"INFO","message":"start","id":"f1229381b2ae88467ba91b70b48fd5aa","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}909agent # [700463.517333] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:36.327790Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"f1229381b2ae88467ba91b70b48fd5aa\"]","target":"flakelet_relay::agent::jobs"}910agent # [700463.555895] agent systemd[1]: Starting flakelet update app (via relay)...911agent # [700463.584330] agent systemd[1]: Started flakelet update app (via relay).912agent # [700463.589508] agent flakelet[3392]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow913agent # [700463.590293] agent flakelet[3392]: app: activating generation 9914agent # [700463.603881] agent systemd[1]: Stopping app slow2...915agent # [700463.605922] agent systemd[1]: app.service: Deactivated successfully.916agent # [700463.606269] agent systemd[1]: Stopped app slow2.917agent # [700463.619933] agent systemd[1]: Reload requested from client PID 3399 ('systemctl') (unit flakelet-relay-job-app.service)...918agent # [700463.619984] agent systemd[1]: Reloading...919agent # [700464.000193] agent systemd[1]: Reloading finished in 379 ms.920agent # [700464.081400] agent systemd[1]: Reload requested from client PID 3429 ('systemctl') (unit flakelet-relay-job-app.service)...921agent # [700464.081444] agent systemd[1]: Reloading...922agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1792670256 | grep -q 'app-slow', in 1.03 seconds)923relay: must succeed: systemctl restart flakelet-relay924agent # [700464.447067] agent systemd[1]: Reloading finished in 365 ms.925agent # [700464.530893] agent systemd[1]: Reload requested from client PID 3461 ('systemctl') (unit flakelet-relay-job-app.service)...926agent # [700464.530942] agent systemd[1]: Reloading...927agent # [700464.546571] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:37.357011Z","level":"INFO","message":"disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}928relay # [700464.546030] relay systemd[1]: Stopping flakelet-relay...929relay # [700464.596837] relay systemd[1]: flakelet-relay.service: Deactivated successfully.930relay # [700464.597191] relay systemd[1]: Stopped flakelet-relay.931relay # [700464.597228] relay systemd[1]: flakelet-relay.service: Consumed 2.846s CPU time over 1min 11.748s wall clock time.932relay # [700464.631417] relay systemd[1]: Starting flakelet-relay...933agent # [700464.932824] agent systemd[1]: Reloading finished in 401 ms.934agent # [700465.046996] agent systemd[1]: Reload requested from client PID 3492 ('systemctl') (unit flakelet-relay-job-app.service)...935agent # [700465.047050] agent systemd[1]: Reloading...936agent # [700465.411484] agent systemd[1]: Reloading finished in 364 ms.937agent # [700465.501177] agent systemd[1]: Starting app slow...938agent # [700465.548817] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:38.359249Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}939relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.78 seconds)940client: waiting for success: grep -q '» ok' /tmp/resume.out941relay # [700466.307927] relay flakelet-relay[929]: {"timestamp":"2026-10-22T11:57:39.118343Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"}942relay # [700466.308734] relay flakelet-relay[929]: {"timestamp":"2026-10-22T11:57:39.118814Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"}943relay # [700466.308562] relay systemd[1]: Started flakelet-relay.944relay # [700467.556939] relay flakelet-relay[929]: {"timestamp":"2026-10-22T11:57:40.367369Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(8), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}945relay # [700467.564165] relay flakelet-relay[929]: {"timestamp":"2026-10-22T11:57:40.374615Z","level":"INFO","message":"job reattached","job":"3cd5a5bd749cfb6cb4336cf02d6732f8","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}946agent # [700467.556874] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:40.367297Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}947agent # [700471.571868] agent systemd[1]: Started app slow.948agent # [700471.580861] agent flakelet[3392]: app: updated to generation 9949agent # [700471.584408] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.950agent # [700472.630873] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:45.441277Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(9)","target":"flakelet_relay::agent::jobs"}951client: (finished: waiting for success: grep -q '» ok' /tmp/resume.out, in 7.08 seconds)952client: must succeed: cat /tmp/resume.out953client: (finished: must succeed: cat /tmp/resume.out, in 0.01 seconds)954(finished: subtest: relay restart mid-run, push resumes via /v1/jobs, in 9.93 seconds)955subtest: job history comes from the agents and survives a relay restart956client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1957relay # [700473.428035] relay flakelet-relay[929]: {"timestamp":"2026-10-22T11:57:46.238442Z","level":"INFO","message":"deploy accepted","job":"188b06c4636b65849b3ba8daac22dc7c","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}958agent # [700473.428433] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:46.238845Z","level":"INFO","message":"start","id":"5be20c693e5c0b60e3f85779794dfb86","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}959agent # [700473.428868] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:46.239342Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5be20c693e5c0b60e3f85779794dfb86\"]","target":"flakelet_relay::agent::jobs"}960agent # [700473.469151] agent systemd[1]: Starting flakelet update other (via relay)...961agent # [700473.501125] agent systemd[1]: Started flakelet update other (via relay).962agent # [700473.506089] agent flakelet[3571]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1963agent # [700473.506668] agent flakelet[3571]: other: up to date964agent # [700473.508234] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.965client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1, in 0.65 seconds)966relay: must succeed: systemctl restart flakelet-relay967relay # [700474.049552] relay flakelet-relay[929]: {"timestamp":"2026-10-22T11:57:46.859977Z","level":"INFO","message":"deploy finished","job":"188b06c4636b65849b3ba8daac22dc7c","ok":true,"target":"flakelet_relay::relay::api"}968relay # [700474.066092] relay systemd[1]: Stopping flakelet-relay...969relay # [700474.131509] relay systemd[1]: flakelet-relay.service: Deactivated successfully.970relay # [700474.131930] relay systemd[1]: Stopped flakelet-relay.971relay # [700474.131963] relay systemd[1]: flakelet-relay.service: Consumed 2.076s CPU time over 9.500s wall clock time.972relay # [700474.160094] relay systemd[1]: Starting flakelet-relay...973agent # [700474.047895] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:46.858287Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}974agent # [700474.066896] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:46.877309Z","level":"INFO","message":"disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}975agent # [700475.070885] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:47.881250Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}976relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.62 seconds)977relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1'978relay # [700475.674169] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:48.484586Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"}979relay # [700475.674770] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:48.484986Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"}980relay # [700475.674703] relay systemd[1]: Started flakelet-relay.981relay # [700477.084544] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:49.894967Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(9), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}982agent # [700477.084439] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:49.894835Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}983relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 2.06 seconds)984client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs985client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs, in 0.02 seconds)986client: must succeed: echo '{"groups": [], "repository": "example/app"}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)987client: (finished: must succeed: echo '{"groups": [], "repository": "example/app"}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.06 seconds)988client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDU3MCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkyNjcwMjcwLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJRTVNWSEFNSlA0RlJRPT09IiwibmJmIjoxNzkyNjcwMjcwLCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.z9gftobbg6KMw-hk7S5LGzZYL0bOuVE87D4L1tg_LF20FXDaTdgFtVHIQKHgudJJOSwuED7ds76Qp7_8mc9_Cw' push --relay https://relay:7443 deploy --id hist2 agent/app989» job 6a239dbf87cfec796e49404c351d787f via relay 0.1.0 (agents: agent 0.1.0)990» wave 0991agent/app | Starting flakelet update app (via relay)...992agent/app | Started flakelet update app (via relay).993agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow994agent/app | app: up to date995relay # [700477.843162] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:50.653569Z","level":"INFO","message":"deploy accepted","job":"6a239dbf87cfec796e49404c351d787f","caller":"example/app","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}996agent # [700477.843712] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:50.654104Z","level":"INFO","message":"start","id":"dce6faec8455f85321e72ee634888126","flakelet":"app","rule":"ci","relay":"relay","caller_name":"\"example/app\"","target":"flakelet_relay::agent::conn"}997agent # [700477.844354] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:50.654817Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"dce6faec8455f85321e72ee634888126\"]","target":"flakelet_relay::agent::jobs"}998agent # [700477.880124] agent systemd[1]: Starting flakelet update app (via relay)...999agent # [700477.907963] agent systemd[1]: Started flakelet update app (via relay).1000agent # [700477.912885] agent flakelet[3599]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow1001agent # [700477.913520] agent flakelet[3599]: app: up to date1002agent # [700477.914996] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.1003agent/app | flakelet-relay-job-app.service: Deactivated successfully.1004» agent/app: unchanged (generation 9)1005» ok1006client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDU3MCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkyNjcwMjcwLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJRTVNWSEFNSlA0RlJRPT09IiwibmJmIjoxNzkyNjcwMjcwLCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.z9gftobbg6KMw-hk7S5LGzZYL0bOuVE87D4L1tg_LF20FXDaTdgFtVHIQKHgudJJOSwuED7ds76Qp7_8mc9_Cw' push --relay https://relay:7443 deploy --id hist2 agent/app, in 0.64 seconds)1007client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDU3MCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkyNjcwMjcwLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJRTVNWSEFNSlA0RlJRPT09IiwibmJmIjoxNzkyNjcwMjcwLCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.z9gftobbg6KMw-hk7S5LGzZYL0bOuVE87D4L1tg_LF20FXDaTdgFtVHIQKHgudJJOSwuED7ds76Qp7_8mc9_Cw' push --relay https://relay:7443 jobs1008client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc5MjY3MDU3MCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzkyNjcwMjcwLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJRTVNWSEFNSlA0RlJRPT09IiwibmJmIjoxNzkyNjcwMjcwLCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.z9gftobbg6KMw-hk7S5LGzZYL0bOuVE87D4L1tg_LF20FXDaTdgFtVHIQKHgudJJOSwuED7ds76Qp7_8mc9_Cw' push --relay https://relay:7443 jobs, in 0.02 seconds)1009(finished: subtest: job history comes from the agents and survives a relay restart, in 5.07 seconds)1010subtest: dashboard login via authorization code flow1011client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login'1012client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login', in 0.02 seconds)1013client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login1014client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login, in 0.09 seconds)1015client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs1016client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs, in 0.02 seconds)1017client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist11018client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist1, in 0.02 seconds)1019client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true1020client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true, in 0.02 seconds)1021client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 4031022client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 403, in 0.02 seconds)1023client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other'1024relay # [700478.455095] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:51.265456Z","level":"INFO","message":"deploy finished","job":"6a239dbf87cfec796e49404c351d787f","ok":true,"target":"flakelet_relay::relay::api"}1025agent # [700478.453530] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:51.263926Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(9)","target":"flakelet_relay::agent::jobs"}1026relay # [700478.535534] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [22/Oct/2026 11:57:51] "GET /authorize?response_type=code&client_id=dashboard&redirect_uri=https%3A%2F%2Frelay%3A7443%2Fui%2Fcallback&scope=openid%20profile%20email%20groups&state=DG08J-km751XmvPZXcLw924xnAbGCapub-tTZtLaDdE&code_challenge=FpM5aabwnVy-5SPFm1nwiEjPvIdolIgG5bpVVOGf34U&code_challenge_method=S256 HTTP/1.1" 302 -1027agent # [700478.714432] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:51.524698Z","level":"INFO","message":"start","id":"53cf003a8276a4a895d254201b62bb68","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"}1028relay # [700478.592740] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [22/Oct/2026 11:57:51] "POST /token HTTP/1.1" 200 -1029relay # [700478.593786] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:51.404229Z","level":"INFO","message":"login","name":"dev@example.org","principals":"[\"oidc:mock:someone\", \"oidc:mock:groups:wheel\"]","target":"flakelet_relay::relay::login"}1030relay # [700478.665180] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:51.475591Z","level":"INFO","message":"job reattached","job":"188b06c4636b65849b3ba8daac22dc7c","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1031relay # [700478.713815] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:51.524192Z","level":"INFO","message":"deploy accepted","job":"2e4c7aafd7f8db073bee5b34a0ac5640","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1032client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other', in 0.02 seconds)1033client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/d0402e561b925ca943f121278bf2dd3f/events || true1034relay # [700478.737735] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:51.548192Z","level":"INFO","message":"job reattached","job":"2e4c7aafd7f8db073bee5b34a0ac5640","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1035agent # [700478.714901] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:51.525365Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"53cf003a8276a4a895d254201b62bb68\"]","target":"flakelet_relay::agent::jobs"}1036agent # [700478.751812] agent systemd[1]: Starting flakelet update other (via relay)...1037agent # [700478.778269] agent systemd[1]: Started flakelet update other (via relay).1038agent # [700478.783421] agent flakelet[3619]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v11039agent # [700478.784077] agent flakelet[3619]: other: up to date1040agent # [700478.786772] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.1041client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/d0402e561b925ca943f121278bf2dd3f/events || true, in 0.61 seconds)1042client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/d0402e561b925ca943f121278bf2dd3f1043client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/d0402e561b925ca943f121278bf2dd3f, in 0.02 seconds)1044client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js1045client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js, in 0.02 seconds)1046client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth'1047client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth', in 0.02 seconds)1048client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other1049client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other, in 0.02 seconds)1050client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected'1051client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected', in 0.02 seconds)1052client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=d0402e561b925ca943f121278bf2dd3f' | grep -q 4001053client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=d0402e561b925ca943f121278bf2dd3f' | grep -q 400, in 0.02 seconds)1054client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 &1055client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 &, in 0.01 seconds)1056client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other1057» job 38796a7ba508eadfe82a1cd5def000bc via relay 0.1.0 (agents: agent 0.1.0)1058» wave 01059agent # [700479.316858] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:52.127264Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}1060agent # [700479.490367] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:52.300782Z","level":"INFO","message":"start","id":"5e317fc57863c2a7c03ebe1bdacd1356","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}1061agent # [700479.491176] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:52.301280Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5e317fc57863c2a7c03ebe1bdacd1356\"]","target":"flakelet_relay::agent::jobs"}1062agent # [700479.532222] agent systemd[1]: Starting flakelet update other (via relay)...1063agent # [700479.563991] agent systemd[1]: Started flakelet update other (via relay).1064agent/other | Starting flakelet update other (via relay)...1065agent/other | Started flakelet update other (via relay).1066agent/other | other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v11067agent/other | other: up to date1068relay # [700479.488951] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:52.299353Z","level":"INFO","message":"deploy accepted","job":"38796a7ba508eadfe82a1cd5def000bc","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1069agent # [700479.570112] agent flakelet[3643]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v11070agent # [700479.570609] agent flakelet[3643]: other: up to date1071agent/otheragent # [700479.572283] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.1072 | flakelet-relay-job-other.service: Deactivated successfully.1073» agent/other: unchanged (generation 1)1074» ok1075client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other, in 0.64 seconds)1076client: waiting for success: grep -q live1 /tmp/ev.out1077client: (finished: waiting for success: grep -q live1 /tmp/ev.out, in 0.01 seconds)1078client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout1079client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout, in 0.02 seconds)1080client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 3031081client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 303, in 0.02 seconds)1082(finished: subtest: dashboard login via authorization code flow, in 1.69 seconds)1083(finished: run the VM test script, in 91.00 seconds)1084test script finished in 91.34s1085cleanup1086kill NspawnMachine (pid 53)1087relay # [700480.112904] relay flakelet-relay[1319]: {"timestamp":"2026-10-22T11:57:52.923318Z","level":"INFO","message":"deploy finished","job":"38796a7ba508eadfe82a1cd5def000bc","ok":true,"target":"flakelet_relay::relay::api"}1088agent # [700480.111243] agent flakelet-agent[2913]: {"timestamp":"2026-10-22T11:57:52.921659Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}1089kill NspawnMachine (pid 52)1090Container agent terminated by signal KILL.1091kill NspawnMachine (pid 54)1092Container client terminated by signal KILL.1093Container relay terminated by signal KILL.1094(finished: cleanup, in 0.44 seconds)1095additionally exposed symbols:1096 agent, client, relay,1097 vlan1,1098 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh1099» job e8d51949ef825f3ca944f3a69969b8f7 via relay 0.1.0 (agents: agent 0.1.0)1100» wave 01101agent/app | Starting flakelet update app (via relay)...1102agent/app | Started flakelet update app (via relay).1103agent/app | app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v21104agent/app | app: activating generation 21105agent/app | app: updated to generation 21106agent/app | flakelet-relay-job-app.service: Deactivated successfully.1107» agent/app: updated (generation 2)1108» ok11091110» job 37c8542e118152521f57c0024956a39e via relay 0.1.0 (agents: agent 0.1.0)1111» wave 01112agent/app | Starting flakelet update app (via relay)...1113agent/app | Started flakelet update app (via relay).1114agent/app | app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken1115agent/app | app: activating generation 41116agent/app | app: deploy failed, rolled back: systemctl start app.service failed:1117agent/app | failed units: app.service. See journalctl -u app.service1118agent/app | flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE1119agent/app | flakelet-relay-job-app.service: Failed with result 'exit-code'.1120» agent/app: rolled-back (generation 3)1121agent/app │ Starting app v1...1122agent/app │ Started app v1.1123agent/app │ Stopping app v1...1124agent/app │ app.service: Deactivated successfully.1125agent/app │ Stopped app v1.1126agent/app │ Starting app v2...1127agent/app │ Started app v2.1128agent/app │ Stopping app v2...1129agent/app │ app.service: Deactivated successfully.1130agent/app │ Stopped app v2.1131agent/app │ Starting app v1...1132agent/app │ Started app v1.1133agent/app │ Stopping app v1...1134agent/app │ app.service: Deactivated successfully.1135agent/app │ Stopped app v1.1136agent/app │ Starting app broken...1137agent/app │ app.service: Unable to locate executable '/nonexistent': No such file or directory1138agent/app │ app.service: Failed at step EXEC spawning /nonexistent: No such file or directory1139agent/app │ app.service: Main process exited, code=exited, status=203/EXEC1140agent/app │ app.service: Failed with result 'exit-code'.1141agent/app │ Failed to start app broken.1142agent/app │ Starting app v1...1143agent/app │ Started app v1.1144» skipped: agent/other1145» failed11461147» job 1a06bb7f9046289c791f4e7e645d1d1b via relay 0.1.0 (agents: agent 0.1.0)1148» wave 01149agent/app | Starting flakelet update app (via relay)...1150agent/app | Started flakelet update app (via relay).1151agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow1152agent/app | app: activating generation 71153agent/app | app: updated to generation 71154agent/app | flakelet-relay-job-app.service: Deactivated successfully.1155» agent/app: updated (generation 7)1156» ok11571158» job aa3311622a8d379f9a61962bb489a198 via relay 0.1.0 (agents: agent 0.1.0)1159» wave 01160agent/app | Starting flakelet update app (via relay)...1161agent/app | Started flakelet update app (via relay).1162agent/app | app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow21163agent/app | app: activating generation 81164agent/app | app: updated to generation 81165agent/app | flakelet-relay-job-app.service: Deactivated successfully.1166» agent/app: updated (generation 8)1167» ok11681169» job 3cd5a5bd749cfb6cb4336cf02d6732f8 via relay 0.1.0 (agents: agent 0.1.0)1170» wave 01171agent/app | Starting flakelet update app (via relay)...1172agent/app | Started flakelet update app (via relay).1173agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow1174agent/app | app: activating generation 91175flakelet-push: stream: error reading a body from connection, resuming job e2eeb5ef52b0be4f6599c11a1b3e56651176flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 1s1177flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 2s1178» job 3cd5a5bd749cfb6cb4336cf02d6732f8 via relay 0.1.0 (agents: agent 0.1.0)1179» wave 01180agent/app | app: updated to generation 91181agent/app | flakelet-relay-job-app.service: Deactivated successfully.1182» agent/app: updated (generation 9)1183» ok118411851792670266 hist1 admin@example.org agent/other:unchanged11861792670256 e2eeb5ef52b0be4f6599c11a1b3e5665 admin@example.org agent/app:updated11871792670246 cdf060eb2d02d6a1af0b70ca612dcff3 admin@example.org agent/app:updated11881792670229 5571a30ee8f66d23cc85835b70f3ee24 admin@example.org agent/app:updated11891792670227 local-app-6-1792670227 root (shell) agent/app:updated11901792670224 local-app-5-1792670224 root (shell) agent/app:updated11911792670221 75e9d03d34a59d0c9eea6f121ba510fd admin@example.org agent/other:unchanged11921792670209 97952b980470a70e3267e622f3147ac8 admin@example.org agent/app:updated11931792670207 2828e3470a9e853f93c6e7d1c86c9f6d admin@example.org agent/app:unchanged11941792670207 781f3e682d7bb002a572c0947c9f7007 admin@example.org agent/app:unchanged11951792670205 f270a6587d87a6b166412fe23e14a3df admin@example.org agent/app:unchanged11961792670201 d60098e5ec16b02675a0cca831e8ddc9 admin@example.org agent/app:rolled-back11971792670200 abba093026d24059ef3b8027ef4ad3cc dev@example.org agent/other:unchanged11981792670198 c2888b0a25e37e6a492222a04c5c18e7 dev@example.org agent/other:unchanged11991792670196 34bd90bd392daef986b8e0d48f01219c someone agent/other:unchanged12001792670193 6bb529813de8353efea58be4377b2fd6 repo:github:example/app:ref:refs/heads/main agent/app:updated12011792670189 a9a2b47b27b9efb1d2653605012456f1 admin@example.org agent/app:updated12021792670187 local-app-1-1792670187 host activation agent/app:updated12031792670187 local-flakelet-agent-1-1792670187 host activation agent/flakelet-agent:updated12041792670187 local-other-1-1792670187 host activation agent/other:updated1205