container-test-run-flakelet-relay
checks.x86_64-linux.nixos-test
· build #33
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Initializing machine ID from random generator.6Test will time out and terminate in 3600.0 seconds7run the VM test script8start all VMs9agent: systemd-nspawn running (pid 52)10agent: Waiting for journal at /build/vm-state-agent/var/log/journal...11client: systemd-nspawn running (pid 53)12relay: systemd-nspawn running (pid 54)13client: Waiting for journal at /build/vm-state-client/var/log/journal...14relay: Waiting for journal at /build/vm-state-relay/var/log/journal...15(finished: start all VMs, in 0.00 seconds)16relay: waiting for unit flakelet-relay.service17nixos-nspawn(agent): TAP vde-tap1 not found; container will be isolated from VDE18nixos-nspawn(agent): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.19nixos-nspawn(relay): TAP vde-tap1 not found; container will be isolated from VDE20nixos-nspawn(relay): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.21nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE22nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.23Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.24Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.25░ Spawning container relay on /build/vm-state-relay.26Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.27░ Spawning container client on /build/vm-state-client.28░ Spawning container agent on /build/vm-state-agent.29agent # No journal files were found.30agent # No journal boot entry found for the specified boot (+0).31client # No journal files were found.32client # No journal boot entry found for the specified boot (+0).33relay # No journal files were found.34relay # No journal boot entry found for the specified boot (+0).35agent # [23510.767073] agent systemd-journald[57]: Journal started36agent # [23510.767115] agent systemd-journald[57]: Runtime Journal (/run/log/journal/33fc49f7cb9c4df4a4a9ffe3811e09ab) is 8M, max 4G, 3.9G free.37agent # [23510.777676] agent systemd[1]: Finished Apply Kernel Variables.38agent # [23510.789682] agent systemd[1]: Finished Create Static Device Nodes in /dev gracefully.39agent # [23510.827915] agent systemd[1]: Starting Flush Journal to Persistent Storage...40agent # [23510.828626] agent systemd[1]: Starting Create Static Device Nodes in /dev...41agent # [23510.836584] agent systemd-journald[57]: Time spent on flushing to /var/log/journal/33fc49f7cb9c4df4a4a9ffe3811e09ab is 1.382ms for 6 entries.42agent # [23510.836584] agent systemd-journald[57]: System Journal (/var/log/journal/33fc49f7cb9c4df4a4a9ffe3811e09ab) is 512B, max 4G, 3.9G free.43agent # [23510.845800] agent systemd[1]: Finished Create Static Device Nodes in /dev.44agent # [23510.846447] agent systemd[1]: Reached target Preparation for Local File Systems.45agent # [23510.846572] agent systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys46agent # [23510.860987] agent systemd[1]: Finished Flush Journal to Persistent Storage.47agent # [23510.930961] agent systemd[1]: Finished Firewall.48agent # [23511.787647] agent systemd[1]: Mounting /run/wrappers...49agent # [23511.819100] agent systemd[1]: Mounted /run/wrappers.50agent # [23511.820140] agent systemd[1]: Reached target Local File Systems.51agent # [23511.821356] agent systemd[1]: Listening on Boot Loader Control Service Socket.52agent # [23511.822927] agent systemd[1]: Starting Create SUID/SGID Wrappers...53client # [23510.759142] client systemd-journald[57]: Journal started54agent # [23511.822975] agent systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container55client # [23510.759181] client systemd-journald[57]: Runtime Journal (/run/log/journal/a32beb28cd1943d5b44cffffc2ee9e5f) is 8M, max 4G, 3.9G free.56agent # [23511.824460] agent systemd[1]: Starting Save Transient machine-id to Disk...57client # [23510.769840] client systemd[1]: Finished Apply Kernel Variables.58agent # [23511.825732] agent systemd[1]: Starting Create System Files and Directories...59client # [23510.781032] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully.60client # [23510.794619] client systemd[1]: Starting Flush Journal to Persistent Storage...61client # [23510.795334] client systemd[1]: Starting Create Static Device Nodes in /dev...62client # [23510.832839] client systemd-journald[57]: Time spent on flushing to /var/log/journal/a32beb28cd1943d5b44cffffc2ee9e5f is 1.344ms for 6 entries.63client # [23510.832839] client systemd-journald[57]: System Journal (/var/log/journal/a32beb28cd1943d5b44cffffc2ee9e5f) is 512B, max 4G, 3.9G free.64client # [23510.841586] client systemd[1]: Finished Flush Journal to Persistent Storage.65client # [23510.841951] client systemd[1]: Finished Create Static Device Nodes in /dev.66client # [23510.843039] client systemd[1]: Reached target Preparation for Local File Systems.67client # [23510.843165] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys68client # [23510.912880] client systemd[1]: Finished Firewall.69client # [23511.758287] client systemd[1]: Mounting /run/wrappers...70client # [23511.819339] client systemd[1]: Mounted /run/wrappers.71client # [23511.820453] client systemd[1]: Reached target Local File Systems.72client # [23511.821723] client systemd[1]: Listening on Boot Loader Control Service Socket.73client # [23511.822953] client systemd[1]: Starting Create SUID/SGID Wrappers...74client # [23511.822999] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container75client # [23511.824466] client systemd[1]: Starting Save Transient machine-id to Disk...76client # [23511.825899] client systemd[1]: Starting Create System Files and Directories...77relay # [23510.766408] relay systemd-journald[57]: Journal started78relay # [23510.766448] relay systemd-journald[57]: Runtime Journal (/run/log/journal/92bd8afdfeae416984ecf16a80fdf3e7) is 8M, max 4G, 3.9G free.79relay # [23510.775961] relay systemd[1]: Finished Apply Kernel Variables.80relay # [23510.787500] relay systemd[1]: Finished Create Static Device Nodes in /dev gracefully.81relay # [23510.827501] relay systemd[1]: Starting Flush Journal to Persistent Storage...82relay # [23510.828210] relay systemd[1]: Starting Create Static Device Nodes in /dev...83relay # [23510.836352] relay systemd-journald[57]: Time spent on flushing to /var/log/journal/92bd8afdfeae416984ecf16a80fdf3e7 is 1.385ms for 6 entries.84relay # [23510.836352] relay systemd-journald[57]: System Journal (/var/log/journal/92bd8afdfeae416984ecf16a80fdf3e7) is 512B, max 4G, 3.9G free.85relay # [23510.845869] relay systemd[1]: Finished Create Static Device Nodes in /dev.86relay # [23510.846506] relay systemd[1]: Reached target Preparation for Local File Systems.87relay # [23510.846633] relay systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys88relay # [23510.858605] relay systemd[1]: Finished Flush Journal to Persistent Storage.89relay # [23510.930285] relay systemd[1]: Finished Firewall.90relay # [23511.787611] relay systemd[1]: Mounting /run/wrappers...91relay # [23511.824933] relay systemd[1]: Mounted /run/wrappers.92relay # [23511.826026] relay systemd[1]: Reached target Local File Systems.93relay # [23511.827342] relay systemd[1]: Listening on Boot Loader Control Service Socket.94relay # [23511.828518] relay systemd[1]: Starting Create SUID/SGID Wrappers...95relay # [23511.828564] relay systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container96relay # [23511.829969] relay systemd[1]: Starting Save Transient machine-id to Disk...97relay # [23511.831017] relay systemd[1]: Starting Create System Files and Directories...98agent # [23511.844023] agent systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted99client # [23511.843731] client suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.DZl2VlNc2V/chsh': Operation not permitted100agent # [23511.844467] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted101client # [23511.844509] client systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted102client # [23511.844919] client systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted103agent # [23511.844795] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal/33fc49f7cb9c4df4a4a9ffe3811e09ab failed: Operation not permitted104agent # [23511.845174] agent systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted105client # [23511.845247] client systemd-tmpfiles[161]: fchmod() of /var/log/journal/a32beb28cd1943d5b44cffffc2ee9e5f failed: Operation not permitted106client # [23511.845587] client systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted107relay # [23511.848810] relay suid-sgid-wrappers-start[176]: chmod: changing permissions of '/run/wrappers/wrappers.7AgdVinOk9/chsh': Operation not permitted108relay # [23511.848882] relay systemd-tmpfiles[169]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted109relay # [23511.849294] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal failed: Operation not permitted110relay # [23511.849603] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal/92bd8afdfeae416984ecf16a80fdf3e7 failed: Operation not permitted111relay # [23511.849919] relay systemd-tmpfiles[169]: fchmod() of /run/log/journal failed: Operation not permitted112relay # [23511.857306] relay systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE113relay # [23511.857346] relay systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'.114relay # [23511.857416] relay systemd[1]: Failed to start Create SUID/SGID Wrappers.115relay # [23511.857889] relay systemd[1]: Finished Create System Files and Directories.116relay # [23511.871770] relay systemd[1]: Starting Rebuild Journal Catalog...117relay # [23511.872542] relay systemd[1]: Starting Record System Boot/Shutdown in UTMP...118relay # [23511.885383] relay systemd[1]: Finished Record System Boot/Shutdown in UTMP.119relay # [23511.890291] relay systemd[1]: Finished Rebuild Journal Catalog.120relay # [23511.891220] relay systemd[1]: Starting Update is Completed...121relay # [23511.900974] relay systemd[1]: Finished Update is Completed.122relay # [23511.901105] relay systemd[1]: Reached target System Initialization.123relay # [23511.901166] relay systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container124relay # [23511.901190] relay systemd[1]: Started Daily Cleanup of Temporary Directories.125relay # [23511.901202] relay systemd[1]: Reached target Timer Units.126relay # [23511.901291] relay systemd[1]: Listening on D-Bus System Message Bus Socket.127relay # [23511.901487] relay systemd[1]: Listening on Nix Daemon Socket.128relay # [23511.901582] relay systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.129relay # [23511.901596] relay systemd[1]: Reached target Socket Units.130relay # [23511.901622] relay systemd[1]: Reached target Basic System.131relay # [23511.902774] relay systemd[1]: Started device-mock.service.132relay # [23511.903333] relay systemd[1]: Starting Re-link flakelet services at boot...133relay # [23511.903924] relay systemd[1]: Starting Import lastlog data into lastlog2 database...134relay # [23511.904861] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)...135relay # [23511.905530] relay systemd[1]: Starting resolvconf update...136relay # [23511.914013] relay systemd[1]: Finished Re-link flakelet services at boot.137relay # [23511.914704] relay systemd[1]: Starting Reconcile flakelet services with the host configuration...138relay # [23511.919973] relay systemd[1]: Finished Import lastlog data into lastlog2 database.139relay # [23511.928755] relay systemd[1]: Finished Reconcile flakelet services with the host configuration.140relay # [23511.982428] relay systemd[1]: Finished resolvconf update.141relay # [23511.982953] relay systemd[1]: Reached target Preparation for Network.142relay # [23511.985187] relay systemd[1]: Starting Address configuration of eth1...143relay # [23511.986898] relay systemd[1]: Starting Extra networking commands....144relay # [23511.993266] relay systemd[1]: nscd.service: Deactivated successfully.145relay # [23511.993439] relay systemd[1]: Stopped Name Service Cache Daemon (nsncd).146relay # [23511.995680] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)...147relay # [23512.007550] relay network-addresses-eth1-start[245]: adding address 192.168.1.3/24... done148relay # [23512.010734] relay network-addresses-eth1-start[245]: adding address 2001:db8:1::3/64... done149client # [23511.853273] client systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE150client # [23511.853310] client systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'.151client # [23511.853351] client systemd[1]: Failed to start Create SUID/SGID Wrappers.152client # [23511.853817] client systemd[1]: Finished Create System Files and Directories.153client # [23511.868143] client systemd[1]: Starting Rebuild Journal Catalog...154client # [23511.868709] client systemd[1]: Starting Record System Boot/Shutdown in UTMP...155client # [23511.880771] client systemd[1]: Finished Record System Boot/Shutdown in UTMP.156client # [23511.886786] client systemd[1]: Finished Rebuild Journal Catalog.157client # [23511.887725] client systemd[1]: Starting Update is Completed...158client # [23511.897304] client systemd[1]: Finished Update is Completed.159client # [23511.897379] client systemd[1]: Reached target System Initialization.160client # [23511.897440] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container161client # [23511.897463] client systemd[1]: Started Daily Cleanup of Temporary Directories.162client # [23511.897477] client systemd[1]: Reached target Timer Units.163client # [23511.897568] client systemd[1]: Listening on D-Bus System Message Bus Socket.164agent # [23511.849846] agent suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.8ZmE9wWdVo/chsh': Operation not permitted165agent # [23511.851435] agent systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE166client # [23511.897760] client systemd[1]: Listening on Nix Daemon Socket.167agent # [23511.851531] agent systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'.168client # [23511.897853] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.169agent # [23511.851723] agent systemd[1]: Failed to start Create SUID/SGID Wrappers.170client # [23511.897864] client systemd[1]: Reached target Socket Units.171agent # [23511.852162] agent systemd[1]: Finished Create System Files and Directories.172client # [23511.897889] client systemd[1]: Reached target Basic System.173agent # [23511.866625] agent systemd[1]: Starting Rebuild Journal Catalog...174client # [23511.898945] client systemd[1]: Starting Import lastlog data into lastlog2 database...175agent # [23511.867448] agent systemd[1]: Starting Record System Boot/Shutdown in UTMP...176client # [23511.899724] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...177agent # [23511.880349] agent systemd[1]: Finished Record System Boot/Shutdown in UTMP.178client # [23511.900587] client systemd[1]: Starting resolvconf update...179agent # [23511.885340] agent systemd[1]: Finished Rebuild Journal Catalog.180client # [23511.916112] client systemd[1]: Finished Import lastlog data into lastlog2 database.181agent # [23511.886947] agent systemd[1]: Starting Update is Completed...182client # [23512.070151] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully.183agent # [23511.895241] agent systemd[1]: Finished Update is Completed.184agent # [23511.895315] agent systemd[1]: Reached target System Initialization.185agent # [23511.895379] agent systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container186agent # [23511.895402] agent systemd[1]: Started Daily Cleanup of Temporary Directories.187agent # [23511.895416] agent systemd[1]: Reached target Timer Units.188agent # [23511.895511] agent systemd[1]: Listening on D-Bus System Message Bus Socket.189agent # [23511.895677] agent systemd[1]: Listening on Nix Daemon Socket.190agent # [23511.895772] agent systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.191agent # [23511.895787] agent systemd[1]: Reached target Socket Units.192agent # [23511.895813] agent systemd[1]: Reached target Basic System.193agent # [23511.896871] agent systemd[1]: Starting Re-link flakelet services at boot...194agent # [23511.897743] agent systemd[1]: Starting Import lastlog data into lastlog2 database...195agent # [23511.898645] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)...196agent # [23511.899356] agent systemd[1]: Starting resolvconf update...197agent # [23511.907429] agent systemd[1]: Finished Re-link flakelet services at boot.198agent # [23511.909740] agent systemd[1]: Starting Reconcile flakelet services with the host configuration...199agent # [23511.916173] agent systemd[1]: Finished Import lastlog data into lastlog2 database.200agent # [23511.921601] agent systemd[1]: Finished Reconcile flakelet services with the host configuration.201agent # [23512.070713] agent systemd[1]: etc-machine\x2did.mount: Deactivated successfully.202agent # [23512.071386] agent systemd[1]: Finished Save Transient machine-id to Disk.203client # [23512.071077] client systemd[1]: Finished Save Transient machine-id to Disk.204client # [23512.095168] client systemd[1]: nscd.service: Deactivated successfully.205client # [23512.095280] client systemd[1]: Stopped Name Service Cache Daemon (nsncd).206client # [23512.126931] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...207client # [23512.127384] client systemd[1]: Finished resolvconf update.208client # [23512.128421] client systemd[1]: Reached target Preparation for Network.209client # [23512.130135] client systemd[1]: Starting Address configuration of eth1...210client # [23512.131445] client systemd[1]: Starting Extra networking commands....211client # [23512.151903] client network-addresses-eth1-start[237]: adding address 192.168.1.2/24... done212client # [23512.155017] client network-addresses-eth1-start[237]: adding address 2001:db8:1::2/64... done213client # [23512.160317] client systemd[1]: Finished Address configuration of eth1.214client # [23512.205450] client systemd[1]: Finished Extra networking commands..215client # [23512.206033] client systemd[1]: Reached target Network.216client # [23512.251550] client systemd[1]: nscd.service: Deactivated successfully.217client # [23512.251696] client systemd[1]: Stopped Name Service Cache Daemon (nsncd).218client # [23512.254461] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...219agent # [23512.104330] agent systemd[1]: nscd.service: Deactivated successfully.220agent # [23512.126582] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd).221agent # [23512.128368] agent systemd[1]: Finished resolvconf update.222agent # [23512.129064] agent systemd[1]: Reached target Preparation for Network.223agent # [23512.130239] agent systemd[1]: Starting Address configuration of eth1...224agent # [23512.131263] agent systemd[1]: Starting Extra networking commands....225agent # [23512.132060] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)...226agent # [23512.149899] agent network-addresses-eth1-start[240]: adding address 192.168.1.1/24... done227agent # [23512.152955] agent network-addresses-eth1-start[240]: adding address 2001:db8:1::1/64... done228agent # [23512.157339] agent systemd[1]: Finished Address configuration of eth1.229agent # [23512.204581] agent systemd[1]: Finished Extra networking commands..230agent # [23512.204720] agent systemd[1]: Reached target Network.231agent # [23512.206048] agent systemd[1]: Starting Update flakelet service app...232agent # [23512.207631] agent systemd[1]: Starting Update flakelet service flakelet-agent...233agent # [23512.208414] agent systemd[1]: Starting Update flakelet service other...234agent # [23512.246645] agent systemd[1]: nscd.service: Deactivated successfully.235agent # [23512.250302] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd).236agent # [23512.253042] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)...237agent # [23512.258635] agent flakelet[304]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1238agent # [23512.259184] agent flakelet[306]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1239agent # [23512.259594] agent flakelet[305]: flakelet-agent: using prebuilt artifact /nix/store/k08li4ibhyqrs18vawivpljkqwngd8d7-flakelet-flakelet-agent240agent # [23512.259594] agent flakelet[305]: flakelet-agent: activating generation 1241agent # [23512.260026] agent flakelet[304]: app: activating generation 1242agent # [23512.260089] agent flakelet[306]: other: activating generation 1243agent # [23512.264636] agent systemd[1]: Reload requested from client PID 314 ('systemctl') (unit flakelet-flakelet-agent.service)...244agent # [23512.264674] agent systemd[1]: Reloading...245relay # [23512.070473] relay systemd[1]: etc-machine\x2did.mount: Deactivated successfully.246relay # [23512.071262] relay systemd[1]: Finished Save Transient machine-id to Disk.247relay # [23512.071494] relay systemd[1]: Finished Address configuration of eth1.248relay # [23512.071686] relay systemd[1]: Finished Extra networking commands..249relay # [23512.073613] relay systemd[1]: Reached target Network.250relay # [23512.076177] relay systemd[1]: Starting Dnsmasq Daemon...251relay # [23512.095312] relay systemd[1]: Starting Nginx Web Server...252relay # [23512.126533] relay systemd[1]: Starting Update flakelet service flakelet-relay...253relay # [23512.138670] relay flakelet[311]: flakelet-relay: using prebuilt artifact /nix/store/b5axqj0b3484061a2byzdk5bdwh9mh1v-flakelet-flakelet-relay254relay # [23512.139332] relay flakelet[311]: flakelet-relay: activating generation 1255relay # [23512.143214] relay systemd[1]: Reload requested from client PID 316 ('systemctl') (unit flakelet-flakelet-relay.service)...256relay # [23512.143260] relay systemd[1]: Reloading...257relay # [23512.467723] relay nsncd[250]: Sep 06 13:36:30.429 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"258relay # [23512.623172] relay systemd[1]: Reloading finished in 479 ms.259client # [23512.527193] client nsncd[303]: Sep 06 13:36:30.488 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"260client # [23512.531424] client systemd[1]: Started Name Service Cache Daemon (nsncd).261client # [23512.531514] client systemd[1]: Reached target Host and Network Name Lookups.262client # [23512.532299] client systemd[1]: Reached target User and Group Name Lookups.263client # [23512.534679] client systemd[1]: Starting User Login Management...264client # [23512.536061] client systemd[1]: Starting Permit User Sessions...265client # [23512.570069] client systemd[1]: Finished Permit User Sessions.266client # [23512.572110] client systemd[1]: Started Console Getty.267client # [23512.572162] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0268client # [23512.572191] client systemd[1]: Reached target Login Prompts.269agent # [23512.540744] agent nsncd[310]: Sep 06 13:36:30.502 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"270agent # [23512.630047] agent systemd[1]: Reloading finished in 364 ms.271agent # [23512.772620] agent systemd[1]: Started Name Service Cache Daemon (nsncd).272agent # [23512.773189] agent systemd[1]: Reload requested from client PID 312 ('systemctl') (unit flakelet-app.service)...273agent # [23512.773240] agent systemd[1]: Reloading...274relay # [23512.768080] relay systemd[1]: Started Name Service Cache Daemon (nsncd).275relay # [23512.768531] relay systemd[1]: Reached target Host and Network Name Lookups.276relay # [23512.768618] relay systemd[1]: Reached target User and Group Name Lookups.277relay # [23512.769984] relay systemd[1]: Starting User Login Management...278relay # [23512.771010] relay systemd[1]: Starting Permit User Sessions...279relay # [23512.795315] relay systemd[1]: Reload requested from client PID 357 ('systemctl') (unit flakelet-flakelet-relay.service)...280relay # [23512.795381] relay systemd[1]: Reloading...281relay # [23512.805624] relay dnsmasq-pre-start[360]: dnsmasq: syntax check OK.282relay # [23513.149739] relay systemd[1]: Reloading finished in 353 ms.283agent # [23513.162449] agent systemd[1]: Reloading finished in 388 ms.284agent # [23513.291734] agent systemd[1]: Reload requested from client PID 313 ('systemctl') (unit flakelet-other.service)...285agent # [23513.291794] agent systemd[1]: Reloading...286relay # [23513.288545] relay systemd[1]: Finished Permit User Sessions.287relay # [23513.315820] relay systemd[1]: Started Console Getty.288relay # [23513.315855] relay systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0289relay # [23513.315869] relay systemd[1]: Reached target Login Prompts.290relay # [23513.322495] relay systemd[1]: Starting flakelet-relay...291agent # [23513.651718] agent systemd[1]: Reloading finished in 359 ms.292agent # [23513.732265] agent systemd[1]: Reached target Host and Network Name Lookups.293agent # [23513.732401] agent systemd[1]: Reached target User and Group Name Lookups.294agent # [23513.733921] agent systemd[1]: Starting User Login Management...295agent # [23513.734969] agent systemd[1]: Starting Permit User Sessions...296agent # [23513.738698] agent systemd[1]: Reload requested from client PID 405 ('systemctl') (unit flakelet-flakelet-agent.service)...297agent # [23513.738729] agent systemd[1]: Reloading...298relay # [23513.782571] relay nginx-pre-start[402]: nginx: the configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf syntax is ok299relay # [23513.783308] relay nginx-pre-start[402]: nginx: configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf test is successful300relay # [23513.818014] relay systemd[1]: Started Nginx Web Server.301relay # [23513.959089] relay systemd[1]: Starting D-Bus System Message Bus...302client # [23513.966417] client systemd-logind[315]: New seat seat0.303client # [23513.995707] client systemd[1]: Starting D-Bus System Message Bus...304client # [23513.995787] client systemd[1]: Started User Login Management.305client # [23513.997011] client systemd[1]: Starting linger-users.service...306client # [23514.032306] client systemd[1]: linger-users.service: Deactivated successfully.307client # [23514.032496] client systemd[1]: Finished linger-users.service.308client # [23514.032624] client systemd[1]: Reached target Multi-User System.309agent # [23514.139531] agent systemd[1]: Reloading finished in 400 ms.310agent # [23514.218576] agent systemd[1]: Finished Permit User Sessions.311agent # [23514.225153] agent systemd[1]: Started Console Getty.312agent # [23514.225247] agent systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0313agent # [23514.225364] agent systemd[1]: Reached target Login Prompts.314agent # [23514.225698] agent systemd[1]: Reload requested from client PID 408 ('systemctl') (unit flakelet-app.service)...315agent # [23514.225723] agent systemd[1]: Reloading...316relay # [23514.347783] relay systemd-logind[354]: New seat seat0.317relay # [23514.348226] relay systemd[1]: Started User Login Management.318relay # [23514.350338] relay systemd[1]: Starting linger-users.service...319relay # [23514.391845] relay systemd[1]: linger-users.service: Deactivated successfully.320relay # [23514.392214] relay systemd[1]: Finished linger-users.service.321relay # [23514.542836] relay dbus-broker-launch[408]: Looking up NSS user entry for 'systemd-timesync'...322relay # [23514.544073] relay dbus-broker-launch[408]: NSS returned no entry for 'systemd-timesync'323relay # [23514.544073] relay dbus-broker-launch[408]: Invalid user-name in /nix/store/jc4z11b21x1n6xiiply0x9mfc84afs4d-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"324relay # [23514.545288] relay systemd[1]: Started D-Bus System Message Bus.325relay # [23514.552540] relay dbus-broker-launch[408]: Ready326relay # [23514.556011] relay systemd[1]: Started Dnsmasq Daemon.327relay # [23514.558281] relay dnsmasq[394]: started, version 2.93 cachesize 150328relay # [23514.558288] relay dnsmasq[394]: compile time options: IPv6 GNU-getopt DBus no-UBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP conntrack ipset nftset auth DNSSEC loop-detect inotify dumpfile329relay # [23514.558295] relay dnsmasq[394]: DBus support enabled: connected to system bus330relay # [23514.558301] relay dnsmasq[394]: no upstream servers configured - please set them from DBus331relay # [23514.558404] relay dnsmasq[394]: read /etc/hosts - 9 names332client # [23514.495559] client dbus-broker-launch[325]: Looking up NSS user entry for 'systemd-timesync'...333client # [23514.496941] client dbus-broker-launch[325]: NSS returned no entry for 'systemd-timesync'334client # [23514.496941] client dbus-broker-launch[325]: Invalid user-name in /nix/store/yz798fjp6ysgkw4jm9hqizlq2701kyyn-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"335client # [23514.497697] client systemd[1]: Started D-Bus System Message Bus.336client # [23514.498154] client systemd[1]: Startup finished in 4.170s.337client # [23514.503261] client dbus-broker-launch[325]: Ready338agent # [23514.578171] agent systemd[1]: Reloading finished in 352 ms.339agent # [23514.658925] agent systemd[1]: Starting flakelet-agent...340agent # [23514.662488] agent systemd[1]: Reload requested from client PID 472 ('systemctl') (unit flakelet-other.service)...341agent # [23514.662526] agent systemd[1]: Reloading...342agent # [23514.735567] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:32.697120Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}343agent # [23515.011849] agent systemd[1]: Reloading finished in 348 ms.344agent # [23515.115695] agent systemd[1]: Started flakelet-agent.345agent # [23515.119953] agent systemd[1]: Starting app v1...346agent # [23515.123148] agent flakelet[305]: flakelet-agent: updated to generation 1347agent # [23515.123656] agent systemd[1]: Starting other v1...348agent # [23515.123955] agent systemd[1]: Finished Update flakelet service flakelet-agent.349agent # [23515.161323] agent systemd-logind[406]: New seat seat0.350agent # [23515.161505] agent systemd[1]: Started app v1.351agent # [23515.161695] agent systemd[1]: Started other v1.352agent # [23515.161837] agent systemd[1]: Started User Login Management.353agent # [23515.164135] agent systemd[1]: Starting D-Bus System Message Bus...354agent # [23515.165018] agent systemd[1]: Starting linger-users.service...355agent # [23515.168769] agent flakelet[306]: other: updated to generation 1356agent # [23515.169257] agent flakelet[304]: app: updated to generation 1357agent # [23515.170917] agent systemd[1]: Finished Update flakelet service app.358agent # [23515.171129] agent systemd[1]: Finished Update flakelet service other.359agent # [23515.171848] agent systemd[1]: Reached target flakelet managed services.360agent # [23515.177790] agent systemd[1]: linger-users.service: Deactivated successfully.361agent # [23515.177925] agent systemd[1]: Finished linger-users.service.362agent # [23515.178069] agent systemd[1]: Reached target Multi-User System.363relay # [23515.417220] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:33.378755Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"}364relay # [23515.417765] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:33.379375Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"}365relay # [23515.417840] relay systemd[1]: Started flakelet-relay.366relay # [23515.427728] relay systemd[1]: Starting health for flakelet-relay...367agent # [23515.643103] agent dbus-broker-launch[899]: Looking up NSS user entry for 'systemd-timesync'...368agent # [23515.644215] agent dbus-broker-launch[899]: NSS returned no entry for 'systemd-timesync'369agent # [23515.644215] agent dbus-broker-launch[899]: Invalid user-name in /nix/store/9jm4z4kmif1yf3786ghlinqlwra7q4q4-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"370agent # [23515.644820] agent systemd[1]: Started D-Bus System Message Bus.371agent # [23515.645372] agent systemd[1]: Startup finished in 5.307s.372agent # [23515.651391] agent dbus-broker-launch[899]: Ready373relay: (finished: waiting for unit flakelet-relay.service, in 6.17 seconds)374relay: waiting for unit nginx.service375relay: (finished: waiting for unit nginx.service, in 0.02 seconds)376agent: waiting for unit flakelet.target377relay # [23515.699265] relay systemd[1]: flakelet-relay-health.service: Deactivated successfully.378relay # [23515.699652] relay systemd[1]: Finished health for flakelet-relay.379relay # [23515.709364] relay flakelet[311]: flakelet-relay: updated to generation 1380relay # [23515.712025] relay systemd[1]: Finished Update flakelet service flakelet-relay.381relay # [23515.712559] relay systemd[1]: Reached target flakelet managed services.382relay # [23515.712731] relay systemd[1]: Reached target Multi-User System.383relay # [23515.712959] relay systemd[1]: Startup finished in 5.380s.384agent: (finished: waiting for unit flakelet.target, in 0.02 seconds)385agent: waiting for unit flakelet-agent.service386agent: (finished: waiting for unit flakelet-agent.service, in 0.02 seconds)387client: waiting for unit multi-user.target388client: (finished: waiting for unit multi-user.target, in 0.02 seconds)389relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1'390relay # [23516.749859] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:34.711566Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: None, revision: None }, Named { name: \"other\", generation: None, revision: None }]","target":"flakelet_relay::relay::agent_conn"}391relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 1.04 seconds)392agent: must succeed: systemctl is-active app.service other.service393agent: (finished: must succeed: systemctl is-active app.service other.service, in 0.01 seconds)394subtest: deploy with client certificate, relay found via SRV395agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json396agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds)397client: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1398agent # [23516.749463] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:34.711208Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}399agent # [23516.759811] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:34.721638Z","level":"INFO","message":"local change","flakelet":"app","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"}400agent # [23516.782193] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:34.744019Z","level":"INFO","message":"local change","flakelet":"other","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"}401agent # [23517.159728] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:35.121396Z","level":"INFO","message":"start","id":"3c1023e5e804ee8829edb6e94e93b24c","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}402agent # [23517.160068] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:35.121831Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"3c1023e5e804ee8829edb6e94e93b24c\"]","target":"flakelet_relay::agent::jobs"}403agent # [23517.197949] agent systemd[1]: Starting flakelet update app (via relay)...404agent # [23517.231035] agent systemd[1]: Started flakelet update app (via relay).405agent # [23517.234882] agent flakelet[927]: app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2406agent # [23517.235545] agent flakelet[927]: app: activating generation 2407agent # [23517.254368] agent systemd[1]: Stopping app v1...408agent # [23517.256039] agent systemd[1]: app.service: Deactivated successfully.409agent # [23517.256299] agent systemd[1]: Stopped app v1.410agent # [23517.273152] agent systemd[1]: Reload requested from client PID 934 ('systemctl') (unit flakelet-relay-job-app.service)...411agent # [23517.273219] agent systemd[1]: Reloading...412relay # [23517.158811] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:35.120528Z","level":"INFO","message":"deploy accepted","job":"95384cb214ce38b665cdd44f501bb6e7","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}413agent # [23517.608491] agent systemd[1]: Reloading finished in 334 ms.414agent # [23517.692684] agent systemd[1]: Reload requested from client PID 964 ('systemctl') (unit flakelet-relay-job-app.service)...415agent # [23517.692727] agent systemd[1]: Reloading...416agent # [23518.013929] agent systemd[1]: Reloading finished in 320 ms.417agent # [23518.078741] agent systemd[1]: Reload requested from client PID 993 ('systemctl') (unit flakelet-relay-job-app.service)...418agent # [23518.078782] agent systemd[1]: Reloading...419agent # [23518.404870] agent systemd[1]: Reloading finished in 325 ms.420agent # [23518.472585] agent systemd[1]: Reload requested from client PID 1024 ('systemctl') (unit flakelet-relay-job-app.service)...421agent # [23518.472620] agent systemd[1]: Reloading...422agent # [23518.794599] agent systemd[1]: Reloading finished in 321 ms.423agent # [23518.870534] agent systemd[1]: Starting app v2...424agent # [23518.912229] agent systemd[1]: Started app v2.425agent # [23518.916292] agent flakelet[927]: app: updated to generation 2426agent # [23518.918044] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.427client: (finished: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1, in 2.88 seconds)428agent: must succeed: systemctl show app.service -p Description | grep -q 'app v2'429agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v2', in 0.02 seconds)430agent: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2'431agent: (finished: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2', in 0.01 seconds)432agent: must succeed: flakelet status --json app | jq -c '.[0].changed.by'433agent: (finished: must succeed: flakelet status --json app | jq -c '.[0].changed.by', in 0.02 seconds)434(finished: subtest: deploy with client certificate, relay found via SRV, in 2.95 seconds)435subtest: deploy with OIDC token, sub principal436agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json437agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)438client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)439client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.05 seconds)440client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjA5OCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NzAxNzk4LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI3RkRLRDdGMlNOUDVBPT09IiwibmJmIjoxNzg4NzAxNzk4LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.GQoeB3QGOZoPwVG7_fmEExVIlyD_vgjIPdewazYlriMyDy7QsFUdCAptKoJrrWJM6C-vKO-GalceD1j2-IsLBg' push --relay https://relay:7443 deploy agent/app 2>&1441relay # [23520.010164] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:37.971836Z","level":"INFO","message":"deploy finished","job":"95384cb214ce38b665cdd44f501bb6e7","ok":true,"target":"flakelet_relay::relay::api"}442relay # [23520.170242] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:38.131976Z","level":"INFO","message":"deploy accepted","job":"83374e72c6935fb1e15c2c8bb2866119","caller":"repo:github:example/app:ref:refs/heads/main","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}443agent # [23520.008362] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:37.970148Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(2)","target":"flakelet_relay::agent::jobs"}444agent # [23520.170659] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:38.132413Z","level":"INFO","message":"start","id":"90c5890d8df9a65b198560eb147ada0b","flakelet":"app","rule":"ci","relay":"relay","caller_name":"\"repo:github:example/app:ref:refs/heads/main\"","target":"flakelet_relay::agent::conn"}445agent # [23520.171380] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:38.133196Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"90c5890d8df9a65b198560eb147ada0b\"]","target":"flakelet_relay::agent::jobs"}446agent # [23520.214905] agent systemd[1]: Starting flakelet update app (via relay)...447agent # [23520.251066] agent systemd[1]: Started flakelet update app (via relay).448agent # [23520.256205] agent flakelet[1101]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1449agent # [23520.256841] agent flakelet[1101]: app: activating generation 3450agent # [23520.270381] agent systemd[1]: Stopping app v2...451agent # [23520.272235] agent systemd[1]: app.service: Deactivated successfully.452agent # [23520.272606] agent systemd[1]: Stopped app v2.453agent # [23520.291495] agent systemd[1]: Reload requested from client PID 1108 ('systemctl') (unit flakelet-relay-job-app.service)...454agent # [23520.291564] agent systemd[1]: Reloading...455agent # [23520.639898] agent systemd[1]: Reloading finished in 347 ms.456agent # [23520.714574] agent systemd[1]: Reload requested from client PID 1138 ('systemctl') (unit flakelet-relay-job-app.service)...457agent # [23520.714611] agent systemd[1]: Reloading...458agent # [23521.039989] agent systemd[1]: Reloading finished in 324 ms.459agent # [23521.100902] agent systemd[1]: Reload requested from client PID 1169 ('systemctl') (unit flakelet-relay-job-app.service)...460agent # [23521.100938] agent systemd[1]: Reloading...461agent # [23521.431871] agent systemd[1]: Reloading finished in 330 ms.462agent # [23521.499862] agent systemd[1]: Reload requested from client PID 1202 ('systemctl') (unit flakelet-relay-job-app.service)...463agent # [23521.499897] agent systemd[1]: Reloading...464agent # [23521.828367] agent systemd[1]: Reloading finished in 328 ms.465agent # [23521.902270] agent systemd[1]: Starting app v1...466agent # [23521.934008] agent systemd[1]: Started app v1.467agent # [23521.939842] agent flakelet[1101]: app: updated to generation 3468agent # [23521.942029] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.469client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjA5OCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NzAxNzk4LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI3RkRLRDdGMlNOUDVBPT09IiwibmJmIjoxNzg4NzAxNzk4LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.GQoeB3QGOZoPwVG7_fmEExVIlyD_vgjIPdewazYlriMyDy7QsFUdCAptKoJrrWJM6C-vKO-GalceD1j2-IsLBg' push --relay https://relay:7443 deploy agent/app 2>&1, in 2.91 seconds)470(finished: subtest: deploy with OIDC token, sub principal, in 2.97 seconds)471subtest: policy denies uncovered target472client: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjA5OCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NzAxNzk4LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI3RkRLRDdGMlNOUDVBPT09IiwibmJmIjoxNzg4NzAxNzk4LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.GQoeB3QGOZoPwVG7_fmEExVIlyD_vgjIPdewazYlriMyDy7QsFUdCAptKoJrrWJM6C-vKO-GalceD1j2-IsLBg' push --relay https://relay:7443 deploy agent/other 2>&1473client: (finished: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjA5OCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NzAxNzk4LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI3RkRLRDdGMlNOUDVBPT09IiwibmJmIjoxNzg4NzAxNzk4LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.GQoeB3QGOZoPwVG7_fmEExVIlyD_vgjIPdewazYlriMyDy7QsFUdCAptKoJrrWJM6C-vKO-GalceD1j2-IsLBg' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.02 seconds)474(finished: subtest: policy denies uncovered target, in 0.02 seconds)475subtest: claim principal from groups, unchanged counts as success476client: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)477client: (finished: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.07 seconds)478client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjEwMSwiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc4ODcwMTgwMSwiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiTUtOTzdNUFBOVTZINj09PSIsIm5iZiI6MTc4ODcwMTgwMSwic3ViIjoic29tZW9uZSJ9.HT3_eZPAIfFpT6RYiDChGYxyZdPA0yc96cjmTW9Laa2tRidLNHagaAcjl7X-_d5-6RmjC7Puxp9qddBCdz-HBA' push --relay https://relay:7443 deploy agent/other 2>&1479agent # [23523.036051] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:40.997783Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}480agent # [23523.162910] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:41.124682Z","level":"INFO","message":"start","id":"4d2de8d19f1ba96265b496a4fbb30016","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"someone\"","target":"flakelet_relay::agent::conn"}481agent # [23523.163532] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:41.125355Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"4d2de8d19f1ba96265b496a4fbb30016\"]","target":"flakelet_relay::agent::jobs"}482agent # [23523.202423] agent systemd[1]: Starting flakelet update other (via relay)...483agent # [23523.222929] agent systemd[1]: Started flakelet update other (via relay).484agent # [23523.228291] agent flakelet[1268]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1485agent # [23523.228813] agent flakelet[1268]: other: up to date486agent # [23523.229593] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.487relay # [23523.037472] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:40.999175Z","level":"INFO","message":"deploy finished","job":"83374e72c6935fb1e15c2c8bb2866119","ok":true,"target":"flakelet_relay::relay::api"}488relay # [23523.162501] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:41.124255Z","level":"INFO","message":"deploy accepted","job":"c7339d99332b1d991885a23bba6fc024","caller":"someone","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}489client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjEwMSwiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc4ODcwMTgwMSwiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiTUtOTzdNUFBOVTZINj09PSIsIm5iZiI6MTc4ODcwMTgwMSwic3ViIjoic29tZW9uZSJ9.HT3_eZPAIfFpT6RYiDChGYxyZdPA0yc96cjmTW9Laa2tRidLNHagaAcjl7X-_d5-6RmjC7Puxp9qddBCdz-HBA' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.64 seconds)490(finished: subtest: claim principal from groups, unchanged counts as success, in 0.71 seconds)491subtest: push login via device flow, cached token used afterwards492client: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1493agent # [23523.770358] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:41.732072Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}494relay # [23523.771730] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:41.733432Z","level":"INFO","message":"deploy finished","job":"c7339d99332b1d991885a23bba6fc024","ok":true,"target":"flakelet_relay::relay::api"}495relay # [23523.797422] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [06/Sep/2026 13:36:41] "POST /device HTTP/1.1" 200 -496relay # [23524.802585] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [06/Sep/2026 13:36:42] "POST /token HTTP/1.1" 400 -497client: (finished: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1, in 2.08 seconds)498client: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600499client: (finished: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600, in 0.01 seconds)500client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1501agent # [23525.874695] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:43.836467Z","level":"INFO","message":"start","id":"25f424ca4c2565e276ef10f5cc85a019","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"}502agent # [23525.875283] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:43.837047Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"25f424ca4c2565e276ef10f5cc85a019\"]","target":"flakelet_relay::agent::jobs"}503agent # [23525.912464] agent systemd[1]: Starting flakelet update other (via relay)...504agent # [23525.943075] agent systemd[1]: Started flakelet update other (via relay).505agent # [23525.946650] agent flakelet[1300]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1506agent # [23525.947166] agent flakelet[1300]: other: up to date507agent # [23525.950103] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.508relay # [23525.847992] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [06/Sep/2026 13:36:43] "POST /token HTTP/1.1" 200 -509relay # [23525.874258] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:43.836050Z","level":"INFO","message":"deploy accepted","job":"f1ab30933e112a3226cbe5fdb737f6e5","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}510client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 0.63 seconds)511client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1512relay # [23526.489230] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:44.450976Z","level":"INFO","message":"deploy finished","job":"f1ab30933e112a3226cbe5fdb737f6e5","ok":true,"target":"flakelet_relay::relay::api"}513relay # [23526.509017] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:44.470824Z","level":"INFO","message":"deploy accepted","job":"7b6c45717236182c0e609ce21ec15677","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}514agent # [23526.487892] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:44.449637Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}515agent # [23526.509365] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:44.471175Z","level":"INFO","message":"start","id":"8180e44c0d503860191025a1ae0d3fb8","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"}516agent # [23526.509628] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:44.471451Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"8180e44c0d503860191025a1ae0d3fb8\"]","target":"flakelet_relay::agent::jobs"}517agent # [23526.568797] agent systemd[1]: Starting flakelet update other (via relay)...518agent # [23526.575466] agent systemd[1]: Started flakelet update other (via relay).519agent # [23526.579561] agent flakelet[1324]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1520agent # [23526.580120] agent flakelet[1324]: other: up to date521agent # [23526.581881] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.522client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 0.63 seconds)523(finished: subtest: push login via device flow, cached token used afterwards, in 3.35 seconds)524subtest: waves: failing first wave skips the second525agent: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json526agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds)527client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1528agent # [23527.117305] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:45.079046Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}529agent # [23527.156497] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:45.118290Z","level":"INFO","message":"start","id":"ca7f4bbdb9a661bfaee05e5206a5f62f","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}530agent # [23527.156899] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:45.118723Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"ca7f4bbdb9a661bfaee05e5206a5f62f\"]","target":"flakelet_relay::agent::jobs"}531agent # [23527.183526] agent systemd[1]: Starting flakelet update app (via relay)...532agent # [23527.215017] agent systemd[1]: Started flakelet update app (via relay).533agent # [23527.219093] agent flakelet[1359]: app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken534agent # [23527.219816] agent flakelet[1359]: app: activating generation 4535agent # [23527.236654] agent systemd[1]: Stopping app v1...536agent # [23527.237130] agent systemd[1]: app.service: Deactivated successfully.537agent # [23527.237398] agent systemd[1]: Stopped app v1.538agent # [23527.253866] agent systemd[1]: Reload requested from client PID 1366 ('systemctl') (unit flakelet-relay-job-app.service)...539agent # [23527.253935] agent systemd[1]: Reloading...540relay # [23527.118501] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:45.080259Z","level":"INFO","message":"deploy finished","job":"7b6c45717236182c0e609ce21ec15677","ok":true,"target":"flakelet_relay::relay::api"}541relay # [23527.156275] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:45.118048Z","level":"INFO","message":"deploy accepted","job":"f34b00b5e570467018b5f76e444dd3b8","caller":"admin@example.org","targets":"[\"agent/app\", \"agent/other\"]","target":"flakelet_relay::relay::api"}542agent # [23527.598549] agent systemd[1]: Reloading finished in 343 ms.543agent # [23527.688011] agent systemd[1]: Reload requested from client PID 1396 ('systemctl') (unit flakelet-relay-job-app.service)...544agent # [23527.688052] agent systemd[1]: Reloading...545agent # [23528.017762] agent systemd[1]: Reloading finished in 329 ms.546agent # [23528.113092] agent systemd[1]: Reload requested from client PID 1425 ('systemctl') (unit flakelet-relay-job-app.service)...547agent # [23528.113134] agent systemd[1]: Reloading...548agent # [23528.441076] agent systemd[1]: Reloading finished in 327 ms.549agent # [23528.535083] agent systemd[1]: Reload requested from client PID 1456 ('systemctl') (unit flakelet-relay-job-app.service)...550agent # [23528.535123] agent systemd[1]: Reloading...551agent # [23528.858905] agent systemd[1]: Reloading finished in 323 ms.552agent # [23528.933433] agent systemd[1]: Starting app broken...553agent # [23528.965522] agent (nonexistent)[1490]: app.service: Unable to locate executable '/nonexistent': No such file or directory554agent # [23528.965545] agent (nonexistent)[1490]: app.service: Failed at step EXEC spawning /nonexistent: No such file or directory555agent # [23528.967944] agent systemd[1]: app.service: Main process exited, code=exited, status=203/EXEC556agent # [23528.968061] agent systemd[1]: app.service: Failed with result 'exit-code'.557agent # [23528.968318] agent systemd[1]: Failed to start app broken.558agent # [23528.996134] agent systemd[1]: Reload requested from client PID 1500 ('systemctl') (unit flakelet-relay-job-app.service)...559agent # [23528.996176] agent systemd[1]: Reloading...560agent # [23529.321987] agent systemd[1]: Reloading finished in 325 ms.561agent # [23529.404514] agent systemd[1]: Reload requested from client PID 1530 ('systemctl') (unit flakelet-relay-job-app.service)...562agent # [23529.404557] agent systemd[1]: Reloading...563agent # [23529.731219] agent systemd[1]: Reloading finished in 326 ms.564agent # [23529.795275] agent systemd[1]: Reload requested from client PID 1560 ('systemctl') (unit flakelet-relay-job-app.service)...565agent # [23529.795311] agent systemd[1]: Reloading...566agent # [23530.122319] agent systemd[1]: Reloading finished in 326 ms.567agent # [23530.215603] agent systemd[1]: Reload requested from client PID 1590 ('systemctl') (unit flakelet-relay-job-app.service)...568agent # [23530.215649] agent systemd[1]: Reloading...569agent # [23530.549506] agent systemd[1]: Reloading finished in 333 ms.570agent # [23530.619261] agent systemd[1]: Starting app v1...571agent # [23530.662126] agent systemd[1]: Started app v1.572agent # [23530.663277] agent flakelet[1359]: app: deploy failed, rolled back: systemctl start app.service failed:573agent # [23530.663277] agent flakelet[1359]: failed units: app.service. See journalctl -u app.service574agent # [23530.665426] agent systemd[1]: flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE575agent # [23530.665537] agent systemd[1]: flakelet-relay-job-app.service: Failed with result 'exit-code'.576client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1, in 4.20 seconds)577agent: must succeed: systemctl show app.service -p Description | grep -q 'app v1'578agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v1', in 0.02 seconds)579(finished: subtest: waves: failing first wave skips the second, in 4.24 seconds)580subtest: host patterns expand on the relay581agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json582agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)583client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/app' 2>&1584agent # [23531.327896] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:49.289612Z","level":"INFO","message":"update finished","flakelet":"app","status":"RolledBack","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}585agent # [23531.390068] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:49.351818Z","level":"INFO","message":"start","id":"ebb304c63236839642ac98cd6209dc9b","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}586agent # [23531.390517] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:49.352338Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"ebb304c63236839642ac98cd6209dc9b\"]","target":"flakelet_relay::agent::jobs"}587agent # [23531.425897] agent systemd[1]: Starting flakelet update app (via relay)...588agent # [23531.462102] agent systemd[1]: Started flakelet update app (via relay).589agent # [23531.467640] agent flakelet[1658]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1590agent # [23531.468374] agent flakelet[1658]: app: up to date591agent # [23531.470690] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.592relay # [23531.329567] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:49.291297Z","level":"INFO","message":"deploy finished","job":"f34b00b5e570467018b5f76e444dd3b8","ok":false,"target":"flakelet_relay::relay::api"}593relay # [23531.389683] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:49.351454Z","level":"INFO","message":"deploy accepted","job":"e534f7f1a91dc09ac1c2f39943d49b03","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}594client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/app' 2>&1, in 0.64 seconds)595client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '*/app' 2>&1596relay # [23532.007380] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:49.969127Z","level":"INFO","message":"deploy finished","job":"e534f7f1a91dc09ac1c2f39943d49b03","ok":true,"target":"flakelet_relay::relay::api"}597relay # [23532.029508] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:49.991301Z","level":"INFO","message":"deploy accepted","job":"f1f2caaa6c0a06dcd4d96a8bf9ece3a7","caller":"admin@example.org","targets":"[\"agent/app\", \"ghost/app\"]","target":"flakelet_relay::relay::api"}598agent # [23532.005656] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:49.967372Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}599agent # [23532.029796] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:49.991560Z","level":"INFO","message":"start","id":"b30ba194c6a5b7340428bfa2d14bb58d","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}600agent # [23532.030157] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:49.991976Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"b30ba194c6a5b7340428bfa2d14bb58d\"]","target":"flakelet_relay::agent::jobs"}601agent # [23532.067680] agent systemd[1]: Starting flakelet update app (via relay)...602agent # [23532.096138] agent systemd[1]: Started flakelet update app (via relay).603agent # [23532.100559] agent flakelet[1682]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1604agent # [23532.101190] agent flakelet[1682]: app: up to date605agent # [23532.103925] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.606client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '*/app' 2>&1, in 0.64 seconds)607client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave '*/app' 2>&1608agent # [23532.644622] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:50.606357Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}609agent # [23532.669353] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:50.631158Z","level":"INFO","message":"start","id":"4bdbb3edc448fe70d1bda81bb20741b2","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}610agent # [23532.669773] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:50.631593Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"4bdbb3edc448fe70d1bda81bb20741b2\"]","target":"flakelet_relay::agent::jobs"}611agent # [23532.707634] agent systemd[1]: Starting flakelet update app (via relay)...612agent # [23532.739101] agent systemd[1]: Started flakelet update app (via relay).613agent # [23532.742720] agent flakelet[1706]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1614agent # [23532.743252] agent flakelet[1706]: app: up to date615agent # [23532.745105] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.616relay # [23532.646182] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:50.607937Z","level":"INFO","message":"deploy finished","job":"f1f2caaa6c0a06dcd4d96a8bf9ece3a7","ok":false,"target":"flakelet_relay::relay::api"}617relay # [23532.669113] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:50.630920Z","level":"INFO","message":"deploy accepted","job":"d1bf4db9cdd59d88a58db921c395b142","caller":"admin@example.org","targets":"[\"agent/app\", \"ghost/app\"]","target":"flakelet_relay::relay::api"}618client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave '*/app' 2>&1, in 0.64 seconds)619client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/nope' 2>&1620client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/nope' 2>&1, in 0.02 seconds)621(finished: subtest: host patterns expand on the relay, in 1.95 seconds)622subtest: detach returns once the job is accepted623agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json624agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)625client: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1626client: (finished: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1, in 0.02 seconds)627agent: waiting for success: systemctl is-active flakelet-relay-job-app.service628agent # [23533.288846] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:51.250601Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"}629agent # [23533.343859] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:51.305626Z","level":"INFO","message":"start","id":"fc63c45be3d71f4cb9ed05b65f5c15d6","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}630agent # [23533.344117] agent flakelet-agent[474]: {"timestamp":"2026-09-06T13:36:51.305919Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"fc63c45be3d71f4cb9ed05b65f5c15d6\"]","target":"flakelet_relay::agent::jobs"}631agent # [23533.382607] agent systemd[1]: Starting flakelet update app (via relay)...632agent # [23533.413149] agent systemd[1]: Started flakelet update app (via relay).633agent # [23533.417677] agent flakelet[1742]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2634agent # [23533.418351] agent flakelet[1742]: app: activating generation 4635agent # [23533.431269] agent systemd[1]: Stopping app v1...636agent # [23533.431722] agent systemd[1]: app.service: Deactivated successfully.637agent # [23533.431984] agent systemd[1]: Stopped app v1.638agent # [23533.449796] agent systemd[1]: Reload requested from client PID 1749 ('systemctl') (unit flakelet-relay-job-app.service)...639agent # [23533.449866] agent systemd[1]: Reloading...640relay # [23533.289818] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:51.251556Z","level":"INFO","message":"deploy finished","job":"d1bf4db9cdd59d88a58db921c395b142","ok":false,"target":"flakelet_relay::relay::api"}641relay # [23533.343646] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:36:51.305404Z","level":"INFO","message":"deploy accepted","job":"54d154147da172e2968b29d856307b58","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}642agent # [23533.786376] agent systemd[1]: Reloading finished in 335 ms.643agent # [23533.854778] agent systemd[1]: Reload requested from client PID 1779 ('systemctl') (unit flakelet-relay-job-app.service)...644agent # [23533.854817] agent systemd[1]: Reloading...645agent # [23534.177510] agent systemd[1]: Reloading finished in 322 ms.646agent # [23534.257832] agent systemd[1]: Reload requested from client PID 1808 ('systemctl') (unit flakelet-relay-job-app.service)...647agent # [23534.257873] agent systemd[1]: Reloading...648agent: (finished: waiting for success: systemctl is-active flakelet-relay-job-app.service, in 1.30 seconds)649??? Warning (UserWarning): wait_until_fails(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.650 File "/nix/store/fv4yr9c0f9kyrfc00100i4rlshiiidbd-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39651agent: waiting for failure: systemctl is-active flakelet-relay-job-app.service652??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.653 File "/nix/store/fv4yr9c0f9kyrfc00100i4rlshiiidbd-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39654agent # [23534.578511] agent systemd[1]: Reloading finished in 320 ms.655agent # [23534.657331] agent systemd[1]: Reload requested from client PID 1841 ('systemctl') (unit flakelet-relay-job-app.service)...656agent # [23534.657365] agent systemd[1]: Reloading...657agent # [23534.979760] agent systemd[1]: Reloading finished in 322 ms.658agent # [23535.076202] agent systemd[1]: Starting app slow2...659agent # [23541.151202] agent systemd[1]: Started app slow2.660agent # [23541.159263] agent flakelet[1742]: app: updated to generation 4661agent # [23541.160123] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.662agent: (finished: waiting for failure: systemctl is-active flakelet-relay-job-app.service, in 7.52 seconds)663(finished: subtest: detach returns once the job is accepted, in 8.86 seconds)664subtest: unknown host is final, missing agent is retried, agents listing665client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1666client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1, in 0.02 seconds)667agent: must succeed: systemctl stop flakelet-agent668agent: (finished: must succeed: systemctl stop flakelet-agent, in 0.08 seconds)669relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0'670relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0', in 0.01 seconds)671client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 &672client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 &, in 0.01 seconds)673client: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out674relay # [23542.206485] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:00.168226Z","level":"INFO","message":"agent disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","host":"agent","target":"flakelet_relay::relay::agent_conn"}675agent # [23542.206200] agent systemd[1]: Stopping flakelet-agent...676agent # [23542.239991] agent systemd[1]: flakelet-agent.service: Deactivated successfully.677agent # [23542.240409] agent systemd[1]: Stopped flakelet-agent.678agent # [23542.240868] agent systemd[1]: flakelet-agent.service: Consumed 1.854s CPU time over 27.581s wall clock time.679client: (finished: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out, in 1.02 seconds)680agent: must succeed: systemctl start flakelet-agent681agent: (finished: must succeed: systemctl start flakelet-agent, in 0.12 seconds)682??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.683 File "/nix/store/fv4yr9c0f9kyrfc00100i4rlshiiidbd-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39684client: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out685agent # [23543.325442] agent systemd[1]: Starting flakelet-agent...686agent # [23543.382622] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:01.344355Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"fc63c45be3d71f4cb9ed05b65f5c15d6\"]","target":"flakelet_relay::agent::jobs"}687agent # [23543.428136] agent systemd[1]: Started flakelet-agent.688agent # [23543.441699] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:01.403475Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}689relay # [23543.441841] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:01.403549Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(4), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}690agent # [23543.923991] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:01.885705Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(4)","target":"flakelet_relay::agent::jobs"}691agent # [23545.314060] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:03.275771Z","level":"INFO","message":"start","id":"4a47905db5021c605dd37f7dfd9b4149","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}692agent # [23545.314982] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:03.276363Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"4a47905db5021c605dd37f7dfd9b4149\"]","target":"flakelet_relay::agent::jobs"}693agent # [23545.348618] agent systemd[1]: Starting flakelet update other (via relay)...694agent # [23545.378035] agent systemd[1]: Started flakelet update other (via relay).695agent # [23545.382749] agent flakelet[2351]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1696agent # [23545.383279] agent flakelet[2351]: other: up to date697agent # [23545.384059] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.698relay # [23545.313597] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:03.275328Z","level":"INFO","message":"deploy accepted","job":"28f2c656a5f1f9ba3edbeba615159332","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}699agent # [23545.919236] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:03.880951Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}700relay # [23545.920561] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:03.882266Z","level":"INFO","message":"deploy finished","job":"28f2c656a5f1f9ba3edbeba615159332","ok":true,"target":"flakelet_relay::relay::api"}701client: (finished: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out, in 3.04 seconds)702client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents703client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents, in 0.02 seconds)704client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)705client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.06 seconds)706client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjEyNCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NzAxODI0LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1VVhSQjVJM1QzN0xDPT09IiwibmJmIjoxNzg4NzAxODI0LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.9Sdz2P51DJbeeBh8LG9cZynZirC5RJJHI7QuWhH4984ZGmobYtWb8FbMOiMtpLw7lrSuCz1d3TTTaxHw9muJCQ' push --relay https://relay:7443 agents707client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjEyNCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NzAxODI0LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1VVhSQjVJM1QzN0xDPT09IiwibmJmIjoxNzg4NzAxODI0LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.9Sdz2P51DJbeeBh8LG9cZynZirC5RJJHI7QuWhH4984ZGmobYtWb8FbMOiMtpLw7lrSuCz1d3TTTaxHw9muJCQ' push --relay https://relay:7443 agents, in 0.02 seconds)708(finished: subtest: unknown host is final, missing agent is retried, agents listing, in 4.40 seconds)709subtest: out-of-band flakelet update reaches the relay without reconnect710agent: must succeed: flakelet status --json app | jq '.[0].generation'711agent: (finished: must succeed: flakelet status --json app | jq '.[0].generation', in 0.03 seconds)712agent: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true713agent: (finished: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true, in 0.01 seconds)714agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json715agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)716agent: must succeed: flakelet update app717app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2718app: activating generation 5719agent # [23546.640667] agent systemd[1]: Stopping app slow2...720agent # [23546.641401] agent systemd[1]: app.service: Deactivated successfully.721agent # [23546.641536] agent systemd[1]: Stopped app slow2.722agent # [23546.650748] agent systemd[1]: Reload requested from client PID 2393 ('systemctl')...723agent # [23546.650786] agent systemd[1]: Reloading...724agent # [23546.974557] agent systemd[1]: Reloading finished in 323 ms.725agent # [23547.055117] agent systemd[1]: Reload requested from client PID 2422 ('systemctl')...726agent # [23547.055158] agent systemd[1]: Reloading...727agent # [23547.382340] agent systemd[1]: Reloading finished in 326 ms.728agent # [23547.469370] agent systemd[1]: Reload requested from client PID 2453 ('systemctl')...729agent # [23547.469415] agent systemd[1]: Reloading...730agent # [23547.800022] agent systemd[1]: Reloading finished in 330 ms.731agent # [23547.874535] agent systemd[1]: Reload requested from client PID 2485 ('systemctl')...732agent # [23547.874571] agent systemd[1]: Reloading...733agent: (finished: must succeed: flakelet update app, in 1.70 seconds)734client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@5'735agent # [23548.204076] agent systemd[1]: Reloading finished in 329 ms.736agent # [23548.276599] agent systemd[1]: Starting app v2...737agent # [23548.314082] agent systemd[1]: Started app v2.738agent # [23549.451618] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:07.413378Z","level":"INFO","message":"local change","flakelet":"app","generation":5,"by":"root (shell)","target":"flakelet_relay::agent::jobs"}739client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@5', in 2.06 seconds)740agent: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true741agent: (finished: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true, in 0.01 seconds)742client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-5-743client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-5-, in 0.02 seconds)744client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-745client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-, in 0.02 seconds)746agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json747agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)748agent: must succeed: flakelet update app749app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1750app: activating generation 6751agent # [23550.469220] agent systemd[1]: Stopping app v2...752agent # [23550.469953] agent systemd[1]: app.service: Deactivated successfully.753agent # [23550.470096] agent systemd[1]: Stopped app v2.754agent # [23550.480893] agent systemd[1]: Reload requested from client PID 2537 ('systemctl')...755agent # [23550.480930] agent systemd[1]: Reloading...756agent # [23550.807201] agent systemd[1]: Reloading finished in 325 ms.757agent # [23550.899596] agent systemd[1]: Reload requested from client PID 2566 ('systemctl')...758agent # [23550.899642] agent systemd[1]: Reloading...759agent # [23551.222273] agent systemd[1]: Reloading finished in 322 ms.760agent # [23551.309926] agent systemd[1]: Reload requested from client PID 2594 ('systemctl')...761agent # [23551.309970] agent systemd[1]: Reloading...762agent # [23551.637200] agent systemd[1]: Reloading finished in 326 ms.763agent # [23551.737226] agent systemd[1]: Reload requested from client PID 2626 ('systemctl')...764agent # [23551.737268] agent systemd[1]: Reloading...765agent: (finished: must succeed: flakelet update app, in 1.75 seconds)766client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@6'767agent # [23552.064212] agent systemd[1]: Reloading finished in 326 ms.768agent # [23552.158750] agent systemd[1]: Starting app v1...769agent # [23552.186980] agent systemd[1]: Started app v1.770agent # [23553.451927] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:11.413722Z","level":"INFO","message":"local change","flakelet":"app","generation":6,"by":"root (shell)","target":"flakelet_relay::agent::jobs"}771client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@6', in 2.07 seconds)772(finished: subtest: out-of-band flakelet update reaches the relay without reconnect, in 7.69 seconds)773subtest: certificate not listed under agents cannot connect as agent774client: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent775client: (finished: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent, in 0.03 seconds)776(finished: subtest: certificate not listed under agents cannot connect as agent, in 0.03 seconds)777subtest: metrics778relay: must succeed: curl -sf http://127.0.0.1:7400/metrics779relay: (finished: must succeed: curl -sf http://127.0.0.1:7400/metrics, in 0.01 seconds)780(finished: subtest: metrics, in 0.01 seconds)781subtest: agent link drop mid-run replays missed lines once782agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json783agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds)784agent: must succeed: date +%s785agent: (finished: must succeed: date +%s, in 0.01 seconds)786client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 &787client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 &, in 0.01 seconds)788agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788701832 | grep -q 'app-slow'789agent # [23554.347941] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:12.309705Z","level":"INFO","message":"start","id":"9f7a128eb04fb75f66b102866c124436","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}790agent # [23554.348665] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:12.310480Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"9f7a128eb04fb75f66b102866c124436\"]","target":"flakelet_relay::agent::jobs"}791agent # [23554.386073] agent systemd[1]: Starting flakelet update app (via relay)...792agent # [23554.393341] agent systemd[1]: Started flakelet update app (via relay).793agent # [23554.397131] agent flakelet[2684]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow794agent # [23554.397791] agent flakelet[2684]: app: activating generation 7795agent # [23554.407771] agent systemd[1]: Stopping app v1...796agent # [23554.408497] agent systemd[1]: app.service: Deactivated successfully.797agent # [23554.408625] agent systemd[1]: Stopped app v1.798agent # [23554.420584] agent systemd[1]: Reload requested from client PID 2691 ('systemctl') (unit flakelet-relay-job-app.service)...799agent # [23554.420621] agent systemd[1]: Reloading...800relay # [23554.289684] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:12.251452Z","level":"INFO","message":"agent rejected: no agents entry matches","principals":"[\"x509:dns:mallory\"]","target":"flakelet_relay::relay::agent_conn"}801relay # [23554.347524] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:12.309318Z","level":"INFO","message":"deploy accepted","job":"2976327c7bcd7518c94ab7cc8d6ca995","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}802agent # [23554.755516] agent systemd[1]: Reloading finished in 334 ms.803agent # [23554.851369] agent systemd[1]: Reload requested from client PID 2721 ('systemctl') (unit flakelet-relay-job-app.service)...804agent # [23554.851408] agent systemd[1]: Reloading...805agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788701832 | grep -q 'app-slow', in 1.02 seconds)806agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done807agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done, in 0.02 seconds)808relay: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done809relay: (finished: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done, in 0.07 seconds)810agent: must succeed: ss -K dport = 7443811agent # [23555.187917] agent systemd[1]: Reloading finished in 336 ms.812agent # [23555.275011] agent systemd[1]: Reload requested from client PID 2750 ('systemctl') (unit flakelet-relay-job-app.service)...813agent # [23555.275054] agent systemd[1]: Reloading...814agent: (finished: must succeed: ss -K dport = 7443, in 0.03 seconds)815agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788701832 | grep -q 'updated to generation'816agent # [23555.476690] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:13.438279Z","level":"INFO","message":"disconnected: IO error: Software caused connection abort (os error 103)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}817agent # [23555.625316] agent systemd[1]: Reloading finished in 349 ms.818relay # [23555.444071] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:13.405773Z","level":"INFO","message":"agent disconnected: IO error: Software caused connection abort (os error 103)","host":"agent","target":"flakelet_relay::relay::agent_conn"}819agent # [23555.726964] agent systemd[1]: Reload requested from client PID 2798 ('systemctl') (unit flakelet-relay-job-app.service)...820agent # [23555.727012] agent systemd[1]: Reloading...821agent # [23556.055430] agent systemd[1]: Reloading finished in 328 ms.822agent # [23556.143231] agent systemd[1]: Starting app slow...823agent # [23556.479563] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:14.441315Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}824agent # [23558.482072] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:16.443812Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}825agent # [23562.174883] agent systemd[1]: Started app slow.826agent # [23562.180466] agent flakelet[2684]: app: updated to generation 7827agent # [23562.182264] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.828agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788701832 | grep -q 'updated to generation', in 7.10 seconds)829agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done830agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done, in 0.02 seconds)831client: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out832agent # [23562.483558] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:20.445300Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}833agent # [23563.295044] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:21.256800Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(7)","target":"flakelet_relay::agent::jobs"}834client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out, in 8.09 seconds)835client: must succeed: cat /tmp/slow.out836client: (finished: must succeed: cat /tmp/slow.out, in 0.01 seconds)837(finished: subtest: agent link drop mid-run replays missed lines once, in 16.39 seconds)838subtest: agent restart mid-run reattaches to the unit839agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json840agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds)841client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 &842client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 &, in 0.01 seconds)843agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2'844relay # [23570.488316] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:28.450079Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}845relay # [23570.489979] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:28.451773Z","level":"INFO","message":"deploy finished","job":"2976327c7bcd7518c94ab7cc8d6ca995","ok":true,"target":"flakelet_relay::relay::api"}846relay # [23570.729731] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:28.691481Z","level":"INFO","message":"deploy accepted","job":"ba1efcf9483700d7a230dc365fc8181f","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}847agent # [23570.488231] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:28.449965Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}848agent # [23570.489463] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:28.451280Z","level":"INFO","message":"start","id":"9f7a128eb04fb75f66b102866c124436","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}849agent # [23570.730248] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:28.691989Z","level":"INFO","message":"start","id":"cfdfac7db31549ca4a0ef9453b3c1f65","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}850agent # [23570.730904] agent flakelet-agent[1926]: {"timestamp":"2026-09-06T13:37:28.692720Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"cfdfac7db31549ca4a0ef9453b3c1f65\"]","target":"flakelet_relay::agent::jobs"}851agent # [23570.762273] agent systemd[1]: Starting flakelet update app (via relay)...852agent # [23570.796231] agent systemd[1]: Started flakelet update app (via relay).853agent # [23570.801302] agent flakelet[2956]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2854agent # [23570.801991] agent flakelet[2956]: app: activating generation 8855agent # [23570.812350] agent systemd[1]: Stopping app slow...856agent # [23570.813068] agent systemd[1]: app.service: Deactivated successfully.857agent # [23570.813197] agent systemd[1]: Stopped app slow.858agent # [23570.822706] agent systemd[1]: Reload requested from client PID 2963 ('systemctl') (unit flakelet-relay-job-app.service)...859agent # [23570.822746] agent systemd[1]: Reloading...860agent # [23571.148771] agent systemd[1]: Reloading finished in 325 ms.861agent # [23571.238368] agent systemd[1]: Reload requested from client PID 2993 ('systemctl') (unit flakelet-relay-job-app.service)...862agent # [23571.238410] agent systemd[1]: Reloading...863agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2', in 1.02 seconds)864agent: must succeed: systemctl restart flakelet-agent865agent # [23571.564351] agent systemd[1]: Reloading finished in 325 ms.866agent # [23571.645591] agent systemd[1]: Reload requested from client PID 3025 ('systemctl') (unit flakelet-relay-job-app.service)...867agent # [23571.645626] agent systemd[1]: Reloading...868agent # [23571.973486] agent systemd[1]: Reloading finished in 327 ms.869agent # [23572.051285] agent systemd[1]: Stopping flakelet-agent...870agent # [23572.060119] agent systemd[1]: Reload requested from client PID 3063 ('systemctl') (unit flakelet-relay-job-app.service)...871agent # [23572.060159] agent systemd[1]: Reloading...872agent # [23572.388946] agent systemd[1]: Reloading finished in 328 ms.873relay # [23572.053288] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:30.015032Z","level":"INFO","message":"agent disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","host":"agent","target":"flakelet_relay::relay::agent_conn"}874agent: (finished: must succeed: systemctl restart flakelet-agent, in 0.86 seconds)875agent: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)"876agent: (finished: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)", in 0.01 seconds)877client: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out878agent # [23572.465916] agent systemd[1]: flakelet-agent.service: Deactivated successfully.879agent # [23572.466165] agent systemd[1]: Stopped flakelet-agent.880agent # [23572.466181] agent systemd[1]: flakelet-agent.service: Consumed 1.132s CPU time over 29.140s wall clock time.881agent # [23572.516869] agent systemd[1]: Starting app slow2...882agent # [23572.518206] agent systemd[1]: Starting flakelet-agent...883agent # [23572.549317] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:30.511101Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"cfdfac7db31549ca4a0ef9453b3c1f65\"]","target":"flakelet_relay::agent::jobs"}884agent # [23572.595588] agent systemd[1]: Started flakelet-agent.885agent # [23572.609684] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:30.571472Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}886agent # [23572.610946] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:30.572765Z","level":"INFO","message":"start","id":"cfdfac7db31549ca4a0ef9453b3c1f65","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}887relay # [23572.609832] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:30.571569Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}888agent # [23578.563135] agent systemd[1]: Started app slow2.889agent # [23578.570386] agent flakelet[2956]: app: updated to generation 8890agent # [23578.573272] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.891agent # [23579.139353] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:37.101103Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(8)","target":"flakelet_relay::agent::jobs"}892relay # [23579.140493] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:37.102164Z","level":"INFO","message":"deploy finished","job":"ba1efcf9483700d7a230dc365fc8181f","ok":true,"target":"flakelet_relay::relay::api"}893client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out, in 7.08 seconds)894client: must succeed: cat /tmp/restart.out895client: (finished: must succeed: cat /tmp/restart.out, in 0.01 seconds)896agent: must succeed: systemctl is-active app.service897agent: (finished: must succeed: systemctl is-active app.service, in 0.01 seconds)898(finished: subtest: agent restart mid-run reattaches to the unit, in 9.03 seconds)899subtest: relay restart mid-run, push resumes via /v1/jobs900agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json901agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds)902agent: must succeed: date +%s903agent: (finished: must succeed: date +%s, in 0.01 seconds)904client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 &905client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 &, in 0.01 seconds)906agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788701857 | grep -q 'app-slow'907agent # [23579.762118] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:37.723833Z","level":"INFO","message":"start","id":"c81e8c7c55cb7bea994cc5304aa7693d","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}908agent # [23579.762463] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:37.724289Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"c81e8c7c55cb7bea994cc5304aa7693d\"]","target":"flakelet_relay::agent::jobs"}909agent # [23579.791128] agent systemd[1]: Starting flakelet update app (via relay)...910agent # [23579.823207] agent systemd[1]: Started flakelet update app (via relay).911agent # [23579.827437] agent flakelet[3565]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow912agent # [23579.828107] agent flakelet[3565]: app: activating generation 9913agent # [23579.839821] agent systemd[1]: Stopping app slow2...914agent # [23579.840533] agent systemd[1]: app.service: Deactivated successfully.915agent # [23579.840657] agent systemd[1]: Stopped app slow2.916agent # [23579.850978] agent systemd[1]: Reload requested from client PID 3572 ('systemctl') (unit flakelet-relay-job-app.service)...917agent # [23579.851026] agent systemd[1]: Reloading...918agent # [23580.176971] agent systemd[1]: Reloading finished in 325 ms.919relay # [23579.761688] relay flakelet-relay[400]: {"timestamp":"2026-09-06T13:37:37.723433Z","level":"INFO","message":"deploy accepted","job":"2ab8e0fbd49132d3729f9cf43111ea48","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}920agent # [23580.247589] agent systemd[1]: Reload requested from client PID 3602 ('systemctl') (unit flakelet-relay-job-app.service)...921agent # [23580.247629] agent systemd[1]: Reloading...922agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788701857 | grep -q 'app-slow', in 1.02 seconds)923relay: must succeed: systemctl restart flakelet-relay924agent # [23580.573559] agent systemd[1]: Reloading finished in 325 ms.925agent # [23580.658700] agent systemd[1]: Reload requested from client PID 3634 ('systemctl') (unit flakelet-relay-job-app.service)...926agent # [23580.658742] agent systemd[1]: Reloading...927agent # [23580.781937] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:38.743678Z","level":"INFO","message":"disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}928relay # [23580.781315] relay systemd[1]: Stopping flakelet-relay...929relay # [23580.837371] relay systemd[1]: flakelet-relay.service: Deactivated successfully.930relay # [23580.837772] relay systemd[1]: Stopped flakelet-relay.931relay # [23580.837810] relay systemd[1]: flakelet-relay.service: Consumed 2.686s CPU time over 1min 7.514s wall clock time.932relay # [23580.873713] relay systemd[1]: Starting flakelet-relay...933agent # [23580.995352] agent systemd[1]: Reloading finished in 336 ms.934agent # [23581.083590] agent systemd[1]: Reload requested from client PID 3670 ('systemctl') (unit flakelet-relay-job-app.service)...935agent # [23581.083632] agent systemd[1]: Reloading...936agent # [23581.414153] agent systemd[1]: Reloading finished in 330 ms.937agent # [23581.491593] agent systemd[1]: Starting app slow...938agent # [23581.788288] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:39.750064Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}939relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.60 seconds)940client: waiting for success: grep -q '» ok' /tmp/resume.out941relay # [23582.365795] relay flakelet-relay[930]: {"timestamp":"2026-09-06T13:37:40.327549Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"}942relay # [23582.366446] relay flakelet-relay[930]: {"timestamp":"2026-09-06T13:37:40.328060Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"}943relay # [23582.366446] relay systemd[1]: Started flakelet-relay.944agent # [23583.800892] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:41.762633Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}945relay # [23583.803275] relay flakelet-relay[930]: {"timestamp":"2026-09-06T13:37:41.765012Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(8), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}946agent # [23587.557141] agent systemd[1]: Started app slow.947agent # [23587.566077] agent flakelet[3565]: app: updated to generation 9948agent # [23587.568895] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.949relay # [23587.808523] relay flakelet-relay[930]: {"timestamp":"2026-09-06T13:37:45.770271Z","level":"INFO","message":"job reattached","job":"2ab8e0fbd49132d3729f9cf43111ea48","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}950agent # [23588.656214] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:46.617958Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(9)","target":"flakelet_relay::agent::jobs"}951client: (finished: waiting for success: grep -q '» ok' /tmp/resume.out, in 7.08 seconds)952client: must succeed: cat /tmp/resume.out953client: (finished: must succeed: cat /tmp/resume.out, in 0.01 seconds)954(finished: subtest: relay restart mid-run, push resumes via /v1/jobs, in 9.74 seconds)955subtest: job history comes from the agents and survives a relay restart956client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1957relay # [23589.480636] relay flakelet-relay[930]: {"timestamp":"2026-09-06T13:37:47.442396Z","level":"INFO","message":"deploy accepted","job":"188b06c4636b65849b3ba8daac22dc7c","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}958agent # [23589.481152] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:47.442846Z","level":"INFO","message":"start","id":"5be20c693e5c0b60e3f85779794dfb86","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}959agent # [23589.481713] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:47.443530Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5be20c693e5c0b60e3f85779794dfb86\"]","target":"flakelet_relay::agent::jobs"}960agent # [23589.520273] agent systemd[1]: Starting flakelet update other (via relay)...961agent # [23589.559231] agent systemd[1]: Started flakelet update other (via relay).962agent # [23589.563598] agent flakelet[3767]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1963agent # [23589.564233] agent flakelet[3767]: other: up to date964agent # [23589.566668] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.965client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1, in 0.64 seconds)966relay: must succeed: systemctl restart flakelet-relay967agent # [23590.101938] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:48.063683Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}968agent # [23590.119985] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:48.081790Z","level":"INFO","message":"disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}969relay # [23590.103534] relay flakelet-relay[930]: {"timestamp":"2026-09-06T13:37:48.065297Z","level":"INFO","message":"deploy finished","job":"188b06c4636b65849b3ba8daac22dc7c","ok":true,"target":"flakelet_relay::relay::api"}970relay # [23590.119739] relay systemd[1]: Stopping flakelet-relay...971relay # [23590.166902] relay systemd[1]: flakelet-relay.service: Deactivated successfully.972relay # [23590.167348] relay systemd[1]: Stopped flakelet-relay.973relay # [23590.167388] relay systemd[1]: flakelet-relay.service: Consumed 2.189s CPU time over 9.293s wall clock time.974relay # [23590.202127] relay systemd[1]: Starting flakelet-relay...975agent # [23591.123448] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:49.085164Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"}976relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.50 seconds)977relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1'978relay # [23591.608419] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:49.570175Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"}979relay # [23591.609312] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:49.570716Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"}980relay # [23591.609077] relay systemd[1]: Started flakelet-relay.981agent # [23593.137758] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:51.099520Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"}982relay # [23593.137886] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:51.099648Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(9), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"}983relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 2.06 seconds)984client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs985client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs, in 0.02 seconds)986client: must succeed: echo '{"groups": [], "repository": "example/app"}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32)987client: (finished: must succeed: echo '{"groups": [], "repository": "example/app"}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.06 seconds)988client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjE3MSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NzAxODcxLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJPTkFTVlBWWUJHUEJJPT09IiwibmJmIjoxNzg4NzAxODcxLCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.xJv5fTMsK9_S9uW22GaFBPiLHQD9H0PRGTQHQvOxZoJ9qZzTytAzCg_36c-osxdi3jqrMzKPJ7SgN9guzOChAQ' push --relay https://relay:7443 deploy --id hist2 agent/app989» job 6a239dbf87cfec796e49404c351d787f via relay 0.1.0 (agents: agent 0.1.0)990» wave 0991agent/app | Starting flakelet update app (via relay)...992agent/app | Started flakelet update app (via relay).993agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow994agent/app | app: up to date995agent # [23593.772483] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:51.734244Z","level":"INFO","message":"start","id":"dce6faec8455f85321e72ee634888126","flakelet":"app","rule":"ci","relay":"relay","caller_name":"\"example/app\"","target":"flakelet_relay::agent::conn"}996agent # [23593.773095] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:51.734845Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"dce6faec8455f85321e72ee634888126\"]","target":"flakelet_relay::agent::jobs"}997agent # [23593.811278] agent systemd[1]: Starting flakelet update app (via relay)...998agent # [23593.844108] agent systemd[1]: Started flakelet update app (via relay).999agent # [23593.848220] agent flakelet[3807]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow1000agent/appagent # [23593.848750] agent flakelet[3807]: app: up to date1001 | agent # [23593.850832] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully.1002flakelet-relay-job-app.service: Deactivated successfully.1003relay # [23593.771983] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:51.733752Z","level":"INFO","message":"deploy accepted","job":"6a239dbf87cfec796e49404c351d787f","caller":"example/app","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"}1004» agent/app: unchanged (generation 9)1005» ok1006client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjE3MSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NzAxODcxLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJPTkFTVlBWWUJHUEJJPT09IiwibmJmIjoxNzg4NzAxODcxLCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.xJv5fTMsK9_S9uW22GaFBPiLHQD9H0PRGTQHQvOxZoJ9qZzTytAzCg_36c-osxdi3jqrMzKPJ7SgN9guzOChAQ' push --relay https://relay:7443 deploy --id hist2 agent/app, in 0.64 seconds)1007client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjE3MSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NzAxODcxLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJPTkFTVlBWWUJHUEJJPT09IiwibmJmIjoxNzg4NzAxODcxLCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.xJv5fTMsK9_S9uW22GaFBPiLHQD9H0PRGTQHQvOxZoJ9qZzTytAzCg_36c-osxdi3jqrMzKPJ7SgN9guzOChAQ' push --relay https://relay:7443 jobs1008client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODcwMjE3MSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NzAxODcxLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJPTkFTVlBWWUJHUEJJPT09IiwibmJmIjoxNzg4NzAxODcxLCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.xJv5fTMsK9_S9uW22GaFBPiLHQD9H0PRGTQHQvOxZoJ9qZzTytAzCg_36c-osxdi3jqrMzKPJ7SgN9guzOChAQ' push --relay https://relay:7443 jobs, in 0.02 seconds)1009(finished: subtest: job history comes from the agents and survives a relay restart, in 4.95 seconds)1010subtest: dashboard login via authorization code flow1011client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login'1012client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login', in 0.02 seconds)1013client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login1014client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login, in 0.09 seconds)1015client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs1016client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs, in 0.02 seconds)1017client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist11018client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist1, in 0.02 seconds)1019client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true1020client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true, in 0.02 seconds)1021client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 4031022client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 403, in 0.02 seconds)1023client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other'1024client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other', in 0.02 seconds)1025client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/f9acb61d03142e2abc6ec23b87d703cb/events || true1026relay # [23594.387361] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:52.349130Z","level":"INFO","message":"deploy finished","job":"6a239dbf87cfec796e49404c351d787f","ok":true,"target":"flakelet_relay::relay::api"}1027relay # [23594.462677] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [06/Sep/2026 13:37:52] "GET /authorize?response_type=code&client_id=dashboard&redirect_uri=https%3A%2F%2Frelay%3A7443%2Fui%2Fcallback&scope=openid%20profile%20email%20groups&state=BgWOw0syZ4D1B-NglBJMZOEKYSQPap4ZDHetSTocHrY&code_challenge=YAdcsQscy_oXRRKfR4VdLQBcw7Oa-EEHS5082PRP7tg&code_challenge_method=S256 HTTP/1.1" 302 -1028relay # [23594.515733] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [06/Sep/2026 13:37:52] "POST /token HTTP/1.1" 200 -1029relay # [23594.516613] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:52.478426Z","level":"INFO","message":"login","name":"dev@example.org","principals":"[\"oidc:mock:someone\", \"oidc:mock:groups:wheel\"]","target":"flakelet_relay::relay::login"}1030relay # [23594.578460] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:52.540231Z","level":"INFO","message":"job reattached","job":"188b06c4636b65849b3ba8daac22dc7c","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1031relay # [23594.621240] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:52.583019Z","level":"INFO","message":"deploy accepted","job":"49e3d8bcd97a0aae99c365f9936ea0ea","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1032relay # [23594.641221] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:52.602986Z","level":"INFO","message":"job reattached","job":"49e3d8bcd97a0aae99c365f9936ea0ea","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1033agent # [23594.386194] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:52.347931Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(9)","target":"flakelet_relay::agent::jobs"}1034agent # [23594.621533] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:52.583318Z","level":"INFO","message":"start","id":"4591572b466d49a83a7db883b8282fe7","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"}1035agent # [23594.621768] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:52.583595Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"4591572b466d49a83a7db883b8282fe7\"]","target":"flakelet_relay::agent::jobs"}1036agent # [23594.660156] agent systemd[1]: Starting flakelet update other (via relay)...1037agent # [23594.692159] agent systemd[1]: Started flakelet update other (via relay).1038agent # [23594.696178] agent flakelet[3839]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v11039agent # [23594.696727] agent flakelet[3839]: other: up to date1040agent # [23594.697780] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.1041client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/f9acb61d03142e2abc6ec23b87d703cb/events || true, in 0.61 seconds)1042client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/f9acb61d03142e2abc6ec23b87d703cb1043client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/f9acb61d03142e2abc6ec23b87d703cb, in 0.02 seconds)1044client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js1045client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js, in 0.02 seconds)1046client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth'1047client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth', in 0.02 seconds)1048client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other1049client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other, in 0.02 seconds)1050client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected'1051client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected', in 0.02 seconds)1052client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=f9acb61d03142e2abc6ec23b87d703cb' | grep -q 4001053client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=f9acb61d03142e2abc6ec23b87d703cb' | grep -q 400, in 0.02 seconds)1054client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 &1055client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 &, in 0.01 seconds)1056client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other1057» job 38796a7ba508eadfe82a1cd5def000bc via relay 0.1.0 (agents: agent 0.1.0)1058» wave 01059agent/other | Starting flakelet update other (via relay)...1060agent/other | Started flakelet update other (via relay).1061agent # [23595.225738] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:53.187465Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"}1062agent # [23595.372937] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:53.334725Z","level":"INFO","message":"start","id":"5e317fc57863c2a7c03ebe1bdacd1356","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"}1063agent # [23595.373293] agent flakelet-agent[3096]: {"timestamp":"2026-09-06T13:37:53.335120Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5e317fc57863c2a7c03ebe1bdacd1356\"]","target":"flakelet_relay::agent::jobs"}1064agent # [23595.400477] agent systemd[1]: Starting flakelet update other (via relay)...1065agent # [23595.433106] agent systemd[1]: Started flakelet update other (via relay).1066agent # [23595.437446] agent flakelet[3863]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v11067agent # [23595.437959] agent flakelet[3863]: other: up to date1068agent/otheragent # [23595.438546] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully.1069 | other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v11070agent/other | other: up to date1071agent/other | flakelet-relay-job-other.service: Deactivated successfully.1072relay # [23595.372624] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:53.334396Z","level":"INFO","message":"deploy accepted","job":"38796a7ba508eadfe82a1cd5def000bc","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"}1073» agent/other: unchanged (generation 1)1074» ok1075client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other, in 1.63 seconds)1076client: waiting for success: grep -q live1 /tmp/ev.out1077client: (finished: waiting for success: grep -q live1 /tmp/ev.out, in 0.01 seconds)1078client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout1079client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout, in 0.02 seconds)1080client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 3031081client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 303, in 0.02 seconds)1082(finished: subtest: dashboard login via authorization code flow, in 2.63 seconds)1083(finished: run the VM test script, in 87.22 seconds)1084test script finished in 87.25s1085cleanup1086kill NspawnMachine (pid 52)1087kill NspawnMachine (pid 53)1088kill NspawnMachine (pid 54)1089Container agent terminated by signal KILL.1090relay # [23596.984468] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T13:37:54.946200Z","level":"INFO","message":"deploy finished","job":"38796a7ba508eadfe82a1cd5def000bc","ok":true,"target":"flakelet_relay::relay::api"}1091Container client terminated by signal KILL.1092Container relay terminated by signal KILL.1093(finished: cleanup, in 0.34 seconds)1094additionally exposed symbols:1095 agent, client, relay,1096 vlan1,1097 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh1098» job 95384cb214ce38b665cdd44f501bb6e7 via relay 0.1.0 (agents: agent 0.1.0)1099» wave 01100agent/app | Starting flakelet update app (via relay)...1101agent/app | Started flakelet update app (via relay).1102agent/app | app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v21103agent/app | app: activating generation 21104agent/app | app: updated to generation 21105agent/app | flakelet-relay-job-app.service: Deactivated successfully.1106» agent/app: updated (generation 2)1107» ok11081109» job f34b00b5e570467018b5f76e444dd3b8 via relay 0.1.0 (agents: agent 0.1.0)1110» wave 01111agent/app | Starting flakelet update app (via relay)...1112agent/app | Started flakelet update app (via relay).1113agent/app | app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken1114agent/app | app: activating generation 41115agent/app | app: deploy failed, rolled back: systemctl start app.service failed:1116agent/app | failed units: app.service. See journalctl -u app.service1117agent/app | flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE1118agent/app | flakelet-relay-job-app.service: Failed with result 'exit-code'.1119» agent/app: rolled-back (generation 3)1120agent/app │ Starting app v1...1121agent/app │ Started app v1.1122agent/app │ Stopping app v1...1123agent/app │ app.service: Deactivated successfully.1124agent/app │ Stopped app v1.1125agent/app │ Starting app v2...1126agent/app │ Started app v2.1127agent/app │ Stopping app v2...1128agent/app │ app.service: Deactivated successfully.1129agent/app │ Stopped app v2.1130agent/app │ Starting app v1...1131agent/app │ Started app v1.1132agent/app │ Stopping app v1...1133agent/app │ app.service: Deactivated successfully.1134agent/app │ Stopped app v1.1135agent/app │ Starting app broken...1136agent/app │ app.service: Unable to locate executable '/nonexistent': No such file or directory1137agent/app │ app.service: Failed at step EXEC spawning /nonexistent: No such file or directory1138agent/app │ app.service: Main process exited, code=exited, status=203/EXEC1139agent/app │ app.service: Failed with result 'exit-code'.1140agent/app │ Failed to start app broken.1141agent/app │ Starting app v1...1142agent/app │ Started app v1.1143» skipped: agent/other1144» failed11451146» job 2976327c7bcd7518c94ab7cc8d6ca995 via relay 0.1.0 (agents: agent 0.1.0)1147» wave 01148agent/app | Starting flakelet update app (via relay)...1149agent/app | Started flakelet update app (via relay).1150agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow1151agent/app | app: activating generation 71152agent/app | app: updated to generation 71153agent/app | flakelet-relay-job-app.service: Deactivated successfully.1154» agent/app: updated (generation 7)1155» ok11561157» job ba1efcf9483700d7a230dc365fc8181f via relay 0.1.0 (agents: agent 0.1.0)1158» wave 01159agent/app | Starting flakelet update app (via relay)...1160agent/app | Started flakelet update app (via relay).1161agent/app | app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow21162agent/app | app: activating generation 81163agent/app | app: updated to generation 81164agent/app | flakelet-relay-job-app.service: Deactivated successfully.1165» agent/app: updated (generation 8)1166» ok11671168» job 2ab8e0fbd49132d3729f9cf43111ea48 via relay 0.1.0 (agents: agent 0.1.0)1169» wave 01170agent/app | Starting flakelet update app (via relay)...1171agent/app | Started flakelet update app (via relay).1172agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow1173agent/app | app: activating generation 91174flakelet-push: stream: error reading a body from connection, resuming job c77c5505ef6edc32f4b01bece3b559ff1175flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 1s1176flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 2s1177flakelet-push: https://relay:7443: 404 Not Found: unknown_job: no connected agent knows this job, retrying in 4s1178» job 2ab8e0fbd49132d3729f9cf43111ea48 via relay 0.1.0 (agents: agent 0.1.0)1179» wave 01180agent/app | app: updated to generation 91181agent/app | flakelet-relay-job-app.service: Deactivated successfully.1182» agent/app: updated (generation 9)1183» ok118411851788701867 hist1 admin@example.org agent/other:unchanged11861788701857 c77c5505ef6edc32f4b01bece3b559ff admin@example.org agent/app:updated11871788701848 66c135937c37116528c671717d5974f9 admin@example.org agent/app:updated11881788701832 34c59e3d0c93e4e79b291d186c26a539 admin@example.org agent/app:updated11891788701830 local-app-6-1788701830 root (shell) agent/app:updated11901788701826 local-app-5-1788701826 root (shell) agent/app:updated11911788701823 8cbdffcd97353b3ee6836b9355899cea admin@example.org agent/other:unchanged11921788701811 bdaa537211a9cea7a435af976db9d9ec admin@example.org agent/app:updated11931788701810 814b5679206d49867fe15108292f2e28 admin@example.org agent/app:unchanged11941788701809 b51ae2a7b721c4bc5a214ba3e33e87b8 admin@example.org agent/app:unchanged11951788701809 c1b59ff16b5e0955a4493d821a1dc50a admin@example.org agent/app:unchanged11961788701805 1c8744aed463949fa2b4421e369449a9 admin@example.org agent/app:rolled-back11971788701804 6954f806c71eba0623593bf8f5cecc94 dev@example.org agent/other:unchanged11981788701803 31fa6b42fbd0fe6b4245f90ec8db7712 dev@example.org agent/other:unchanged11991788701801 89ff7a6040301a62c732ff2c519b5af9 someone agent/other:unchanged12001788701798 d36ab2c23fd28c3c540fc4aef5ba0e97 repo:github:example/app:ref:refs/heads/main agent/app:updated12011788701795 64210b1e6794a6d0feea96524cf81af9 admin@example.org agent/app:updated12021788701793 local-app-1-1788701793 host activation agent/app:updated12031788701793 local-other-1-1788701793 host activation agent/other:updated1204