these 2 derivations will be built: /nix/store/1kj8wplwspzpl6iixjacqrxd5yw5vdlr-nixos-test-driver-flakelet-relay.drv /nix/store/3vfz72vix6a171zp4bqp9cx1qmbq9i31-container-test-run-flakelet-relay.drv building '/nix/store/1kj8wplwspzpl6iixjacqrxd5yw5vdlr-nixos-test-driver-flakelet-relay.drv' nixos-test-driver-flakelet-relay> tribuchet: building on jamie nixos-test-driver-flakelet-relay> Running type check (enable/disable: config.skipTypeCheck) nixos-test-driver-flakelet-relay> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck nixos-test-driver-flakelet-relay> All checks passed! nixos-test-driver-flakelet-relay> Linting test script (enable/disable: config.skipLint) nixos-test-driver-flakelet-relay> See https://nixos.org/manual/nixos/stable/#test-opt-skipLint nixos-test-driver-flakelet-relay> All checks passed! building '/nix/store/3vfz72vix6a171zp4bqp9cx1qmbq9i31-container-test-run-flakelet-relay.drv' container-test-run-flakelet-relay> tribuchet: building on jamie container-test-run-flakelet-relay> Machine state will be reset. To keep it, pass --keep-machine-state container-test-run-flakelet-relay> start all VLans container-test-run-flakelet-relay> (finished: start all VLans, in 0.00 seconds) container-test-run-flakelet-relay> Initializing machine ID from random generator. container-test-run-flakelet-relay> Test will time out and terminate in 3600.0 seconds container-test-run-flakelet-relay> run the VM test script container-test-run-flakelet-relay> start all VMs container-test-run-flakelet-relay> agent: systemd-nspawn running (pid 52) container-test-run-flakelet-relay> client: systemd-nspawn running (pid 53) container-test-run-flakelet-relay> agent: Waiting for journal at /build/vm-state-agent/var/log/journal... container-test-run-flakelet-relay> relay: systemd-nspawn running (pid 56) container-test-run-flakelet-relay> client: Waiting for journal at /build/vm-state-client/var/log/journal... container-test-run-flakelet-relay> relay: Waiting for journal at /build/vm-state-relay/var/log/journal... container-test-run-flakelet-relay> (finished: start all VMs, in 0.00 seconds) container-test-run-flakelet-relay> relay: waiting for unit flakelet-relay.service container-test-run-flakelet-relay> nixos-nspawn(agent): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-flakelet-relay> nixos-nspawn(agent): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-flakelet-relay> nixos-nspawn(relay): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-flakelet-relay> nixos-nspawn(relay): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-flakelet-relay> nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-flakelet-relay> nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-flakelet-relay> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-flakelet-relay> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-flakelet-relay> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-flakelet-relay> ░ Spawning container relay on /build/vm-state-relay. container-test-run-flakelet-relay> ░ Spawning container agent on /build/vm-state-agent. container-test-run-flakelet-relay> ░ Spawning container client on /build/vm-state-client. container-test-run-flakelet-relay> agent # No journal boot entry found for the specified boot (+0). container-test-run-flakelet-relay> relay # No journal boot entry found for the specified boot (+0). container-test-run-flakelet-relay> client # [ 7061.191386] client systemd-journald[57]: Journal started container-test-run-flakelet-relay> client # [ 7061.191427] client systemd-journald[57]: Runtime Journal (/run/log/journal/beebb7e4cf2a41b49a6fa83eac40fbc1) is 8M, max 4G, 3.9G free. container-test-run-flakelet-relay> client # [ 7061.200836] client systemd[1]: Finished Apply Kernel Variables. container-test-run-flakelet-relay> client # [ 7061.212429] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-flakelet-relay> client # [ 7061.226280] client systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-flakelet-relay> client # [ 7061.227029] client systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-flakelet-relay> client # [ 7061.265680] client systemd-journald[57]: Time spent on flushing to /var/log/journal/beebb7e4cf2a41b49a6fa83eac40fbc1 is 1.474ms for 6 entries. container-test-run-flakelet-relay> client # [ 7061.265680] client systemd-journald[57]: System Journal (/var/log/journal/beebb7e4cf2a41b49a6fa83eac40fbc1) is 512B, max 4G, 3.9G free. container-test-run-flakelet-relay> client # [ 7061.274968] client systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-flakelet-relay> client # [ 7061.275627] client systemd[1]: Reached target Preparation for Local File Systems. container-test-run-flakelet-relay> client # [ 7061.275748] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-flakelet-relay> client # [ 7061.289761] client systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-flakelet-relay> client # [ 7061.357238] client systemd[1]: Finished Firewall. container-test-run-flakelet-relay> relay # [ 7061.199612] relay systemd-journald[57]: Journal started container-test-run-flakelet-relay> relay # [ 7061.199652] relay systemd-journald[57]: Runtime Journal (/run/log/journal/c996461445a04a8b95cc6cbe29159b81) is 8M, max 4G, 3.9G free. container-test-run-flakelet-relay> relay # [ 7061.210217] relay systemd[1]: Finished Apply Kernel Variables. container-test-run-flakelet-relay> relay # [ 7061.222390] relay systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-flakelet-relay> relay # [ 7061.260572] relay systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-flakelet-relay> relay # [ 7061.261235] relay systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-flakelet-relay> relay # [ 7061.269337] relay systemd-journald[57]: Time spent on flushing to /var/log/journal/c996461445a04a8b95cc6cbe29159b81 is 1.370ms for 6 entries. container-test-run-flakelet-relay> relay # [ 7061.269337] relay systemd-journald[57]: System Journal (/var/log/journal/c996461445a04a8b95cc6cbe29159b81) is 512B, max 4G, 3.9G free. container-test-run-flakelet-relay> relay # [ 7061.278804] relay systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-flakelet-relay> relay # [ 7061.279420] relay systemd[1]: Reached target Preparation for Local File Systems. container-test-run-flakelet-relay> relay # [ 7061.279538] relay systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-flakelet-relay> relay # [ 7061.291769] relay systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-flakelet-relay> relay # [ 7061.369215] relay systemd[1]: Finished Firewall. container-test-run-flakelet-relay> relay # [ 7062.199150] relay systemd[1]: Mounting /run/wrappers... container-test-run-flakelet-relay> relay # [ 7062.255664] relay systemd[1]: Mounted /run/wrappers. container-test-run-flakelet-relay> relay # [ 7062.256697] relay systemd[1]: Reached target Local File Systems. container-test-run-flakelet-relay> relay # [ 7062.258054] relay systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-flakelet-relay> relay # [ 7062.259548] relay systemd[1]: Starting Create SUID/SGID Wrappers... container-test-run-flakelet-relay> relay # [ 7062.259595] relay systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> relay # [ 7062.260601] relay systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-flakelet-relay> relay # [ 7062.261760] relay systemd[1]: Starting Create System Files and Directories... container-test-run-flakelet-relay> agent # [ 7061.199738] agent systemd-journald[57]: Journal started container-test-run-flakelet-relay> agent # [ 7061.199779] agent systemd-journald[57]: Runtime Journal (/run/log/journal/a914c331a22d43f1b9e5f531ead0a58b) is 8M, max 4G, 3.9G free. container-test-run-flakelet-relay> agent # [ 7061.210273] agent systemd[1]: Finished Apply Kernel Variables. container-test-run-flakelet-relay> agent # [ 7061.222282] agent systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-flakelet-relay> agent # [ 7061.260905] agent systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-flakelet-relay> agent # [ 7061.261598] agent systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-flakelet-relay> agent # [ 7061.269823] agent systemd-journald[57]: Time spent on flushing to /var/log/journal/a914c331a22d43f1b9e5f531ead0a58b is 2.461ms for 6 entries. container-test-run-flakelet-relay> agent # [ 7061.269823] agent systemd-journald[57]: System Journal (/var/log/journal/a914c331a22d43f1b9e5f531ead0a58b) is 512B, max 4G, 3.9G free. container-test-run-flakelet-relay> agent # [ 7061.278927] agent systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-flakelet-relay> agent # [ 7061.279561] agent systemd[1]: Reached target Preparation for Local File Systems. container-test-run-flakelet-relay> agent # [ 7061.279683] agent systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-flakelet-relay> agent # [ 7061.296953] agent systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-flakelet-relay> agent # [ 7061.356076] agent systemd[1]: Finished Firewall. container-test-run-flakelet-relay> agent # [ 7062.222787] agent systemd[1]: Mounting /run/wrappers... container-test-run-flakelet-relay> agent # [ 7062.254589] agent systemd[1]: Mounted /run/wrappers. container-test-run-flakelet-relay> agent # [ 7062.255658] agent systemd[1]: Reached target Local File Systems. container-test-run-flakelet-relay> agent # [ 7062.257028] agent systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-flakelet-relay> agent # [ 7062.258419] agent systemd[1]: Starting Create SUID/SGID Wrappers... container-test-run-flakelet-relay> agent # [ 7062.258466] agent systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> relay # [ 7062.280515] relay systemd-tmpfiles[169]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-flakelet-relay> agent # [ 7062.259686] agent systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-flakelet-relay> relay # [ 7062.280951] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-flakelet-relay> agent # [ 7062.260787] agent systemd[1]: Starting Create System Files and Directories... container-test-run-flakelet-relay> client # [ 7062.201895] client systemd[1]: Mounting /run/wrappers... container-test-run-flakelet-relay> relay # [ 7062.281281] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal/c996461445a04a8b95cc6cbe29159b81 failed: Operation not permitted container-test-run-flakelet-relay> client # [ 7062.256268] client systemd[1]: Mounted /run/wrappers. container-test-run-flakelet-relay> agent # [ 7062.281209] agent suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.cs2OJV7Pck/chsh': Operation not permitted container-test-run-flakelet-relay> client # [ 7062.257325] client systemd[1]: Reached target Local File Systems. container-test-run-flakelet-relay> relay # [ 7062.281324] relay suid-sgid-wrappers-start[176]: chmod: changing permissions of '/run/wrappers/wrappers.jMNvumgjLJ/chsh': Operation not permitted container-test-run-flakelet-relay> agent # [ 7062.281617] agent systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-flakelet-relay> relay # [ 7062.281632] relay systemd-tmpfiles[169]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-flakelet-relay> client # [ 7062.258582] client systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-flakelet-relay> agent # [ 7062.282049] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-flakelet-relay> client # [ 7062.259721] client systemd[1]: Starting Create SUID/SGID Wrappers... container-test-run-flakelet-relay> agent # [ 7062.282352] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal/a914c331a22d43f1b9e5f531ead0a58b failed: Operation not permitted container-test-run-flakelet-relay> client # [ 7062.259762] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> client # [ 7062.261036] client systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-flakelet-relay> client # [ 7062.261982] client systemd[1]: Starting Create System Files and Directories... container-test-run-flakelet-relay> client # [ 7062.280645] client suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.8zrARbJTov/chsh': Operation not permitted container-test-run-flakelet-relay> client # [ 7062.281018] client systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-flakelet-relay> client # [ 7062.281442] client systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-flakelet-relay> agent # [ 7062.282672] agent systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-flakelet-relay> client # [ 7062.281746] client systemd-tmpfiles[161]: fchmod() of /var/log/journal/beebb7e4cf2a41b49a6fa83eac40fbc1 failed: Operation not permitted container-test-run-flakelet-relay> client # [ 7062.282115] client systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-flakelet-relay> relay # [ 7062.288052] relay systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> relay # [ 7062.288094] relay systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> relay # [ 7062.288140] relay systemd[1]: Failed to start Create SUID/SGID Wrappers. container-test-run-flakelet-relay> relay # [ 7062.288628] relay systemd[1]: Finished Create System Files and Directories. container-test-run-flakelet-relay> relay # [ 7062.351264] relay systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7062.364180] relay systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-flakelet-relay> relay # [ 7062.394606] relay systemd[1]: Starting Rebuild Journal Catalog... container-test-run-flakelet-relay> relay # [ 7062.395499] relay systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-flakelet-relay> relay # [ 7062.407616] relay systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-flakelet-relay> relay # [ 7062.415611] relay systemd[1]: Finished Rebuild Journal Catalog. container-test-run-flakelet-relay> relay # [ 7062.416475] relay systemd[1]: Starting Update is Completed... container-test-run-flakelet-relay> relay # [ 7062.425503] relay systemd[1]: Finished Update is Completed. container-test-run-flakelet-relay> relay # [ 7062.425625] relay systemd[1]: Reached target System Initialization. container-test-run-flakelet-relay> relay # [ 7062.425690] relay systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> relay # [ 7062.425710] relay systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-flakelet-relay> relay # [ 7062.425724] relay systemd[1]: Reached target Timer Units. container-test-run-flakelet-relay> relay # [ 7062.425815] relay systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-flakelet-relay> relay # [ 7062.426029] relay systemd[1]: Listening on Nix Daemon Socket. container-test-run-flakelet-relay> relay # [ 7062.426125] relay systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-flakelet-relay> relay # [ 7062.426139] relay systemd[1]: Reached target Socket Units. container-test-run-flakelet-relay> relay # [ 7062.426165] relay systemd[1]: Reached target Basic System. container-test-run-flakelet-relay> relay # [ 7062.427263] relay systemd[1]: Started device-mock.service. container-test-run-flakelet-relay> relay # [ 7062.428035] relay systemd[1]: Starting Re-link flakelet services at boot... container-test-run-flakelet-relay> relay # [ 7062.428732] relay systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-flakelet-relay> relay # [ 7062.429421] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> relay # [ 7062.430093] relay systemd[1]: Starting resolvconf update... container-test-run-flakelet-relay> relay # [ 7062.440286] relay systemd[1]: Finished Re-link flakelet services at boot. container-test-run-flakelet-relay> relay # [ 7062.440957] relay systemd[1]: Starting Reconcile flakelet services with the host configuration... container-test-run-flakelet-relay> relay # [ 7062.448528] relay systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-flakelet-relay> relay # [ 7062.452403] relay systemd[1]: Finished Reconcile flakelet services with the host configuration. container-test-run-flakelet-relay> client # [ 7062.288062] client systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> client # [ 7062.288102] client systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> client # [ 7062.288154] client systemd[1]: Failed to start Create SUID/SGID Wrappers. container-test-run-flakelet-relay> client # [ 7062.288692] client systemd[1]: Finished Create System Files and Directories. container-test-run-flakelet-relay> client # [ 7062.351391] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-flakelet-relay> client # [ 7062.364325] client systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-flakelet-relay> client # [ 7062.394630] client systemd[1]: Starting Rebuild Journal Catalog... container-test-run-flakelet-relay> client # [ 7062.395441] client systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-flakelet-relay> client # [ 7062.407560] client systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-flakelet-relay> client # [ 7062.414292] client systemd[1]: Finished Rebuild Journal Catalog. container-test-run-flakelet-relay> client # [ 7062.415430] client systemd[1]: Starting Update is Completed... container-test-run-flakelet-relay> client # [ 7062.426825] client systemd[1]: Finished Update is Completed. container-test-run-flakelet-relay> client # [ 7062.426958] client systemd[1]: Reached target System Initialization. container-test-run-flakelet-relay> client # [ 7062.427024] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> client # [ 7062.427045] client systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-flakelet-relay> client # [ 7062.427059] client systemd[1]: Reached target Timer Units. container-test-run-flakelet-relay> client # [ 7062.427157] client systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-flakelet-relay> client # [ 7062.427319] client systemd[1]: Listening on Nix Daemon Socket. container-test-run-flakelet-relay> client # [ 7062.427407] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-flakelet-relay> client # [ 7062.427421] client systemd[1]: Reached target Socket Units. container-test-run-flakelet-relay> client # [ 7062.427446] client systemd[1]: Reached target Basic System. container-test-run-flakelet-relay> client # [ 7062.428386] client systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-flakelet-relay> client # [ 7062.429359] client systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> client # [ 7062.429888] client systemd[1]: Starting resolvconf update... container-test-run-flakelet-relay> client # [ 7062.446539] client systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-flakelet-relay> agent # [ 7062.285053] agent systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> agent # [ 7062.285147] agent systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> agent # [ 7062.285345] agent systemd[1]: Failed to start Create SUID/SGID Wrappers. container-test-run-flakelet-relay> agent # [ 7062.285745] agent systemd[1]: Finished Create System Files and Directories. container-test-run-flakelet-relay> agent # [ 7062.347620] agent systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7062.359597] agent systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-flakelet-relay> agent # [ 7062.362461] agent systemd[1]: Starting Rebuild Journal Catalog... container-test-run-flakelet-relay> agent # [ 7062.363320] agent systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-flakelet-relay> agent # [ 7062.403597] agent systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-flakelet-relay> agent # [ 7062.410008] agent systemd[1]: Finished Rebuild Journal Catalog. container-test-run-flakelet-relay> agent # [ 7062.411132] agent systemd[1]: Starting Update is Completed... container-test-run-flakelet-relay> agent # [ 7062.419143] agent systemd[1]: Finished Update is Completed. container-test-run-flakelet-relay> agent # [ 7062.419232] agent systemd[1]: Reached target System Initialization. container-test-run-flakelet-relay> agent # [ 7062.419293] agent systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> agent # [ 7062.419315] agent systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-flakelet-relay> agent # [ 7062.419328] agent systemd[1]: Reached target Timer Units. container-test-run-flakelet-relay> agent # [ 7062.419420] agent systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-flakelet-relay> agent # [ 7062.419593] agent systemd[1]: Listening on Nix Daemon Socket. container-test-run-flakelet-relay> agent # [ 7062.419685] agent systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-flakelet-relay> agent # [ 7062.419699] agent systemd[1]: Reached target Socket Units. container-test-run-flakelet-relay> agent # [ 7062.419725] agent systemd[1]: Reached target Basic System. container-test-run-flakelet-relay> agent # [ 7062.420731] agent systemd[1]: Starting Re-link flakelet services at boot... container-test-run-flakelet-relay> agent # [ 7062.421504] agent systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-flakelet-relay> agent # [ 7062.422648] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 7062.423944] agent systemd[1]: Starting resolvconf update... container-test-run-flakelet-relay> agent # [ 7062.432206] agent systemd[1]: Finished Re-link flakelet services at boot. container-test-run-flakelet-relay> agent # [ 7062.433665] agent systemd[1]: Starting Reconcile flakelet services with the host configuration... container-test-run-flakelet-relay> agent # [ 7062.438500] agent systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-flakelet-relay> agent # [ 7062.446513] agent systemd[1]: Finished Reconcile flakelet services with the host configuration. container-test-run-flakelet-relay> relay # [ 7062.510584] relay systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7062.510698] relay systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> relay # [ 7062.537561] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> relay # [ 7062.537692] relay systemd[1]: Finished resolvconf update. container-test-run-flakelet-relay> relay # [ 7062.538420] relay systemd[1]: Reached target Preparation for Network. container-test-run-flakelet-relay> relay # [ 7062.539318] relay systemd[1]: Starting Address configuration of eth1... container-test-run-flakelet-relay> relay # [ 7062.540157] relay systemd[1]: Starting Extra networking commands.... container-test-run-flakelet-relay> relay # [ 7062.558747] relay network-addresses-eth1-start[250]: adding address 192.168.1.3/24... done container-test-run-flakelet-relay> relay # [ 7062.561798] relay network-addresses-eth1-start[250]: adding address 2001:db8:1::3/64... done container-test-run-flakelet-relay> relay # [ 7062.565529] relay systemd[1]: Finished Address configuration of eth1. container-test-run-flakelet-relay> relay # [ 7062.606910] relay systemd[1]: Finished Extra networking commands.. container-test-run-flakelet-relay> relay # [ 7062.607534] relay systemd[1]: Reached target Network. container-test-run-flakelet-relay> relay # [ 7062.608839] relay systemd[1]: Starting Dnsmasq Daemon... container-test-run-flakelet-relay> relay # [ 7062.609665] relay systemd[1]: Starting Nginx Web Server... container-test-run-flakelet-relay> relay # [ 7062.610414] relay systemd[1]: Starting Update flakelet service flakelet-relay... container-test-run-flakelet-relay> relay # [ 7062.646057] relay flakelet[311]: flakelet-relay: using prebuilt artifact /nix/store/h395iyz9mh3cgzdb5h23w492d95kp8l0-flakelet-flakelet-relay container-test-run-flakelet-relay> relay # [ 7062.646665] relay flakelet[311]: flakelet-relay: activating generation 1 container-test-run-flakelet-relay> relay # [ 7062.650240] relay systemd[1]: Reload requested from client PID 316 ('systemctl') (unit flakelet-flakelet-relay.service)... container-test-run-flakelet-relay> relay # [ 7062.650275] relay systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7062.509661] agent systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7062.509787] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> agent # [ 7062.537586] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 7062.537746] agent systemd[1]: Finished resolvconf update. container-test-run-flakelet-relay> agent # [ 7062.538585] agent systemd[1]: Reached target Preparation for Network. container-test-run-flakelet-relay> agent # [ 7062.539555] agent systemd[1]: Starting Address configuration of eth1... container-test-run-flakelet-relay> agent # [ 7062.540419] agent systemd[1]: Starting Extra networking commands.... container-test-run-flakelet-relay> agent # [ 7062.560444] agent network-addresses-eth1-start[241]: adding address 192.168.1.1/24... done container-test-run-flakelet-relay> agent # [ 7062.564920] agent network-addresses-eth1-start[241]: adding address 2001:db8:1::1/64... done container-test-run-flakelet-relay> agent # [ 7062.568840] agent systemd[1]: Finished Address configuration of eth1. container-test-run-flakelet-relay> agent # [ 7062.638260] agent systemd[1]: Finished Extra networking commands.. container-test-run-flakelet-relay> agent # [ 7062.638503] agent systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7062.638608] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> agent # [ 7062.640764] agent systemd[1]: Reached target Network. container-test-run-flakelet-relay> agent # [ 7062.641982] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 7062.642907] agent systemd[1]: Starting Update flakelet service app... container-test-run-flakelet-relay> agent # [ 7062.643819] agent systemd[1]: Starting Update flakelet service flakelet-agent... container-test-run-flakelet-relay> agent # [ 7062.644602] agent systemd[1]: Starting Update flakelet service other... container-test-run-flakelet-relay> agent # [ 7062.654481] agent flakelet[308]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 7062.655029] agent flakelet[308]: app: activating generation 1 container-test-run-flakelet-relay> agent # [ 7062.655343] agent flakelet[309]: flakelet-agent: using prebuilt artifact /nix/store/s2dk5ic4br290qs8phcvqkyjq2jz4vrv-flakelet-flakelet-agent container-test-run-flakelet-relay> agent # [ 7062.655973] agent flakelet[309]: flakelet-agent: activating generation 1 container-test-run-flakelet-relay> agent # [ 7062.656222] agent flakelet[310]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 7062.656739] agent flakelet[310]: other: activating generation 1 container-test-run-flakelet-relay> agent # [ 7062.662013] agent systemd[1]: Reload requested from client PID 313 ('systemctl') (unit flakelet-flakelet-agent.service)... container-test-run-flakelet-relay> agent # [ 7062.662054] agent systemd[1]: Reloading... container-test-run-flakelet-relay> client # [ 7062.497935] client systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> client # [ 7062.499016] client systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> client # [ 7062.508182] client systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> client # [ 7062.537369] client systemd[1]: Finished resolvconf update. container-test-run-flakelet-relay> client # [ 7062.537797] client systemd[1]: Reached target Preparation for Network. container-test-run-flakelet-relay> client # [ 7062.539382] client systemd[1]: Starting Address configuration of eth1... container-test-run-flakelet-relay> client # [ 7062.540777] client systemd[1]: Starting Extra networking commands.... container-test-run-flakelet-relay> client # [ 7062.559825] client network-addresses-eth1-start[238]: adding address 192.168.1.2/24... done container-test-run-flakelet-relay> client # [ 7062.562452] client network-addresses-eth1-start[238]: adding address 2001:db8:1::2/64... done container-test-run-flakelet-relay> client # [ 7062.565908] client systemd[1]: Finished Address configuration of eth1. container-test-run-flakelet-relay> client # [ 7062.611081] client systemd[1]: Finished Extra networking commands.. container-test-run-flakelet-relay> client # [ 7062.611621] client systemd[1]: Reached target Network. container-test-run-flakelet-relay> client # [ 7062.642765] client systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> client # [ 7062.642887] client systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> client # [ 7062.645184] client systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> relay # [ 7062.951640] relay nsncd[246]: Sep 06 09:02:20.913 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-flakelet-relay> relay # [ 7063.074834] relay systemd[1]: Reloading finished in 424 ms. container-test-run-flakelet-relay> agent # [ 7062.999160] agent nsncd[307]: Sep 06 09:02:20.960 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-flakelet-relay> agent # [ 7063.081628] agent systemd[1]: Reloading finished in 419 ms. container-test-run-flakelet-relay> agent # [ 7063.210572] agent systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> agent # [ 7063.211154] agent systemd[1]: Reload requested from client PID 312 ('systemctl') (unit flakelet-app.service)... container-test-run-flakelet-relay> agent # [ 7063.211208] agent systemd[1]: Reloading... container-test-run-flakelet-relay> client # [ 7062.980974] client nsncd[303]: Sep 06 09:02:20.942 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-flakelet-relay> client # [ 7062.980899] client systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> client # [ 7062.980958] client systemd[1]: Reached target Host and Network Name Lookups. container-test-run-flakelet-relay> client # [ 7062.981069] client systemd[1]: Reached target User and Group Name Lookups. container-test-run-flakelet-relay> client # [ 7062.982763] client systemd[1]: Starting User Login Management... container-test-run-flakelet-relay> client # [ 7062.990083] client systemd[1]: Starting Permit User Sessions... container-test-run-flakelet-relay> client # [ 7063.027039] client systemd[1]: Finished Permit User Sessions. container-test-run-flakelet-relay> client # [ 7063.028999] client systemd[1]: Started Console Getty. container-test-run-flakelet-relay> client # [ 7063.029068] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-flakelet-relay> client # [ 7063.029104] client systemd[1]: Reached target Login Prompts. container-test-run-flakelet-relay> relay # [ 7063.207569] relay systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> relay # [ 7063.208507] relay systemd[1]: Reached target Host and Network Name Lookups. container-test-run-flakelet-relay> relay # [ 7063.208569] relay systemd[1]: Reached target User and Group Name Lookups. container-test-run-flakelet-relay> relay # [ 7063.209778] relay systemd[1]: Starting User Login Management... container-test-run-flakelet-relay> relay # [ 7063.210710] relay systemd[1]: Starting Permit User Sessions... container-test-run-flakelet-relay> relay # [ 7063.222064] relay systemd[1]: Reload requested from client PID 357 ('systemctl') (unit flakelet-flakelet-relay.service)... container-test-run-flakelet-relay> relay # [ 7063.222128] relay systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 7063.262039] relay dnsmasq-pre-start[368]: dnsmasq: syntax check OK. container-test-run-flakelet-relay> relay # [ 7063.590138] relay systemd[1]: Reloading finished in 367 ms. container-test-run-flakelet-relay> relay # [ 7063.731021] relay systemd[1]: Finished Permit User Sessions. container-test-run-flakelet-relay> relay # [ 7063.759794] relay systemd[1]: Started Console Getty. container-test-run-flakelet-relay> relay # [ 7063.759857] relay systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-flakelet-relay> relay # [ 7063.759923] relay systemd[1]: Reached target Login Prompts. container-test-run-flakelet-relay> relay # [ 7063.763412] relay systemd[1]: Starting flakelet-relay... container-test-run-flakelet-relay> agent # [ 7063.590434] agent systemd[1]: Reloading finished in 378 ms. container-test-run-flakelet-relay> agent # [ 7063.733583] agent systemd[1]: Reload requested from client PID 314 ('systemctl') (unit flakelet-other.service)... container-test-run-flakelet-relay> agent # [ 7063.733639] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7064.100460] agent systemd[1]: Reloading finished in 366 ms. container-test-run-flakelet-relay> agent # [ 7064.183497] agent systemd[1]: Reached target Host and Network Name Lookups. container-test-run-flakelet-relay> agent # [ 7064.183635] agent systemd[1]: Reached target User and Group Name Lookups. container-test-run-flakelet-relay> agent # [ 7064.185124] agent systemd[1]: Starting User Login Management... container-test-run-flakelet-relay> agent # [ 7064.186086] agent systemd[1]: Starting Permit User Sessions... container-test-run-flakelet-relay> agent # [ 7064.189948] agent systemd[1]: Reload requested from client PID 405 ('systemctl') (unit flakelet-flakelet-agent.service)... container-test-run-flakelet-relay> agent # [ 7064.189980] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 7064.317371] relay nginx-pre-start[402]: nginx: the configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf syntax is ok container-test-run-flakelet-relay> relay # [ 7064.318128] relay nginx-pre-start[402]: nginx: configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf test is successful container-test-run-flakelet-relay> relay # [ 7064.336062] relay systemd[1]: Started Nginx Web Server. container-test-run-flakelet-relay> relay # [ 7064.369812] relay systemd[1]: Starting D-Bus System Message Bus... container-test-run-flakelet-relay> client # [ 7064.455392] client systemd-logind[315]: New seat seat0. container-test-run-flakelet-relay> client # [ 7064.455622] client systemd[1]: Started User Login Management. container-test-run-flakelet-relay> client # [ 7064.457073] client systemd[1]: Starting D-Bus System Message Bus... container-test-run-flakelet-relay> client # [ 7064.458040] client systemd[1]: Starting linger-users.service... container-test-run-flakelet-relay> client # [ 7064.496272] client systemd[1]: linger-users.service: Deactivated successfully. container-test-run-flakelet-relay> client # [ 7064.496814] client systemd[1]: Finished linger-users.service. container-test-run-flakelet-relay> client # [ 7064.497404] client systemd[1]: Reached target Multi-User System. container-test-run-flakelet-relay> agent # [ 7064.569310] agent systemd[1]: Reloading finished in 378 ms. container-test-run-flakelet-relay> agent # [ 7064.647637] agent systemd[1]: Finished Permit User Sessions. container-test-run-flakelet-relay> agent # [ 7064.653056] agent systemd[1]: Started Console Getty. container-test-run-flakelet-relay> agent # [ 7064.653151] agent systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-flakelet-relay> agent # [ 7064.653269] agent systemd[1]: Reached target Login Prompts. container-test-run-flakelet-relay> agent # [ 7064.655204] agent systemd[1]: Reload requested from client PID 408 ('systemctl') (unit flakelet-app.service)... container-test-run-flakelet-relay> agent # [ 7064.655234] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 7064.806450] relay systemd-logind[355]: New seat seat0. container-test-run-flakelet-relay> relay # [ 7064.806779] relay systemd[1]: Started User Login Management. container-test-run-flakelet-relay> relay # [ 7064.808996] relay systemd[1]: Starting linger-users.service... container-test-run-flakelet-relay> relay # [ 7064.852715] relay systemd[1]: linger-users.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7064.853055] relay systemd[1]: Finished linger-users.service. container-test-run-flakelet-relay> relay # [ 7064.931939] relay dbus-broker-launch[406]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-flakelet-relay> relay # [ 7064.933459] relay dbus-broker-launch[406]: NSS returned no entry for 'systemd-timesync' container-test-run-flakelet-relay> relay # [ 7064.933459] relay dbus-broker-launch[406]: Invalid user-name in /nix/store/27h4g2jdw18vrabfh6p1l0n8ss5dhbp5-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-flakelet-relay> relay # [ 7064.934507] relay systemd[1]: Started D-Bus System Message Bus. container-test-run-flakelet-relay> relay # [ 7064.940789] relay dbus-broker-launch[406]: Ready container-test-run-flakelet-relay> relay # [ 7064.942466] relay systemd[1]: Started Dnsmasq Daemon. container-test-run-flakelet-relay> relay # [ 7064.944303] relay dnsmasq[394]: started, version 2.93 cachesize 150 container-test-run-flakelet-relay> relay # [ 7064.944311] relay dnsmasq[394]: compile time options: IPv6 GNU-getopt DBus no-UBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP conntrack ipset nftset auth DNSSEC loop-detect inotify dumpfile container-test-run-flakelet-relay> relay # [ 7064.944317] relay dnsmasq[394]: DBus support enabled: connected to system bus container-test-run-flakelet-relay> relay # [ 7064.944323] relay dnsmasq[394]: no upstream servers configured - please set them from DBus container-test-run-flakelet-relay> relay # [ 7064.944431] relay dnsmasq[394]: read /etc/hosts - 9 names container-test-run-flakelet-relay> agent # [ 7065.002981] agent systemd[1]: Reloading finished in 347 ms. container-test-run-flakelet-relay> agent # [ 7065.087564] agent systemd[1]: Starting flakelet-agent... container-test-run-flakelet-relay> agent # [ 7065.089379] agent systemd[1]: Reload requested from client PID 445 ('systemctl') (unit flakelet-other.service)... container-test-run-flakelet-relay> agent # [ 7065.089423] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7065.164565] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:23.126304Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7065.422587] agent systemd[1]: Reloading finished in 332 ms. container-test-run-flakelet-relay> client # [ 7064.986155] client dbus-broker-launch[325]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-flakelet-relay> client # [ 7064.987717] client dbus-broker-launch[325]: NSS returned no entry for 'systemd-timesync' container-test-run-flakelet-relay> client # [ 7064.987717] client dbus-broker-launch[325]: Invalid user-name in /nix/store/zf4qd09sm09a3f6c7ph9j8x45mxdi014-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-flakelet-relay> client # [ 7064.988526] client systemd[1]: Started D-Bus System Message Bus. container-test-run-flakelet-relay> client # [ 7064.988978] client systemd[1]: Startup finished in 4.234s. container-test-run-flakelet-relay> client # [ 7064.993622] client dbus-broker-launch[325]: Ready container-test-run-flakelet-relay> agent # [ 7065.497027] agent systemd[1]: Started flakelet-agent. container-test-run-flakelet-relay> agent # [ 7065.501576] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 7065.503862] agent systemd[1]: Starting other v1... container-test-run-flakelet-relay> agent # [ 7065.520405] agent flakelet[309]: flakelet-agent: updated to generation 1 container-test-run-flakelet-relay> agent # [ 7065.526193] agent systemd[1]: Finished Update flakelet service flakelet-agent. container-test-run-flakelet-relay> agent # [ 7065.530399] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> agent # [ 7065.531175] agent systemd[1]: Started other v1. container-test-run-flakelet-relay> agent # [ 7065.545539] agent flakelet[308]: app: updated to generation 1 container-test-run-flakelet-relay> agent # [ 7065.547103] agent systemd[1]: Finished Update flakelet service app. container-test-run-flakelet-relay> agent # [ 7065.548470] agent flakelet[310]: other: updated to generation 1 container-test-run-flakelet-relay> agent # [ 7065.549272] agent systemd[1]: Finished Update flakelet service other. container-test-run-flakelet-relay> agent # [ 7065.549934] agent systemd[1]: Reached target flakelet managed services. container-test-run-flakelet-relay> agent # [ 7065.585595] agent systemd-logind[406]: New seat seat0. container-test-run-flakelet-relay> agent # [ 7065.586975] agent systemd[1]: Starting D-Bus System Message Bus... container-test-run-flakelet-relay> agent # [ 7065.587047] agent systemd[1]: Started User Login Management. container-test-run-flakelet-relay> agent # [ 7065.588022] agent systemd[1]: Starting linger-users.service... container-test-run-flakelet-relay> agent # [ 7065.625840] agent systemd[1]: linger-users.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7065.626385] agent systemd[1]: Finished linger-users.service. container-test-run-flakelet-relay> agent # [ 7065.626532] agent systemd[1]: Reached target Multi-User System. container-test-run-flakelet-relay> relay # [ 7065.822445] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:23.784220Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 7065.822962] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:23.784705Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 7065.823083] relay systemd[1]: Started flakelet-relay. container-test-run-flakelet-relay> relay # [ 7065.838048] relay systemd[1]: Starting health for flakelet-relay... container-test-run-flakelet-relay> relay # [ 7066.097725] relay systemd[1]: flakelet-relay-health.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7066.098126] relay systemd[1]: Finished health for flakelet-relay. container-test-run-flakelet-relay> relay # [ 7066.138671] relay flakelet[311]: flakelet-relay: updated to generation 1 container-test-run-flakelet-relay> relay # [ 7066.141236] relay systemd[1]: Finished Update flakelet service flakelet-relay. container-test-run-flakelet-relay> relay # [ 7066.141771] relay systemd[1]: Reached target flakelet managed services. container-test-run-flakelet-relay> relay # [ 7066.141945] relay systemd[1]: Reached target Multi-User System. container-test-run-flakelet-relay> relay # [ 7066.142204] relay systemd[1]: Startup finished in 5.378s. container-test-run-flakelet-relay> relay: (finished: waiting for unit flakelet-relay.service, in 6.15 seconds) container-test-run-flakelet-relay> relay: waiting for unit nginx.service container-test-run-flakelet-relay> relay: (finished: waiting for unit nginx.service, in 0.01 seconds) container-test-run-flakelet-relay> agent: waiting for unit flakelet.target container-test-run-flakelet-relay> agent: (finished: waiting for unit flakelet.target, in 0.02 seconds) container-test-run-flakelet-relay> agent: waiting for unit flakelet-agent.service container-test-run-flakelet-relay> agent # [ 7066.048430] agent dbus-broker-launch[904]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-flakelet-relay> agent # [ 7066.049738] agent dbus-broker-launch[904]: NSS returned no entry for 'systemd-timesync' container-test-run-flakelet-relay> agent # [ 7066.049738] agent dbus-broker-launch[904]: Invalid user-name in /nix/store/q3c2gxfm178wqgzv8m87na4aa72wxc04-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-flakelet-relay> agent # [ 7066.050793] agent systemd[1]: Started D-Bus System Message Bus. container-test-run-flakelet-relay> agent # [ 7066.051399] agent systemd[1]: Startup finished in 5.286s. container-test-run-flakelet-relay> agent # [ 7066.056891] agent dbus-broker-launch[904]: Ready container-test-run-flakelet-relay> agent: (finished: waiting for unit flakelet-agent.service, in 0.01 seconds) container-test-run-flakelet-relay> client: waiting for unit multi-user.target container-test-run-flakelet-relay> client: (finished: waiting for unit multi-user.target, in 0.02 seconds) container-test-run-flakelet-relay> relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1' container-test-run-flakelet-relay> agent # [ 7067.181210] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:25.142997Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 1.03 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl is-active app.service other.service container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl is-active app.service other.service, in 0.01 seconds) container-test-run-flakelet-relay> subtest: deploy with client certificate, relay found via SRV container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1 container-test-run-flakelet-relay> relay # [ 7067.181283] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:25.143048Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: None, revision: None }, Named { name: \"other\", generation: None, revision: None }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> relay # [ 7067.563719] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:25.525362Z","level":"INFO","message":"deploy accepted","job":"4dfcd6a1307dc3955ab5419a0b58ae41","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7067.564053] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:25.525787Z","level":"INFO","message":"start","id":"a742e8befb0ec735d510a2d553480bde","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7067.564785] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:25.526569Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"a742e8befb0ec735d510a2d553480bde\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7067.637373] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 7067.674134] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 7067.678617] agent flakelet[939]: app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2 container-test-run-flakelet-relay> agent # [ 7067.679322] agent flakelet[939]: app: activating generation 2 container-test-run-flakelet-relay> agent # [ 7067.692329] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 7067.692784] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7067.693060] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 7067.709924] agent systemd[1]: Reload requested from client PID 946 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7067.709994] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7068.046084] agent systemd[1]: Reloading finished in 335 ms. container-test-run-flakelet-relay> agent # [ 7068.136677] agent systemd[1]: Reload requested from client PID 976 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7068.136718] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7068.469304] agent systemd[1]: Reloading finished in 332 ms. container-test-run-flakelet-relay> agent # [ 7068.662547] agent systemd[1]: Reload requested from client PID 1005 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7068.662593] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7068.985952] agent systemd[1]: Reloading finished in 322 ms. container-test-run-flakelet-relay> agent # [ 7069.072561] agent systemd[1]: Reload requested from client PID 1036 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7069.072598] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7069.401665] agent systemd[1]: Reloading finished in 328 ms. container-test-run-flakelet-relay> agent # [ 7069.488749] agent systemd[1]: Starting app v2... container-test-run-flakelet-relay> agent # [ 7069.521139] agent systemd[1]: Started app v2. container-test-run-flakelet-relay> agent # [ 7069.533613] agent flakelet[939]: app: updated to generation 2 container-test-run-flakelet-relay> agent # [ 7069.534509] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1, in 3.09 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl show app.service -p Description | grep -q 'app v2' container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v2', in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2' container-test-run-flakelet-relay> agent: (finished: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2', in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: deploy with client certificate, relay found via SRV, in 3.13 seconds) container-test-run-flakelet-relay> subtest: deploy with OIDC token, sub principal container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.06 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODY4NTY0OCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4Njg1MzQ4LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJOQURDUlE3N1VXVjNJPT09IiwibmJmIjoxNzg4Njg1MzQ4LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.D1Hoqor04I__1xe3qvWC6WaC_Zq-tfkAdSMGxeaiEwqzpRqC1vKH0CDtnkNzf7wc0mbkcsJa2OQBA8nVvAYtBg' push --relay https://relay:7443 deploy agent/app 2>&1 container-test-run-flakelet-relay> agent # [ 7070.625890] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:28.587692Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(2)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7070.750044] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:28.711786Z","level":"INFO","message":"start","id":"355af35f92dabd8a7da971721a569813","flakelet":"app","rule":"ci","relay":"relay","caller":"Some(\"oidc:mock:repo:github:example/app:ref:refs/heads/main\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7070.750370] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:28.712198Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"355af35f92dabd8a7da971721a569813\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7070.813200] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 7070.846076] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 7070.850372] agent flakelet[1126]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 7070.851052] agent flakelet[1126]: app: activating generation 3 container-test-run-flakelet-relay> agent # [ 7070.863986] agent systemd[1]: Stopping app v2... container-test-run-flakelet-relay> agent # [ 7070.864461] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7070.864721] agent systemd[1]: Stopped app v2. container-test-run-flakelet-relay> agent # [ 7070.882248] agent systemd[1]: Reload requested from client PID 1133 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7070.882317] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 7070.627080] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:28.588809Z","level":"INFO","message":"deploy finished","job":"4dfcd6a1307dc3955ab5419a0b58ae41","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7070.749735] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:28.711470Z","level":"INFO","message":"deploy accepted","job":"cd96155a35c1a6aa5712f5567681a905","caller":"oidc:mock:repo:github:example/app:ref:refs/heads/main","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7071.216874] agent systemd[1]: Reloading finished in 333 ms. container-test-run-flakelet-relay> agent # [ 7071.314989] agent systemd[1]: Reload requested from client PID 1166 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7071.315035] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7071.636419] agent systemd[1]: Reloading finished in 320 ms. container-test-run-flakelet-relay> agent # [ 7071.727413] agent systemd[1]: Reload requested from client PID 1196 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7071.727451] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7072.053395] agent systemd[1]: Reloading finished in 325 ms. container-test-run-flakelet-relay> agent # [ 7072.662970] agent systemd[1]: Reload requested from client PID 1229 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7072.663016] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7072.986078] agent systemd[1]: Reloading finished in 322 ms. container-test-run-flakelet-relay> agent # [ 7073.172525] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 7073.200105] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> agent # [ 7073.214350] agent flakelet[1126]: app: updated to generation 3 container-test-run-flakelet-relay> agent # [ 7073.215869] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODY4NTY0OCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4Njg1MzQ4LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJOQURDUlE3N1VXVjNJPT09IiwibmJmIjoxNzg4Njg1MzQ4LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.D1Hoqor04I__1xe3qvWC6WaC_Zq-tfkAdSMGxeaiEwqzpRqC1vKH0CDtnkNzf7wc0mbkcsJa2OQBA8nVvAYtBg' push --relay https://relay:7443 deploy agent/app 2>&1, in 3.51 seconds) container-test-run-flakelet-relay> (finished: subtest: deploy with OIDC token, sub principal, in 3.58 seconds) container-test-run-flakelet-relay> subtest: policy denies uncovered target container-test-run-flakelet-relay> client: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODY4NTY0OCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4Njg1MzQ4LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJOQURDUlE3N1VXVjNJPT09IiwibmJmIjoxNzg4Njg1MzQ4LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.D1Hoqor04I__1xe3qvWC6WaC_Zq-tfkAdSMGxeaiEwqzpRqC1vKH0CDtnkNzf7wc0mbkcsJa2OQBA8nVvAYtBg' push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> client: (finished: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODY4NTY0OCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4Njg1MzQ4LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJOQURDUlE3N1VXVjNJPT09IiwibmJmIjoxNzg4Njg1MzQ4LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.D1Hoqor04I__1xe3qvWC6WaC_Zq-tfkAdSMGxeaiEwqzpRqC1vKH0CDtnkNzf7wc0mbkcsJa2OQBA8nVvAYtBg' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: policy denies uncovered target, in 0.02 seconds) container-test-run-flakelet-relay> subtest: claim principal from groups, unchanged counts as success container-test-run-flakelet-relay> client: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.06 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODY4NTY1MiwiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc4ODY4NTM1MiwiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiQlpCTlRXWVNUNk1MND09PSIsIm5iZiI6MTc4ODY4NTM1Miwic3ViIjoic29tZW9uZSJ9.3KET3ZS6n-Z1fhnSz-9sl94tt6VEyGC-IxEteklFVPOyBbscn29OagaHbucUvWD4VjZi9XpdAQtTkNtIGPg0BQ' push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> relay # [ 7074.230099] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:32.191745Z","level":"INFO","message":"deploy finished","job":"cd96155a35c1a6aa5712f5567681a905","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7074.333588] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:32.295373Z","level":"INFO","message":"deploy accepted","job":"959ca5ec796686c88899089851a18af2","caller":"oidc:mock:groups:wheel","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7074.228656] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:32.190402Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7074.333956] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:32.295683Z","level":"INFO","message":"start","id":"c2c3f1cf0b0879eaf102daece276dd10","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"oidc:mock:groups:wheel\\noidc:mock:someone\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7074.334331] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:32.296160Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"c2c3f1cf0b0879eaf102daece276dd10\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7074.404254] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 7074.434147] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 7074.438723] agent flakelet[1318]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 7074.439317] agent flakelet[1318]: other: up to date container-test-run-flakelet-relay> agent # [ 7074.441795] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODY4NTY1MiwiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc4ODY4NTM1MiwiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiQlpCTlRXWVNUNk1MND09PSIsIm5iZiI6MTc4ODY4NTM1Miwic3ViIjoic29tZW9uZSJ9.3KET3ZS6n-Z1fhnSz-9sl94tt6VEyGC-IxEteklFVPOyBbscn29OagaHbucUvWD4VjZi9XpdAQtTkNtIGPg0BQ' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.70 seconds) container-test-run-flakelet-relay> (finished: subtest: claim principal from groups, unchanged counts as success, in 0.76 seconds) container-test-run-flakelet-relay> subtest: push login via device flow, cached token used afterwards container-test-run-flakelet-relay> client: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1 container-test-run-flakelet-relay> relay # [ 7075.011308] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:32.973040Z","level":"INFO","message":"deploy finished","job":"959ca5ec796686c88899089851a18af2","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7075.035702] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[186]: 127.0.0.1 - - [06/Sep/2026 09:02:32] "POST /device HTTP/1.1" 200 - container-test-run-flakelet-relay> agent # [ 7075.009634] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:32.971377Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> relay # [ 7076.041284] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[186]: 127.0.0.1 - - [06/Sep/2026 09:02:34] "POST /token HTTP/1.1" 400 - container-test-run-flakelet-relay> client: (finished: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1, in 2.08 seconds) container-test-run-flakelet-relay> client: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600 container-test-run-flakelet-relay> client: (finished: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> relay # [ 7077.093659] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[186]: 127.0.0.1 - - [06/Sep/2026 09:02:35] "POST /token HTTP/1.1" 200 - container-test-run-flakelet-relay> relay # [ 7077.124563] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:35.086323Z","level":"INFO","message":"deploy accepted","job":"55b16216bd80e7cc0e70e5f290549a48","caller":"oidc:mock:groups:wheel","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7077.124993] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:35.086726Z","level":"INFO","message":"start","id":"65140e5e088b2f3ea1662d4d43680e9e","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"oidc:mock:groups:wheel\\noidc:mock:someone\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7077.125967] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:35.087442Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"65140e5e088b2f3ea1662d4d43680e9e\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7077.202499] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 7077.240570] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 7077.244474] agent flakelet[1373]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 7077.244995] agent flakelet[1373]: other: up to date container-test-run-flakelet-relay> agent # [ 7077.245428] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 0.72 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> relay # [ 7077.820777] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:35.782493Z","level":"INFO","message":"deploy finished","job":"55b16216bd80e7cc0e70e5f290549a48","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7077.842182] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:35.803983Z","level":"INFO","message":"deploy accepted","job":"aa13de94fa454e8f2fc4c6a769f479a9","caller":"oidc:mock:groups:wheel","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7077.819692] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:35.781490Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7077.842452] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:35.804275Z","level":"INFO","message":"start","id":"0a05a2e1c1723af0db56358d198d6b4c","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"oidc:mock:groups:wheel\\noidc:mock:someone\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7077.842652] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:35.804486Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"0a05a2e1c1723af0db56358d198d6b4c\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7077.908744] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 7077.941093] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 7077.945724] agent flakelet[1416]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 7077.946253] agent flakelet[1416]: other: up to date container-test-run-flakelet-relay> agent # [ 7077.948189] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 1.70 seconds) container-test-run-flakelet-relay> (finished: subtest: push login via device flow, cached token used afterwards, in 4.51 seconds) container-test-run-flakelet-relay> subtest: waves: failing first wave skips the second container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1 container-test-run-flakelet-relay> relay # [ 7079.518176] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:37.479918Z","level":"INFO","message":"deploy finished","job":"aa13de94fa454e8f2fc4c6a769f479a9","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7079.548241] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:37.510061Z","level":"INFO","message":"deploy accepted","job":"00227d8e7a7cc2ba4f5b00bc61918b89","caller":"x509:email:admin@example.org","targets":"[\"agent/app\", \"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7079.517207] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:37.479001Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7079.548500] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:37.510296Z","level":"INFO","message":"start","id":"73ef3a66c5660ac4d3a0e3ccbdfaefe0","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7079.548687] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:37.510520Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"73ef3a66c5660ac4d3a0e3ccbdfaefe0\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7079.609353] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 7079.628047] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 7079.632488] agent flakelet[1472]: app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken container-test-run-flakelet-relay> agent # [ 7079.633227] agent flakelet[1472]: app: activating generation 4 container-test-run-flakelet-relay> agent # [ 7079.642456] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 7079.643167] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7079.643298] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 7079.652331] agent systemd[1]: Reload requested from client PID 1479 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7079.652369] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7079.980207] agent systemd[1]: Reloading finished in 327 ms. container-test-run-flakelet-relay> agent # [ 7080.123913] agent systemd[1]: Reload requested from client PID 1509 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7080.123950] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7080.589986] agent systemd[1]: Reloading finished in 465 ms. container-test-run-flakelet-relay> agent # [ 7080.652465] agent systemd[1]: Reload requested from client PID 1539 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7080.652497] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7080.976112] agent systemd[1]: Reloading finished in 323 ms. container-test-run-flakelet-relay> agent # [ 7081.051893] agent systemd[1]: Reload requested from client PID 1569 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7081.051932] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7081.375023] agent systemd[1]: Reloading finished in 322 ms. container-test-run-flakelet-relay> agent # [ 7081.435967] agent systemd[1]: Starting app broken... container-test-run-flakelet-relay> agent # [ 7081.462453] agent (nonexistent)[1602]: app.service: Unable to locate executable '/nonexistent': No such file or directory container-test-run-flakelet-relay> agent # [ 7081.462476] agent (nonexistent)[1602]: app.service: Failed at step EXEC spawning /nonexistent: No such file or directory container-test-run-flakelet-relay> agent # [ 7081.464351] agent systemd[1]: app.service: Main process exited, code=exited, status=203/EXEC container-test-run-flakelet-relay> agent # [ 7081.464445] agent systemd[1]: app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> agent # [ 7081.464603] agent systemd[1]: Failed to start app broken. container-test-run-flakelet-relay> agent # [ 7081.496787] agent systemd[1]: Reload requested from client PID 1619 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7081.496824] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7081.821927] agent systemd[1]: Reloading finished in 324 ms. container-test-run-flakelet-relay> agent # [ 7081.889765] agent systemd[1]: Reload requested from client PID 1651 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7081.889801] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7082.216429] agent systemd[1]: Reloading finished in 326 ms. container-test-run-flakelet-relay> agent # [ 7082.284877] agent systemd[1]: Reload requested from client PID 1680 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7082.284915] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7082.608206] agent systemd[1]: Reloading finished in 322 ms. container-test-run-flakelet-relay> agent # [ 7082.685443] agent systemd[1]: Reload requested from client PID 1710 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7082.685482] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7083.008626] agent systemd[1]: Reloading finished in 322 ms. container-test-run-flakelet-relay> agent # [ 7083.125522] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 7083.156065] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> agent # [ 7083.157026] agent flakelet[1472]: app: deploy failed, rolled back: systemctl start app.service failed: container-test-run-flakelet-relay> agent # [ 7083.157026] agent flakelet[1472]: failed units: app.service. See journalctl -u app.service container-test-run-flakelet-relay> agent # [ 7083.159043] agent systemd[1]: flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> agent # [ 7083.159143] agent systemd[1]: flakelet-relay-job-app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1, in 5.19 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl show app.service -p Description | grep -q 'app v1' container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v1', in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: waves: failing first wave skips the second, in 5.22 seconds) container-test-run-flakelet-relay> subtest: host patterns expand on the relay container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/app' 2>&1 container-test-run-flakelet-relay> relay # [ 7084.716950] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:42.678687Z","level":"INFO","message":"deploy finished","job":"00227d8e7a7cc2ba4f5b00bc61918b89","ok":false,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7084.780787] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:42.742555Z","level":"INFO","message":"deploy accepted","job":"d9bda1ab3ae3a59d3600968c846cba03","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7084.714479] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:42.676202Z","level":"INFO","message":"update finished","flakelet":"app","status":"RolledBack","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7084.781277] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:42.742974Z","level":"INFO","message":"start","id":"6e0db61b0cc2b0102bbd4deb99e42b6a","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7084.782313] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:42.744101Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"6e0db61b0cc2b0102bbd4deb99e42b6a\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7084.852761] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 7084.888966] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 7084.893975] agent flakelet[1797]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 7084.894802] agent flakelet[1797]: app: up to date container-test-run-flakelet-relay> agent # [ 7084.895845] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/app' 2>&1, in 0.71 seconds) container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '*/app' 2>&1 container-test-run-flakelet-relay> relay # [ 7085.470347] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:43.432100Z","level":"INFO","message":"deploy finished","job":"d9bda1ab3ae3a59d3600968c846cba03","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7085.491896] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:43.453687Z","level":"INFO","message":"deploy accepted","job":"a913193c885b6e29e8abe4f2008999ae","caller":"x509:email:admin@example.org","targets":"[\"agent/app\", \"ghost/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7085.469201] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:43.430929Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7085.492127] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:43.453930Z","level":"INFO","message":"start","id":"cbeb394ab3f22ba31f05a8703398ec11","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7085.492381] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:43.454209Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"cbeb394ab3f22ba31f05a8703398ec11\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7085.552485] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 7085.585220] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 7085.589560] agent flakelet[1845]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 7085.590220] agent flakelet[1845]: app: up to date container-test-run-flakelet-relay> agent # [ 7085.591235] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '*/app' 2>&1, in 0.68 seconds) container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave '*/app' 2>&1 container-test-run-flakelet-relay> agent # [ 7086.144955] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:44.106683Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7086.170786] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:44.132587Z","level":"INFO","message":"start","id":"f9bf4f98499eb54afa481bf0b6e18728","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7086.171196] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:44.133016Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"f9bf4f98499eb54afa481bf0b6e18728\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7086.231357] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 7086.263134] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 7086.266857] agent flakelet[1882]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 7086.267414] agent flakelet[1882]: app: up to date container-test-run-flakelet-relay> agent # [ 7086.268335] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7086.146338] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:44.108076Z","level":"INFO","message":"deploy finished","job":"a913193c885b6e29e8abe4f2008999ae","ok":false,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7086.170498] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:44.132298Z","level":"INFO","message":"deploy accepted","job":"ca60a38b12d8c41ecd6c31499bdb10d9","caller":"x509:email:admin@example.org","targets":"[\"agent/app\", \"ghost/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave '*/app' 2>&1, in 0.68 seconds) container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/nope' 2>&1 container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/nope' 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: host patterns expand on the relay, in 2.11 seconds) container-test-run-flakelet-relay> subtest: detach returns once the job is accepted container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1 container-test-run-flakelet-relay> client: (finished: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> agent: waiting for success: systemctl is-active flakelet-relay-job-app.service container-test-run-flakelet-relay> relay # [ 7086.828868] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:44.790652Z","level":"INFO","message":"deploy finished","job":"ca60a38b12d8c41ecd6c31499bdb10d9","ok":false,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7086.880102] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:44.841911Z","level":"INFO","message":"deploy accepted","job":"b08f8b65947cdda6e37439d228f655b8","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7086.827671] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:44.789411Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7086.880402] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:44.842179Z","level":"INFO","message":"start","id":"4698fd466c30f35a91fb2461c47c08d8","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7086.880638] agent flakelet-agent[473]: {"timestamp":"2026-09-06T09:02:44.842464Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"4698fd466c30f35a91fb2461c47c08d8\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7086.941369] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 7086.975139] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 7086.979231] agent flakelet[1923]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2 container-test-run-flakelet-relay> agent # [ 7086.979894] agent flakelet[1923]: app: activating generation 4 container-test-run-flakelet-relay> agent # [ 7086.990986] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 7086.992478] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7086.992750] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 7087.005994] agent systemd[1]: Reload requested from client PID 1930 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7087.006066] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7087.364395] agent systemd[1]: Reloading finished in 357 ms. container-test-run-flakelet-relay> agent # [ 7087.449158] agent systemd[1]: Reload requested from client PID 1964 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7087.449194] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7087.767138] agent systemd[1]: Reloading finished in 317 ms. container-test-run-flakelet-relay> agent # [ 7087.838370] agent systemd[1]: Reload requested from client PID 1994 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7087.838402] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7088.180044] agent systemd[1]: Reloading finished in 341 ms. container-test-run-flakelet-relay> agent: (finished: waiting for success: systemctl is-active flakelet-relay-job-app.service, in 1.38 seconds) container-test-run-flakelet-relay> ??? Warning (UserWarning): wait_until_fails(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. container-test-run-flakelet-relay> File "/nix/store/fv4yr9c0f9kyrfc00100i4rlshiiidbd-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 container-test-run-flakelet-relay> agent: waiting for failure: systemctl is-active flakelet-relay-job-app.service container-test-run-flakelet-relay> ??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. container-test-run-flakelet-relay> File "/nix/store/fv4yr9c0f9kyrfc00100i4rlshiiidbd-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 container-test-run-flakelet-relay> agent # [ 7088.271343] agent systemd[1]: Reload requested from client PID 2030 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7088.271390] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7088.614963] agent systemd[1]: Reloading finished in 343 ms. container-test-run-flakelet-relay> agent # [ 7088.679296] agent systemd[1]: Starting app slow2... container-test-run-flakelet-relay> agent # [ 7094.744033] agent systemd[1]: Started app slow2. container-test-run-flakelet-relay> agent # [ 7094.761108] agent flakelet[1923]: app: updated to generation 4 container-test-run-flakelet-relay> agent # [ 7094.761840] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> agent: (finished: waiting for failure: systemctl is-active flakelet-relay-job-app.service, in 7.51 seconds) container-test-run-flakelet-relay> (finished: subtest: detach returns once the job is accepted, in 8.92 seconds) container-test-run-flakelet-relay> subtest: unknown host is final, missing agent is retried, agents listing container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1 container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl stop flakelet-agent container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl stop flakelet-agent, in 0.06 seconds) container-test-run-flakelet-relay> relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0' container-test-run-flakelet-relay> relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out container-test-run-flakelet-relay> relay # [ 7095.804916] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:53.766657Z","level":"INFO","message":"agent disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","host":"agent","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 7095.804945] agent systemd[1]: Stopping flakelet-agent... container-test-run-flakelet-relay> agent # [ 7095.837661] agent systemd[1]: flakelet-agent.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7095.837950] agent systemd[1]: Stopped flakelet-agent. container-test-run-flakelet-relay> agent # [ 7095.838250] agent systemd[1]: flakelet-agent.service: Consumed 2.635s CPU time over 30.750s wall clock time. container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out, in 1.02 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl start flakelet-agent container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl start flakelet-agent, in 0.15 seconds) container-test-run-flakelet-relay> ??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. container-test-run-flakelet-relay> File "/nix/store/fv4yr9c0f9kyrfc00100i4rlshiiidbd-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out container-test-run-flakelet-relay> agent # [ 7096.906768] agent systemd[1]: Starting flakelet-agent... container-test-run-flakelet-relay> agent # [ 7096.961929] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:02:54.923724Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"4698fd466c30f35a91fb2461c47c08d8\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7097.042467] agent systemd[1]: Started flakelet-agent. container-test-run-flakelet-relay> agent # [ 7097.055469] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:02:55.017262Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 7097.055565] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:55.017331Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(4), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 7097.527583] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:02:55.489323Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(4)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7098.896529] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:02:56.858257Z","level":"INFO","message":"start","id":"c9c127d387631dea2e7a70d381d0285a","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7098.897529] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:02:56.859060Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"c9c127d387631dea2e7a70d381d0285a\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7098.962142] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 7099.001094] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 7099.006567] agent flakelet[2595]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 7099.007125] agent flakelet[2595]: other: up to date container-test-run-flakelet-relay> agent # [ 7099.008654] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7098.896038] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:56.857770Z","level":"INFO","message":"deploy accepted","job":"f3ebb7267e1d179e612602b696e6536a","caller":"x509:email:admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7099.576318] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:02:57.538097Z","level":"INFO","message":"deploy finished","job":"f3ebb7267e1d179e612602b696e6536a","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7099.574936] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:02:57.536668Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out, in 3.04 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.05 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODY4NTY3OCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4Njg1Mzc4LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJQVE5ZNllYNlVVQzZHPT09IiwibmJmIjoxNzg4Njg1Mzc4LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.CELycyo3gFHSMaVk5TCqRVSBOAc0mUU2RJWTXmWFBoJrGQwmQyvFyA-6tZwNxcKt3RJOMlOUuM8fG2EfgZjzDA' push --relay https://relay:7443 agents container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODY4NTY3OCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4Njg1Mzc4LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJQVE5ZNllYNlVVQzZHPT09IiwibmJmIjoxNzg4Njg1Mzc4LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.CELycyo3gFHSMaVk5TCqRVSBOAc0mUU2RJWTXmWFBoJrGQwmQyvFyA-6tZwNxcKt3RJOMlOUuM8fG2EfgZjzDA' push --relay https://relay:7443 agents, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: unknown host is final, missing agent is retried, agents listing, in 4.40 seconds) container-test-run-flakelet-relay> subtest: out-of-band flakelet update reaches the relay without reconnect container-test-run-flakelet-relay> agent: must succeed: flakelet status --json app | jq '.[0].generation' container-test-run-flakelet-relay> agent: (finished: must succeed: flakelet status --json app | jq '.[0].generation', in 0.06 seconds) container-test-run-flakelet-relay> agent: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true container-test-run-flakelet-relay> agent: (finished: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: flakelet update app container-test-run-flakelet-relay> app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2 container-test-run-flakelet-relay> app: activating generation 5 container-test-run-flakelet-relay> agent # [ 7100.281743] agent systemd[1]: Stopping app slow2... container-test-run-flakelet-relay> agent # [ 7100.282231] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7100.282499] agent systemd[1]: Stopped app slow2. container-test-run-flakelet-relay> agent # [ 7100.299846] agent systemd[1]: Reload requested from client PID 2655 ('systemctl')... container-test-run-flakelet-relay> agent # [ 7100.299918] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7100.638087] agent systemd[1]: Reloading finished in 337 ms. container-test-run-flakelet-relay> agent # [ 7100.733964] agent systemd[1]: Reload requested from client PID 2684 ('systemctl')... container-test-run-flakelet-relay> agent # [ 7100.734008] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7101.060665] agent systemd[1]: Reloading finished in 326 ms. container-test-run-flakelet-relay> agent # [ 7101.156977] agent systemd[1]: Reload requested from client PID 2714 ('systemctl')... container-test-run-flakelet-relay> agent # [ 7101.157021] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7101.476636] agent systemd[1]: Reloading finished in 319 ms. container-test-run-flakelet-relay> agent # [ 7101.590287] agent systemd[1]: Reload requested from client PID 2745 ('systemctl')... container-test-run-flakelet-relay> agent # [ 7101.590326] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7101.908140] agent systemd[1]: Reloading finished in 317 ms. container-test-run-flakelet-relay> agent: (finished: must succeed: flakelet update app, in 1.81 seconds) container-test-run-flakelet-relay> client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@5' container-test-run-flakelet-relay> agent # [ 7102.007755] agent systemd[1]: Starting app v2... container-test-run-flakelet-relay> agent # [ 7102.045740] agent systemd[1]: Started app v2. container-test-run-flakelet-relay> client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@5', in 2.06 seconds) container-test-run-flakelet-relay> agent: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true container-test-run-flakelet-relay> agent: (finished: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: flakelet update app container-test-run-flakelet-relay> app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> app: activating generation 6 container-test-run-flakelet-relay> agent # [ 7104.170724] agent systemd[1]: Stopping app v2... container-test-run-flakelet-relay> agent # [ 7104.171202] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7104.171471] agent systemd[1]: Stopped app v2. container-test-run-flakelet-relay> agent # [ 7104.187775] agent systemd[1]: Reload requested from client PID 2812 ('systemctl')... container-test-run-flakelet-relay> agent # [ 7104.187845] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7104.527971] agent systemd[1]: Reloading finished in 339 ms. container-test-run-flakelet-relay> agent # [ 7104.615548] agent systemd[1]: Reload requested from client PID 2841 ('systemctl')... container-test-run-flakelet-relay> agent # [ 7104.615588] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7104.935461] agent systemd[1]: Reloading finished in 319 ms. container-test-run-flakelet-relay> agent # [ 7105.024180] agent systemd[1]: Reload requested from client PID 2869 ('systemctl')... container-test-run-flakelet-relay> agent # [ 7105.024217] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7105.345075] agent systemd[1]: Reloading finished in 320 ms. container-test-run-flakelet-relay> agent # [ 7105.445235] agent systemd[1]: Reload requested from client PID 2901 ('systemctl')... container-test-run-flakelet-relay> agent # [ 7105.445274] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: must succeed: flakelet update app, in 1.75 seconds) container-test-run-flakelet-relay> client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@6' container-test-run-flakelet-relay> agent # [ 7105.765288] agent systemd[1]: Reloading finished in 319 ms. container-test-run-flakelet-relay> agent # [ 7105.855023] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 7105.883880] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@6', in 2.06 seconds) container-test-run-flakelet-relay> (finished: subtest: out-of-band flakelet update reaches the relay without reconnect, in 7.79 seconds) container-test-run-flakelet-relay> subtest: certificate not listed under agents cannot connect as agent container-test-run-flakelet-relay> client: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent container-test-run-flakelet-relay> client: (finished: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent, in 0.03 seconds) container-test-run-flakelet-relay> (finished: subtest: certificate not listed under agents cannot connect as agent, in 0.03 seconds) container-test-run-flakelet-relay> subtest: metrics container-test-run-flakelet-relay> relay: must succeed: curl -sf http://127.0.0.1:7400/metrics container-test-run-flakelet-relay> relay: (finished: must succeed: curl -sf http://127.0.0.1:7400/metrics, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: metrics, in 0.02 seconds) container-test-run-flakelet-relay> subtest: agent link drop mid-run replays missed lines once container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: date +%s container-test-run-flakelet-relay> agent: (finished: must succeed: date +%s, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788685385 | grep -q 'app-slow' container-test-run-flakelet-relay> relay # [ 7107.986071] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:03:05.947777Z","level":"INFO","message":"agent rejected: no agents entry matches","principals":"[\"x509:dns:mallory\"]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> relay # [ 7108.044681] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:03:06.006484Z","level":"INFO","message":"deploy accepted","job":"2f7e4406758476db1103d11a4bf18a40","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7108.045140] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:06.006827Z","level":"INFO","message":"start","id":"0f054014d003d4bfe50d32985e3dfbc9","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7108.045968] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:06.007477Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"0f054014d003d4bfe50d32985e3dfbc9\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7108.103664] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 7108.132077] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 7108.135739] agent flakelet[2975]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent # [ 7108.136359] agent flakelet[2975]: app: activating generation 7 container-test-run-flakelet-relay> agent # [ 7108.147588] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 7108.147922] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7108.148158] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 7108.162467] agent systemd[1]: Reload requested from client PID 2982 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7108.162525] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7108.492265] agent systemd[1]: Reloading finished in 329 ms. container-test-run-flakelet-relay> agent # [ 7108.596023] agent systemd[1]: Reload requested from client PID 3012 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7108.596060] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7108.915666] agent systemd[1]: Reloading finished in 319 ms. container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788685385 | grep -q 'app-slow', in 1.02 seconds) container-test-run-flakelet-relay> agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done container-test-run-flakelet-relay> agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done, in 0.02 seconds) container-test-run-flakelet-relay> relay: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done container-test-run-flakelet-relay> relay: (finished: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done, in 0.06 seconds) container-test-run-flakelet-relay> agent: must succeed: ss -K dport = 7443 container-test-run-flakelet-relay> agent: (finished: must succeed: ss -K dport = 7443, in 0.03 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788685385 | grep -q 'updated to generation' container-test-run-flakelet-relay> agent # [ 7108.995684] agent systemd[1]: Reload requested from client PID 3041 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7108.995722] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7109.155424] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:07.117170Z","level":"INFO","message":"disconnected: IO error: Software caused connection abort (os error 103)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 7109.124259] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:03:07.086005Z","level":"INFO","message":"agent disconnected: IO error: Software caused connection abort (os error 103)","host":"agent","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 7109.315344] agent systemd[1]: Reloading finished in 319 ms. container-test-run-flakelet-relay> agent # [ 7109.429645] agent systemd[1]: Reload requested from client PID 3089 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7109.429682] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7109.753337] agent systemd[1]: Reloading finished in 323 ms. container-test-run-flakelet-relay> agent # [ 7109.863476] agent systemd[1]: Starting app slow... container-test-run-flakelet-relay> agent # [ 7110.158610] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:08.120251Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7112.161187] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:10.122943Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7115.935148] agent systemd[1]: Started app slow. container-test-run-flakelet-relay> agent # [ 7115.952626] agent flakelet[2975]: app: updated to generation 7 container-test-run-flakelet-relay> agent # [ 7115.955290] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7116.163507] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:14.125234Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788685385 | grep -q 'updated to generation', in 7.10 seconds) container-test-run-flakelet-relay> agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done container-test-run-flakelet-relay> agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done, in 0.02 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out container-test-run-flakelet-relay> agent # [ 7117.036294] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:14.997996Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(7)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out, in 8.09 seconds) container-test-run-flakelet-relay> client: must succeed: cat /tmp/slow.out container-test-run-flakelet-relay> client: (finished: must succeed: cat /tmp/slow.out, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: agent link drop mid-run replays missed lines once, in 16.38 seconds) container-test-run-flakelet-relay> subtest: agent restart mid-run reattaches to the unit container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2' container-test-run-flakelet-relay> agent # [ 7124.168408] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:22.130141Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7124.169574] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:22.131393Z","level":"INFO","message":"start","id":"0f054014d003d4bfe50d32985e3dfbc9","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7124.415826] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:22.377532Z","level":"INFO","message":"start","id":"638ec0810267b76f17c85a0a788502f3","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7124.416376] agent flakelet-agent[2146]: {"timestamp":"2026-09-06T09:03:22.378193Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"638ec0810267b76f17c85a0a788502f3\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> relay # [ 7124.168438] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:03:22.130207Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> relay # [ 7124.170062] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:03:22.131868Z","level":"INFO","message":"deploy finished","job":"2f7e4406758476db1103d11a4bf18a40","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7124.415340] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:03:22.377136Z","level":"INFO","message":"deploy accepted","job":"397f7251692b357519a399ab8d87e5ba","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7124.484387] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 7124.523121] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 7124.526770] agent flakelet[3308]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2 container-test-run-flakelet-relay> agent # [ 7124.527436] agent flakelet[3308]: app: activating generation 8 container-test-run-flakelet-relay> agent # [ 7124.540676] agent systemd[1]: Stopping app slow... container-test-run-flakelet-relay> agent # [ 7124.541158] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7124.541424] agent systemd[1]: Stopped app slow. container-test-run-flakelet-relay> agent # [ 7124.557566] agent systemd[1]: Reload requested from client PID 3315 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7124.557635] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7124.896111] agent systemd[1]: Reloading finished in 337 ms. container-test-run-flakelet-relay> agent # [ 7124.975919] agent systemd[1]: Reload requested from client PID 3345 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7124.975955] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2', in 1.02 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl restart flakelet-agent container-test-run-flakelet-relay> agent # [ 7125.297851] agent systemd[1]: Reloading finished in 321 ms. container-test-run-flakelet-relay> agent # [ 7125.373313] agent systemd[1]: Reload requested from client PID 3376 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7125.373346] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7125.697933] agent systemd[1]: Reloading finished in 324 ms. container-test-run-flakelet-relay> agent # [ 7125.762428] agent systemd[1]: Stopping flakelet-agent... container-test-run-flakelet-relay> agent # [ 7125.766783] agent systemd[1]: Reload requested from client PID 3413 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7125.766824] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 7125.762640] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:03:23.724407Z","level":"INFO","message":"agent disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","host":"agent","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl restart flakelet-agent, in 0.88 seconds) container-test-run-flakelet-relay> agent: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)" container-test-run-flakelet-relay> agent: (finished: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)", in 0.01 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out container-test-run-flakelet-relay> agent # [ 7126.098090] agent systemd[1]: Reloading finished in 330 ms. container-test-run-flakelet-relay> agent # [ 7126.155584] agent systemd[1]: flakelet-agent.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7126.155753] agent systemd[1]: Stopped flakelet-agent. container-test-run-flakelet-relay> agent # [ 7126.155770] agent systemd[1]: flakelet-agent.service: Consumed 2.490s CPU time over 29.248s wall clock time. container-test-run-flakelet-relay> agent # [ 7126.173659] agent systemd[1]: Starting app slow2... container-test-run-flakelet-relay> agent # [ 7126.174659] agent systemd[1]: Starting flakelet-agent... container-test-run-flakelet-relay> agent # [ 7126.229774] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:24.191560Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"638ec0810267b76f17c85a0a788502f3\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7126.303234] agent systemd[1]: Started flakelet-agent. container-test-run-flakelet-relay> agent # [ 7126.316922] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:24.278718Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7126.318068] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:24.279893Z","level":"INFO","message":"start","id":"638ec0810267b76f17c85a0a788502f3","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 7126.317053] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:03:24.278769Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 7132.244986] agent systemd[1]: Started app slow2. container-test-run-flakelet-relay> agent # [ 7132.259706] agent flakelet[3308]: app: updated to generation 8 container-test-run-flakelet-relay> agent # [ 7132.261422] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7132.845281] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:03:30.807034Z","level":"INFO","message":"deploy finished","job":"397f7251692b357519a399ab8d87e5ba","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7132.843915] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:30.805625Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(8)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out, in 7.08 seconds) container-test-run-flakelet-relay> client: must succeed: cat /tmp/restart.out container-test-run-flakelet-relay> client: (finished: must succeed: cat /tmp/restart.out, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl is-active app.service container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl is-active app.service, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: agent restart mid-run reattaches to the unit, in 9.03 seconds) container-test-run-flakelet-relay> subtest: relay restart mid-run, push resumes via /v1/jobs container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: date +%s container-test-run-flakelet-relay> agent: (finished: must succeed: date +%s, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788685411 | grep -q 'app-slow' container-test-run-flakelet-relay> relay # [ 7133.453584] relay flakelet-relay[400]: {"timestamp":"2026-09-06T09:03:31.415387Z","level":"INFO","message":"deploy accepted","job":"5db510f7502269d7f2fdbab4153621fc","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7133.453937] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:31.415642Z","level":"INFO","message":"start","id":"c5d4faf96eaaff01d4f4aa34015fc3a5","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7133.454548] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:31.416367Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"c5d4faf96eaaff01d4f4aa34015fc3a5\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7133.518845] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 7133.554153] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 7133.558511] agent flakelet[3957]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent # [ 7133.559187] agent flakelet[3957]: app: activating generation 9 container-test-run-flakelet-relay> agent # [ 7133.572173] agent systemd[1]: Stopping app slow2... container-test-run-flakelet-relay> agent # [ 7133.572633] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 7133.572910] agent systemd[1]: Stopped app slow2. container-test-run-flakelet-relay> agent # [ 7133.589525] agent systemd[1]: Reload requested from client PID 3964 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7133.589593] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7133.925395] agent systemd[1]: Reloading finished in 335 ms. container-test-run-flakelet-relay> agent # [ 7133.997954] agent systemd[1]: Reload requested from client PID 3994 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7133.997992] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788685411 | grep -q 'app-slow', in 1.02 seconds) container-test-run-flakelet-relay> relay: must succeed: systemctl restart flakelet-relay container-test-run-flakelet-relay> agent # [ 7134.319886] agent systemd[1]: Reloading finished in 321 ms. container-test-run-flakelet-relay> agent # [ 7134.387483] agent systemd[1]: Reload requested from client PID 4025 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7134.387517] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7134.476381] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:32.438117Z","level":"INFO","message":"disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 7134.475995] relay systemd[1]: Stopping flakelet-relay... container-test-run-flakelet-relay> relay # [ 7134.521520] relay systemd[1]: flakelet-relay.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7134.521786] relay systemd[1]: Stopped flakelet-relay. container-test-run-flakelet-relay> relay # [ 7134.521811] relay systemd[1]: flakelet-relay.service: Consumed 2.807s CPU time over 1min 10.758s wall clock time. container-test-run-flakelet-relay> relay # [ 7134.538084] relay systemd[1]: Starting flakelet-relay... container-test-run-flakelet-relay> agent # [ 7134.716836] agent systemd[1]: Reloading finished in 328 ms. container-test-run-flakelet-relay> agent # [ 7134.793632] agent systemd[1]: Reload requested from client PID 4061 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 7134.793667] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 7135.119941] agent systemd[1]: Reloading finished in 325 ms. container-test-run-flakelet-relay> agent # [ 7135.201649] agent systemd[1]: Starting app slow... container-test-run-flakelet-relay> agent # [ 7135.479038] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:33.440774Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.49 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q '» ok' /tmp/resume.out container-test-run-flakelet-relay> relay # [ 7135.952367] relay flakelet-relay[930]: {"timestamp":"2026-09-06T09:03:33.914105Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 7135.953196] relay flakelet-relay[930]: {"timestamp":"2026-09-06T09:03:33.914520Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 7135.952906] relay systemd[1]: Started flakelet-relay. container-test-run-flakelet-relay> relay # [ 7137.494802] relay flakelet-relay[930]: {"timestamp":"2026-09-06T09:03:35.456552Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(8), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 7137.494691] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:35.456409Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7141.269033] agent systemd[1]: Started app slow. container-test-run-flakelet-relay> agent # [ 7141.286726] agent flakelet[3957]: app: updated to generation 9 container-test-run-flakelet-relay> agent # [ 7141.289431] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7141.495628] relay flakelet-relay[930]: {"timestamp":"2026-09-06T09:03:39.457301Z","level":"INFO","message":"job reattached","job":"5db510f7502269d7f2fdbab4153621fc","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7142.400954] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:40.362663Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(9)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q '» ok' /tmp/resume.out, in 7.09 seconds) container-test-run-flakelet-relay> client: must succeed: cat /tmp/resume.out container-test-run-flakelet-relay> client: (finished: must succeed: cat /tmp/resume.out, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: relay restart mid-run, push resumes via /v1/jobs, in 9.64 seconds) container-test-run-flakelet-relay> subtest: job history comes from the agents and survives a relay restart container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1 container-test-run-flakelet-relay> relay # [ 7143.070051] relay flakelet-relay[930]: {"timestamp":"2026-09-06T09:03:41.031817Z","level":"INFO","message":"deploy accepted","job":"188b06c4636b65849b3ba8daac22dc7c","caller":"x509:email:admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7143.070542] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:41.032241Z","level":"INFO","message":"start","id":"5be20c693e5c0b60e3f85779794dfb86","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7143.071315] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:41.033130Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5be20c693e5c0b60e3f85779794dfb86\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7143.131281] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 7143.168082] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 7143.172381] agent flakelet[4202]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 7143.172934] agent flakelet[4202]: other: up to date container-test-run-flakelet-relay> agent # [ 7143.176072] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1, in 0.70 seconds) container-test-run-flakelet-relay> relay: must succeed: systemctl restart flakelet-relay container-test-run-flakelet-relay> relay # [ 7143.745143] relay flakelet-relay[930]: {"timestamp":"2026-09-06T09:03:41.706885Z","level":"INFO","message":"deploy finished","job":"188b06c4636b65849b3ba8daac22dc7c","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7143.760812] relay systemd[1]: Stopping flakelet-relay... container-test-run-flakelet-relay> relay # [ 7143.795439] relay systemd[1]: flakelet-relay.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7143.795751] relay systemd[1]: Stopped flakelet-relay. container-test-run-flakelet-relay> relay # [ 7143.795779] relay systemd[1]: flakelet-relay.service: Consumed 2.287s CPU time over 9.257s wall clock time. container-test-run-flakelet-relay> relay # [ 7143.812122] relay systemd[1]: Starting flakelet-relay... container-test-run-flakelet-relay> agent # [ 7143.743635] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:41.705355Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7143.761201] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:41.722989Z","level":"INFO","message":"disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.45 seconds) container-test-run-flakelet-relay> relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1' container-test-run-flakelet-relay> agent # [ 7144.764960] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:42.726687Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 7145.199251] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T09:03:43.161000Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 7145.200163] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T09:03:43.161472Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 7145.199821] relay systemd[1]: Started flakelet-relay. container-test-run-flakelet-relay> relay # [ 7146.778920] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T09:03:44.740648Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(9), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 7146.778833] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:44.740543Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 2.05 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.06 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODY4NTcyNSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4Njg1NDI1LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJGS0ZTM0tGQ1JPQzdHPT09IiwibmJmIjoxNzg4Njg1NDI1LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.3TojkQJts2lLwtVAFNqK_QyRt01vQ4CeAxzIBpUWHGyjrASNPqmQRHrqQw-053VY8_SD9IdG_-4q5dmO_Is1Ag' push --relay https://relay:7443 jobs container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODY4NTcyNSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4Njg1NDI1LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJGS0ZTM0tGQ1JPQzdHPT09IiwibmJmIjoxNzg4Njg1NDI1LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.3TojkQJts2lLwtVAFNqK_QyRt01vQ4CeAxzIBpUWHGyjrASNPqmQRHrqQw-053VY8_SD9IdG_-4q5dmO_Is1Ag' push --relay https://relay:7443 jobs, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: job history comes from the agents and survives a relay restart, in 4.30 seconds) container-test-run-flakelet-relay> subtest: dashboard login via authorization code flow container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login, in 0.08 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist1 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist1, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 403 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 403, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/ef85ddceb1a01629e101e7eeb99ebcfe/events || true container-test-run-flakelet-relay> relay # [ 7147.406305] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[186]: 127.0.0.1 - - [06/Sep/2026 09:03:45] "GET /authorize?response_type=code&client_id=dashboard&redirect_uri=https%3A%2F%2Frelay%3A7443%2Fui%2Fcallback&scope=openid%20profile%20email%20groups&state=c_pBSB24gzPnLECny4aku529JsV_bB34RPfF-SQkcag&code_challenge=ksGes9YjRjZ1Xc0V8ocLTnPAFtpEfnhhE24HCvn1CpU&code_challenge_method=S256 HTTP/1.1" 302 - container-test-run-flakelet-relay> relay # [ 7147.454559] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[186]: 127.0.0.1 - - [06/Sep/2026 09:03:45] "POST /token HTTP/1.1" 200 - container-test-run-flakelet-relay> relay # [ 7147.455498] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T09:03:45.417301Z","level":"INFO","message":"login","name":"someone","principals":"[\"oidc:mock:someone\", \"oidc:mock:groups:wheel\"]","target":"flakelet_relay::relay::login"} container-test-run-flakelet-relay> relay # [ 7147.517733] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T09:03:45.479498Z","level":"INFO","message":"job reattached","job":"188b06c4636b65849b3ba8daac22dc7c","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7147.560448] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T09:03:45.522207Z","level":"INFO","message":"deploy accepted","job":"a518ed429ad2ba96f34fb9ac3cb9fe02","caller":"oidc:mock:someone","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 7147.581441] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T09:03:45.543256Z","level":"INFO","message":"job reattached","job":"a518ed429ad2ba96f34fb9ac3cb9fe02","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 7147.560771] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:45.522485Z","level":"INFO","message":"start","id":"f9b5b9bbbb4c84003ad440f2a3e0450a","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"oidc:mock:someone\\noidc:mock:groups:wheel\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 7147.561300] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:45.523118Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"f9b5b9bbbb4c84003ad440f2a3e0450a\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7147.625171] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 7147.657048] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 7147.661258] agent flakelet[4266]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 7147.661806] agent flakelet[4266]: other: up to date container-test-run-flakelet-relay> agent # [ 7147.663903] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/ef85ddceb1a01629e101e7eeb99ebcfe/events || true, in 0.68 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/ef85ddceb1a01629e101e7eeb99ebcfe container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/ef85ddceb1a01629e101e7eeb99ebcfe, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=ef85ddceb1a01629e101e7eeb99ebcfe' | grep -q 400 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=ef85ddceb1a01629e101e7eeb99ebcfe' | grep -q 400, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other container-test-run-flakelet-relay> » job 38796a7ba508eadfe82a1cd5def000bc via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/other | Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent/other | Started flakelet update other (via relay). container-test-run-flakelet-relay> agent/other | other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent/other | other: up to date container-test-run-flakelet-relay> agent # [ 7148.236106] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:46.197817Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 7148.385795] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:46.347526Z","level":"INFO","message":"start","id":"5e317fc57863c2a7c03ebe1bdacd1356","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent/otheragent # [ 7148.386343] agent flakelet-agent[3445]: {"timestamp":"2026-09-06T09:03:46.348161Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5e317fc57863c2a7c03ebe1bdacd1356\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> | agent # [ 7148.428289] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> flakelet-relay-job-other.service: Deactivated successfully.agent # [ 7148.461177] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> container-test-run-flakelet-relay> agent # [ 7148.465471] agent flakelet[4316]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 7148.466115] agent flakelet[4316]: other: up to date container-test-run-flakelet-relay> agent # [ 7148.468384] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 7148.385417] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T09:03:46.347190Z","level":"INFO","message":"deploy accepted","job":"38796a7ba508eadfe82a1cd5def000bc","caller":"x509:email:admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> » agent/other: unchanged (generation 1) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other, in 0.67 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q live1 /tmp/ev.out container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q live1 /tmp/ev.out, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 303 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 303, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: dashboard login via authorization code flow, in 1.74 seconds) container-test-run-flakelet-relay> (finished: run the VM test script, in 88.83 seconds) container-test-run-flakelet-relay> test script finished in 88.86s container-test-run-flakelet-relay> cleanup container-test-run-flakelet-relay> kill NspawnMachine (pid 52) container-test-run-flakelet-relay> kill NspawnMachine (pid 53) container-test-run-flakelet-relay> Container agent terminated by signal KILL. container-test-run-flakelet-relay> kill NspawnMachine (pid 56) container-test-run-flakelet-relay> Container client terminated by signal KILL. container-test-run-flakelet-relay> relay # [ 7149.037983] relay flakelet-relay[1320]: {"timestamp":"2026-09-06T09:03:46.999720Z","level":"INFO","message":"deploy finished","job":"38796a7ba508eadfe82a1cd5def000bc","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> Container relay terminated by signal KILL. container-test-run-flakelet-relay> (finished: cleanup, in 0.39 seconds) container-test-run-flakelet-relay> additionally exposed symbols: container-test-run-flakelet-relay> agent, client, relay, container-test-run-flakelet-relay> vlan1, container-test-run-flakelet-relay> start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh container-test-run-flakelet-relay> » job 4dfcd6a1307dc3955ab5419a0b58ae41 via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2 container-test-run-flakelet-relay> agent/app | app: activating generation 2 container-test-run-flakelet-relay> agent/app | app: updated to generation 2 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 2) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job 00227d8e7a7cc2ba4f5b00bc61918b89 via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken container-test-run-flakelet-relay> agent/app | app: activating generation 4 container-test-run-flakelet-relay> agent/app | app: deploy failed, rolled back: systemctl start app.service failed: container-test-run-flakelet-relay> agent/app | failed units: app.service. See journalctl -u app.service container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> » agent/app: rolled-back (generation 3) container-test-run-flakelet-relay> agent/app │ Starting app v1... container-test-run-flakelet-relay> agent/app │ Started app v1. container-test-run-flakelet-relay> agent/app │ Stopping app v1... container-test-run-flakelet-relay> agent/app │ app.service: Deactivated successfully. container-test-run-flakelet-relay> agent/app │ Stopped app v1. container-test-run-flakelet-relay> agent/app │ Starting app v2... container-test-run-flakelet-relay> agent/app │ Started app v2. container-test-run-flakelet-relay> agent/app │ Stopping app v2... container-test-run-flakelet-relay> agent/app │ app.service: Deactivated successfully. container-test-run-flakelet-relay> agent/app │ Stopped app v2. container-test-run-flakelet-relay> agent/app │ Starting app v1... container-test-run-flakelet-relay> agent/app │ Started app v1. container-test-run-flakelet-relay> agent/app │ Stopping app v1... container-test-run-flakelet-relay> agent/app │ app.service: Deactivated successfully. container-test-run-flakelet-relay> agent/app │ Stopped app v1. container-test-run-flakelet-relay> agent/app │ Starting app broken... container-test-run-flakelet-relay> agent/app │ app.service: Unable to locate executable '/nonexistent': No such file or directory container-test-run-flakelet-relay> agent/app │ app.service: Failed at step EXEC spawning /nonexistent: No such file or directory container-test-run-flakelet-relay> agent/app │ app.service: Main process exited, code=exited, status=203/EXEC container-test-run-flakelet-relay> agent/app │ app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> agent/app │ Failed to start app broken. container-test-run-flakelet-relay> agent/app │ Starting app v1... container-test-run-flakelet-relay> agent/app │ Started app v1. container-test-run-flakelet-relay> » skipped: agent/other container-test-run-flakelet-relay> » failed container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job 2f7e4406758476db1103d11a4bf18a40 via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent/app | app: activating generation 7 container-test-run-flakelet-relay> agent/app | app: updated to generation 7 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 7) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job 397f7251692b357519a399ab8d87e5ba via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2 container-test-run-flakelet-relay> agent/app | app: activating generation 8 container-test-run-flakelet-relay> agent/app | app: updated to generation 8 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 8) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job 5db510f7502269d7f2fdbab4153621fc via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent/app | app: activating generation 9 container-test-run-flakelet-relay> flakelet-push: stream: error reading a body from connection, resuming job e5707f82854f8fdd588d08d9f9ae5826 container-test-run-flakelet-relay> flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 1s container-test-run-flakelet-relay> flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 2s container-test-run-flakelet-relay> flakelet-push: https://relay:7443: 404 Not Found: unknown_job: no connected agent knows this job, retrying in 4s container-test-run-flakelet-relay> » job 5db510f7502269d7f2fdbab4153621fc via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | app: updated to generation 9 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 9) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> 1788685421 hist1 x509:email:admin@example.org agent/other:unchanged container-test-run-flakelet-relay> 1788685411 e5707f82854f8fdd588d08d9f9ae5826 x509:email:admin@example.org agent/app:updated container-test-run-flakelet-relay> 1788685402 bafd9178d160b3adf54068c48b7fda36 x509:email:admin@example.org agent/app:updated container-test-run-flakelet-relay> 1788685386 fc13e4685ca22452e70e4f6c5a1a43d6 x509:email:admin@example.org agent/app:updated container-test-run-flakelet-relay> 1788685376 5accdb95d5c0386dc8e4606407464c22 x509:email:admin@example.org agent/other:unchanged container-test-run-flakelet-relay> 1788685364 2d35fa56e6416c3c564f3fadce9009be x509:email:admin@example.org agent/app:unchanged container-test-run-flakelet-relay> 1788685364 c4bd6d68c3bec95f77603357eea390c1 x509:email:admin@example.org agent/app:updated container-test-run-flakelet-relay> 1788685363 2aded468b05bd93489963a17092d3c73 x509:email:admin@example.org agent/app:unchanged container-test-run-flakelet-relay> 1788685362 3875b5a120a705361df332f2c790211e x509:email:admin@example.org agent/app:unchanged container-test-run-flakelet-relay> 1788685357 6113256b3149d9c799443b152432a5a5 x509:email:admin@example.org agent/app:rolled-back container-test-run-flakelet-relay> 1788685355 d5785d4d35bc9355d9876bc5769db0f5 oidc:mock:groups:wheel agent/other:unchanged container-test-run-flakelet-relay> 1788685355 d5cb1f5ebbc5da4fac39905e219edc81 oidc:mock:groups:wheel agent/other:unchanged container-test-run-flakelet-relay> 1788685352 80030772b4dd62db8184ae9f6f226604 oidc:mock:groups:wheel agent/other:unchanged container-test-run-flakelet-relay> 1788685348 0d178d0bfa8625fccac50f94c61e4c07 oidc:mock:repo:github:example/app:ref:refs/heads/main agent/app:updated container-test-run-flakelet-relay> 1788685345 d4ced8f77ac827270a49fa52c1e54b0f x509:email:admin@example.org agent/app:updated container-test-run-flakelet-relay> post-build step Upload coverage to codecov: ok Skipping codecov: project=Mic92/flakelet-relay attr=checks.x86_64-linux.nixos-test