these 30 derivations will be built: /nix/store/ch36w961d5lvphnpbycnb61z2cx5qcgh-push.drv /nix/store/1v0bkm8257gv5h8h0c8yy53jl1a73mc9-system-path.drv /nix/store/xfn4jk1zw02iq4ignann3vf195b09ix2-dbus-1.drv /nix/store/50v43f1g8fiaqc5da5dlshhbqzxginp0-X-Restart-Triggers-dbus-broker.drv /nix/store/1149nw0yrxi8c88db9jplly9k3xmh1f0-unit-dbus-broker.service.drv /nix/store/1ban9nlk9yf3byz5jv6aq5nh0d84yr8n-flakelet-relay-policy-checks.drv /nix/store/gbc06200ia1aya15j1cwy07pnv29fi9q-dry-activate.drv /nix/store/bi58vmqnqmfldjal4rx91g39js9hdikz-unit-flakelet-relay.service.drv /nix/store/83n5hcxmm7lvd0faznqy2an8g0zc27ah-system-units.drv /nix/store/rwv3caab6d4qf19yxdvli1xid885ryxs-etc.drv /nix/store/lxj184sjjd5wdd24q9k2jpkaj6za0w0x-activate.drv /nix/store/3521w69qj1w7cgsilzpkhczlfhxk10y9-nixos-system-relay-test.drv /nix/store/831yyf5b8byxfwjbn7yc53g4nhsf5947-run-relay-nspawn.drv /nix/store/847bqs6lyp9yvqcvsw3ikd416q5sqjvm-unit-flakelet-agent.service.drv /nix/store/a35n62if5q93fhamhdnp6ygrwxqsmpqa-system-units.drv /nix/store/ri9k61wyq3vpmpp1qhlpmvjiw9r534mw-system-units.drv /nix/store/ad6b4s95b23s3hbn7g3xk1s99v6387jr-etc.drv /nix/store/i4ig0ypqasb51v770j3raj8fvkw1x0jm-unit-dbus-broker.service.drv /nix/store/wb1y95xdvlnyps4p6a2s6rnvb5adbd90-user-units.drv /nix/store/lhmi141rdkq19faw1gv70haxmgx042bm-etc.drv /nix/store/c44s7a4n0kfgla5ghd56kzr9c9v11liv-activate.drv /nix/store/rpzxzpgysmiwq283h5dixwz98zls5ls0-nixos-system-client-test.drv /nix/store/i233rv897hh30pk18k6l9771vcr1pffy-run-client-nspawn.drv /nix/store/gwr7s3881viwrfqmamli5xm4br3paqyv-dry-activate.drv /nix/store/mb5kggmib6q3dkyjk7fvjabhhqg1scs4-activate.drv /nix/store/sraf0i3gwykpjjknnhv453c7s1z9w5c7-nixos-system-agent-test.drv /nix/store/s7437nd725n6z3z6fjd5ypvg2xprdi6i-run-agent-nspawn.drv /nix/store/xy6ra5ssgwj4b7mwpqdm807mfmd6p38g-driverConfiguration.json.drv /nix/store/qrjk5f65vafsqlxb332kw7nxsz653gz9-nixos-test-driver-flakelet-relay.drv /nix/store/gvhgz9ikkiw6scxsk6krxwwb006ffqhv-container-test-run-flakelet-relay.drv this path will be fetched (1.0 KiB download, 2.2 KiB unpacked): /nix/store/n8h94xzr916qdbfci22676kx8mhl5s11-dry-activate building '/nix/store/ch36w961d5lvphnpbycnb61z2cx5qcgh-push.drv' building '/nix/store/847bqs6lyp9yvqcvsw3ikd416q5sqjvm-unit-flakelet-agent.service.drv' building '/nix/store/bi58vmqnqmfldjal4rx91g39js9hdikz-unit-flakelet-relay.service.drv' push> tribuchet: building on jamie unit-flakelet-agent.service> tribuchet: building on jamie unit-flakelet-relay.service> tribuchet: building on jamie building '/nix/store/gbc06200ia1aya15j1cwy07pnv29fi9q-dry-activate.drv' building '/nix/store/gwr7s3881viwrfqmamli5xm4br3paqyv-dry-activate.drv' building '/nix/store/1ban9nlk9yf3byz5jv6aq5nh0d84yr8n-flakelet-relay-policy-checks.drv' dry-activate> tribuchet: building on jamie dry-activate> tribuchet: building on jamie flakelet-relay-policy-checks> tribuchet: building on jamie unit-flakelet-relay.service> structuredAttrs is enabled flakelet-relay-policy-checks> check: oidc:mock:repo:github:example/app:ref:refs/heads/main -> agent/app (expect allow) flakelet-relay-policy-checks> agent/app allowed by ci unit-flakelet-agent.service> structuredAttrs is enabled flakelet-relay-policy-checks> check: oidc:mock:repo:github:example/app:ref:refs/heads/main -> agent/other (expect deny) flakelet-relay-policy-checks> agent/other denied building '/nix/store/1v0bkm8257gv5h8h0c8yy53jl1a73mc9-system-path.drv' building '/nix/store/83n5hcxmm7lvd0faznqy2an8g0zc27ah-system-units.drv' building '/nix/store/ri9k61wyq3vpmpp1qhlpmvjiw9r534mw-system-units.drv' system-path> tribuchet: building on jamie system-units> tribuchet: building on jamie system-units> tribuchet: building on jamie system-path> structuredAttrs is enabled system-path> created 6399 symlinks in user environment building '/nix/store/ad6b4s95b23s3hbn7g3xk1s99v6387jr-etc.drv' building '/nix/store/rwv3caab6d4qf19yxdvli1xid885ryxs-etc.drv' etc> tribuchet: building on jamie etc> tribuchet: building on jamie building '/nix/store/xfn4jk1zw02iq4ignann3vf195b09ix2-dbus-1.drv' dbus-1> tribuchet: building on jamie building '/nix/store/mb5kggmib6q3dkyjk7fvjabhhqg1scs4-activate.drv' building '/nix/store/lxj184sjjd5wdd24q9k2jpkaj6za0w0x-activate.drv' activate> tribuchet: building on jamie activate> tribuchet: building on jamie building '/nix/store/50v43f1g8fiaqc5da5dlshhbqzxginp0-X-Restart-Triggers-dbus-broker.drv' X-Restart-Triggers-dbus-broker> tribuchet: building on jamie building '/nix/store/sraf0i3gwykpjjknnhv453c7s1z9w5c7-nixos-system-agent-test.drv' building '/nix/store/3521w69qj1w7cgsilzpkhczlfhxk10y9-nixos-system-relay-test.drv' building '/nix/store/1149nw0yrxi8c88db9jplly9k3xmh1f0-unit-dbus-broker.service.drv' building '/nix/store/i4ig0ypqasb51v770j3raj8fvkw1x0jm-unit-dbus-broker.service.drv' nixos-system-agent-test> tribuchet: building on jamie nixos-system-relay-test> tribuchet: building on jamie unit-dbus-broker.service> tribuchet: building on jamie unit-dbus-broker.service> tribuchet: building on jamie unit-dbus-broker.service> structuredAttrs is enabled unit-dbus-broker.service> structuredAttrs is enabled nixos-system-agent-test> structuredAttrs is enabled nixos-system-relay-test> structuredAttrs is enabled building '/nix/store/wb1y95xdvlnyps4p6a2s6rnvb5adbd90-user-units.drv' user-units> tribuchet: building on jamie building '/nix/store/a35n62if5q93fhamhdnp6ygrwxqsmpqa-system-units.drv' building '/nix/store/s7437nd725n6z3z6fjd5ypvg2xprdi6i-run-agent-nspawn.drv' building '/nix/store/831yyf5b8byxfwjbn7yc53g4nhsf5947-run-relay-nspawn.drv' run-agent-nspawn> tribuchet: building on jamie system-units> tribuchet: building on jamie run-relay-nspawn> tribuchet: building on jamie building '/nix/store/lhmi141rdkq19faw1gv70haxmgx042bm-etc.drv' etc> tribuchet: building on jamie building '/nix/store/c44s7a4n0kfgla5ghd56kzr9c9v11liv-activate.drv' activate> tribuchet: building on jamie building '/nix/store/rpzxzpgysmiwq283h5dixwz98zls5ls0-nixos-system-client-test.drv' nixos-system-client-test> tribuchet: building on jamie nixos-system-client-test> structuredAttrs is enabled building '/nix/store/i233rv897hh30pk18k6l9771vcr1pffy-run-client-nspawn.drv' run-client-nspawn> tribuchet: building on jamie building '/nix/store/xy6ra5ssgwj4b7mwpqdm807mfmd6p38g-driverConfiguration.json.drv' driverConfiguration.json> tribuchet: building on jamie driverConfiguration.json> structuredAttrs is enabled building '/nix/store/qrjk5f65vafsqlxb332kw7nxsz653gz9-nixos-test-driver-flakelet-relay.drv' nixos-test-driver-flakelet-relay> tribuchet: building on jamie nixos-test-driver-flakelet-relay> Running type check (enable/disable: config.skipTypeCheck) nixos-test-driver-flakelet-relay> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck nixos-test-driver-flakelet-relay> All checks passed! nixos-test-driver-flakelet-relay> Linting test script (enable/disable: config.skipLint) nixos-test-driver-flakelet-relay> See https://nixos.org/manual/nixos/stable/#test-opt-skipLint nixos-test-driver-flakelet-relay> All checks passed! building '/nix/store/gvhgz9ikkiw6scxsk6krxwwb006ffqhv-container-test-run-flakelet-relay.drv' container-test-run-flakelet-relay> tribuchet: building on jamie container-test-run-flakelet-relay> Machine state will be reset. To keep it, pass --keep-machine-state container-test-run-flakelet-relay> start all VLans container-test-run-flakelet-relay> (finished: start all VLans, in 0.00 seconds) container-test-run-flakelet-relay> Initializing machine ID from random generator. container-test-run-flakelet-relay> Test will time out and terminate in 3600.0 seconds container-test-run-flakelet-relay> run the VM test script container-test-run-flakelet-relay> start all VMs container-test-run-flakelet-relay> agent: systemd-nspawn running (pid 53) container-test-run-flakelet-relay> client: systemd-nspawn running (pid 52) container-test-run-flakelet-relay> relay: systemd-nspawn running (pid 54) container-test-run-flakelet-relay> agent: Waiting for journal at /build/vm-state-agent/var/log/journal... container-test-run-flakelet-relay> client: Waiting for journal at /build/vm-state-client/var/log/journal... container-test-run-flakelet-relay> relay: Waiting for journal at /build/vm-state-relay/var/log/journal... container-test-run-flakelet-relay> (finished: start all VMs, in 0.00 seconds) container-test-run-flakelet-relay> relay: waiting for unit flakelet-relay.service container-test-run-flakelet-relay> nixos-nspawn(agent): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-flakelet-relay> nixos-nspawn(agent): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-flakelet-relay> nixos-nspawn(relay): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-flakelet-relay> nixos-nspawn(relay): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-flakelet-relay> nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-flakelet-relay> nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-flakelet-relay> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-flakelet-relay> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-flakelet-relay> ░ Spawning container agent on /build/vm-state-agent. container-test-run-flakelet-relay> ░ Spawning container relay on /build/vm-state-relay. container-test-run-flakelet-relay> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-flakelet-relay> ░ Spawning container client on /build/vm-state-client. container-test-run-flakelet-relay> agent # No journal files were found. container-test-run-flakelet-relay> agent # No journal boot entry found for the specified boot (+0). container-test-run-flakelet-relay> relay # No journal files were found. container-test-run-flakelet-relay> relay # No journal boot entry found for the specified boot (+0). container-test-run-flakelet-relay> client # No journal files were found. container-test-run-flakelet-relay> client # No journal boot entry found for the specified boot (+0). container-test-run-flakelet-relay> agent # [ 9799.031967] agent systemd-journald[57]: Journal started container-test-run-flakelet-relay> agent # [ 9799.032014] agent systemd-journald[57]: Runtime Journal (/run/log/journal/fa15072b70c8451c882034502739af8e) is 8M, max 4G, 3.9G free. container-test-run-flakelet-relay> agent # [ 9799.043280] agent systemd[1]: Finished Apply Kernel Variables. container-test-run-flakelet-relay> agent # [ 9799.055829] agent systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-flakelet-relay> agent # [ 9799.070527] agent systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-flakelet-relay> agent # [ 9799.071410] agent systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-flakelet-relay> agent # [ 9799.111406] agent systemd-journald[57]: Time spent on flushing to /var/log/journal/fa15072b70c8451c882034502739af8e is 2.739ms for 6 entries. container-test-run-flakelet-relay> client # [ 9799.029585] client systemd-journald[57]: Journal started container-test-run-flakelet-relay> agent # [ 9799.111406] agent systemd-journald[57]: System Journal (/var/log/journal/fa15072b70c8451c882034502739af8e) is 512B, max 4G, 3.9G free. container-test-run-flakelet-relay> client # [ 9799.029628] client systemd-journald[57]: Runtime Journal (/run/log/journal/a8b01b8011b649f79a2e7457e77bdb16) is 8M, max 4G, 3.9G free. container-test-run-flakelet-relay> agent # [ 9799.120733] agent systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-flakelet-relay> client # [ 9799.043965] client systemd[1]: Finished Apply Kernel Variables. container-test-run-flakelet-relay> agent # [ 9799.121487] agent systemd[1]: Reached target Preparation for Local File Systems. container-test-run-flakelet-relay> client # [ 9799.056829] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-flakelet-relay> relay # [ 9799.032101] relay systemd-journald[57]: Journal started container-test-run-flakelet-relay> client # [ 9799.071590] client systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-flakelet-relay> relay # [ 9799.032141] relay systemd-journald[57]: Runtime Journal (/run/log/journal/96fe1008cd0e4e64bf15be0b40f5e86e) is 8M, max 4G, 3.9G free. container-test-run-flakelet-relay> client # [ 9799.072221] client systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-flakelet-relay> agent # [ 9799.121606] agent systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-flakelet-relay> relay # [ 9799.043227] relay systemd[1]: Finished Apply Kernel Variables. container-test-run-flakelet-relay> agent # [ 9799.138585] agent systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-flakelet-relay> client # [ 9799.111586] client systemd-journald[57]: Time spent on flushing to /var/log/journal/a8b01b8011b649f79a2e7457e77bdb16 is 1.480ms for 6 entries. container-test-run-flakelet-relay> relay # [ 9799.055783] relay systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-flakelet-relay> client # [ 9799.111586] client systemd-journald[57]: System Journal (/var/log/journal/a8b01b8011b649f79a2e7457e77bdb16) is 512B, max 4G, 3.9G free. container-test-run-flakelet-relay> agent # [ 9799.189938] agent systemd[1]: Finished Firewall. container-test-run-flakelet-relay> relay # [ 9799.070398] relay systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-flakelet-relay> client # [ 9799.121069] client systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-flakelet-relay> relay # [ 9799.072162] relay systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-flakelet-relay> client # [ 9799.121774] client systemd[1]: Reached target Preparation for Local File Systems. container-test-run-flakelet-relay> relay # [ 9799.110850] relay systemd-journald[57]: Time spent on flushing to /var/log/journal/96fe1008cd0e4e64bf15be0b40f5e86e is 2.843ms for 6 entries. container-test-run-flakelet-relay> client # [ 9799.121879] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-flakelet-relay> relay # [ 9799.110850] relay systemd-journald[57]: System Journal (/var/log/journal/96fe1008cd0e4e64bf15be0b40f5e86e) is 512B, max 4G, 3.9G free. container-test-run-flakelet-relay> client # [ 9799.132379] client systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-flakelet-relay> relay # [ 9799.120665] relay systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-flakelet-relay> client # [ 9799.182363] client systemd[1]: Finished Firewall. container-test-run-flakelet-relay> relay # [ 9799.121422] relay systemd[1]: Reached target Preparation for Local File Systems. container-test-run-flakelet-relay> relay # [ 9799.121540] relay systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-flakelet-relay> relay # [ 9799.140417] relay systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-flakelet-relay> relay # [ 9799.201037] relay systemd[1]: Finished Firewall. container-test-run-flakelet-relay> relay # [ 9800.030709] relay systemd[1]: Mounting /run/wrappers... container-test-run-flakelet-relay> relay # [ 9800.089455] relay systemd[1]: Mounted /run/wrappers. container-test-run-flakelet-relay> relay # [ 9800.090490] relay systemd[1]: Reached target Local File Systems. container-test-run-flakelet-relay> relay # [ 9800.091776] relay systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-flakelet-relay> relay # [ 9800.093224] relay systemd[1]: Starting Create SUID/SGID Wrappers... container-test-run-flakelet-relay> relay # [ 9800.093272] relay systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> relay # [ 9800.094609] relay systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-flakelet-relay> relay # [ 9800.095751] relay systemd[1]: Starting Create System Files and Directories... container-test-run-flakelet-relay> relay # [ 9800.115082] relay systemd-tmpfiles[169]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-flakelet-relay> relay # [ 9800.115536] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-flakelet-relay> relay # [ 9800.115874] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal/96fe1008cd0e4e64bf15be0b40f5e86e failed: Operation not permitted container-test-run-flakelet-relay> relay # [ 9800.116268] relay systemd-tmpfiles[169]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-flakelet-relay> client # [ 9800.058685] client systemd[1]: Mounting /run/wrappers... container-test-run-flakelet-relay> client # [ 9800.096787] client systemd[1]: Mounted /run/wrappers. container-test-run-flakelet-relay> client # [ 9800.097836] client systemd[1]: Reached target Local File Systems. container-test-run-flakelet-relay> client # [ 9800.099181] client systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-flakelet-relay> client # [ 9800.100310] client systemd[1]: Starting Create SUID/SGID Wrappers... container-test-run-flakelet-relay> client # [ 9800.100363] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> client # [ 9800.101623] client systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-flakelet-relay> client # [ 9800.102850] client systemd[1]: Starting Create System Files and Directories... container-test-run-flakelet-relay> client # [ 9800.122354] client systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-flakelet-relay> client # [ 9800.122786] client systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-flakelet-relay> client # [ 9800.123146] client systemd-tmpfiles[161]: fchmod() of /var/log/journal/a8b01b8011b649f79a2e7457e77bdb16 failed: Operation not permitted container-test-run-flakelet-relay> client # [ 9800.123525] client systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-flakelet-relay> agent # [ 9800.058819] agent systemd[1]: Mounting /run/wrappers... container-test-run-flakelet-relay> agent # [ 9800.095883] agent systemd[1]: Mounted /run/wrappers. container-test-run-flakelet-relay> agent # [ 9800.097010] agent systemd[1]: Reached target Local File Systems. container-test-run-flakelet-relay> agent # [ 9800.098368] agent systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-flakelet-relay> agent # [ 9800.099511] agent systemd[1]: Starting Create SUID/SGID Wrappers... container-test-run-flakelet-relay> agent # [ 9800.099561] agent systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> agent # [ 9800.100689] agent systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-flakelet-relay> agent # [ 9800.101768] agent systemd[1]: Starting Create System Files and Directories... container-test-run-flakelet-relay> agent # [ 9800.124205] agent suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.GBRuZTN2TX/chsh': Operation not permitted container-test-run-flakelet-relay> agent # [ 9800.126030] agent systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-flakelet-relay> agent # [ 9800.126455] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-flakelet-relay> agent # [ 9800.126765] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal/fa15072b70c8451c882034502739af8e failed: Operation not permitted container-test-run-flakelet-relay> agent # [ 9800.127140] agent systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-flakelet-relay> relay # [ 9800.119241] relay suid-sgid-wrappers-start[176]: chmod: changing permissions of '/run/wrappers/wrappers.xJqFR8jd1Z/chsh': Operation not permitted container-test-run-flakelet-relay> relay # [ 9800.125917] relay systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> relay # [ 9800.126206] relay systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> relay # [ 9800.126505] relay systemd[1]: Failed to start Create SUID/SGID Wrappers. container-test-run-flakelet-relay> relay # [ 9800.126947] relay systemd[1]: Finished Create System Files and Directories. container-test-run-flakelet-relay> relay # [ 9800.141451] relay systemd[1]: Starting Rebuild Journal Catalog... container-test-run-flakelet-relay> relay # [ 9800.142182] relay systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-flakelet-relay> relay # [ 9800.154853] relay systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-flakelet-relay> relay # [ 9800.163791] relay systemd[1]: Finished Rebuild Journal Catalog. container-test-run-flakelet-relay> relay # [ 9800.165028] relay systemd[1]: Starting Update is Completed... container-test-run-flakelet-relay> relay # [ 9800.175107] relay systemd[1]: Finished Update is Completed. container-test-run-flakelet-relay> relay # [ 9800.175211] relay systemd[1]: Reached target System Initialization. container-test-run-flakelet-relay> relay # [ 9800.175286] relay systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> relay # [ 9800.175317] relay systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-flakelet-relay> relay # [ 9800.175332] relay systemd[1]: Reached target Timer Units. container-test-run-flakelet-relay> relay # [ 9800.175440] relay systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-flakelet-relay> relay # [ 9800.175617] relay systemd[1]: Listening on Nix Daemon Socket. container-test-run-flakelet-relay> relay # [ 9800.175723] relay systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-flakelet-relay> relay # [ 9800.175736] relay systemd[1]: Reached target Socket Units. container-test-run-flakelet-relay> relay # [ 9800.175769] relay systemd[1]: Reached target Basic System. container-test-run-flakelet-relay> relay # [ 9800.177565] relay systemd[1]: Started device-mock.service. container-test-run-flakelet-relay> relay # [ 9800.178348] relay systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-flakelet-relay> relay # [ 9800.179354] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> relay # [ 9800.180673] relay systemd[1]: Starting resolvconf update... container-test-run-flakelet-relay> relay # [ 9800.205599] relay systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-flakelet-relay> relay # [ 9800.311684] relay systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-flakelet-relay> client # [ 9800.126053] client suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.BATVrySNFq/chsh': Operation not permitted container-test-run-flakelet-relay> client # [ 9800.131468] client systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> client # [ 9800.131511] client systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> client # [ 9800.131564] client systemd[1]: Failed to start Create SUID/SGID Wrappers. container-test-run-flakelet-relay> client # [ 9800.132016] client systemd[1]: Finished Create System Files and Directories. container-test-run-flakelet-relay> client # [ 9800.145768] client systemd[1]: Starting Rebuild Journal Catalog... container-test-run-flakelet-relay> client # [ 9800.146393] client systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-flakelet-relay> client # [ 9800.158667] client systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-flakelet-relay> client # [ 9800.168768] client systemd[1]: Finished Rebuild Journal Catalog. container-test-run-flakelet-relay> client # [ 9800.169758] client systemd[1]: Starting Update is Completed... container-test-run-flakelet-relay> client # [ 9800.179172] client systemd[1]: Finished Update is Completed. container-test-run-flakelet-relay> client # [ 9800.180072] client systemd[1]: Reached target System Initialization. container-test-run-flakelet-relay> client # [ 9800.180227] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> client # [ 9800.180294] client systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-flakelet-relay> client # [ 9800.180325] client systemd[1]: Reached target Timer Units. container-test-run-flakelet-relay> client # [ 9800.180544] client systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-flakelet-relay> client # [ 9800.180856] client systemd[1]: Listening on Nix Daemon Socket. container-test-run-flakelet-relay> client # [ 9800.181063] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-flakelet-relay> client # [ 9800.181089] client systemd[1]: Reached target Socket Units. container-test-run-flakelet-relay> client # [ 9800.181144] client systemd[1]: Reached target Basic System. container-test-run-flakelet-relay> client # [ 9800.183327] client systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-flakelet-relay> client # [ 9800.184590] client systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> client # [ 9800.189477] client systemd[1]: Starting resolvconf update... container-test-run-flakelet-relay> client # [ 9800.210048] client systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-flakelet-relay> client # [ 9800.296886] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-flakelet-relay> client # [ 9800.297891] client systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-flakelet-relay> agent # [ 9800.134459] agent systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> agent # [ 9800.134505] agent systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> agent # [ 9800.134560] agent systemd[1]: Failed to start Create SUID/SGID Wrappers. container-test-run-flakelet-relay> agent # [ 9800.135012] agent systemd[1]: Finished Create System Files and Directories. container-test-run-flakelet-relay> agent # [ 9800.148652] agent systemd[1]: Starting Rebuild Journal Catalog... container-test-run-flakelet-relay> agent # [ 9800.149256] agent systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-flakelet-relay> agent # [ 9800.162115] agent systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-flakelet-relay> agent # [ 9800.171530] agent systemd[1]: Finished Rebuild Journal Catalog. container-test-run-flakelet-relay> agent # [ 9800.172409] agent systemd[1]: Starting Update is Completed... container-test-run-flakelet-relay> agent # [ 9800.182960] agent systemd[1]: Finished Update is Completed. container-test-run-flakelet-relay> agent # [ 9800.183144] agent systemd[1]: Reached target System Initialization. container-test-run-flakelet-relay> agent # [ 9800.183237] agent systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> agent # [ 9800.183273] agent systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-flakelet-relay> agent # [ 9800.183291] agent systemd[1]: Reached target Timer Units. container-test-run-flakelet-relay> agent # [ 9800.183417] agent systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-flakelet-relay> agent # [ 9800.183603] agent systemd[1]: Listening on Nix Daemon Socket. container-test-run-flakelet-relay> agent # [ 9800.183718] agent systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-flakelet-relay> agent # [ 9800.183735] agent systemd[1]: Reached target Socket Units. container-test-run-flakelet-relay> agent # [ 9800.183762] agent systemd[1]: Reached target Basic System. container-test-run-flakelet-relay> agent # [ 9800.186343] agent systemd[1]: Starting Re-link flakelet services at boot... container-test-run-flakelet-relay> agent # [ 9800.189412] agent systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-flakelet-relay> agent # [ 9800.190380] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 9800.191401] agent systemd[1]: Starting resolvconf update... container-test-run-flakelet-relay> agent # [ 9800.204823] agent systemd[1]: Finished Re-link flakelet services at boot. container-test-run-flakelet-relay> agent # [ 9800.205872] agent systemd[1]: Starting Reconcile flakelet services with the host configuration... container-test-run-flakelet-relay> agent # [ 9800.212736] agent systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-flakelet-relay> agent # [ 9800.222085] agent systemd[1]: Finished Reconcile flakelet services with the host configuration. container-test-run-flakelet-relay> agent # [ 9800.296844] agent systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9800.297904] agent systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-flakelet-relay> client # [ 9800.327277] client systemd[1]: Finished resolvconf update. container-test-run-flakelet-relay> client # [ 9800.327426] client systemd[1]: Reached target Preparation for Network. container-test-run-flakelet-relay> client # [ 9800.328602] client systemd[1]: Starting Address configuration of eth1... container-test-run-flakelet-relay> client # [ 9800.335188] client systemd[1]: Starting Extra networking commands.... container-test-run-flakelet-relay> client # [ 9800.335387] client systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> client # [ 9800.335562] client systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> client # [ 9800.338222] client systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> client # [ 9800.376138] client network-addresses-eth1-start[234]: adding address 192.168.1.2/24... done container-test-run-flakelet-relay> client # [ 9800.379470] client network-addresses-eth1-start[234]: adding address 2001:db8:1::2/64... done container-test-run-flakelet-relay> client # [ 9800.383484] client systemd[1]: Finished Address configuration of eth1. container-test-run-flakelet-relay> client # [ 9800.430942] client systemd[1]: Finished Extra networking commands.. container-test-run-flakelet-relay> client # [ 9800.431610] client systemd[1]: Reached target Network. container-test-run-flakelet-relay> client # [ 9800.466321] client systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> client # [ 9800.466470] client systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> client # [ 9800.468988] client systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 9800.328051] agent systemd[1]: Finished resolvconf update. container-test-run-flakelet-relay> agent # [ 9800.328195] agent systemd[1]: Reached target Preparation for Network. container-test-run-flakelet-relay> agent # [ 9800.334585] agent systemd[1]: Starting Address configuration of eth1... container-test-run-flakelet-relay> agent # [ 9800.335387] agent systemd[1]: Starting Extra networking commands.... container-test-run-flakelet-relay> agent # [ 9800.338650] agent systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9800.359204] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> agent # [ 9800.361886] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 9800.376945] agent network-addresses-eth1-start[237]: adding address 192.168.1.1/24... done container-test-run-flakelet-relay> agent # [ 9800.380156] agent network-addresses-eth1-start[237]: adding address 2001:db8:1::1/64... done container-test-run-flakelet-relay> agent # [ 9800.384690] agent systemd[1]: Finished Address configuration of eth1. container-test-run-flakelet-relay> agent # [ 9800.431844] agent systemd[1]: Finished Extra networking commands.. container-test-run-flakelet-relay> agent # [ 9800.431952] agent systemd[1]: Reached target Network. container-test-run-flakelet-relay> agent # [ 9800.433382] agent systemd[1]: Starting flakelet-agent... container-test-run-flakelet-relay> agent # [ 9800.434187] agent systemd[1]: Starting Update flakelet service app... container-test-run-flakelet-relay> agent # [ 9800.435107] agent systemd[1]: Starting Update flakelet service other... container-test-run-flakelet-relay> agent # [ 9800.455395] agent systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9800.466310] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> agent # [ 9800.469042] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 9800.474797] agent flakelet[305]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 9800.475294] agent flakelet[306]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 9800.475541] agent flakelet[305]: app: activating generation 1 container-test-run-flakelet-relay> agent # [ 9800.475701] agent flakelet[306]: other: activating generation 1 container-test-run-flakelet-relay> agent # [ 9800.481836] agent systemd[1]: Reload requested from client PID 320 ('systemctl') (unit flakelet-app.service)... container-test-run-flakelet-relay> agent # [ 9800.481899] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9800.500866] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:41.629972Z","level":"WARN","message":"SRV _flakelet-relay._tcp.test: lookup failed","target":"flakelet_agent"} container-test-run-flakelet-relay> relay # [ 9800.313178] relay systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-flakelet-relay> relay # [ 9800.359276] relay systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9800.359516] relay systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> relay # [ 9800.362093] relay systemd[1]: Finished resolvconf update. container-test-run-flakelet-relay> relay # [ 9800.363257] relay systemd[1]: Reached target Preparation for Network. container-test-run-flakelet-relay> relay # [ 9800.364536] relay systemd[1]: Starting Address configuration of eth1... container-test-run-flakelet-relay> relay # [ 9800.365674] relay systemd[1]: Starting Extra networking commands.... container-test-run-flakelet-relay> relay # [ 9800.367047] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> relay # [ 9800.387623] relay network-addresses-eth1-start[245]: adding address 192.168.1.3/24... done container-test-run-flakelet-relay> relay # [ 9800.390768] relay network-addresses-eth1-start[245]: adding address 2001:db8:1::3/64... done container-test-run-flakelet-relay> relay # [ 9800.396549] relay systemd[1]: Finished Address configuration of eth1. container-test-run-flakelet-relay> relay # [ 9800.429420] relay systemd[1]: Finished Extra networking commands.. container-test-run-flakelet-relay> relay # [ 9800.429698] relay systemd[1]: Reached target Network. container-test-run-flakelet-relay> relay # [ 9800.432292] relay systemd[1]: Starting Dnsmasq Daemon... container-test-run-flakelet-relay> relay # [ 9800.434600] relay systemd[1]: Starting flakelet-relay... container-test-run-flakelet-relay> relay # [ 9800.436278] relay systemd[1]: Starting Nginx Web Server... container-test-run-flakelet-relay> client # [ 9800.823816] client nsncd[303]: Sep 05 09:22:41.953 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-flakelet-relay> client # [ 9800.823832] client systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> client # [ 9800.823931] client systemd[1]: Reached target Host and Network Name Lookups. container-test-run-flakelet-relay> client # [ 9800.824033] client systemd[1]: Reached target User and Group Name Lookups. container-test-run-flakelet-relay> client # [ 9800.826296] client systemd[1]: Starting User Login Management... container-test-run-flakelet-relay> client # [ 9800.831969] client systemd[1]: Starting Permit User Sessions... container-test-run-flakelet-relay> client # [ 9800.877426] client systemd[1]: Finished Permit User Sessions. container-test-run-flakelet-relay> client # [ 9800.880430] client systemd[1]: Started Console Getty. container-test-run-flakelet-relay> client # [ 9800.880496] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-flakelet-relay> client # [ 9800.880524] client systemd[1]: Reached target Login Prompts. container-test-run-flakelet-relay> agent # [ 9800.817871] agent nsncd[311]: Sep 05 09:22:41.947 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-flakelet-relay> agent # [ 9800.927966] agent systemd[1]: Reloading finished in 445 ms. container-test-run-flakelet-relay> agent # [ 9801.001668] agent systemd[1]: Started flakelet-agent. container-test-run-flakelet-relay> agent # [ 9801.001840] agent systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> agent # [ 9801.002390] agent systemd[1]: Reload requested from client PID 321 ('systemctl') (unit flakelet-other.service)... container-test-run-flakelet-relay> agent # [ 9801.002437] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 9800.843682] relay nsncd[247]: Sep 05 09:22:41.972 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-flakelet-relay> relay # [ 9800.843978] relay systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> relay # [ 9800.844093] relay systemd[1]: Reached target Host and Network Name Lookups. container-test-run-flakelet-relay> relay # [ 9800.844191] relay systemd[1]: Reached target User and Group Name Lookups. container-test-run-flakelet-relay> relay # [ 9800.868653] relay systemd[1]: Starting User Login Management... container-test-run-flakelet-relay> relay # [ 9800.870064] relay systemd[1]: Starting Permit User Sessions... container-test-run-flakelet-relay> relay # [ 9800.880589] relay systemd[1]: Finished Permit User Sessions. container-test-run-flakelet-relay> relay # [ 9800.881671] relay systemd[1]: Started Console Getty. container-test-run-flakelet-relay> relay # [ 9800.881699] relay systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-flakelet-relay> relay # [ 9800.881712] relay systemd[1]: Reached target Login Prompts. container-test-run-flakelet-relay> relay # [ 9801.222843] relay dnsmasq-pre-start[335]: dnsmasq: syntax check OK. container-test-run-flakelet-relay> agent # [ 9801.354275] agent systemd[1]: Reloading finished in 351 ms. container-test-run-flakelet-relay> agent # [ 9801.433006] agent systemd[1]: Reached target Host and Network Name Lookups. container-test-run-flakelet-relay> agent # [ 9801.433135] agent systemd[1]: Reached target User and Group Name Lookups. container-test-run-flakelet-relay> agent # [ 9801.434906] agent systemd[1]: Starting User Login Management... container-test-run-flakelet-relay> agent # [ 9801.435879] agent systemd[1]: Starting Permit User Sessions... container-test-run-flakelet-relay> agent # [ 9801.443273] agent systemd[1]: Reload requested from client PID 765 ('systemctl') (unit flakelet-app.service)... container-test-run-flakelet-relay> agent # [ 9801.443309] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9801.808496] agent systemd[1]: Reloading finished in 364 ms. container-test-run-flakelet-relay> agent # [ 9801.875772] agent systemd[1]: Finished Permit User Sessions. container-test-run-flakelet-relay> agent # [ 9801.878357] agent systemd[1]: Started Console Getty. container-test-run-flakelet-relay> agent # [ 9801.878434] agent systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-flakelet-relay> agent # [ 9801.878516] agent systemd[1]: Reached target Login Prompts. container-test-run-flakelet-relay> agent # [ 9801.883802] agent systemd[1]: Reload requested from client PID 801 ('systemctl') (unit flakelet-other.service)... container-test-run-flakelet-relay> agent # [ 9801.883836] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 9801.845764] relay systemd[1]: Starting D-Bus System Message Bus... container-test-run-flakelet-relay> agent # [ 9802.227173] agent systemd[1]: Reloading finished in 342 ms. container-test-run-flakelet-relay> agent # [ 9802.279118] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 9802.317325] agent systemd[1]: Starting other v1... container-test-run-flakelet-relay> agent # [ 9802.321535] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> agent # [ 9802.328823] agent systemd[1]: Started other v1. container-test-run-flakelet-relay> agent # [ 9802.348330] agent flakelet[305]: app: updated to generation 1 container-test-run-flakelet-relay> agent # [ 9802.350359] agent systemd[1]: Finished Update flakelet service app. container-test-run-flakelet-relay> agent # [ 9802.353775] agent flakelet[306]: other: updated to generation 1 container-test-run-flakelet-relay> agent # [ 9802.355461] agent systemd[1]: Finished Update flakelet service other. container-test-run-flakelet-relay> agent # [ 9802.355598] agent systemd[1]: Reached target flakelet managed services. container-test-run-flakelet-relay> relay # [ 9802.294768] relay nginx-pre-start[340]: nginx: the configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf syntax is ok container-test-run-flakelet-relay> relay # [ 9802.295460] relay nginx-pre-start[340]: nginx: configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf test is successful container-test-run-flakelet-relay> relay # [ 9802.316790] relay systemd[1]: Started Nginx Web Server. container-test-run-flakelet-relay> relay # [ 9802.439808] relay dbus-broker-launch[339]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-flakelet-relay> relay # [ 9802.441426] relay dbus-broker-launch[339]: NSS returned no entry for 'systemd-timesync' container-test-run-flakelet-relay> relay # [ 9802.441426] relay dbus-broker-launch[339]: Invalid user-name in /nix/store/pd3rv2ciyy2nyh6p07ia27ibygignzlq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-flakelet-relay> relay # [ 9802.442567] relay systemd[1]: Started D-Bus System Message Bus. container-test-run-flakelet-relay> relay # [ 9802.448302] relay dbus-broker-launch[339]: Ready container-test-run-flakelet-relay> relay # [ 9802.451378] relay systemd[1]: Started Dnsmasq Daemon. container-test-run-flakelet-relay> relay # [ 9802.454222] relay dnsmasq[337]: started, version 2.93 cachesize 150 container-test-run-flakelet-relay> relay # [ 9802.454245] relay dnsmasq[337]: compile time options: IPv6 GNU-getopt DBus no-UBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP conntrack ipset nftset auth DNSSEC loop-detect inotify dumpfile container-test-run-flakelet-relay> relay # [ 9802.454260] relay dnsmasq[337]: DBus support enabled: connected to system bus container-test-run-flakelet-relay> relay # [ 9802.454277] relay dnsmasq[337]: no upstream servers configured - please set them from DBus container-test-run-flakelet-relay> relay # [ 9802.454425] relay dnsmasq[337]: read /etc/hosts - 9 names container-test-run-flakelet-relay> relay # [ 9802.503387] relay systemd-logind[323]: New seat seat0. container-test-run-flakelet-relay> relay # [ 9802.503756] relay systemd[1]: Started User Login Management. container-test-run-flakelet-relay> relay # [ 9802.512817] relay systemd[1]: Starting linger-users.service... container-test-run-flakelet-relay> relay # [ 9802.537966] relay systemd[1]: linger-users.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9802.538122] relay systemd[1]: Finished linger-users.service. container-test-run-flakelet-relay> client # [ 9802.481433] client systemd-logind[315]: New seat seat0. container-test-run-flakelet-relay> client # [ 9802.481854] client systemd[1]: Started User Login Management. container-test-run-flakelet-relay> client # [ 9802.484324] client systemd[1]: Starting D-Bus System Message Bus... container-test-run-flakelet-relay> client # [ 9802.485959] client systemd[1]: Starting linger-users.service... container-test-run-flakelet-relay> client # [ 9802.522221] client systemd[1]: linger-users.service: Deactivated successfully. container-test-run-flakelet-relay> client # [ 9802.522549] client systemd[1]: Finished linger-users.service. container-test-run-flakelet-relay> client # [ 9802.524032] client systemd[1]: Reached target Multi-User System. container-test-run-flakelet-relay> relay # [ 9802.805319] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:43.934385Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 9802.806146] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:43.935044Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 9802.805823] relay systemd[1]: Started flakelet-relay. container-test-run-flakelet-relay> relay # [ 9802.806082] relay systemd[1]: Reached target Multi-User System. container-test-run-flakelet-relay> relay # [ 9802.806311] relay systemd[1]: Startup finished in 4.216s. container-test-run-flakelet-relay> relay: (finished: waiting for unit flakelet-relay.service, in 5.16 seconds) container-test-run-flakelet-relay> relay: waiting for unit nginx.service container-test-run-flakelet-relay> relay: (finished: waiting for unit nginx.service, in 0.02 seconds) container-test-run-flakelet-relay> agent: waiting for unit flakelet.target container-test-run-flakelet-relay> agent # [ 9802.855392] agent systemd-logind[763]: New seat seat0. container-test-run-flakelet-relay> agent # [ 9802.855926] agent systemd[1]: Started User Login Management. container-test-run-flakelet-relay> agent # [ 9802.858273] agent systemd[1]: Starting D-Bus System Message Bus... container-test-run-flakelet-relay> agent # [ 9802.859758] agent systemd[1]: Starting linger-users.service... container-test-run-flakelet-relay> agent # [ 9802.901479] agent systemd[1]: linger-users.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9802.901914] agent systemd[1]: Finished linger-users.service. container-test-run-flakelet-relay> agent # [ 9802.903291] agent systemd[1]: Reached target Multi-User System. container-test-run-flakelet-relay> client # [ 9802.939058] client dbus-broker-launch[325]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-flakelet-relay> client # [ 9802.940572] client dbus-broker-launch[325]: NSS returned no entry for 'systemd-timesync' container-test-run-flakelet-relay> client # [ 9802.940572] client dbus-broker-launch[325]: Invalid user-name in /nix/store/3jlg9dnbk1xdcxk6rmb07a91hj8c8kb8-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-flakelet-relay> client # [ 9802.941654] client systemd[1]: Started D-Bus System Message Bus. container-test-run-flakelet-relay> client # [ 9802.942144] client systemd[1]: Startup finished in 4.349s. container-test-run-flakelet-relay> client # [ 9802.948371] client dbus-broker-launch[325]: Ready container-test-run-flakelet-relay> agent: (finished: waiting for unit flakelet.target, in 0.11 seconds) container-test-run-flakelet-relay> agent: waiting for unit flakelet-agent.service container-test-run-flakelet-relay> agent: (finished: waiting for unit flakelet-agent.service, in 0.02 seconds) container-test-run-flakelet-relay> client: waiting for unit multi-user.target container-test-run-flakelet-relay> client: (finished: waiting for unit multi-user.target, in 0.02 seconds) container-test-run-flakelet-relay> relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1' container-test-run-flakelet-relay> agent # [ 9803.266976] agent dbus-broker-launch[839]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-flakelet-relay> agent # [ 9803.268617] agent dbus-broker-launch[839]: NSS returned no entry for 'systemd-timesync' container-test-run-flakelet-relay> agent # [ 9803.268617] agent dbus-broker-launch[839]: Invalid user-name in /nix/store/q3c2gxfm178wqgzv8m87na4aa72wxc04-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-flakelet-relay> agent # [ 9803.269333] agent systemd[1]: Started D-Bus System Message Bus. container-test-run-flakelet-relay> agent # [ 9803.269941] agent systemd[1]: Startup finished in 4.677s. container-test-run-flakelet-relay> agent # [ 9803.274585] agent dbus-broker-launch[839]: Ready container-test-run-flakelet-relay> relay # [ 9805.609874] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:46.739068Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(1), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 9805.609438] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:46.738630Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 3.07 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl is-active app.service other.service container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl is-active app.service other.service, in 0.01 seconds) container-test-run-flakelet-relay> subtest: deploy with client certificate, relay found via SRV container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1 container-test-run-flakelet-relay> agent # [ 9806.503973] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:47.633101Z","level":"INFO","message":"start","id":"12789b685056a4b43e3e61b64b8fe8d1","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9806.504623] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:47.633910Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"12789b685056a4b43e3e61b64b8fe8d1\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9806.573596] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 9806.596109] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 9806.601153] agent flakelet[868]: app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2 container-test-run-flakelet-relay> agent # [ 9806.601951] agent flakelet[868]: app: activating generation 2 container-test-run-flakelet-relay> agent # [ 9806.616977] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 9806.618893] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9806.619260] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 9806.637467] agent systemd[1]: Reload requested from client PID 875 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9806.637553] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 9806.503064] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:47.632283Z","level":"INFO","message":"deploy accepted","job":"6af0a7ca099a0d6326fa9e5b7c4a84fb","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 9806.979758] agent systemd[1]: Reloading finished in 341 ms. container-test-run-flakelet-relay> agent # [ 9807.062327] agent systemd[1]: Reload requested from client PID 905 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9807.062386] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9807.390504] agent systemd[1]: Reloading finished in 327 ms. container-test-run-flakelet-relay> agent # [ 9807.460404] agent systemd[1]: Reload requested from client PID 934 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9807.460456] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9807.787840] agent systemd[1]: Reloading finished in 326 ms. container-test-run-flakelet-relay> agent # [ 9807.859400] agent systemd[1]: Reload requested from client PID 965 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9807.859450] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9808.188229] agent systemd[1]: Reloading finished in 328 ms. container-test-run-flakelet-relay> agent # [ 9808.249955] agent systemd[1]: Starting app v2... container-test-run-flakelet-relay> agent # [ 9808.281342] agent systemd[1]: Started app v2. container-test-run-flakelet-relay> agent # [ 9808.298784] agent flakelet[868]: app: updated to generation 2 container-test-run-flakelet-relay> agent # [ 9808.301116] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1, in 2.94 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl show app.service -p Description | grep -q 'app v2' container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v2', in 0.02 seconds) container-test-run-flakelet-relay> agent: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2' container-test-run-flakelet-relay> agent: (finished: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2', in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: deploy with client certificate, relay found via SRV, in 2.98 seconds) container-test-run-flakelet-relay> subtest: deploy with OIDC token, sub principal container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.05 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODYwMDQ3MCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NjAwMTcwLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1NVg0TDYzNVVNVVJPPT09IiwibmJmIjoxNzg4NjAwMTcwLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.TS3kCPN6xNrMa_DricocWp7GyiXz3ACrTTU9J-duv6TlHFBeJRweV6INelT0ilvlTaHcWIcTr__q_QtkF2ymBA' push --relay https://relay:7443 deploy agent/app 2>&1 container-test-run-flakelet-relay> agent # [ 9809.414685] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:50.543901Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(2)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9809.544154] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:50.673407Z","level":"INFO","message":"start","id":"b96912aeda20ac1b1744e093c22c33a3","flakelet":"app","rule":"ci","relay":"relay","caller":"Some(\"oidc:mock:repo:github:example/app:ref:refs/heads/main\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9809.544602] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:50.673890Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"b96912aeda20ac1b1744e093c22c33a3\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9809.601207] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 9809.631771] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 9809.636772] agent flakelet[1023]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 9809.637455] agent flakelet[1023]: app: activating generation 3 container-test-run-flakelet-relay> agent # [ 9809.651766] agent systemd[1]: Stopping app v2... container-test-run-flakelet-relay> agent # [ 9809.652299] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9809.652647] agent systemd[1]: Stopped app v2. container-test-run-flakelet-relay> agent # [ 9809.671892] agent systemd[1]: Reload requested from client PID 1030 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9809.671978] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 9809.415724] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:50.544952Z","level":"INFO","message":"deploy finished","job":"6af0a7ca099a0d6326fa9e5b7c4a84fb","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 9809.543940] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:50.673124Z","level":"INFO","message":"deploy accepted","job":"b897cf8b33afef1d52b81fc89e2819ae","caller":"oidc:mock:repo:github:example/app:ref:refs/heads/main","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 9810.010303] agent systemd[1]: Reloading finished in 337 ms. container-test-run-flakelet-relay> agent # [ 9810.080692] agent systemd[1]: Reload requested from client PID 1060 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9810.080787] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9810.408996] agent systemd[1]: Reloading finished in 327 ms. container-test-run-flakelet-relay> agent # [ 9810.470753] agent systemd[1]: Reload requested from client PID 1089 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9810.470846] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9810.800927] agent systemd[1]: Reloading finished in 329 ms. container-test-run-flakelet-relay> agent # [ 9810.875110] agent systemd[1]: Reload requested from client PID 1120 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9810.875159] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9811.202154] agent systemd[1]: Reloading finished in 326 ms. container-test-run-flakelet-relay> agent # [ 9811.269383] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 9811.300228] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> agent # [ 9811.318439] agent flakelet[1023]: app: updated to generation 3 container-test-run-flakelet-relay> agent # [ 9811.319460] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODYwMDQ3MCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NjAwMTcwLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1NVg0TDYzNVVNVVJPPT09IiwibmJmIjoxNzg4NjAwMTcwLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.TS3kCPN6xNrMa_DricocWp7GyiXz3ACrTTU9J-duv6TlHFBeJRweV6INelT0ilvlTaHcWIcTr__q_QtkF2ymBA' push --relay https://relay:7443 deploy agent/app 2>&1, in 2.92 seconds) container-test-run-flakelet-relay> (finished: subtest: deploy with OIDC token, sub principal, in 2.99 seconds) container-test-run-flakelet-relay> subtest: policy denies uncovered target container-test-run-flakelet-relay> client: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODYwMDQ3MCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NjAwMTcwLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1NVg0TDYzNVVNVVJPPT09IiwibmJmIjoxNzg4NjAwMTcwLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.TS3kCPN6xNrMa_DricocWp7GyiXz3ACrTTU9J-duv6TlHFBeJRweV6INelT0ilvlTaHcWIcTr__q_QtkF2ymBA' push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> client: (finished: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODYwMDQ3MCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NjAwMTcwLCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1NVg0TDYzNVVNVVJPPT09IiwibmJmIjoxNzg4NjAwMTcwLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.TS3kCPN6xNrMa_DricocWp7GyiXz3ACrTTU9J-duv6TlHFBeJRweV6INelT0ilvlTaHcWIcTr__q_QtkF2ymBA' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: policy denies uncovered target, in 0.02 seconds) container-test-run-flakelet-relay> subtest: claim principal from groups, unchanged counts as success container-test-run-flakelet-relay> client: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.05 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODYwMDQ3MywiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc4ODYwMDE3MywiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiU0NJRkdWM0xOS0dRSz09PSIsIm5iZiI6MTc4ODYwMDE3Mywic3ViIjoic29tZW9uZSJ9.FG88qNCBJzC4WBOW8J4gmGtSExZ-kPe463snEOw06Oz8H9BjjcF2ukfxKQ1JsugnMKqesQAMmpxbhDPR-gqBAg' push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> agent # [ 9812.432332] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:53.561495Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9812.534475] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:53.663657Z","level":"INFO","message":"start","id":"6c03f131bc50b0841a2f923b28175275","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"oidc:mock:groups:wheel\\noidc:mock:someone\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9812.534978] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:53.664266Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"6c03f131bc50b0841a2f923b28175275\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9812.591100] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 9812.623070] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 9812.628027] agent flakelet[1169]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 9812.628753] agent flakelet[1169]: other: up to date container-test-run-flakelet-relay> agent # [ 9812.631411] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9812.433320] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:53.562464Z","level":"INFO","message":"deploy finished","job":"b897cf8b33afef1d52b81fc89e2819ae","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 9812.533991] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:53.663215Z","level":"INFO","message":"deploy accepted","job":"568a6bee74f5f449e4aca1ab4ab0bce6","caller":"oidc:mock:groups:wheel\noidc:mock:someone","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODYwMDQ3MywiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc4ODYwMDE3MywiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiU0NJRkdWM0xOS0dRSz09PSIsIm5iZiI6MTc4ODYwMDE3Mywic3ViIjoic29tZW9uZSJ9.FG88qNCBJzC4WBOW8J4gmGtSExZ-kPe463snEOw06Oz8H9BjjcF2ukfxKQ1JsugnMKqesQAMmpxbhDPR-gqBAg' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.68 seconds) container-test-run-flakelet-relay> (finished: subtest: claim principal from groups, unchanged counts as success, in 0.73 seconds) container-test-run-flakelet-relay> subtest: push login via device flow, cached token used afterwards container-test-run-flakelet-relay> client: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1 container-test-run-flakelet-relay> agent # [ 9813.186551] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:54.315767Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> relay # [ 9813.187378] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:54.316619Z","level":"INFO","message":"deploy finished","job":"568a6bee74f5f449e4aca1ab4ab0bce6","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 9813.211606] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [05/Sep/2026 09:22:54] "POST /device HTTP/1.1" 200 - container-test-run-flakelet-relay> relay # [ 9814.216593] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [05/Sep/2026 09:22:55] "POST /token HTTP/1.1" 400 - container-test-run-flakelet-relay> client: (finished: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1, in 2.07 seconds) container-test-run-flakelet-relay> client: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600 container-test-run-flakelet-relay> client: (finished: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> agent # [ 9815.295885] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:56.425099Z","level":"INFO","message":"start","id":"7f84ba214999158fd38434cb2bd74a1b","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"oidc:mock:groups:wheel\\noidc:mock:someone\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9815.296856] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:56.425602Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"7f84ba214999158fd38434cb2bd74a1b\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9815.359113] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 9815.378718] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 9815.382756] agent flakelet[1187]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 9815.383496] agent flakelet[1187]: other: up to date container-test-run-flakelet-relay> agent # [ 9815.386479] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9815.260895] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [05/Sep/2026 09:22:56] "POST /token HTTP/1.1" 200 - container-test-run-flakelet-relay> relay # [ 9815.295583] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:56.424804Z","level":"INFO","message":"deploy accepted","job":"a029b83a921e693cf26756d06fc3ea98","caller":"oidc:mock:groups:wheel\noidc:mock:someone","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 0.67 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> agent # [ 9815.946283] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:57.075500Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9815.968298] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:57.097500Z","level":"INFO","message":"start","id":"60a52f8fdb022d88dbc660aa26d8e78c","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"oidc:mock:groups:wheel\\noidc:mock:someone\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9815.968779] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:57.098024Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"60a52f8fdb022d88dbc660aa26d8e78c\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9816.032714] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 9816.057767] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 9816.063280] agent flakelet[1205]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 9816.064036] agent flakelet[1205]: other: up to date container-test-run-flakelet-relay> agent # [ 9816.066835] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9815.947138] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:57.076312Z","level":"INFO","message":"deploy finished","job":"a029b83a921e693cf26756d06fc3ea98","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 9815.967879] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:57.097114Z","level":"INFO","message":"deploy accepted","job":"76955167c5621997a8e1f1ea6aabc3fc","caller":"oidc:mock:groups:wheel\noidc:mock:someone","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 0.68 seconds) container-test-run-flakelet-relay> (finished: subtest: push login via device flow, cached token used afterwards, in 3.44 seconds) container-test-run-flakelet-relay> subtest: waves: failing first wave skips the second container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1 container-test-run-flakelet-relay> agent # [ 9816.624666] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:57.753845Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9816.662444] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:57.791652Z","level":"INFO","message":"start","id":"d18e30caa86678479034a64c31ba355c","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9816.662939] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:22:57.792187Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"d18e30caa86678479034a64c31ba355c\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9816.722230] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 9816.743327] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 9816.748680] agent flakelet[1226]: app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken container-test-run-flakelet-relay> agent # [ 9816.749360] agent flakelet[1226]: app: activating generation 4 container-test-run-flakelet-relay> agent # [ 9816.764827] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 9816.765376] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9816.765728] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 9816.786674] agent systemd[1]: Reload requested from client PID 1233 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9816.786759] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 9816.625359] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:57.754565Z","level":"INFO","message":"deploy finished","job":"76955167c5621997a8e1f1ea6aabc3fc","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 9816.662036] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:22:57.791254Z","level":"INFO","message":"deploy accepted","job":"4c7c4b8823e7193fda2f5f7b0b37ca1b","caller":"x509:email:admin@example.org","targets":"[\"agent/app\", \"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 9817.130239] agent systemd[1]: Reloading finished in 342 ms. container-test-run-flakelet-relay> agent # [ 9817.176306] agent systemd[1]: Reload requested from client PID 1263 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9817.176358] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9817.505393] agent systemd[1]: Reloading finished in 328 ms. container-test-run-flakelet-relay> agent # [ 9817.556780] agent systemd[1]: Reload requested from client PID 1292 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9817.556833] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9817.887782] agent systemd[1]: Reloading finished in 330 ms. container-test-run-flakelet-relay> agent # [ 9817.952228] agent systemd[1]: Reload requested from client PID 1323 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9817.952276] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9818.274311] agent systemd[1]: Reloading finished in 321 ms. container-test-run-flakelet-relay> agent # [ 9818.340025] agent systemd[1]: Starting app broken... container-test-run-flakelet-relay> agent # [ 9818.370306] agent (nonexistent)[1353]: app.service: Unable to locate executable '/nonexistent': No such file or directory container-test-run-flakelet-relay> agent # [ 9818.370329] agent (nonexistent)[1353]: app.service: Failed at step EXEC spawning /nonexistent: No such file or directory container-test-run-flakelet-relay> agent # [ 9818.371612] agent systemd[1]: app.service: Main process exited, code=exited, status=203/EXEC container-test-run-flakelet-relay> agent # [ 9818.371736] agent systemd[1]: app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> agent # [ 9818.372166] agent systemd[1]: Failed to start app broken. container-test-run-flakelet-relay> agent # [ 9818.423384] agent systemd[1]: Reload requested from client PID 1360 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9818.423457] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9818.759898] agent systemd[1]: Reloading finished in 335 ms. container-test-run-flakelet-relay> agent # [ 9818.839567] agent systemd[1]: Reload requested from client PID 1390 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9818.839627] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9819.176991] agent systemd[1]: Reloading finished in 336 ms. container-test-run-flakelet-relay> agent # [ 9819.256039] agent systemd[1]: Reload requested from client PID 1420 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9819.256080] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9819.586958] agent systemd[1]: Reloading finished in 330 ms. container-test-run-flakelet-relay> agent # [ 9819.678749] agent systemd[1]: Reload requested from client PID 1450 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9819.678839] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9820.007296] agent systemd[1]: Reloading finished in 327 ms. container-test-run-flakelet-relay> agent # [ 9820.083391] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 9820.121662] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> agent # [ 9820.122908] agent flakelet[1226]: app: deploy failed, rolled back: systemctl start app.service failed: container-test-run-flakelet-relay> agent # [ 9820.122908] agent flakelet[1226]: failed units: app.service. See journalctl -u app.service container-test-run-flakelet-relay> agent # [ 9820.125296] agent systemd[1]: flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> agent # [ 9820.125408] agent systemd[1]: flakelet-relay-job-app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1, in 4.19 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl show app.service -p Description | grep -q 'app v1' container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v1', in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: waves: failing first wave skips the second, in 4.22 seconds) container-test-run-flakelet-relay> subtest: detach returns once the job is accepted container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1 container-test-run-flakelet-relay> client: (finished: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> agent: waiting for success: systemctl is-active flakelet-relay-job-app.service container-test-run-flakelet-relay> agent # [ 9820.829782] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:23:01.958998Z","level":"INFO","message":"update finished","flakelet":"app","status":"RolledBack","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9820.884364] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:23:02.013533Z","level":"INFO","message":"start","id":"424691955d403bae68bd5aef2d4e9fee","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9820.884589] agent flakelet-agent[304]: {"timestamp":"2026-09-05T09:23:02.013852Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"424691955d403bae68bd5aef2d4e9fee\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9820.925524] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 9820.959882] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 9820.964694] agent flakelet[1505]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2 container-test-run-flakelet-relay> agent # [ 9820.965342] agent flakelet[1505]: app: activating generation 4 container-test-run-flakelet-relay> agent # [ 9820.979263] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 9820.979788] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9820.980164] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 9820.999174] agent systemd[1]: Reload requested from client PID 1512 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9820.999226] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 9820.830798] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:01.960062Z","level":"INFO","message":"deploy finished","job":"4c7c4b8823e7193fda2f5f7b0b37ca1b","ok":false,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 9820.884050] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:02.013265Z","level":"INFO","message":"deploy accepted","job":"fd5cdabf896963f201ed75292ecf7d96","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 9821.332720] agent systemd[1]: Reloading finished in 333 ms. container-test-run-flakelet-relay> agent # [ 9821.417716] agent systemd[1]: Reload requested from client PID 1542 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9821.417768] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9821.747158] agent systemd[1]: Reloading finished in 328 ms. container-test-run-flakelet-relay> agent # [ 9821.815612] agent systemd[1]: Reload requested from client PID 1571 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9821.815663] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: waiting for success: systemctl is-active flakelet-relay-job-app.service, in 1.32 seconds) container-test-run-flakelet-relay> ??? Warning (UserWarning): wait_until_fails(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. container-test-run-flakelet-relay> File "/nix/store/fv4yr9c0f9kyrfc00100i4rlshiiidbd-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 container-test-run-flakelet-relay> agent: waiting for failure: systemctl is-active flakelet-relay-job-app.service container-test-run-flakelet-relay> ??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. container-test-run-flakelet-relay> File "/nix/store/fv4yr9c0f9kyrfc00100i4rlshiiidbd-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 container-test-run-flakelet-relay> agent # [ 9822.143819] agent systemd[1]: Reloading finished in 327 ms. container-test-run-flakelet-relay> agent # [ 9822.217370] agent systemd[1]: Reload requested from client PID 1604 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9822.217412] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9822.547319] agent systemd[1]: Reloading finished in 329 ms. container-test-run-flakelet-relay> agent # [ 9822.618665] agent systemd[1]: Starting app slow2... container-test-run-flakelet-relay> agent # [ 9828.696317] agent systemd[1]: Started app slow2. container-test-run-flakelet-relay> agent # [ 9828.721284] agent flakelet[1505]: app: updated to generation 4 container-test-run-flakelet-relay> agent # [ 9828.724716] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> agent: (finished: waiting for failure: systemctl is-active flakelet-relay-job-app.service, in 7.50 seconds) container-test-run-flakelet-relay> (finished: subtest: detach returns once the job is accepted, in 8.86 seconds) container-test-run-flakelet-relay> subtest: unknown host is final, missing agent is retried, agents listing container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1 container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl stop flakelet-agent container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl stop flakelet-agent, in 0.04 seconds) container-test-run-flakelet-relay> relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0' container-test-run-flakelet-relay> relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out container-test-run-flakelet-relay> agent # [ 9829.744879] agent systemd[1]: Stopping flakelet-agent... container-test-run-flakelet-relay> agent # [ 9829.770395] agent systemd[1]: flakelet-agent.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9829.771014] agent systemd[1]: Stopped flakelet-agent. container-test-run-flakelet-relay> relay # [ 9829.746445] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:10.875648Z","level":"INFO","message":"agent disconnected: websocket closed","host":"agent","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out, in 1.02 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl start flakelet-agent container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl start flakelet-agent, in 0.07 seconds) container-test-run-flakelet-relay> ??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. container-test-run-flakelet-relay> File "/nix/store/fv4yr9c0f9kyrfc00100i4rlshiiidbd-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out container-test-run-flakelet-relay> agent # [ 9830.832832] agent systemd[1]: Starting flakelet-agent... container-test-run-flakelet-relay> agent # [ 9830.890098] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:12.019338Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"424691955d403bae68bd5aef2d4e9fee\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9830.890307] agent systemd[1]: Started flakelet-agent. container-test-run-flakelet-relay> agent # [ 9830.996188] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:12.125386Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 9830.996340] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:12.125548Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(4), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 9831.459127] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:12.588357Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(4)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9832.817499] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:13.946698Z","level":"INFO","message":"start","id":"6ad9b875759ee7a1943e89f54182617f","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9832.818475] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:13.947267Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"6ad9b875759ee7a1943e89f54182617f\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9832.883657] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 9832.921158] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 9832.927271] agent flakelet[2071]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 9832.927926] agent flakelet[2071]: other: up to date container-test-run-flakelet-relay> agent # [ 9832.929491] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9832.817168] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:13.946384Z","level":"INFO","message":"deploy accepted","job":"52b462e6205662acd1e3329c8c354295","caller":"x509:email:admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 9833.485633] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:14.614792Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> relay # [ 9833.486454] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:14.615660Z","level":"INFO","message":"deploy finished","job":"52b462e6205662acd1e3329c8c354295","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out, in 3.04 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.05 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODYwMDQ5NSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NjAwMTk1LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1R1JJRVlKMk9MVEhJPT09IiwibmJmIjoxNzg4NjAwMTk1LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.9NaTAh2b51AMxjmM00AhfVtYzjXMO-q8B9Y41OiUjQ5jluP6YQ2Jtl8UhRBet0FRxDtaT-QxEXzqh0NBb9c8DQ' push --relay https://relay:7443 agents container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODYwMDQ5NSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NjAwMTk1LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI1R1JJRVlKMk9MVEhJPT09IiwibmJmIjoxNzg4NjAwMTk1LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.9NaTAh2b51AMxjmM00AhfVtYzjXMO-q8B9Y41OiUjQ5jluP6YQ2Jtl8UhRBet0FRxDtaT-QxEXzqh0NBb9c8DQ' push --relay https://relay:7443 agents, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: unknown host is final, missing agent is retried, agents listing, in 4.31 seconds) container-test-run-flakelet-relay> subtest: certificate not listed under agents cannot connect as agent container-test-run-flakelet-relay> client: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent container-test-run-flakelet-relay> client: (finished: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: certificate not listed under agents cannot connect as agent, in 0.02 seconds) container-test-run-flakelet-relay> subtest: metrics container-test-run-flakelet-relay> relay: must succeed: curl -sf http://127.0.0.1:7400/metrics container-test-run-flakelet-relay> relay: (finished: must succeed: curl -sf http://127.0.0.1:7400/metrics, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: metrics, in 0.01 seconds) container-test-run-flakelet-relay> subtest: agent link drop mid-run replays missed lines once container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: date +%s container-test-run-flakelet-relay> agent: (finished: must succeed: date +%s, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788600195 | grep -q 'app-slow' container-test-run-flakelet-relay> relay # [ 9834.041977] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:15.171235Z","level":"INFO","message":"agent rejected: no agents entry matches","principals":"[\"x509:dns:mallory\"]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> relay # [ 9834.094984] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:15.224204Z","level":"INFO","message":"deploy accepted","job":"afda3db5d68ad6337a79df5480bd18d8","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 9834.095279] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:15.224514Z","level":"INFO","message":"start","id":"520637ba23e35b5e2f01ee67b368c7b8","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9834.096163] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:15.224891Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"520637ba23e35b5e2f01ee67b368c7b8\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9834.158630] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 9834.196088] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 9834.201100] agent flakelet[2096]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent # [ 9834.201868] agent flakelet[2096]: app: activating generation 5 container-test-run-flakelet-relay> agent # [ 9834.217704] agent systemd[1]: Stopping app slow2... container-test-run-flakelet-relay> agent # [ 9834.218219] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9834.218560] agent systemd[1]: Stopped app slow2. container-test-run-flakelet-relay> agent # [ 9834.237698] agent systemd[1]: Reload requested from client PID 2103 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9834.237784] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9834.587495] agent systemd[1]: Reloading finished in 348 ms. container-test-run-flakelet-relay> agent # [ 9834.675385] agent systemd[1]: Reload requested from client PID 2133 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9834.675440] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788600195 | grep -q 'app-slow', in 1.03 seconds) container-test-run-flakelet-relay> agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done container-test-run-flakelet-relay> agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done, in 0.02 seconds) container-test-run-flakelet-relay> relay: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done container-test-run-flakelet-relay> relay: (finished: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done, in 0.06 seconds) container-test-run-flakelet-relay> agent: must succeed: ss -K dport = 7443 container-test-run-flakelet-relay> agent: (finished: must succeed: ss -K dport = 7443, in 0.03 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788600195 | grep -q 'updated to generation' container-test-run-flakelet-relay> agent # [ 9835.005827] agent systemd[1]: Reloading finished in 329 ms. container-test-run-flakelet-relay> agent # [ 9835.096751] agent systemd[1]: Reload requested from client PID 2162 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9835.096804] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9835.216626] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:16.345847Z","level":"INFO","message":"disconnected: Software caused connection abort (os error 103)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 9835.181857] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:16.311118Z","level":"INFO","message":"agent disconnected: Software caused connection abort (os error 103)","host":"agent","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 9835.430379] agent systemd[1]: Reloading finished in 333 ms. container-test-run-flakelet-relay> agent # [ 9835.496314] agent systemd[1]: Reload requested from client PID 2207 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9835.496348] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9835.829083] agent systemd[1]: Reloading finished in 332 ms. container-test-run-flakelet-relay> agent # [ 9835.897644] agent systemd[1]: Starting app slow... container-test-run-flakelet-relay> agent # [ 9836.219429] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:17.348642Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9838.222795] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:19.352007Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9841.969265] agent systemd[1]: Started app slow. container-test-run-flakelet-relay> agent # [ 9841.993922] agent flakelet[2096]: app: updated to generation 5 container-test-run-flakelet-relay> agent # [ 9841.997294] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788600195 | grep -q 'updated to generation', in 7.11 seconds) container-test-run-flakelet-relay> agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done container-test-run-flakelet-relay> agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done, in 0.02 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out container-test-run-flakelet-relay> agent # [ 9842.226186] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:23.355246Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9843.094028] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:24.223227Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(5)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out, in 8.10 seconds) container-test-run-flakelet-relay> client: must succeed: cat /tmp/slow.out container-test-run-flakelet-relay> client: (finished: must succeed: cat /tmp/slow.out, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: agent link drop mid-run replays missed lines once, in 16.40 seconds) container-test-run-flakelet-relay> subtest: agent restart mid-run reattaches to the unit container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2' container-test-run-flakelet-relay> agent # [ 9850.319148] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:31.448400Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9850.320091] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:31.448743Z","level":"INFO","message":"start","id":"520637ba23e35b5e2f01ee67b368c7b8","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9850.492751] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:31.621959Z","level":"INFO","message":"start","id":"306cc3ade78fab75774a8f785da01b11","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9850.493271] agent flakelet-agent[1658]: {"timestamp":"2026-09-05T09:23:31.622556Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"306cc3ade78fab75774a8f785da01b11\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9850.554805] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> relay # [ 9850.319339] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:31.448545Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(5), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> relay # [ 9850.320405] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:31.449170Z","level":"INFO","message":"deploy finished","job":"afda3db5d68ad6337a79df5480bd18d8","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 9850.492493] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:31.621723Z","level":"INFO","message":"deploy accepted","job":"5907808eb0f934f250a6187bbbf5e0b3","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 9850.584939] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 9850.589332] agent flakelet[2308]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2 container-test-run-flakelet-relay> agent # [ 9850.590107] agent flakelet[2308]: app: activating generation 6 container-test-run-flakelet-relay> agent # [ 9850.604195] agent systemd[1]: Stopping app slow... container-test-run-flakelet-relay> agent # [ 9850.605135] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9850.605317] agent systemd[1]: Stopped app slow. container-test-run-flakelet-relay> agent # [ 9850.619320] agent systemd[1]: Reload requested from client PID 2315 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9850.619407] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9850.962700] agent systemd[1]: Reloading finished in 342 ms. container-test-run-flakelet-relay> agent # [ 9851.031989] agent systemd[1]: Reload requested from client PID 2345 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9851.032094] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2', in 1.03 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl restart flakelet-agent container-test-run-flakelet-relay> agent # [ 9851.363910] agent systemd[1]: Reloading finished in 331 ms. container-test-run-flakelet-relay> agent # [ 9851.433198] agent systemd[1]: Reload requested from client PID 2374 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9851.433239] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9851.766374] agent systemd[1]: Reloading finished in 332 ms. container-test-run-flakelet-relay> agent # [ 9851.825196] agent systemd[1]: Stopping flakelet-agent... container-test-run-flakelet-relay> agent # [ 9851.833267] agent systemd[1]: Reload requested from client PID 2409 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9851.833306] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 9851.825580] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:32.954784Z","level":"INFO","message":"agent disconnected: websocket closed","host":"agent","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl restart flakelet-agent, in 0.78 seconds) container-test-run-flakelet-relay> agent: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)" container-test-run-flakelet-relay> agent: (finished: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)", in 0.01 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out container-test-run-flakelet-relay> agent # [ 9852.168756] agent systemd[1]: Reloading finished in 335 ms. container-test-run-flakelet-relay> agent # [ 9852.225631] agent systemd[1]: flakelet-agent.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9852.225918] agent systemd[1]: Stopped flakelet-agent. container-test-run-flakelet-relay> agent # [ 9852.230153] agent systemd[1]: Starting flakelet-agent... container-test-run-flakelet-relay> agent # [ 9852.232813] agent systemd[1]: Starting app slow2... container-test-run-flakelet-relay> agent # [ 9852.287232] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:33.416451Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"306cc3ade78fab75774a8f785da01b11\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9852.287313] agent systemd[1]: Started flakelet-agent. container-test-run-flakelet-relay> agent # [ 9852.396742] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:33.525964Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9852.397052] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:33.526339Z","level":"INFO","message":"start","id":"306cc3ade78fab75774a8f785da01b11","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 9852.396928] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:33.526132Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(5), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 9858.299197] agent systemd[1]: Started app slow2. container-test-run-flakelet-relay> agent # [ 9858.320826] agent flakelet[2308]: app: updated to generation 6 container-test-run-flakelet-relay> agent # [ 9858.324305] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9858.893053] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:40.022272Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(6)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> relay # [ 9858.893947] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:40.023179Z","level":"INFO","message":"deploy finished","job":"5907808eb0f934f250a6187bbbf5e0b3","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out, in 7.08 seconds) container-test-run-flakelet-relay> client: must succeed: cat /tmp/restart.out container-test-run-flakelet-relay> client: (finished: must succeed: cat /tmp/restart.out, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl is-active app.service container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl is-active app.service, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: agent restart mid-run reattaches to the unit, in 8.95 seconds) container-test-run-flakelet-relay> subtest: relay restart mid-run, push resumes via /v1/jobs container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: date +%s container-test-run-flakelet-relay> agent: (finished: must succeed: date +%s, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788600220 | grep -q 'app-slow' container-test-run-flakelet-relay> agent # [ 9859.450736] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:40.579958Z","level":"INFO","message":"start","id":"ad85b412876b6a89a25f87ecb420f931","flakelet":"app","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9859.451053] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:40.580336Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"ad85b412876b6a89a25f87ecb420f931\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9859.505684] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 9859.537779] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 9859.543049] agent flakelet[2875]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent # [ 9859.543804] agent flakelet[2875]: app: activating generation 7 container-test-run-flakelet-relay> agent # [ 9859.559717] agent systemd[1]: Stopping app slow2... container-test-run-flakelet-relay> agent # [ 9859.560252] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 9859.560595] agent systemd[1]: Stopped app slow2. container-test-run-flakelet-relay> agent # [ 9859.581365] agent systemd[1]: Reload requested from client PID 2882 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9859.581453] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 9859.450443] relay flakelet-relay[306]: {"timestamp":"2026-09-05T09:23:40.579693Z","level":"INFO","message":"deploy accepted","job":"d429113a99f15c533ab5e632ef438473","caller":"x509:email:admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 9859.923726] agent systemd[1]: Reloading finished in 341 ms. container-test-run-flakelet-relay> agent # [ 9859.970233] agent systemd[1]: Reload requested from client PID 2912 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9859.970320] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9860.302745] agent systemd[1]: Reloading finished in 331 ms. container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1788600220 | grep -q 'app-slow', in 1.03 seconds) container-test-run-flakelet-relay> relay: must succeed: systemctl restart flakelet-relay container-test-run-flakelet-relay> agent # [ 9860.357768] agent systemd[1]: Reload requested from client PID 2941 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9860.357818] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9860.477991] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:41.607208Z","level":"INFO","message":"disconnected: websocket closed","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 9860.477447] relay systemd[1]: Stopping flakelet-relay... container-test-run-flakelet-relay> relay # [ 9860.519199] relay systemd[1]: flakelet-relay.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9860.519673] relay systemd[1]: Stopped flakelet-relay. container-test-run-flakelet-relay> relay # [ 9860.519707] relay systemd[1]: flakelet-relay.service: Consumed 2.478s CPU time over 1min 84ms wall clock time. container-test-run-flakelet-relay> relay # [ 9860.549743] relay systemd[1]: Starting flakelet-relay... container-test-run-flakelet-relay> agent # [ 9860.699751] agent systemd[1]: Reloading finished in 341 ms. container-test-run-flakelet-relay> agent # [ 9860.789379] agent systemd[1]: Reload requested from client PID 2975 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 9860.789418] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 9861.124231] agent systemd[1]: Reloading finished in 334 ms. container-test-run-flakelet-relay> agent # [ 9861.201240] agent systemd[1]: Starting app slow... container-test-run-flakelet-relay> agent # [ 9861.481604] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:42.610655Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.48 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q '» ok' /tmp/resume.out container-test-run-flakelet-relay> relay # [ 9861.943375] relay flakelet-relay[867]: {"timestamp":"2026-09-05T09:23:43.072602Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 9861.944200] relay flakelet-relay[867]: {"timestamp":"2026-09-05T09:23:43.073102Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 9861.943922] relay systemd[1]: Started flakelet-relay. container-test-run-flakelet-relay> relay # [ 9863.594396] relay flakelet-relay[867]: {"timestamp":"2026-09-05T09:23:44.723601Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(6), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 9863.594220] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:44.723419Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9867.268415] agent systemd[1]: Started app slow. container-test-run-flakelet-relay> agent # [ 9867.290059] agent flakelet[2875]: app: updated to generation 7 container-test-run-flakelet-relay> agent # [ 9867.293409] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9867.502444] relay flakelet-relay[867]: {"timestamp":"2026-09-05T09:23:48.631696Z","level":"INFO","message":"job reattached","job":"d429113a99f15c533ab5e632ef438473","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 9868.385127] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:49.514347Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(7)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q '» ok' /tmp/resume.out, in 7.09 seconds) container-test-run-flakelet-relay> client: must succeed: cat /tmp/resume.out container-test-run-flakelet-relay> client: (finished: must succeed: cat /tmp/resume.out, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: relay restart mid-run, push resumes via /v1/jobs, in 9.64 seconds) container-test-run-flakelet-relay> subtest: job history comes from the agents and survives a relay restart container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1 container-test-run-flakelet-relay> agent # [ 9869.061681] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:50.190874Z","level":"INFO","message":"start","id":"5be20c693e5c0b60e3f85779794dfb86","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9869.062217] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:50.191502Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5be20c693e5c0b60e3f85779794dfb86\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9869.127153] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 9869.153334] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 9869.158532] agent flakelet[3042]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 9869.159073] agent flakelet[3042]: other: up to date container-test-run-flakelet-relay> agent # [ 9869.162088] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9869.061226] relay flakelet-relay[867]: {"timestamp":"2026-09-05T09:23:50.190445Z","level":"INFO","message":"deploy accepted","job":"188b06c4636b65849b3ba8daac22dc7c","caller":"x509:email:admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1, in 0.68 seconds) container-test-run-flakelet-relay> relay: must succeed: systemctl restart flakelet-relay container-test-run-flakelet-relay> agent # [ 9869.719597] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:50.848759Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9869.737124] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:50.866388Z","level":"INFO","message":"disconnected: websocket closed","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 9869.720495] relay flakelet-relay[867]: {"timestamp":"2026-09-05T09:23:50.849704Z","level":"INFO","message":"deploy finished","job":"188b06c4636b65849b3ba8daac22dc7c","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 9869.736814] relay systemd[1]: Stopping flakelet-relay... container-test-run-flakelet-relay> relay # [ 9869.768268] relay systemd[1]: flakelet-relay.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9869.768764] relay systemd[1]: Stopped flakelet-relay. container-test-run-flakelet-relay> relay # [ 9869.768802] relay systemd[1]: flakelet-relay.service: Consumed 1.647s CPU time over 9.218s wall clock time. container-test-run-flakelet-relay> relay # [ 9869.805038] relay systemd[1]: Starting flakelet-relay... container-test-run-flakelet-relay> agent # [ 9870.740329] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:51.869526Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.45 seconds) container-test-run-flakelet-relay> relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1' container-test-run-flakelet-relay> relay # [ 9871.166560] relay flakelet-relay[1257]: {"timestamp":"2026-09-05T09:23:52.295799Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 9871.167102] relay flakelet-relay[1257]: {"timestamp":"2026-09-05T09:23:52.296297Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 9871.167129] relay systemd[1]: Started flakelet-relay. container-test-run-flakelet-relay> relay # [ 9872.842043] relay flakelet-relay[1257]: {"timestamp":"2026-09-05T09:23:53.971228Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 2.06 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.05 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODYwMDUzNCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NjAwMjM0LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJQUUNDRzNZMlhQT05XPT09IiwibmJmIjoxNzg4NjAwMjM0LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.UwsgDhe3M7gqjkO8bn7A4UvTDpjVT9xAFq8xj7FRntbWNB0rRjhIK5cXv7wV6A36rpjGdB2-NakH5FLNrDoNBg' push --relay https://relay:7443 jobs container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4ODYwMDUzNCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg4NjAwMjM0LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJQUUNDRzNZMlhQT05XPT09IiwibmJmIjoxNzg4NjAwMjM0LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.UwsgDhe3M7gqjkO8bn7A4UvTDpjVT9xAFq8xj7FRntbWNB0rRjhIK5cXv7wV6A36rpjGdB2-NakH5FLNrDoNBg' push --relay https://relay:7443 jobs, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: job history comes from the agents and survives a relay restart, in 4.28 seconds) container-test-run-flakelet-relay> subtest: dashboard login via authorization code flow container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login' container-test-run-flakelet-relay> agent # [ 9872.841795] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:53.971017Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login, in 0.08 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist1 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist1, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 403 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 403, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/015fc657227e01f70457877efaf55830/events || true container-test-run-flakelet-relay> agent # [ 9873.515142] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:54.644293Z","level":"INFO","message":"start","id":"4a6a7d89cd66a038cc234fc4ea7faf24","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"oidc:mock:someone\\noidc:mock:groups:wheel\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9873.515543] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:54.644827Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"4a6a7d89cd66a038cc234fc4ea7faf24\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9873.571857] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 9873.594079] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 9873.599358] agent flakelet[3070]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 9873.600140] agent flakelet[3070]: other: up to date container-test-run-flakelet-relay> agent # [ 9873.601601] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9873.370304] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [05/Sep/2026 09:23:54] "GET /authorize?response_type=code&client_id=dashboard&redirect_uri=https%3A%2F%2Frelay%3A7443%2Fui%2Fcallback&scope=openid%20profile%20email%20groups&state=rz4LvzBZZT-MNAM22dANSjNhgJlw1lXn0im37SQ_AV8&code_challenge=pm_bU7QtH7DJxIG2PAytzuO7rRxgDuHCPf8d36Veq8Q&code_challenge_method=S256 HTTP/1.1" 302 - container-test-run-flakelet-relay> relay # [ 9873.415939] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [05/Sep/2026 09:23:54] "POST /token HTTP/1.1" 200 - container-test-run-flakelet-relay> relay # [ 9873.417195] relay flakelet-relay[1257]: {"timestamp":"2026-09-05T09:23:54.546460Z","level":"INFO","message":"login","name":"someone","principals":"[\"oidc:mock:someone\", \"oidc:mock:groups:wheel\"]","target":"flakelet_relay::relay::login"} container-test-run-flakelet-relay> relay # [ 9873.478221] relay flakelet-relay[1257]: {"timestamp":"2026-09-05T09:23:54.607441Z","level":"INFO","message":"job reattached","job":"188b06c4636b65849b3ba8daac22dc7c","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 9873.514723] relay flakelet-relay[1257]: {"timestamp":"2026-09-05T09:23:54.643942Z","level":"INFO","message":"deploy accepted","job":"57f2d47d32122aa4b3e6b26acb701dbe","caller":"oidc:mock:someone\noidc:mock:groups:wheel","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 9873.531974] relay flakelet-relay[1257]: {"timestamp":"2026-09-05T09:23:54.661213Z","level":"INFO","message":"job reattached","job":"57f2d47d32122aa4b3e6b26acb701dbe","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/015fc657227e01f70457877efaf55830/events || true, in 0.65 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/015fc657227e01f70457877efaf55830 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/015fc657227e01f70457877efaf55830, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=015fc657227e01f70457877efaf55830' | grep -q 400 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=015fc657227e01f70457877efaf55830' | grep -q 400, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other container-test-run-flakelet-relay> » job 38796a7ba508eadfe82a1cd5def000bc via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/other | Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent/other | Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 9874.159840] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:55.289065Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9874.307215] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:55.436420Z","level":"INFO","message":"start","id":"5e317fc57863c2a7c03ebe1bdacd1356","flakelet":"other","rule":"admins","relay":"relay","caller":"Some(\"x509:email:admin@example.org\")","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 9874.307706] agent flakelet-agent[2440]: {"timestamp":"2026-09-05T09:23:55.436953Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5e317fc57863c2a7c03ebe1bdacd1356\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 9874.370112] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 9874.398670] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 9874.403992] agent flakelet[3088]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 9874.404802] agent flakelet[3088]: other: up to date container-test-run-flakelet-relay> agent # [ 9874.407372] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> agent/other | other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent/other | other: up to date container-test-run-flakelet-relay> agent/other | flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 9874.306919] relay flakelet-relay[1257]: {"timestamp":"2026-09-05T09:23:55.436136Z","level":"INFO","message":"deploy accepted","job":"38796a7ba508eadfe82a1cd5def000bc","caller":"x509:email:admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> » agent/other: unchanged (generation 1) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other, in 0.68 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q live1 /tmp/ev.out container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q live1 /tmp/ev.out, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 303 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 303, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: dashboard login via authorization code flow, in 1.70 seconds) container-test-run-flakelet-relay> (finished: run the VM test script, in 76.98 seconds) container-test-run-flakelet-relay> test script finished in 77.01s container-test-run-flakelet-relay> cleanup container-test-run-flakelet-relay> kill NspawnMachine (pid 53) container-test-run-flakelet-relay> kill NspawnMachine (pid 52) container-test-run-flakelet-relay> Container agent terminated by signal KILL. container-test-run-flakelet-relay> kill NspawnMachine (pid 54) container-test-run-flakelet-relay> Container client terminated by signal KILL. container-test-run-flakelet-relay> (finished: cleanup, in 0.29 seconds) container-test-run-flakelet-relay> additionally exposed symbols: container-test-run-flakelet-relay> agent, client, relay, container-test-run-flakelet-relay> vlan1, container-test-run-flakelet-relay> start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh container-test-run-flakelet-relay> » job 6af0a7ca099a0d6326fa9e5b7c4a84fb via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2 container-test-run-flakelet-relay> agent/app | app: activating generation 2 container-test-run-flakelet-relay> agent/app | app: updated to generation 2 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 2) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job 4c7c4b8823e7193fda2f5f7b0b37ca1b via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken container-test-run-flakelet-relay> agent/app | app: activating generation 4 container-test-run-flakelet-relay> agent/app | app: deploy failed, rolled back: systemctl start app.service failed: container-test-run-flakelet-relay> agent/app | failed units: app.service. See journalctl -u app.service container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> » agent/app: rolled-back (generation 3) container-test-run-flakelet-relay> agent/app │ Starting app v1... container-test-run-flakelet-relay> agent/app │ Started app v1. container-test-run-flakelet-relay> agent/app │ Stopping app v1... container-test-run-flakelet-relay> agent/app │ app.service: Deactivated successfully. container-test-run-flakelet-relay> agent/app │ Stopped app v1. container-test-run-flakelet-relay> agent/app │ Starting app v2... container-test-run-flakelet-relay> agent/app │ Started app v2. container-test-run-flakelet-relay> agent/app │ Stopping app v2... container-test-run-flakelet-relay> agent/app │ app.service: Deactivated successfully. container-test-run-flakelet-relay> agent/app │ Stopped app v2. container-test-run-flakelet-relay> agent/app │ Starting app v1... container-test-run-flakelet-relay> agent/app │ Started app v1. container-test-run-flakelet-relay> agent/app │ Stopping app v1... container-test-run-flakelet-relay> agent/app │ app.service: Deactivated successfully. container-test-run-flakelet-relay> agent/app │ Stopped app v1. container-test-run-flakelet-relay> agent/app │ Starting app broken... container-test-run-flakelet-relay> agent/app │ app.service: Unable to locate executable '/nonexistent': No such file or directory container-test-run-flakelet-relay> agent/app │ app.service: Failed at step EXEC spawning /nonexistent: No such file or directory container-test-run-flakelet-relay> agent/app │ app.service: Main process exited, code=exited, status=203/EXEC container-test-run-flakelet-relay> agent/app │ app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> agent/app │ Failed to start app broken. container-test-run-flakelet-relay> agent/app │ Starting app v1... container-test-run-flakelet-relay> agent/app │ Started app v1. container-test-run-flakelet-relay> » skipped: agent/other container-test-run-flakelet-relay> » failed container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job afda3db5d68ad6337a79df5480bd18d8 via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent/app | app: activating generation 5 container-test-run-flakelet-relay> agent/app | app: updated to generation 5 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 5) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job 5907808eb0f934f250a6187bbbf5e0b3 via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2 container-test-run-flakelet-relay> agent/app | app: activating generation 6 container-test-run-flakelet-relay> agent/app | app: updated to generation 6 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 6) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job d429113a99f15c533ab5e632ef438473 via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent/app | app: activating generation 7 container-test-run-flakelet-relay> flakelet-push: stream: error reading a body from connection, resuming job 2def18c83c16f82e2c098ecab252c525 container-test-run-flakelet-relay> flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 1s container-test-run-flakelet-relay> flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 2s container-test-run-flakelet-relay> flakelet-push: https://relay:7443: 404 Not Found: unknown_job: no connected agent knows this job, retrying in 4s container-test-run-flakelet-relay> » job d429113a99f15c533ab5e632ef438473 via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | app: updated to generation 7 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 7) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> 1788600230 hist1 x509:email:admin@example.org agent/other:unchanged container-test-run-flakelet-relay> 1788600220 2def18c83c16f82e2c098ecab252c525 x509:email:admin@example.org agent/app:updated container-test-run-flakelet-relay> 1788600211 a4a0f63bbdc473a2ba16566647b23459 x509:email:admin@example.org agent/app:updated container-test-run-flakelet-relay> 1788600195 07ea4757a6978c2028c343e26e80e958 x509:email:admin@example.org agent/app:updated container-test-run-flakelet-relay> 1788600193 f7ea5dd97eac17826ec016cdb04b624e x509:email:admin@example.org agent/other:unchanged container-test-run-flakelet-relay> 1788600182 841b221c219fa8c306a63591d68d905c x509:email:admin@example.org agent/app:updated container-test-run-flakelet-relay> 1788600177 7e98866e023e0c9f849281b26b07d396 x509:email:admin@example.org agent/app:rolled-back container-test-run-flakelet-relay> 1788600177 9d23105786a8fd6b24d6276454f65168 oidc:mock:groups:wheel agent/other:unchanged container-test-run-flakelet-relay> 1788600176 ca6a9306dd346a4b0b030de6b8e13563 oidc:mock:groups:wheel agent/other:unchanged container-test-run-flakelet-relay> 1788600173 4fa89c40ee4a366a28bd1f0f91fa8ee5 oidc:mock:groups:wheel agent/other:unchanged container-test-run-flakelet-relay> 1788600170 99ffa1b87007617824c24ae6c8de336f oidc:mock:repo:github:example/app:ref:refs/heads/main agent/app:updated container-test-run-flakelet-relay> 1788600167 3e11c6e1a3228e4b1b30ce131ebbcbf1 x509:email:admin@example.org agent/app:updated container-test-run-flakelet-relay> container-test-run-flakelet-relay> Container relay terminated by signal KILL. post-build step Upload coverage to codecov: ok Skipping codecov: project=Mic92/flakelet-relay attr=checks.x86_64-linux.nixos-test