these 42 derivations will be built: /nix/store/4466b35cb08avh7g960pc7yb72b4qwbj-push.drv /nix/store/31qwakrwqhllfzx0gx8kwby78wgmpaxa-system-path.drv /nix/store/n5gqkwqx4jmhwzlgzsxinn771n9x68h9-dbus-1.drv /nix/store/cfv3bk43x4qng622b5vp4scvsm0d169b-X-Restart-Triggers-dbus-broker.drv /nix/store/brid236zxqgb332wbw6cn6r8rb65d2q6-unit-dbus-broker.service.drv /nix/store/fnx547fca7fh3p2y3cb2haa7v1lvi13i-system-units.drv /nix/store/dhnsli5jm2ywm76r7bsrdd2q42p1ibba-unit-dbus-broker.service.drv /nix/store/rzzvz9j1fhsi9prf69a2gzvv7nfzih9b-user-units.drv /nix/store/jc190sgpym9m6rgvz4ahh3kqg4q278sg-etc.drv /nix/store/0drz79m8065pa1w1l2y9p8iivbwyzmzn-activate.drv /nix/store/1jr36cjya9a7iz7av9n7zinq8689723n-flakelet-agent.service.drv /nix/store/nzc0g71j63r2ka8x3787ai316i31v333-flakelet-relay.json.drv /nix/store/y853rhwdr8c4d8dnygl1hrn37mdsd81c-flakelet-relay.service.drv /nix/store/k9wdlrwlgy8zs48l7xf1illkrad7zkll-flakelet-flakelet-relay-units.drv /nix/store/8hndi5j0k2s18g257h0649sk9gbji668-flakelet-flakelet-relay.drv /nix/store/hm0jyq6wb2js1w148g0cxc589j74fyk0-flakelet-config.json.drv /nix/store/bvxxc3yy5k88z1gkp43h1am603pm1ihm-X-Restart-Triggers-flakelet-reconcile.drv /nix/store/gmjb8abmm84lcl3jqiqim0mr0fx0z8jy-unit-flakelet-reconcile.service.drv /nix/store/ha6rwxziij2ksj8g24mv63m3x4b0p4py-X-Restart-Triggers-flakelet-flakelet-relay.drv /nix/store/z4wgbdblk9ipgzivys7pnhnrny4f4asb-unit-flakelet-flakelet-relay.service.drv /nix/store/k6mbw5qpxhs8gkj2gpzjz25cwx9ma9av-system-units.drv /nix/store/scbk1s2f4yjy7i4rq4wh331p4804jj2m-etc.drv /nix/store/hmw3ll98cxz9pbplda5aba796hd0vm0n-activate.drv /nix/store/6vxv4l54967jj89kcy40z7gfi7l56pd2-nixos-system-relay-test.drv /nix/store/1li50pz5pphh3cg0qlsgnffdhvh9fjnr-run-relay-nspawn.drv /nix/store/2rgm0w5gyd5q1p0mxbhvrwaiybcvr7pj-flakelet-flakelet-agent-units.drv /nix/store/9c5l6msc7xmcz0q2hyh3chp9wd700x00-flakelet-flakelet-agent.drv /nix/store/yn3hdga2j1kylds3yv8vxs175fw3cb0d-flakelet-config.json.drv /nix/store/z5v6xhrzrd4pabrybjjmhhjqaip16d9l-X-Restart-Triggers-flakelet-reconcile.drv /nix/store/7l04jb6f9p3iflsd0ldklf868qzpwzn3-unit-flakelet-reconcile.service.drv /nix/store/cxrqpbzjl814c4mk2b6rjlis3m15cdny-X-Restart-Triggers-flakelet-flakelet-agent.drv /nix/store/zl93fv9gnqw7ccg235al3zladvcgh9md-unit-flakelet-flakelet-agent.service.drv /nix/store/zzx9n11l97jrf2qdzrmx0vddbvd1yfxr-system-units.drv /nix/store/88881v9fwx2yri23mci3gwsb515s4bkc-etc.drv /nix/store/fb132a2l6vaj4bni55736qb9mbikbwgf-activate.drv /nix/store/55s914xbasacqzsh2prialiky7k4n1fl-nixos-system-agent-test.drv /nix/store/5c3kivav8mbrldkwhx6y6fj6i0bxpavg-nixos-system-client-test.drv /nix/store/gxhywfcd9vh52nbn85ds5y37rcrhfchj-run-client-nspawn.drv /nix/store/s9vk7xw67y308ij4610nfsm82b7facws-run-agent-nspawn.drv /nix/store/lfq2c5mgl3qp50m8k7rhlgq2fpj2hv31-driverConfiguration.json.drv /nix/store/hvnjbxfwgd96qq4w1nda7gwp2bkflakk-nixos-test-driver-flakelet-relay.drv /nix/store/zx9mvc6cdqyq6v7pi669n43lpiwqa864-container-test-run-flakelet-relay.drv building '/nix/store/4466b35cb08avh7g960pc7yb72b4qwbj-push.drv' building '/nix/store/cxrqpbzjl814c4mk2b6rjlis3m15cdny-X-Restart-Triggers-flakelet-flakelet-agent.drv' building '/nix/store/ha6rwxziij2ksj8g24mv63m3x4b0p4py-X-Restart-Triggers-flakelet-flakelet-relay.drv' X-Restart-Triggers-flakelet-flakelet-agent> tribuchet: building on jamie push> tribuchet: building on jamie building '/nix/store/1jr36cjya9a7iz7av9n7zinq8689723n-flakelet-agent.service.drv' X-Restart-Triggers-flakelet-flakelet-relay> tribuchet: building on jamie building '/nix/store/nzc0g71j63r2ka8x3787ai316i31v333-flakelet-relay.json.drv' flakelet-agent.service> tribuchet: building on jamie flakelet-relay.json> tribuchet: building on jamie flakelet-relay.json> check: oidc:mock:repo:github:example/app:ref:refs/heads/main -> agent/app (expect allow) flakelet-relay.json> agent/app allowed by ci flakelet-relay.json> check: oidc:mock:repo:github:example/app:ref:refs/heads/main -> agent/other (expect deny) flakelet-relay.json> agent/other denied building '/nix/store/zl93fv9gnqw7ccg235al3zladvcgh9md-unit-flakelet-flakelet-agent.service.drv' building '/nix/store/z4wgbdblk9ipgzivys7pnhnrny4f4asb-unit-flakelet-flakelet-relay.service.drv' unit-flakelet-flakelet-agent.service> tribuchet: building on jamie unit-flakelet-flakelet-relay.service> tribuchet: building on jamie building '/nix/store/y853rhwdr8c4d8dnygl1hrn37mdsd81c-flakelet-relay.service.drv' flakelet-relay.service> tribuchet: building on jamie building '/nix/store/2rgm0w5gyd5q1p0mxbhvrwaiybcvr7pj-flakelet-flakelet-agent-units.drv' building '/nix/store/31qwakrwqhllfzx0gx8kwby78wgmpaxa-system-path.drv' flakelet-flakelet-agent-units> tribuchet: building on jamie system-path> tribuchet: building on jamie unit-flakelet-flakelet-agent.service> structuredAttrs is enabled unit-flakelet-flakelet-relay.service> structuredAttrs is enabled system-path> structuredAttrs is enabled building '/nix/store/k9wdlrwlgy8zs48l7xf1illkrad7zkll-flakelet-flakelet-relay-units.drv' system-path> created 6399 symlinks in user environment flakelet-flakelet-relay-units> tribuchet: building on jamie building '/nix/store/9c5l6msc7xmcz0q2hyh3chp9wd700x00-flakelet-flakelet-agent.drv' flakelet-flakelet-agent> tribuchet: building on jamie building '/nix/store/8hndi5j0k2s18g257h0649sk9gbji668-flakelet-flakelet-relay.drv' flakelet-flakelet-relay> tribuchet: building on jamie building '/nix/store/yn3hdga2j1kylds3yv8vxs175fw3cb0d-flakelet-config.json.drv' flakelet-config.json> tribuchet: building on jamie flakelet-config.json> structuredAttrs is enabled building '/nix/store/n5gqkwqx4jmhwzlgzsxinn771n9x68h9-dbus-1.drv' dbus-1> tribuchet: building on jamie building '/nix/store/z5v6xhrzrd4pabrybjjmhhjqaip16d9l-X-Restart-Triggers-flakelet-reconcile.drv' building '/nix/store/hm0jyq6wb2js1w148g0cxc589j74fyk0-flakelet-config.json.drv' X-Restart-Triggers-flakelet-reconcile> tribuchet: building on jamie flakelet-config.json> tribuchet: building on jamie flakelet-config.json> structuredAttrs is enabled building '/nix/store/7l04jb6f9p3iflsd0ldklf868qzpwzn3-unit-flakelet-reconcile.service.drv' building '/nix/store/cfv3bk43x4qng622b5vp4scvsm0d169b-X-Restart-Triggers-dbus-broker.drv' building '/nix/store/bvxxc3yy5k88z1gkp43h1am603pm1ihm-X-Restart-Triggers-flakelet-reconcile.drv' X-Restart-Triggers-dbus-broker> tribuchet: building on jamie unit-flakelet-reconcile.service> tribuchet: building on jamie unit-flakelet-reconcile.service> structuredAttrs is enabled building '/nix/store/zzx9n11l97jrf2qdzrmx0vddbvd1yfxr-system-units.drv' X-Restart-Triggers-flakelet-reconcile> tribuchet: building on jamie system-units> tribuchet: building on jamie building '/nix/store/brid236zxqgb332wbw6cn6r8rb65d2q6-unit-dbus-broker.service.drv' building '/nix/store/dhnsli5jm2ywm76r7bsrdd2q42p1ibba-unit-dbus-broker.service.drv' unit-dbus-broker.service> tribuchet: building on jamie unit-dbus-broker.service> tribuchet: building on jamie building '/nix/store/gmjb8abmm84lcl3jqiqim0mr0fx0z8jy-unit-flakelet-reconcile.service.drv' unit-flakelet-reconcile.service> tribuchet: building on jamie unit-dbus-broker.service> structuredAttrs is enabled unit-dbus-broker.service> structuredAttrs is enabled unit-flakelet-reconcile.service> structuredAttrs is enabled building '/nix/store/rzzvz9j1fhsi9prf69a2gzvv7nfzih9b-user-units.drv' building '/nix/store/fnx547fca7fh3p2y3cb2haa7v1lvi13i-system-units.drv' user-units> tribuchet: building on jamie building '/nix/store/k6mbw5qpxhs8gkj2gpzjz25cwx9ma9av-system-units.drv' system-units> tribuchet: building on jamie system-units> tribuchet: building on jamie building '/nix/store/88881v9fwx2yri23mci3gwsb515s4bkc-etc.drv' etc> tribuchet: building on jamie building '/nix/store/fb132a2l6vaj4bni55736qb9mbikbwgf-activate.drv' activate> tribuchet: building on jamie building '/nix/store/jc190sgpym9m6rgvz4ahh3kqg4q278sg-etc.drv' etc> tribuchet: building on jamie building '/nix/store/scbk1s2f4yjy7i4rq4wh331p4804jj2m-etc.drv' etc> tribuchet: building on jamie building '/nix/store/55s914xbasacqzsh2prialiky7k4n1fl-nixos-system-agent-test.drv' nixos-system-agent-test> tribuchet: building on jamie nixos-system-agent-test> structuredAttrs is enabled building '/nix/store/0drz79m8065pa1w1l2y9p8iivbwyzmzn-activate.drv' activate> tribuchet: building on jamie building '/nix/store/s9vk7xw67y308ij4610nfsm82b7facws-run-agent-nspawn.drv' building '/nix/store/hmw3ll98cxz9pbplda5aba796hd0vm0n-activate.drv' run-agent-nspawn> tribuchet: building on jamie activate> tribuchet: building on jamie building '/nix/store/5c3kivav8mbrldkwhx6y6fj6i0bxpavg-nixos-system-client-test.drv' nixos-system-client-test> tribuchet: building on jamie nixos-system-client-test> structuredAttrs is enabled building '/nix/store/6vxv4l54967jj89kcy40z7gfi7l56pd2-nixos-system-relay-test.drv' nixos-system-relay-test> tribuchet: building on jamie building '/nix/store/gxhywfcd9vh52nbn85ds5y37rcrhfchj-run-client-nspawn.drv' run-client-nspawn> tribuchet: building on jamie nixos-system-relay-test> structuredAttrs is enabled building '/nix/store/1li50pz5pphh3cg0qlsgnffdhvh9fjnr-run-relay-nspawn.drv' run-relay-nspawn> tribuchet: building on jamie building '/nix/store/lfq2c5mgl3qp50m8k7rhlgq2fpj2hv31-driverConfiguration.json.drv' driverConfiguration.json> tribuchet: building on jamie driverConfiguration.json> structuredAttrs is enabled building '/nix/store/hvnjbxfwgd96qq4w1nda7gwp2bkflakk-nixos-test-driver-flakelet-relay.drv' nixos-test-driver-flakelet-relay> tribuchet: building on jamie nixos-test-driver-flakelet-relay> Running type check (enable/disable: config.skipTypeCheck) nixos-test-driver-flakelet-relay> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck nixos-test-driver-flakelet-relay> All checks passed! nixos-test-driver-flakelet-relay> Linting test script (enable/disable: config.skipLint) nixos-test-driver-flakelet-relay> See https://nixos.org/manual/nixos/stable/#test-opt-skipLint nixos-test-driver-flakelet-relay> All checks passed! building '/nix/store/zx9mvc6cdqyq6v7pi669n43lpiwqa864-container-test-run-flakelet-relay.drv' container-test-run-flakelet-relay> tribuchet: building on jamie container-test-run-flakelet-relay> Machine state will be reset. To keep it, pass --keep-machine-state container-test-run-flakelet-relay> start all VLans container-test-run-flakelet-relay> (finished: start all VLans, in 0.00 seconds) container-test-run-flakelet-relay> Initializing machine ID from random generator. container-test-run-flakelet-relay> Test will time out and terminate in 3600.0 seconds container-test-run-flakelet-relay> run the VM test script container-test-run-flakelet-relay> start all VMs container-test-run-flakelet-relay> agent: systemd-nspawn running (pid 52) container-test-run-flakelet-relay> client: systemd-nspawn running (pid 53) container-test-run-flakelet-relay> relay: systemd-nspawn running (pid 54) container-test-run-flakelet-relay> client: Waiting for journal at /build/vm-state-client/var/log/journal... container-test-run-flakelet-relay> agent: Waiting for journal at /build/vm-state-agent/var/log/journal... container-test-run-flakelet-relay> relay: Waiting for journal at /build/vm-state-relay/var/log/journal... container-test-run-flakelet-relay> (finished: start all VMs, in 0.00 seconds) container-test-run-flakelet-relay> relay: waiting for unit flakelet-relay.service container-test-run-flakelet-relay> nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-flakelet-relay> nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-flakelet-relay> nixos-nspawn(agent): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-flakelet-relay> nixos-nspawn(agent): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-flakelet-relay> nixos-nspawn(relay): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-flakelet-relay> nixos-nspawn(relay): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-flakelet-relay> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-flakelet-relay> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-flakelet-relay> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-flakelet-relay> ░ Spawning container relay on /build/vm-state-relay. container-test-run-flakelet-relay> ░ Spawning container agent on /build/vm-state-agent. container-test-run-flakelet-relay> ░ Spawning container client on /build/vm-state-client. container-test-run-flakelet-relay> client # No journal files were found. container-test-run-flakelet-relay> client # No journal boot entry found for the specified boot (+0). container-test-run-flakelet-relay> agent # No journal files were found. container-test-run-flakelet-relay> relay # No journal files were found. container-test-run-flakelet-relay> agent # No journal boot entry found for the specified boot (+0). container-test-run-flakelet-relay> relay # No journal boot entry found for the specified boot (+0). container-test-run-flakelet-relay> client # [ 1623.414132] client systemd-journald[57]: Journal started container-test-run-flakelet-relay> client # [ 1623.414173] client systemd-journald[57]: Runtime Journal (/run/log/journal/e7bd8cb67446493ba4d66cd8739bf680) is 8M, max 4G, 3.9G free. container-test-run-flakelet-relay> relay # [ 1623.411594] relay systemd-journald[57]: Journal started container-test-run-flakelet-relay> client # [ 1623.428505] client systemd[1]: Finished Apply Kernel Variables. container-test-run-flakelet-relay> relay # [ 1623.411636] relay systemd-journald[57]: Runtime Journal (/run/log/journal/e499d335cd314db7a5ed1a38f336e4c2) is 8M, max 4G, 3.9G free. container-test-run-flakelet-relay> client # [ 1623.441694] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-flakelet-relay> client # [ 1623.466570] client systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-flakelet-relay> client # [ 1623.467228] client systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-flakelet-relay> client # [ 1623.475008] client systemd-journald[57]: Time spent on flushing to /var/log/journal/e7bd8cb67446493ba4d66cd8739bf680 is 1.734ms for 6 entries. container-test-run-flakelet-relay> client # [ 1623.475008] client systemd-journald[57]: System Journal (/var/log/journal/e7bd8cb67446493ba4d66cd8739bf680) is 512B, max 4G, 3.9G free. container-test-run-flakelet-relay> relay # [ 1623.426808] relay systemd[1]: Finished Apply Kernel Variables. container-test-run-flakelet-relay> client # [ 1623.487592] client systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-flakelet-relay> relay # [ 1623.440075] relay systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-flakelet-relay> client # [ 1623.488384] client systemd[1]: Reached target Preparation for Local File Systems. container-test-run-flakelet-relay> client # [ 1623.488485] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-flakelet-relay> relay # [ 1623.466592] relay systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-flakelet-relay> agent # [ 1623.403898] agent systemd-journald[57]: Journal started container-test-run-flakelet-relay> relay # [ 1623.467358] relay systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-flakelet-relay> relay # [ 1623.476535] relay systemd-journald[57]: Time spent on flushing to /var/log/journal/e499d335cd314db7a5ed1a38f336e4c2 is 1.748ms for 6 entries. container-test-run-flakelet-relay> relay # [ 1623.476535] relay systemd-journald[57]: System Journal (/var/log/journal/e499d335cd314db7a5ed1a38f336e4c2) is 512B, max 4G, 3.9G free. container-test-run-flakelet-relay> agent # [ 1623.403941] agent systemd-journald[57]: Runtime Journal (/run/log/journal/2fbe0909353f4e0596c9e26af9d5844c) is 8M, max 4G, 3.9G free. container-test-run-flakelet-relay> client # [ 1623.498185] client systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-flakelet-relay> agent # [ 1623.414892] agent systemd[1]: Finished Apply Kernel Variables. container-test-run-flakelet-relay> relay # [ 1623.488680] relay systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-flakelet-relay> agent # [ 1623.427774] agent systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-flakelet-relay> client # [ 1623.575949] client systemd[1]: Finished Firewall. container-test-run-flakelet-relay> agent # [ 1623.443408] agent systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-flakelet-relay> relay # [ 1623.489560] relay systemd[1]: Reached target Preparation for Local File Systems. container-test-run-flakelet-relay> client # [ 1624.435650] client systemd[1]: Mounting /run/wrappers... container-test-run-flakelet-relay> relay # [ 1623.489695] relay systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-flakelet-relay> agent # [ 1623.444635] agent systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-flakelet-relay> relay # [ 1623.500905] relay systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-flakelet-relay> agent # [ 1623.473135] agent systemd-journald[57]: Time spent on flushing to /var/log/journal/2fbe0909353f4e0596c9e26af9d5844c is 1.926ms for 6 entries. container-test-run-flakelet-relay> relay # [ 1623.594047] relay systemd[1]: Finished Firewall. container-test-run-flakelet-relay> agent # [ 1623.473135] agent systemd-journald[57]: System Journal (/var/log/journal/2fbe0909353f4e0596c9e26af9d5844c) is 512B, max 4G, 3.9G free. container-test-run-flakelet-relay> client # [ 1624.457740] client systemd[1]: Mounted /run/wrappers. container-test-run-flakelet-relay> client # [ 1624.458520] client systemd[1]: Reached target Local File Systems. container-test-run-flakelet-relay> client # [ 1624.459361] client systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-flakelet-relay> client # [ 1624.460431] client systemd[1]: Starting Create SUID/SGID Wrappers... container-test-run-flakelet-relay> client # [ 1624.460457] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> client # [ 1624.461364] client systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-flakelet-relay> relay # [ 1624.412763] relay systemd[1]: Mounting /run/wrappers... container-test-run-flakelet-relay> relay # [ 1624.460138] relay systemd[1]: Mounted /run/wrappers. container-test-run-flakelet-relay> relay # [ 1624.461286] relay systemd[1]: Reached target Local File Systems. container-test-run-flakelet-relay> relay # [ 1624.462741] relay systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-flakelet-relay> agent # [ 1623.480864] agent systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-flakelet-relay> client # [ 1624.462149] client systemd[1]: Starting Create System Files and Directories... container-test-run-flakelet-relay> agent # [ 1623.481642] agent systemd[1]: Reached target Preparation for Local File Systems. container-test-run-flakelet-relay> agent # [ 1623.481752] agent systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-flakelet-relay> agent # [ 1623.495734] agent systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-flakelet-relay> agent # [ 1623.563669] agent systemd[1]: Finished Firewall. container-test-run-flakelet-relay> agent # [ 1624.435618] agent systemd[1]: Mounting /run/wrappers... container-test-run-flakelet-relay> client # [ 1624.480308] client systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-flakelet-relay> client # [ 1624.480731] client systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-flakelet-relay> client # [ 1624.481081] client systemd-tmpfiles[161]: fchmod() of /var/log/journal/e7bd8cb67446493ba4d66cd8739bf680 failed: Operation not permitted container-test-run-flakelet-relay> client # [ 1624.481445] client systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-flakelet-relay> relay # [ 1624.463974] relay systemd[1]: Starting Create SUID/SGID Wrappers... container-test-run-flakelet-relay> relay # [ 1624.464032] relay systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> relay # [ 1624.465057] relay systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-flakelet-relay> relay # [ 1624.466300] relay systemd[1]: Starting Create System Files and Directories... container-test-run-flakelet-relay> relay # [ 1624.489266] relay systemd-tmpfiles[169]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-flakelet-relay> relay # [ 1624.489737] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-flakelet-relay> relay # [ 1624.490292] relay suid-sgid-wrappers-start[176]: chmod: changing permissions of '/run/wrappers/wrappers.DWWurLlCqg/chsh': Operation not permitted container-test-run-flakelet-relay> relay # [ 1624.490103] relay systemd-tmpfiles[169]: fchmod() of /var/log/journal/e499d335cd314db7a5ed1a38f336e4c2 failed: Operation not permitted container-test-run-flakelet-relay> relay # [ 1624.490498] relay systemd-tmpfiles[169]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-flakelet-relay> agent # [ 1624.474055] agent systemd[1]: Mounted /run/wrappers. container-test-run-flakelet-relay> agent # [ 1624.475273] agent systemd[1]: Reached target Local File Systems. container-test-run-flakelet-relay> agent # [ 1624.476521] agent systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-flakelet-relay> agent # [ 1624.477647] agent systemd[1]: Starting Create SUID/SGID Wrappers... container-test-run-flakelet-relay> agent # [ 1624.477693] agent systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> agent # [ 1624.478611] agent systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-flakelet-relay> agent # [ 1624.479821] agent systemd[1]: Starting Create System Files and Directories... container-test-run-flakelet-relay> agent # [ 1624.497123] agent suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.apQqCrPj2s/chsh': Operation not permitted container-test-run-flakelet-relay> agent # [ 1624.499596] agent systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-flakelet-relay> agent # [ 1624.500049] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-flakelet-relay> agent # [ 1624.500385] agent systemd-tmpfiles[161]: fchmod() of /var/log/journal/2fbe0909353f4e0596c9e26af9d5844c failed: Operation not permitted container-test-run-flakelet-relay> agent # [ 1624.500763] agent systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-flakelet-relay> relay # [ 1624.494514] relay systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> relay # [ 1624.494762] relay systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> relay # [ 1624.494907] relay systemd[1]: Failed to start Create SUID/SGID Wrappers. container-test-run-flakelet-relay> relay # [ 1624.495383] relay systemd[1]: Finished Create System Files and Directories. container-test-run-flakelet-relay> relay # [ 1624.509783] relay systemd[1]: Starting Rebuild Journal Catalog... container-test-run-flakelet-relay> relay # [ 1624.510379] relay systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-flakelet-relay> relay # [ 1624.521394] relay systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-flakelet-relay> relay # [ 1624.532045] relay systemd[1]: Finished Rebuild Journal Catalog. container-test-run-flakelet-relay> relay # [ 1624.533164] relay systemd[1]: Starting Update is Completed... container-test-run-flakelet-relay> relay # [ 1624.542249] relay systemd[1]: Finished Update is Completed. container-test-run-flakelet-relay> relay # [ 1624.542939] relay systemd[1]: Reached target System Initialization. container-test-run-flakelet-relay> relay # [ 1624.543043] relay systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> relay # [ 1624.543091] relay systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-flakelet-relay> relay # [ 1624.543113] relay systemd[1]: Reached target Timer Units. container-test-run-flakelet-relay> relay # [ 1624.543236] relay systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-flakelet-relay> relay # [ 1624.543419] relay systemd[1]: Listening on Nix Daemon Socket. container-test-run-flakelet-relay> relay # [ 1624.543546] relay systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-flakelet-relay> relay # [ 1624.543565] relay systemd[1]: Reached target Socket Units. container-test-run-flakelet-relay> relay # [ 1624.543600] relay systemd[1]: Reached target Basic System. container-test-run-flakelet-relay> relay # [ 1624.544843] relay systemd[1]: Started device-mock.service. container-test-run-flakelet-relay> relay # [ 1624.545678] relay systemd[1]: Starting Re-link flakelet services at boot... container-test-run-flakelet-relay> relay # [ 1624.546368] relay systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-flakelet-relay> relay # [ 1624.547268] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> relay # [ 1624.547836] relay systemd[1]: Starting resolvconf update... container-test-run-flakelet-relay> relay # [ 1624.556628] relay systemd[1]: Finished Re-link flakelet services at boot. container-test-run-flakelet-relay> relay # [ 1624.559085] relay systemd[1]: Starting Reconcile flakelet services with the host configuration... container-test-run-flakelet-relay> relay # [ 1624.565207] relay systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-flakelet-relay> relay # [ 1624.577775] relay systemd[1]: Finished Reconcile flakelet services with the host configuration. container-test-run-flakelet-relay> relay # [ 1624.641510] relay systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 1624.642283] relay systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-flakelet-relay> relay # [ 1624.642479] relay systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 1624.642597] relay systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> relay # [ 1624.644283] relay systemd[1]: Finished resolvconf update. container-test-run-flakelet-relay> relay # [ 1624.646232] relay systemd[1]: Reached target Preparation for Network. container-test-run-flakelet-relay> relay # [ 1624.647250] relay systemd[1]: Starting Address configuration of eth1... container-test-run-flakelet-relay> relay # [ 1624.648038] relay systemd[1]: Starting Extra networking commands.... container-test-run-flakelet-relay> relay # [ 1624.648898] relay systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 1624.511680] agent systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> agent # [ 1624.511752] agent systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> agent # [ 1624.511827] agent systemd[1]: Failed to start Create SUID/SGID Wrappers. container-test-run-flakelet-relay> agent # [ 1624.512637] agent systemd[1]: Finished Create System Files and Directories. container-test-run-flakelet-relay> agent # [ 1624.617562] agent systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1624.634250] agent systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-flakelet-relay> agent # [ 1624.637846] agent systemd[1]: Starting Rebuild Journal Catalog... container-test-run-flakelet-relay> agent # [ 1624.638656] agent systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-flakelet-relay> agent # [ 1624.650238] agent systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-flakelet-relay> agent # [ 1624.659140] agent systemd[1]: Finished Rebuild Journal Catalog. container-test-run-flakelet-relay> agent # [ 1624.660399] agent systemd[1]: Starting Update is Completed... container-test-run-flakelet-relay> agent # [ 1624.671138] agent systemd[1]: Finished Update is Completed. container-test-run-flakelet-relay> agent # [ 1624.671389] agent systemd[1]: Reached target System Initialization. container-test-run-flakelet-relay> agent # [ 1624.671511] agent systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> agent # [ 1624.671555] agent systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-flakelet-relay> agent # [ 1624.671587] agent systemd[1]: Reached target Timer Units. container-test-run-flakelet-relay> agent # [ 1624.671760] agent systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-flakelet-relay> agent # [ 1624.672090] agent systemd[1]: Listening on Nix Daemon Socket. container-test-run-flakelet-relay> agent # [ 1624.672275] agent systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-flakelet-relay> agent # [ 1624.672303] agent systemd[1]: Reached target Socket Units. container-test-run-flakelet-relay> agent # [ 1624.672361] agent systemd[1]: Reached target Basic System. container-test-run-flakelet-relay> agent # [ 1624.674143] agent systemd[1]: Starting Re-link flakelet services at boot... container-test-run-flakelet-relay> agent # [ 1624.674959] agent systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-flakelet-relay> agent # [ 1624.675933] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 1624.676876] agent systemd[1]: Starting resolvconf update... container-test-run-flakelet-relay> client # [ 1624.485770] client systemd[1]: Finished Create System Files and Directories. container-test-run-flakelet-relay> client # [ 1624.485939] client suid-sgid-wrappers-start[168]: chmod: changing permissions of '/run/wrappers/wrappers.SARz9JNZcq/chsh': Operation not permitted container-test-run-flakelet-relay> client # [ 1624.498074] client systemd[1]: suid-sgid-wrappers.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> client # [ 1624.498171] client systemd[1]: suid-sgid-wrappers.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> client # [ 1624.498347] client systemd[1]: Failed to start Create SUID/SGID Wrappers. container-test-run-flakelet-relay> client # [ 1624.500789] client systemd[1]: Starting Rebuild Journal Catalog... container-test-run-flakelet-relay> client # [ 1624.501800] client systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-flakelet-relay> client # [ 1624.513569] client systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-flakelet-relay> client # [ 1624.520066] client systemd[1]: Finished Rebuild Journal Catalog. container-test-run-flakelet-relay> client # [ 1624.521357] client systemd[1]: Starting Update is Completed... container-test-run-flakelet-relay> client # [ 1624.532543] client systemd[1]: Finished Update is Completed. container-test-run-flakelet-relay> client # [ 1624.532692] client systemd[1]: Reached target System Initialization. container-test-run-flakelet-relay> client # [ 1624.532765] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-flakelet-relay> client # [ 1624.532795] client systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-flakelet-relay> client # [ 1624.532810] client systemd[1]: Reached target Timer Units. container-test-run-flakelet-relay> client # [ 1624.532916] client systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-flakelet-relay> client # [ 1624.533078] client systemd[1]: Listening on Nix Daemon Socket. container-test-run-flakelet-relay> client # [ 1624.533184] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-flakelet-relay> client # [ 1624.533197] client systemd[1]: Reached target Socket Units. container-test-run-flakelet-relay> client # [ 1624.533227] client systemd[1]: Reached target Basic System. container-test-run-flakelet-relay> client # [ 1624.534678] client systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-flakelet-relay> client # [ 1624.535825] client systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> client # [ 1624.536728] client systemd[1]: Starting resolvconf update... container-test-run-flakelet-relay> client # [ 1624.555051] client systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-flakelet-relay> client # [ 1624.610189] client systemd[1]: Finished resolvconf update. container-test-run-flakelet-relay> client # [ 1624.610323] client systemd[1]: Reached target Preparation for Network. container-test-run-flakelet-relay> client # [ 1624.611347] client systemd[1]: Starting Address configuration of eth1... container-test-run-flakelet-relay> client # [ 1624.612845] client systemd[1]: Starting Extra networking commands.... container-test-run-flakelet-relay> client # [ 1624.632500] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-flakelet-relay> client # [ 1624.633513] client systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-flakelet-relay> client # [ 1624.633603] client network-addresses-eth1-start[232]: adding address 192.168.1.2/24... done container-test-run-flakelet-relay> client # [ 1624.633681] client systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> client # [ 1624.633832] client systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> client # [ 1624.636792] client network-addresses-eth1-start[232]: adding address 2001:db8:1::2/64... done container-test-run-flakelet-relay> client # [ 1624.637614] client systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> client # [ 1624.642017] client systemd[1]: Finished Address configuration of eth1. container-test-run-flakelet-relay> client # [ 1624.688213] client systemd[1]: Finished Extra networking commands.. container-test-run-flakelet-relay> client # [ 1624.688349] client systemd[1]: Reached target Network. container-test-run-flakelet-relay> client # [ 1624.717965] client systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> client # [ 1624.718157] client systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> client # [ 1624.720581] client systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> relay # [ 1624.668472] relay network-addresses-eth1-start[249]: adding address 192.168.1.3/24... done container-test-run-flakelet-relay> relay # [ 1624.671480] relay network-addresses-eth1-start[249]: adding address 2001:db8:1::3/64... done container-test-run-flakelet-relay> relay # [ 1624.675461] relay systemd[1]: Finished Address configuration of eth1. container-test-run-flakelet-relay> relay # [ 1624.723318] relay systemd[1]: Finished Extra networking commands.. container-test-run-flakelet-relay> relay # [ 1624.723473] relay systemd[1]: Reached target Network. container-test-run-flakelet-relay> relay # [ 1624.724906] relay systemd[1]: Starting Dnsmasq Daemon... container-test-run-flakelet-relay> relay # [ 1624.725822] relay systemd[1]: Starting Nginx Web Server... container-test-run-flakelet-relay> relay # [ 1624.726632] relay systemd[1]: Starting Update flakelet service flakelet-relay... container-test-run-flakelet-relay> relay # [ 1624.737989] relay flakelet[311]: flakelet-relay: using prebuilt artifact /nix/store/scb2zliys282p7sm8hm96z3f027bppg2-flakelet-flakelet-relay container-test-run-flakelet-relay> relay # [ 1624.738624] relay flakelet[311]: flakelet-relay: activating generation 1 container-test-run-flakelet-relay> relay # [ 1624.745961] relay systemd[1]: Reload requested from client PID 314 ('systemctl') (unit flakelet-flakelet-relay.service)... container-test-run-flakelet-relay> relay # [ 1624.745998] relay systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1624.686315] agent systemd[1]: Finished Re-link flakelet services at boot. container-test-run-flakelet-relay> agent # [ 1624.688630] agent systemd[1]: Starting Reconcile flakelet services with the host configuration... container-test-run-flakelet-relay> agent # [ 1624.693735] agent systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-flakelet-relay> agent # [ 1624.708496] agent systemd[1]: Finished Reconcile flakelet services with the host configuration. container-test-run-flakelet-relay> agent # [ 1624.750511] agent systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1624.750743] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> agent # [ 1624.754549] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 1624.790349] agent systemd[1]: Finished resolvconf update. container-test-run-flakelet-relay> agent # [ 1624.790785] agent systemd[1]: Reached target Preparation for Network. container-test-run-flakelet-relay> agent # [ 1624.792598] agent systemd[1]: Starting Address configuration of eth1... container-test-run-flakelet-relay> agent # [ 1624.794320] agent systemd[1]: Starting Extra networking commands.... container-test-run-flakelet-relay> agent # [ 1624.812679] agent network-addresses-eth1-start[242]: adding address 192.168.1.1/24... done container-test-run-flakelet-relay> agent # [ 1624.815677] agent network-addresses-eth1-start[242]: adding address 2001:db8:1::1/64... done container-test-run-flakelet-relay> agent # [ 1624.820153] agent systemd[1]: Finished Address configuration of eth1. container-test-run-flakelet-relay> agent # [ 1624.888602] agent systemd[1]: Finished Extra networking commands.. container-test-run-flakelet-relay> agent # [ 1624.888883] agent systemd[1]: Reached target Network. container-test-run-flakelet-relay> agent # [ 1624.890727] agent systemd[1]: Starting Update flakelet service app... container-test-run-flakelet-relay> agent # [ 1624.892087] agent systemd[1]: Starting Update flakelet service flakelet-agent... container-test-run-flakelet-relay> agent # [ 1624.893309] agent systemd[1]: Starting Update flakelet service other... container-test-run-flakelet-relay> agent # [ 1624.893775] agent systemd[1]: nscd.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1624.894049] agent systemd[1]: Stopped Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> agent # [ 1624.915725] agent systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-flakelet-relay> agent # [ 1624.928346] agent flakelet[306]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 1624.929210] agent flakelet[305]: flakelet-agent: using prebuilt artifact /nix/store/bv94b8df0vwrv93mzqlb1qk6w90lpi4w-flakelet-flakelet-agent container-test-run-flakelet-relay> agent # [ 1624.929210] agent flakelet[305]: flakelet-agent: activating generation 1 container-test-run-flakelet-relay> agent # [ 1624.929768] agent flakelet[304]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 1624.929768] agent flakelet[304]: app: activating generation 1 container-test-run-flakelet-relay> agent # [ 1624.930314] agent flakelet[306]: other: activating generation 1 container-test-run-flakelet-relay> agent # [ 1624.934369] agent systemd[1]: Reload requested from client PID 312 ('systemctl') (unit flakelet-other.service)... container-test-run-flakelet-relay> agent # [ 1624.934416] agent systemd[1]: Reloading... container-test-run-flakelet-relay> client # [ 1625.108156] client nsncd[303]: Sep 10 12:01:46.602 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-flakelet-relay> client # [ 1625.108184] client systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> client # [ 1625.108290] client systemd[1]: Reached target Host and Network Name Lookups. container-test-run-flakelet-relay> client # [ 1625.108385] client systemd[1]: Reached target User and Group Name Lookups. container-test-run-flakelet-relay> client # [ 1625.110803] client systemd[1]: Starting User Login Management... container-test-run-flakelet-relay> client # [ 1625.112346] client systemd[1]: Starting Permit User Sessions... container-test-run-flakelet-relay> client # [ 1625.150425] client systemd[1]: Finished Permit User Sessions. container-test-run-flakelet-relay> client # [ 1625.153373] client systemd[1]: Started Console Getty. container-test-run-flakelet-relay> client # [ 1625.153435] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-flakelet-relay> client # [ 1625.153469] client systemd[1]: Reached target Login Prompts. container-test-run-flakelet-relay> agent # [ 1625.152815] agent nsncd[310]: Sep 10 12:01:46.647 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-flakelet-relay> agent # [ 1625.305841] agent systemd[1]: Reloading finished in 370 ms. container-test-run-flakelet-relay> agent # [ 1625.363017] agent systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> agent # [ 1625.363594] agent systemd[1]: Reload requested from client PID 313 ('systemctl') (unit flakelet-flakelet-agent.service)... container-test-run-flakelet-relay> agent # [ 1625.363648] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 1625.169364] relay nsncd[251]: Sep 10 12:01:46.664 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-flakelet-relay> relay # [ 1625.213487] relay systemd[1]: Reloading finished in 467 ms. container-test-run-flakelet-relay> relay # [ 1625.290446] relay systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-flakelet-relay> relay # [ 1625.290943] relay systemd[1]: Reached target Host and Network Name Lookups. container-test-run-flakelet-relay> relay # [ 1625.291038] relay systemd[1]: Reached target User and Group Name Lookups. container-test-run-flakelet-relay> relay # [ 1625.292361] relay systemd[1]: Starting User Login Management... container-test-run-flakelet-relay> relay # [ 1625.293242] relay systemd[1]: Starting Permit User Sessions... container-test-run-flakelet-relay> relay # [ 1625.311336] relay systemd[1]: Reload requested from client PID 357 ('systemctl') (unit flakelet-flakelet-relay.service)... container-test-run-flakelet-relay> relay # [ 1625.311395] relay systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 1625.426872] relay dnsmasq-pre-start[393]: dnsmasq: syntax check OK. container-test-run-flakelet-relay> agent # [ 1625.722957] agent systemd[1]: Reloading finished in 358 ms. container-test-run-flakelet-relay> agent # [ 1625.793530] agent systemd[1]: Reload requested from client PID 314 ('systemctl') (unit flakelet-app.service)... container-test-run-flakelet-relay> agent # [ 1625.793592] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1626.138378] agent systemd[1]: Reloading finished in 344 ms. container-test-run-flakelet-relay> relay # [ 1625.684278] relay systemd[1]: Reloading finished in 372 ms. container-test-run-flakelet-relay> relay # [ 1625.752728] relay systemd[1]: Finished Permit User Sessions. container-test-run-flakelet-relay> relay # [ 1625.755429] relay systemd[1]: Started Console Getty. container-test-run-flakelet-relay> relay # [ 1625.755495] relay systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-flakelet-relay> relay # [ 1625.755583] relay systemd[1]: Reached target Login Prompts. container-test-run-flakelet-relay> relay # [ 1625.774539] relay systemd[1]: Starting flakelet-relay... container-test-run-flakelet-relay> agent # [ 1626.198432] agent systemd[1]: Reached target Host and Network Name Lookups. container-test-run-flakelet-relay> agent # [ 1626.198586] agent systemd[1]: Reached target User and Group Name Lookups. container-test-run-flakelet-relay> agent # [ 1626.200039] agent systemd[1]: Starting User Login Management... container-test-run-flakelet-relay> agent # [ 1626.201209] agent systemd[1]: Starting Permit User Sessions... container-test-run-flakelet-relay> agent # [ 1626.204638] agent systemd[1]: Reload requested from client PID 405 ('systemctl') (unit flakelet-other.service)... container-test-run-flakelet-relay> agent # [ 1626.204668] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 1626.309038] relay systemd[1]: Starting D-Bus System Message Bus... container-test-run-flakelet-relay> relay # [ 1626.416289] relay nginx-pre-start[403]: nginx: the configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf syntax is ok container-test-run-flakelet-relay> relay # [ 1626.416956] relay nginx-pre-start[403]: nginx: configuration file /nix/store/01avjj26wcihp926xgasszcj5s0k7cbs-nginx.conf test is successful container-test-run-flakelet-relay> relay # [ 1626.430999] relay systemd[1]: Started Nginx Web Server. container-test-run-flakelet-relay> client # [ 1626.549039] client systemd-logind[315]: New seat seat0. container-test-run-flakelet-relay> client # [ 1626.549471] client systemd[1]: Started User Login Management. container-test-run-flakelet-relay> client # [ 1626.551545] client systemd[1]: Starting D-Bus System Message Bus... container-test-run-flakelet-relay> client # [ 1626.553106] client systemd[1]: Starting linger-users.service... container-test-run-flakelet-relay> client # [ 1626.584051] client systemd[1]: linger-users.service: Deactivated successfully. container-test-run-flakelet-relay> client # [ 1626.584422] client systemd[1]: Finished linger-users.service. container-test-run-flakelet-relay> client # [ 1626.585775] client systemd[1]: Reached target Multi-User System. container-test-run-flakelet-relay> agent # [ 1626.613960] agent systemd[1]: Reloading finished in 408 ms. container-test-run-flakelet-relay> agent # [ 1626.667411] agent systemd[1]: Finished Permit User Sessions. container-test-run-flakelet-relay> agent # [ 1626.679696] agent systemd[1]: Reload requested from client PID 409 ('systemctl') (unit flakelet-flakelet-agent.service)... container-test-run-flakelet-relay> agent # [ 1626.679736] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 1626.758184] relay systemd-logind[354]: New seat seat0. container-test-run-flakelet-relay> relay # [ 1626.758451] relay systemd[1]: Started User Login Management. container-test-run-flakelet-relay> relay # [ 1626.760021] relay systemd[1]: Starting linger-users.service... container-test-run-flakelet-relay> relay # [ 1626.799935] relay systemd[1]: linger-users.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 1626.800313] relay systemd[1]: Finished linger-users.service. container-test-run-flakelet-relay> relay # [ 1626.885801] relay dbus-broker-launch[402]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-flakelet-relay> relay # [ 1626.887254] relay dbus-broker-launch[402]: NSS returned no entry for 'systemd-timesync' container-test-run-flakelet-relay> relay # [ 1626.887254] relay dbus-broker-launch[402]: Invalid user-name in /nix/store/d6qla8vgy057drw03ps2mdgny56bml50-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-flakelet-relay> relay # [ 1626.888105] relay systemd[1]: Started D-Bus System Message Bus. container-test-run-flakelet-relay> relay # [ 1626.894648] relay dbus-broker-launch[402]: Ready container-test-run-flakelet-relay> relay # [ 1626.896787] relay systemd[1]: Started Dnsmasq Daemon. container-test-run-flakelet-relay> relay # [ 1626.899133] relay dnsmasq[394]: started, version 2.93 cachesize 150 container-test-run-flakelet-relay> relay # [ 1626.899147] relay dnsmasq[394]: compile time options: IPv6 GNU-getopt DBus no-UBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP conntrack ipset nftset auth DNSSEC loop-detect inotify dumpfile container-test-run-flakelet-relay> relay # [ 1626.899153] relay dnsmasq[394]: DBus support enabled: connected to system bus container-test-run-flakelet-relay> relay # [ 1626.899160] relay dnsmasq[394]: no upstream servers configured - please set them from DBus container-test-run-flakelet-relay> relay # [ 1626.899244] relay dnsmasq[394]: read /etc/hosts - 9 names container-test-run-flakelet-relay> client # [ 1627.033129] client dbus-broker-launch[325]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-flakelet-relay> client # [ 1627.034881] client dbus-broker-launch[325]: NSS returned no entry for 'systemd-timesync' container-test-run-flakelet-relay> client # [ 1627.034881] client dbus-broker-launch[325]: Invalid user-name in /nix/store/gbwg00c6y2pl3w579c4cbmskfbxpjddb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-flakelet-relay> client # [ 1627.035691] client systemd[1]: Started D-Bus System Message Bus. container-test-run-flakelet-relay> client # [ 1627.036155] client systemd[1]: Startup finished in 4.067s. container-test-run-flakelet-relay> client # [ 1627.042059] client dbus-broker-launch[325]: Ready container-test-run-flakelet-relay> agent # [ 1627.040484] agent systemd[1]: Reloading finished in 360 ms. container-test-run-flakelet-relay> agent # [ 1627.094879] agent systemd[1]: Started Console Getty. container-test-run-flakelet-relay> agent # [ 1627.094971] agent systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-flakelet-relay> agent # [ 1627.095089] agent systemd[1]: Reached target Login Prompts. container-test-run-flakelet-relay> agent # [ 1627.096321] agent systemd[1]: Starting other v1... container-test-run-flakelet-relay> agent # [ 1627.097997] agent systemd[1]: Reload requested from client PID 444 ('systemctl') (unit flakelet-app.service)... container-test-run-flakelet-relay> agent # [ 1627.098034] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1627.446726] agent systemd[1]: Reloading finished in 348 ms. container-test-run-flakelet-relay> agent # [ 1627.505512] agent systemd[1]: Started other v1. container-test-run-flakelet-relay> agent # [ 1627.514401] agent systemd[1]: Starting flakelet-agent... container-test-run-flakelet-relay> agent # [ 1627.518479] agent flakelet[306]: other: updated to generation 1 container-test-run-flakelet-relay> agent # [ 1627.519288] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 1627.542224] agent systemd[1]: Finished Update flakelet service other. container-test-run-flakelet-relay> agent # [ 1627.560026] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> agent # [ 1627.566066] agent flakelet[304]: app: updated to generation 1 container-test-run-flakelet-relay> agent # [ 1627.568208] agent systemd[1]: Finished Update flakelet service app. container-test-run-flakelet-relay> agent # [ 1627.580121] agent systemd-logind[406]: New seat seat0. container-test-run-flakelet-relay> agent # [ 1627.580499] agent systemd[1]: Started User Login Management. container-test-run-flakelet-relay> agent # [ 1627.581777] agent systemd[1]: Starting D-Bus System Message Bus... container-test-run-flakelet-relay> agent # [ 1627.582616] agent systemd[1]: Starting linger-users.service... container-test-run-flakelet-relay> agent # [ 1627.594815] agent systemd[1]: linger-users.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1627.595045] agent systemd[1]: Finished linger-users.service. container-test-run-flakelet-relay> agent # [ 1627.597862] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:49.092495Z","level":"INFO","message":"local change","flakelet":"app","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1627.598706] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:49.092771Z","level":"INFO","message":"local change","flakelet":"other","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1627.598494] agent systemd[1]: Started flakelet-agent. container-test-run-flakelet-relay> agent # [ 1627.601157] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:49.095911Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1627.604273] agent flakelet[305]: flakelet-agent: updated to generation 1 container-test-run-flakelet-relay> agent # [ 1627.606467] agent systemd[1]: Finished Update flakelet service flakelet-agent. container-test-run-flakelet-relay> agent # [ 1627.606623] agent systemd[1]: Reached target flakelet managed services. container-test-run-flakelet-relay> agent # [ 1627.606675] agent systemd[1]: Reached target Multi-User System. container-test-run-flakelet-relay> agent # [ 1627.623930] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:49.118623Z","level":"INFO","message":"local change","flakelet":"flakelet-agent","generation":1,"by":"host activation","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> relay # [ 1627.735981] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:01:49.230623Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 1627.736832] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:01:49.231251Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 1627.736599] relay systemd[1]: Started flakelet-relay. container-test-run-flakelet-relay> relay # [ 1627.746945] relay systemd[1]: Starting health for flakelet-relay... container-test-run-flakelet-relay> relay: (finished: waiting for unit flakelet-relay.service, in 5.66 seconds) container-test-run-flakelet-relay> relay: waiting for unit nginx.service container-test-run-flakelet-relay> relay: (finished: waiting for unit nginx.service, in 0.02 seconds) container-test-run-flakelet-relay> agent: waiting for unit flakelet.target container-test-run-flakelet-relay> agent: (finished: waiting for unit flakelet.target, in 0.02 seconds) container-test-run-flakelet-relay> agent: waiting for unit flakelet-agent.service container-test-run-flakelet-relay> agent: (finished: waiting for unit flakelet-agent.service, in 0.02 seconds) container-test-run-flakelet-relay> client: waiting for unit multi-user.target container-test-run-flakelet-relay> client: (finished: waiting for unit multi-user.target, in 0.02 seconds) container-test-run-flakelet-relay> relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1' container-test-run-flakelet-relay> relay # [ 1628.023601] relay systemd[1]: flakelet-relay-health.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 1628.023860] relay systemd[1]: Finished health for flakelet-relay. container-test-run-flakelet-relay> relay # [ 1628.034086] relay flakelet[311]: flakelet-relay: updated to generation 1 container-test-run-flakelet-relay> relay # [ 1628.042271] relay systemd[1]: Finished Update flakelet service flakelet-relay. container-test-run-flakelet-relay> relay # [ 1628.042876] relay systemd[1]: Reached target flakelet managed services. container-test-run-flakelet-relay> relay # [ 1628.043079] relay systemd[1]: Reached target Multi-User System. container-test-run-flakelet-relay> relay # [ 1628.044114] relay systemd[1]: Startup finished in 5.080s. container-test-run-flakelet-relay> agent # [ 1628.028035] agent dbus-broker-launch[895]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-flakelet-relay> agent # [ 1628.029609] agent dbus-broker-launch[895]: NSS returned no entry for 'systemd-timesync' container-test-run-flakelet-relay> agent # [ 1628.029609] agent dbus-broker-launch[895]: Invalid user-name in /nix/store/8mp15gfn2m81r8005nnkppky8976lhbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-flakelet-relay> agent # [ 1628.030143] agent systemd[1]: Started D-Bus System Message Bus. container-test-run-flakelet-relay> agent # [ 1628.030454] agent systemd[1]: Startup finished in 5.058s. container-test-run-flakelet-relay> agent # [ 1628.035549] agent dbus-broker-launch[895]: Ready container-test-run-flakelet-relay> relay # [ 1629.621731] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:01:51.116451Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(1), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 1629.621384] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:51.116077Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 2.06 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl is-active app.service other.service container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl is-active app.service other.service, in 0.01 seconds) container-test-run-flakelet-relay> subtest: deploy with client certificate, relay found via SRV container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1 container-test-run-flakelet-relay> relay # [ 1630.308410] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:01:51.803094Z","level":"INFO","message":"deploy accepted","job":"978eca48bdbce97b00a2d9536c36e2a6","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1630.309352] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:51.804033Z","level":"INFO","message":"start","id":"4b0ec70ed53f7872ff493e5c72708052","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1630.310259] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:51.804963Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"4b0ec70ed53f7872ff493e5c72708052\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1630.356855] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1630.373454] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1630.377771] agent flakelet[926]: app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2 container-test-run-flakelet-relay> agent # [ 1630.378533] agent flakelet[926]: app: activating generation 2 container-test-run-flakelet-relay> agent # [ 1630.400297] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 1630.400825] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1630.401187] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 1630.422841] agent systemd[1]: Reload requested from client PID 933 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1630.422922] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1630.775036] agent systemd[1]: Reloading finished in 351 ms. container-test-run-flakelet-relay> agent # [ 1630.824944] agent systemd[1]: Reload requested from client PID 963 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1630.824993] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1631.171810] agent systemd[1]: Reloading finished in 346 ms. container-test-run-flakelet-relay> agent # [ 1631.225313] agent systemd[1]: Reload requested from client PID 992 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1631.225360] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1631.564227] agent systemd[1]: Reloading finished in 338 ms. container-test-run-flakelet-relay> agent # [ 1631.618758] agent systemd[1]: Reload requested from client PID 1026 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1631.618801] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1631.962630] agent systemd[1]: Reloading finished in 343 ms. container-test-run-flakelet-relay> agent # [ 1632.007642] agent systemd[1]: Starting app v2... container-test-run-flakelet-relay> agent # [ 1632.023809] agent systemd[1]: Started app v2. container-test-run-flakelet-relay> agent # [ 1632.031379] agent flakelet[926]: app: updated to generation 2 container-test-run-flakelet-relay> agent # [ 1632.034032] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay-srv test --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app 2>&1, in 2.87 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl show app.service -p Description | grep -q 'app v2' container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v2', in 0.02 seconds) container-test-run-flakelet-relay> agent: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2' container-test-run-flakelet-relay> agent: (finished: must succeed: journalctl -u flakelet-relay-job-app.service | grep -q 'generation 2', in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: flakelet status --json app | jq -c '.[0].changed.by' container-test-run-flakelet-relay> agent: (finished: must succeed: flakelet status --json app | jq -c '.[0].changed.by', in 0.03 seconds) container-test-run-flakelet-relay> (finished: subtest: deploy with client certificate, relay found via SRV, in 2.95 seconds) container-test-run-flakelet-relay> subtest: deploy with OIDC token, sub principal container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.05 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjAxNCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg5MDQxNzE0LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJPTlpLNExXSU1TN1FJPT09IiwibmJmIjoxNzg5MDQxNzE0LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.Z42-zwbIaHqnPjGe53zJbZdoW7jh9MRcCindyNFCbyMHWpxWma0M38E7CW2JBEmp6pyihEkhgXs17LFFGvkZCw' push --relay https://relay:7443 deploy agent/app 2>&1 container-test-run-flakelet-relay> agent # [ 1633.151059] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:54.645745Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(2)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1633.322592] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:54.817291Z","level":"INFO","message":"start","id":"7cde9ee37caa0e2c126597d942a2408c","flakelet":"app","rule":"ci","relay":"relay","caller_name":"\"repo:github:example/app:ref:refs/heads/main\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1633.323048] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:54.817709Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"7cde9ee37caa0e2c126597d942a2408c\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1633.370837] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1633.396192] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1633.400248] agent flakelet[1092]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 1633.400845] agent flakelet[1092]: app: activating generation 3 container-test-run-flakelet-relay> relay # [ 1633.152980] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:01:54.647652Z","level":"INFO","message":"deploy finished","job":"978eca48bdbce97b00a2d9536c36e2a6","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1633.322168] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:01:54.816891Z","level":"INFO","message":"deploy accepted","job":"2d25ef66b9059ae8612c7120932a430c","caller":"repo:github:example/app:ref:refs/heads/main","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1633.418981] agent systemd[1]: Stopping app v2... container-test-run-flakelet-relay> agent # [ 1633.419511] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1633.419866] agent systemd[1]: Stopped app v2. container-test-run-flakelet-relay> agent # [ 1633.440288] agent systemd[1]: Reload requested from client PID 1099 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1633.440336] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1633.780945] agent systemd[1]: Reloading finished in 340 ms. container-test-run-flakelet-relay> agent # [ 1633.832367] agent systemd[1]: Reload requested from client PID 1133 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1633.832409] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1634.166372] agent systemd[1]: Reloading finished in 333 ms. container-test-run-flakelet-relay> agent # [ 1634.218814] agent systemd[1]: Reload requested from client PID 1162 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1634.218908] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1634.565926] agent systemd[1]: Reloading finished in 346 ms. container-test-run-flakelet-relay> agent # [ 1634.611907] agent systemd[1]: Reload requested from client PID 1193 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1634.611959] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1634.953093] agent systemd[1]: Reloading finished in 340 ms. container-test-run-flakelet-relay> agent # [ 1635.004016] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 1635.022063] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> agent # [ 1635.029633] agent flakelet[1092]: app: updated to generation 3 container-test-run-flakelet-relay> agent # [ 1635.032402] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjAxNCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg5MDQxNzE0LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJPTlpLNExXSU1TN1FJPT09IiwibmJmIjoxNzg5MDQxNzE0LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.Z42-zwbIaHqnPjGe53zJbZdoW7jh9MRcCindyNFCbyMHWpxWma0M38E7CW2JBEmp6pyihEkhgXs17LFFGvkZCw' push --relay https://relay:7443 deploy agent/app 2>&1, in 2.86 seconds) container-test-run-flakelet-relay> (finished: subtest: deploy with OIDC token, sub principal, in 2.93 seconds) container-test-run-flakelet-relay> subtest: policy denies uncovered target container-test-run-flakelet-relay> client: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjAxNCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg5MDQxNzE0LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJPTlpLNExXSU1TN1FJPT09IiwibmJmIjoxNzg5MDQxNzE0LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.Z42-zwbIaHqnPjGe53zJbZdoW7jh9MRcCindyNFCbyMHWpxWma0M38E7CW2JBEmp6pyihEkhgXs17LFFGvkZCw' push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> client: (finished: must fail: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjAxNCwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg5MDQxNzE0LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJPTlpLNExXSU1TN1FJPT09IiwibmJmIjoxNzg5MDQxNzE0LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.Z42-zwbIaHqnPjGe53zJbZdoW7jh9MRcCindyNFCbyMHWpxWma0M38E7CW2JBEmp6pyihEkhgXs17LFFGvkZCw' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: policy denies uncovered target, in 0.02 seconds) container-test-run-flakelet-relay> subtest: claim principal from groups, unchanged counts as success container-test-run-flakelet-relay> client: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": ["wheel"]}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'someone' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.05 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjAxNywiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc4OTA0MTcxNywiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiVEVGMklFQ1lTN1RERz09PSIsIm5iZiI6MTc4OTA0MTcxNywic3ViIjoic29tZW9uZSJ9.wWlK19YQiQMvv7jfh6kQUE6euGVXdnQtK9zqWthsdHyZw36yK51Hup53n0H9x1NjLYn_rZdLAyyyEqMqDcJHBQ' push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> agent # [ 1636.147042] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:57.641677Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1636.252805] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:57.747484Z","level":"INFO","message":"start","id":"99e47470316e190f58cb4b64ef60390b","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"someone\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1636.253430] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:57.748149Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"99e47470316e190f58cb4b64ef60390b\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1636.305327] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 1636.323425] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 1636.328177] agent flakelet[1247]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 1636.328906] agent flakelet[1247]: other: up to date container-test-run-flakelet-relay> agent # [ 1636.331795] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 1636.148895] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:01:57.643542Z","level":"INFO","message":"deploy finished","job":"2d25ef66b9059ae8612c7120932a430c","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1636.252381] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:01:57.746999Z","level":"INFO","message":"deploy accepted","job":"659c9c681f79de2a9ee0e321e1dfd91d","caller":"someone","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjAxNywiZ3JvdXBzIjpbIndoZWVsIl0sImlhdCI6MTc4OTA0MTcxNywiaXNzIjoiaHR0cHM6Ly9yZWxheTo4NDQzIiwianRpIjoiVEVGMklFQ1lTN1RERz09PSIsIm5iZiI6MTc4OTA0MTcxNywic3ViIjoic29tZW9uZSJ9.wWlK19YQiQMvv7jfh6kQUE6euGVXdnQtK9zqWthsdHyZw36yK51Hup53n0H9x1NjLYn_rZdLAyyyEqMqDcJHBQ' push --relay https://relay:7443 deploy agent/other 2>&1, in 0.65 seconds) container-test-run-flakelet-relay> (finished: subtest: claim principal from groups, unchanged counts as success, in 0.70 seconds) container-test-run-flakelet-relay> subtest: push login via device flow, cached token used afterwards container-test-run-flakelet-relay> client: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1 container-test-run-flakelet-relay> relay # [ 1636.876209] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:01:58.370905Z","level":"INFO","message":"deploy finished","job":"659c9c681f79de2a9ee0e321e1dfd91d","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1636.900995] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [10/Sep/2026 12:01:58] "POST /device HTTP/1.1" 200 - container-test-run-flakelet-relay> agent # [ 1636.874510] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:01:58.369202Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> relay # [ 1637.906554] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [10/Sep/2026 12:01:59] "POST /token HTTP/1.1" 400 - container-test-run-flakelet-relay> client: (finished: must succeed: push login --issuer https://relay:8443 --client-id flakelet-relay 2>&1, in 2.08 seconds) container-test-run-flakelet-relay> client: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600 container-test-run-flakelet-relay> client: (finished: must succeed: test "$(stat -c %a /root/.local/state/flakelet-push/token.json)" = 600, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> relay # [ 1638.954959] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [10/Sep/2026 12:02:00] "POST /token HTTP/1.1" 200 - container-test-run-flakelet-relay> relay # [ 1638.986350] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:00.481042Z","level":"INFO","message":"deploy accepted","job":"53e225197b740d082f765bab464c46b9","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1638.986713] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:00.481401Z","level":"INFO","message":"start","id":"ebe4cdd05a1c69f73b308b1015e17bb3","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1638.987687] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:00.482111Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"ebe4cdd05a1c69f73b308b1015e17bb3\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1639.035114] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 1639.061483] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 1639.066817] agent flakelet[1271]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 1639.067543] agent flakelet[1271]: other: up to date container-test-run-flakelet-relay> agent # [ 1639.069872] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 0.65 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1 container-test-run-flakelet-relay> relay # [ 1639.617344] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:01.112035Z","level":"INFO","message":"deploy finished","job":"53e225197b740d082f765bab464c46b9","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1639.637117] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:01.131804Z","level":"INFO","message":"deploy accepted","job":"8d1cde1f50ee12275b4ba14118676b13","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1639.616034] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:01.110651Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1639.637632] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:01.132312Z","level":"INFO","message":"start","id":"5ddb2996a14ca0d67d884b68df872d1c","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1639.638342] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:01.133060Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5ddb2996a14ca0d67d884b68df872d1c\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1639.684947] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 1639.701195] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 1639.706162] agent flakelet[1295]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 1639.706874] agent flakelet[1295]: other: up to date container-test-run-flakelet-relay> agent # [ 1639.708777] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 deploy agent/other 2>&1, in 0.63 seconds) container-test-run-flakelet-relay> (finished: subtest: push login via device flow, cached token used afterwards, in 3.38 seconds) container-test-run-flakelet-relay> subtest: waves: failing first wave skips the second container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1 container-test-run-flakelet-relay> relay # [ 1640.252849] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:01.747546Z","level":"INFO","message":"deploy finished","job":"8d1cde1f50ee12275b4ba14118676b13","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1640.289797] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:01.784482Z","level":"INFO","message":"deploy accepted","job":"f5f1dad339c76008e9cec33ef9e59bf5","caller":"admin@example.org","targets":"[\"agent/app\", \"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1640.251279] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:01.745973Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1640.290244] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:01.784926Z","level":"INFO","message":"start","id":"26952831be38fd9cc5bf8f5755bd98ce","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1640.290805] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:01.785523Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"26952831be38fd9cc5bf8f5755bd98ce\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1640.337359] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1640.353665] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1640.358204] agent flakelet[1318]: app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken container-test-run-flakelet-relay> agent # [ 1640.358929] agent flakelet[1318]: app: activating generation 4 container-test-run-flakelet-relay> agent # [ 1640.380934] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 1640.381472] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1640.381811] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 1640.403029] agent systemd[1]: Reload requested from client PID 1325 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1640.403114] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1640.754081] agent systemd[1]: Reloading finished in 350 ms. container-test-run-flakelet-relay> agent # [ 1640.806430] agent systemd[1]: Reload requested from client PID 1355 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1640.806481] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1641.151053] agent systemd[1]: Reloading finished in 344 ms. container-test-run-flakelet-relay> agent # [ 1641.185868] agent systemd[1]: Reload requested from client PID 1384 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1641.185964] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1641.532404] agent systemd[1]: Reloading finished in 345 ms. container-test-run-flakelet-relay> agent # [ 1641.582520] agent systemd[1]: Reload requested from client PID 1415 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1641.582612] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1641.924292] agent systemd[1]: Reloading finished in 340 ms. container-test-run-flakelet-relay> agent # [ 1641.970187] agent systemd[1]: Starting app broken... container-test-run-flakelet-relay> agent # [ 1641.984415] agent (nonexistent)[1449]: app.service: Unable to locate executable '/nonexistent': No such file or directory container-test-run-flakelet-relay> agent # [ 1641.984438] agent (nonexistent)[1449]: app.service: Failed at step EXEC spawning /nonexistent: No such file or directory container-test-run-flakelet-relay> agent # [ 1641.986612] agent systemd[1]: app.service: Main process exited, code=exited, status=203/EXEC container-test-run-flakelet-relay> agent # [ 1641.986722] agent systemd[1]: app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> agent # [ 1641.987039] agent systemd[1]: Failed to start app broken. container-test-run-flakelet-relay> agent # [ 1642.017964] agent systemd[1]: Reload requested from client PID 1455 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1642.018021] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1642.358215] agent systemd[1]: Reloading finished in 339 ms. container-test-run-flakelet-relay> agent # [ 1642.400835] agent systemd[1]: Reload requested from client PID 1485 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1642.400890] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1642.745987] agent systemd[1]: Reloading finished in 344 ms. container-test-run-flakelet-relay> agent # [ 1642.790106] agent systemd[1]: Reload requested from client PID 1515 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1642.790152] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1643.133986] agent systemd[1]: Reloading finished in 343 ms. container-test-run-flakelet-relay> agent # [ 1643.183590] agent systemd[1]: Reload requested from client PID 1545 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1643.183627] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1643.521237] agent systemd[1]: Reloading finished in 337 ms. container-test-run-flakelet-relay> agent # [ 1643.568986] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 1643.587051] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> agent # [ 1643.588316] agent flakelet[1318]: app: deploy failed, rolled back: systemctl start app.service failed: container-test-run-flakelet-relay> agent # [ 1643.588316] agent flakelet[1318]: failed units: app.service. See journalctl -u app.service container-test-run-flakelet-relay> agent # [ 1643.590458] agent systemd[1]: flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> agent # [ 1643.590582] agent systemd[1]: flakelet-relay-job-app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave agent/other 2>&1, in 4.08 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl show app.service -p Description | grep -q 'app v1' container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl show app.service -p Description | grep -q 'app v1', in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: waves: failing first wave skips the second, in 4.11 seconds) container-test-run-flakelet-relay> subtest: host patterns expand on the relay container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/app' 2>&1 container-test-run-flakelet-relay> relay # [ 1644.340701] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:05.835400Z","level":"INFO","message":"deploy finished","job":"f5f1dad339c76008e9cec33ef9e59bf5","ok":false,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1644.402131] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:05.896818Z","level":"INFO","message":"deploy accepted","job":"f05a14785ad27aae1b1029d000c4bb7d","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1644.338904] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:05.833593Z","level":"INFO","message":"update finished","flakelet":"app","status":"RolledBack","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1644.402606] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:05.897288Z","level":"INFO","message":"start","id":"1cf5283742fc5fbdb0c773effd2e5acb","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1644.403195] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:05.897955Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"1cf5283742fc5fbdb0c773effd2e5acb\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1644.449559] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1644.464798] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1644.469483] agent flakelet[1605]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 1644.470201] agent flakelet[1605]: app: up to date container-test-run-flakelet-relay> agent # [ 1644.471102] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/app' 2>&1, in 0.64 seconds) container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '*/app' 2>&1 container-test-run-flakelet-relay> relay # [ 1645.021963] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:06.516659Z","level":"INFO","message":"deploy finished","job":"f05a14785ad27aae1b1029d000c4bb7d","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1645.045658] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:06.540406Z","level":"INFO","message":"deploy accepted","job":"f8d801880c0fee78c81b0fc103f2ad57","caller":"admin@example.org","targets":"[\"agent/app\", \"ghost/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1645.020309] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:06.514999Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1645.046180] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:06.540912Z","level":"INFO","message":"start","id":"79b5d5729dc2aa800569c5b2e6587d85","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1645.046659] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:06.541421Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"79b5d5729dc2aa800569c5b2e6587d85\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1645.093881] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1645.109342] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1645.113700] agent flakelet[1625]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 1645.114411] agent flakelet[1625]: app: up to date container-test-run-flakelet-relay> agent # [ 1645.117468] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '*/app' 2>&1, in 0.64 seconds) container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave '*/app' 2>&1 container-test-run-flakelet-relay> relay # [ 1645.660425] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:07.155116Z","level":"INFO","message":"deploy finished","job":"f8d801880c0fee78c81b0fc103f2ad57","ok":false,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1645.682781] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:07.177469Z","level":"INFO","message":"deploy accepted","job":"3439734f91fade89d09c36269ac55497","caller":"admin@example.org","targets":"[\"agent/app\", \"ghost/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1645.658725] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:07.153414Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1645.683226] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:07.177919Z","level":"INFO","message":"start","id":"daf0da91af3451e61d7b3decce5b4545","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1645.683512] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:07.178280Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"daf0da91af3451e61d7b3decce5b4545\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1645.732739] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1645.751423] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1645.756164] agent flakelet[1649]: app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> agent # [ 1645.756689] agent flakelet[1649]: app: up to date container-test-run-flakelet-relay> agent # [ 1645.760056] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app --wave '*/app' 2>&1, in 0.64 seconds) container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/nope' 2>&1 container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy '@all/nope' 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: host patterns expand on the relay, in 1.96 seconds) container-test-run-flakelet-relay> subtest: detach returns once the job is accepted container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1 container-test-run-flakelet-relay> client: (finished: must succeed: timeout 20 push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --detach agent/app 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> agent: waiting for success: systemctl is-active flakelet-relay-job-app.service container-test-run-flakelet-relay> relay # [ 1646.301481] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:07.796196Z","level":"INFO","message":"deploy finished","job":"3439734f91fade89d09c36269ac55497","ok":false,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1646.360805] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:07.855491Z","level":"INFO","message":"deploy accepted","job":"08774625343cf4fc5b27d607be2a9df9","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1646.299672] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:07.794354Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(3)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1646.361157] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:07.855853Z","level":"INFO","message":"start","id":"4e2b3b97b3d161192eb0f321d63e300e","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1646.361430] agent flakelet-agent[504]: {"timestamp":"2026-09-10T12:02:07.856198Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"4e2b3b97b3d161192eb0f321d63e300e\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1646.405457] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1646.425521] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1646.429844] agent flakelet[1673]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2 container-test-run-flakelet-relay> agent # [ 1646.430580] agent flakelet[1673]: app: activating generation 4 container-test-run-flakelet-relay> agent # [ 1646.447018] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 1646.447540] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1646.447882] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 1646.468271] agent systemd[1]: Reload requested from client PID 1680 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1646.468360] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1646.818502] agent systemd[1]: Reloading finished in 349 ms. container-test-run-flakelet-relay> agent # [ 1646.866834] agent systemd[1]: Reload requested from client PID 1710 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1646.866929] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1647.205701] agent systemd[1]: Reloading finished in 338 ms. container-test-run-flakelet-relay> agent # [ 1647.249319] agent systemd[1]: Reload requested from client PID 1739 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1647.249417] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1647.589340] agent systemd[1]: Reloading finished in 339 ms. container-test-run-flakelet-relay> agent: (finished: waiting for success: systemctl is-active flakelet-relay-job-app.service, in 1.27 seconds) container-test-run-flakelet-relay> ??? Warning (UserWarning): wait_until_fails(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. container-test-run-flakelet-relay> File "/nix/store/f3vbkhcnzmgjphqaarrzgjdpzrb02va5-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 container-test-run-flakelet-relay> agent: waiting for failure: systemctl is-active flakelet-relay-job-app.service container-test-run-flakelet-relay> ??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. container-test-run-flakelet-relay> File "/nix/store/f3vbkhcnzmgjphqaarrzgjdpzrb02va5-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 container-test-run-flakelet-relay> agent # [ 1647.644229] agent systemd[1]: Reload requested from client PID 1775 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1647.644275] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1647.990732] agent systemd[1]: Reloading finished in 346 ms. container-test-run-flakelet-relay> agent # [ 1648.040940] agent systemd[1]: Starting app slow2... container-test-run-flakelet-relay> agent: (finished: waiting for failure: systemctl is-active flakelet-relay-job-app.service, in 6.49 seconds) container-test-run-flakelet-relay> (finished: subtest: detach returns once the job is accepted, in 7.79 seconds) container-test-run-flakelet-relay> subtest: unknown host is final, missing agent is retried, agents listing container-test-run-flakelet-relay> client: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1 container-test-run-flakelet-relay> client: (finished: must fail: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy nope/app 2>&1, in 0.02 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl stop flakelet-agent container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl stop flakelet-agent, in 0.08 seconds) container-test-run-flakelet-relay> relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0' container-test-run-flakelet-relay> relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 0', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/other > /tmp/retry.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out container-test-run-flakelet-relay> agent # [ 1654.090599] agent systemd[1]: Started app slow2. container-test-run-flakelet-relay> agent # [ 1654.099712] agent flakelet[1673]: app: updated to generation 4 container-test-run-flakelet-relay> agent # [ 1654.103499] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1654.155485] agent systemd[1]: Stopping flakelet-agent... container-test-run-flakelet-relay> agent # [ 1654.182704] agent systemd[1]: flakelet-agent.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1654.183286] agent systemd[1]: Stopped flakelet-agent. container-test-run-flakelet-relay> agent # [ 1654.183804] agent systemd[1]: flakelet-agent.service: Consumed 1.450s CPU time over 26.668s wall clock time. container-test-run-flakelet-relay> relay # [ 1654.155756] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:15.650402Z","level":"INFO","message":"agent disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","host":"agent","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent_unavailable.*retrying' /tmp/retry.out, in 1.02 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl start flakelet-agent container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl start flakelet-agent, in 0.09 seconds) container-test-run-flakelet-relay> ??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. container-test-run-flakelet-relay> File "/nix/store/f3vbkhcnzmgjphqaarrzgjdpzrb02va5-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out container-test-run-flakelet-relay> relay # [ 1655.361565] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:16.856249Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(4), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 1655.277642] agent systemd[1]: Starting flakelet-agent... container-test-run-flakelet-relay> agent # [ 1655.322176] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:16.816888Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"4e2b3b97b3d161192eb0f321d63e300e\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1655.350679] agent systemd[1]: Started flakelet-agent. container-test-run-flakelet-relay> agent # [ 1655.361443] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:16.856141Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1655.873511] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:17.368198Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(4)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> relay # [ 1657.263817] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:18.758531Z","level":"INFO","message":"deploy accepted","job":"b746dd80aa30c0eb469f6ea5e8715226","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1657.264336] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:18.759012Z","level":"INFO","message":"start","id":"47a099343acfaeb3da4f2b9d0ce90a0a","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1657.265484] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:18.759564Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"47a099343acfaeb3da4f2b9d0ce90a0a\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1657.314423] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 1657.338025] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 1657.343078] agent flakelet[2251]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 1657.343569] agent flakelet[2251]: other: up to date container-test-run-flakelet-relay> agent # [ 1657.347201] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1657.891855] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:19.386542Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> relay # [ 1657.893577] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:19.388229Z","level":"INFO","message":"deploy finished","job":"b746dd80aa30c0eb469f6ea5e8715226","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent/other: unchanged' /tmp/retry.out, in 3.05 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": []}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.05 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjAzOSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg5MDQxNzM5LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJOQjJHQUxXSVI1NUFHPT09IiwibmJmIjoxNzg5MDQxNzM5LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.BQaE1hDuZYG10wOOCZRXpTWB59hiUqVW1gKFPc-f_eaCVO9dSMuzPB_wq0O41r5rZutxikFXFcKRr_ZHqBrBBA' push --relay https://relay:7443 agents container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjAzOSwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg5MDQxNzM5LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiJOQjJHQUxXSVI1NUFHPT09IiwibmJmIjoxNzg5MDQxNzM5LCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.BQaE1hDuZYG10wOOCZRXpTWB59hiUqVW1gKFPc-f_eaCVO9dSMuzPB_wq0O41r5rZutxikFXFcKRr_ZHqBrBBA' push --relay https://relay:7443 agents, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: unknown host is final, missing agent is retried, agents listing, in 4.38 seconds) container-test-run-flakelet-relay> subtest: out-of-band flakelet update reaches the relay without reconnect container-test-run-flakelet-relay> agent: must succeed: flakelet status --json app | jq '.[0].generation' container-test-run-flakelet-relay> agent: (finished: must succeed: flakelet status --json app | jq '.[0].generation', in 0.04 seconds) container-test-run-flakelet-relay> agent: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true container-test-run-flakelet-relay> agent: (finished: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: flakelet update app container-test-run-flakelet-relay> app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2 container-test-run-flakelet-relay> app: activating generation 5 container-test-run-flakelet-relay> agent # [ 1658.586700] agent systemd[1]: Stopping app slow2... container-test-run-flakelet-relay> agent # [ 1658.587243] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1658.587591] agent systemd[1]: Stopped app slow2. container-test-run-flakelet-relay> agent # [ 1658.609349] agent systemd[1]: Reload requested from client PID 2285 ('systemctl')... container-test-run-flakelet-relay> agent # [ 1658.609441] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1658.960956] agent systemd[1]: Reloading finished in 350 ms. container-test-run-flakelet-relay> agent # [ 1659.010219] agent systemd[1]: Reload requested from client PID 2314 ('systemctl')... container-test-run-flakelet-relay> agent # [ 1659.010277] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1659.350464] agent systemd[1]: Reloading finished in 339 ms. container-test-run-flakelet-relay> agent # [ 1659.393974] agent systemd[1]: Reload requested from client PID 2345 ('systemctl')... container-test-run-flakelet-relay> agent # [ 1659.394035] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1659.734700] agent systemd[1]: Reloading finished in 340 ms. container-test-run-flakelet-relay> agent # [ 1659.776467] agent systemd[1]: Reload requested from client PID 2375 ('systemctl')... container-test-run-flakelet-relay> agent # [ 1659.776556] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1660.125250] agent systemd[1]: Reloading finished in 347 ms. container-test-run-flakelet-relay> agent: (finished: must succeed: flakelet update app, in 1.64 seconds) container-test-run-flakelet-relay> client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@5' container-test-run-flakelet-relay> agent # [ 1660.171587] agent systemd[1]: Starting app v2... container-test-run-flakelet-relay> agent # [ 1660.190926] agent systemd[1]: Started app v2. container-test-run-flakelet-relay> agent # [ 1661.380670] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:22.875363Z","level":"INFO","message":"local change","flakelet":"app","generation":5,"by":"root (shell)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@5', in 2.07 seconds) container-test-run-flakelet-relay> agent: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true container-test-run-flakelet-relay> agent: (finished: must succeed: journalctl -u flakelet-agent -o cat | grep -c '"connected"' || true, in 0.01 seconds) container-test-run-flakelet-relay> client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-5- container-test-run-flakelet-relay> client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-5-, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app- container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs | grep local-app-, in 0.02 seconds) container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: flakelet update app container-test-run-flakelet-relay> app: using prebuilt artifact /nix/store/hysydfr96ds875vr0jgw5rjxi4p39h2j-flakelet-app-v1 container-test-run-flakelet-relay> app: activating generation 6 container-test-run-flakelet-relay> agent # [ 1662.372166] agent systemd[1]: Stopping app v2... container-test-run-flakelet-relay> agent # [ 1662.372699] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1662.373044] agent systemd[1]: Stopped app v2. container-test-run-flakelet-relay> agent # [ 1662.393526] agent systemd[1]: Reload requested from client PID 2421 ('systemctl')... container-test-run-flakelet-relay> agent # [ 1662.393615] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1662.749157] agent systemd[1]: Reloading finished in 354 ms. container-test-run-flakelet-relay> agent # [ 1662.793237] agent systemd[1]: Reload requested from client PID 2450 ('systemctl')... container-test-run-flakelet-relay> agent # [ 1662.793286] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1663.131920] agent systemd[1]: Reloading finished in 338 ms. container-test-run-flakelet-relay> agent # [ 1663.185346] agent systemd[1]: Reload requested from client PID 2478 ('systemctl')... container-test-run-flakelet-relay> agent # [ 1663.185393] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1663.531144] agent systemd[1]: Reloading finished in 345 ms. container-test-run-flakelet-relay> agent # [ 1663.579417] agent systemd[1]: Reload requested from client PID 2511 ('systemctl')... container-test-run-flakelet-relay> agent # [ 1663.579465] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: must succeed: flakelet update app, in 1.65 seconds) container-test-run-flakelet-relay> client: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@6' container-test-run-flakelet-relay> agent # [ 1663.920753] agent systemd[1]: Reloading finished in 340 ms. container-test-run-flakelet-relay> agent # [ 1663.963034] agent systemd[1]: Starting app v1... container-test-run-flakelet-relay> agent # [ 1663.981158] agent systemd[1]: Started app v1. container-test-run-flakelet-relay> agent # [ 1665.377713] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:26.872405Z","level":"INFO","message":"local change","flakelet":"app","generation":6,"by":"root (shell)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> client: (finished: waiting for success: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem agents | grep -q 'app@6', in 2.07 seconds) container-test-run-flakelet-relay> (finished: subtest: out-of-band flakelet update reaches the relay without reconnect, in 7.57 seconds) container-test-run-flakelet-relay> subtest: certificate not listed under agents cannot connect as agent container-test-run-flakelet-relay> client: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent container-test-run-flakelet-relay> client: (finished: must succeed: curl -s -o /dev/null -w '%{http_code}' --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/cert.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/mallory/key.pem -H 'Upgrade: websocket' -H 'Connection: Upgrade' -H 'Sec-WebSocket-Version: 13' -H 'Sec-WebSocket-Key: dGhlIHNhbXBsZSBub25jZQ==' https://relay:7443/v1/agent, in 0.03 seconds) container-test-run-flakelet-relay> (finished: subtest: certificate not listed under agents cannot connect as agent, in 0.03 seconds) container-test-run-flakelet-relay> subtest: metrics container-test-run-flakelet-relay> relay: must succeed: curl -sf http://127.0.0.1:7400/metrics container-test-run-flakelet-relay> relay: (finished: must succeed: curl -sf http://127.0.0.1:7400/metrics, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: metrics, in 0.02 seconds) container-test-run-flakelet-relay> subtest: agent link drop mid-run replays missed lines once container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: date +%s container-test-run-flakelet-relay> agent: (finished: must succeed: date +%s, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/slow.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1789041747 | grep -q 'app-slow' container-test-run-flakelet-relay> relay # [ 1666.088915] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:27.583605Z","level":"INFO","message":"agent rejected: no agents entry matches","principals":"[\"x509:dns:mallory\"]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> relay # [ 1666.153289] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:27.647928Z","level":"INFO","message":"deploy accepted","job":"21a442279068855740f433f05738da0d","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1666.153722] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:27.648411Z","level":"INFO","message":"start","id":"bcd578e0d32162a17654b8405cda25b0","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1666.154334] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:27.649071Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"bcd578e0d32162a17654b8405cda25b0\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1666.197493] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1666.219241] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1666.223963] agent flakelet[2560]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent # [ 1666.224719] agent flakelet[2560]: app: activating generation 7 container-test-run-flakelet-relay> agent # [ 1666.246161] agent systemd[1]: Stopping app v1... container-test-run-flakelet-relay> agent # [ 1666.246691] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1666.247042] agent systemd[1]: Stopped app v1. container-test-run-flakelet-relay> agent # [ 1666.268302] agent systemd[1]: Reload requested from client PID 2567 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1666.268390] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1666.617737] agent systemd[1]: Reloading finished in 348 ms. container-test-run-flakelet-relay> agent # [ 1666.671390] agent systemd[1]: Reload requested from client PID 2597 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1666.671479] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1789041747 | grep -q 'app-slow', in 1.03 seconds) container-test-run-flakelet-relay> agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done container-test-run-flakelet-relay> agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route add unreachable $a; done, in 0.02 seconds) container-test-run-flakelet-relay> relay: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done container-test-run-flakelet-relay> relay: (finished: must succeed: for a in $(getent ahosts agent | cut -d' ' -f1 | sort -u); do ss -K dst "[$a]"; done, in 0.06 seconds) container-test-run-flakelet-relay> agent: must succeed: ss -K dport = 7443 container-test-run-flakelet-relay> agent # [ 1667.012763] agent systemd[1]: Reloading finished in 340 ms. container-test-run-flakelet-relay> agent # [ 1667.053445] agent systemd[1]: Reload requested from client PID 2626 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1667.053494] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: must succeed: ss -K dport = 7443, in 0.03 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1789041747 | grep -q 'updated to generation' container-test-run-flakelet-relay> relay # [ 1667.238186] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:28.732915Z","level":"INFO","message":"agent disconnected: IO error: Software caused connection abort (os error 103)","host":"agent","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 1667.270381] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:28.765035Z","level":"INFO","message":"disconnected: IO error: Software caused connection abort (os error 103)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1667.394268] agent systemd[1]: Reloading finished in 340 ms. container-test-run-flakelet-relay> agent # [ 1667.444970] agent systemd[1]: Reload requested from client PID 2674 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1667.445027] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1667.793688] agent systemd[1]: Reloading finished in 348 ms. container-test-run-flakelet-relay> agent # [ 1667.838922] agent systemd[1]: Starting app slow... container-test-run-flakelet-relay> agent # [ 1668.273828] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:29.768475Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1670.276543] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:31.771174Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1673.885032] agent systemd[1]: Started app slow. container-test-run-flakelet-relay> agent # [ 1673.894669] agent flakelet[2560]: app: updated to generation 7 container-test-run-flakelet-relay> agent # [ 1673.898454] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1789041747 | grep -q 'updated to generation', in 7.11 seconds) container-test-run-flakelet-relay> agent: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done container-test-run-flakelet-relay> agent: (finished: must succeed: for a in $(getent ahosts relay | cut -d' ' -f1 | sort -u); do ip route del unreachable $a; done, in 0.02 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out container-test-run-flakelet-relay> agent # [ 1674.279438] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:35.774172Z","level":"WARN","message":"connect failed: connect relay:7443: No route to host (os error 113)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1675.026605] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:36.521257Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(7)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/slow.out, in 8.10 seconds) container-test-run-flakelet-relay> client: must succeed: cat /tmp/slow.out container-test-run-flakelet-relay> client: (finished: must succeed: cat /tmp/slow.out, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: agent link drop mid-run replays missed lines once, in 16.41 seconds) container-test-run-flakelet-relay> subtest: agent restart mid-run reattaches to the unit container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/restart.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2' container-test-run-flakelet-relay> relay # [ 1682.284958] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:43.779566Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> relay # [ 1682.285985] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:43.780180Z","level":"INFO","message":"deploy finished","job":"21a442279068855740f433f05738da0d","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1682.559425] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:44.053995Z","level":"INFO","message":"deploy accepted","job":"9cdec76f5ab11b04823202bcd0df9fa5","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1682.284824] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:43.779464Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1682.285806] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:43.779709Z","level":"INFO","message":"start","id":"bcd578e0d32162a17654b8405cda25b0","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1682.559804] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:44.054380Z","level":"INFO","message":"start","id":"a65cf58ea1265e1431782531a9c8fe20","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1682.559974] agent flakelet-agent[1838]: {"timestamp":"2026-09-10T12:02:44.054736Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"a65cf58ea1265e1431782531a9c8fe20\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1682.604671] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1682.622156] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1682.626631] agent flakelet[2796]: app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2 container-test-run-flakelet-relay> agent # [ 1682.627265] agent flakelet[2796]: app: activating generation 8 container-test-run-flakelet-relay> agent # [ 1682.649142] agent systemd[1]: Stopping app slow... container-test-run-flakelet-relay> agent # [ 1682.649624] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1682.649981] agent systemd[1]: Stopped app slow. container-test-run-flakelet-relay> agent # [ 1682.673117] agent systemd[1]: Reload requested from client PID 2803 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1682.673202] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1683.025236] agent systemd[1]: Reloading finished in 351 ms. container-test-run-flakelet-relay> agent # [ 1683.075030] agent systemd[1]: Reload requested from client PID 2833 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1683.075065] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since -20s | grep -q 'app-slow2', in 1.03 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl restart flakelet-agent container-test-run-flakelet-relay> agent # [ 1683.409122] agent systemd[1]: Reloading finished in 333 ms. container-test-run-flakelet-relay> agent # [ 1683.455054] agent systemd[1]: Reload requested from client PID 2865 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1683.455104] agent systemd[1]: Reloading... container-test-run-flakelet-relay> relay # [ 1683.839038] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:45.333710Z","level":"INFO","message":"agent disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","host":"agent","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 1683.801628] agent systemd[1]: Reloading finished in 346 ms. container-test-run-flakelet-relay> agent # [ 1683.838454] agent systemd[1]: Stopping flakelet-agent... container-test-run-flakelet-relay> agent # [ 1683.849785] agent systemd[1]: Reload requested from client PID 2901 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1683.849877] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl restart flakelet-agent, in 0.75 seconds) container-test-run-flakelet-relay> agent: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)" container-test-run-flakelet-relay> agent: (finished: must succeed: test -n "$(ls /var/lib/flakelet-agent/jobs)", in 0.01 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out container-test-run-flakelet-relay> relay # [ 1684.334524] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:45.829203Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(7), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 1684.197069] agent systemd[1]: Reloading finished in 346 ms. container-test-run-flakelet-relay> agent # [ 1684.232818] agent systemd[1]: flakelet-agent.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1684.233118] agent systemd[1]: Stopped flakelet-agent. container-test-run-flakelet-relay> agent # [ 1684.251163] agent systemd[1]: Starting flakelet-agent... container-test-run-flakelet-relay> agent # [ 1684.252643] agent systemd[1]: Starting app slow2... container-test-run-flakelet-relay> agent # [ 1684.295222] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:02:45.789892Z","level":"INFO","message":"reattaching to running unit","flakelet":"app","ids":"[\"a65cf58ea1265e1431782531a9c8fe20\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1684.320775] agent systemd[1]: Started flakelet-agent. container-test-run-flakelet-relay> agent # [ 1684.334402] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:02:45.829090Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1684.335647] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:02:45.830410Z","level":"INFO","message":"start","id":"a65cf58ea1265e1431782531a9c8fe20","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1690.290150] agent systemd[1]: Started app slow2. container-test-run-flakelet-relay> agent # [ 1690.299944] agent flakelet[2796]: app: updated to generation 8 container-test-run-flakelet-relay> agent # [ 1690.303926] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1690.891184] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:02:52.385898Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(8)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> relay # [ 1690.893093] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:52.387769Z","level":"INFO","message":"deploy finished","job":"9cdec76f5ab11b04823202bcd0df9fa5","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q 'agent/app: updated' /tmp/restart.out, in 7.09 seconds) container-test-run-flakelet-relay> client: must succeed: cat /tmp/restart.out container-test-run-flakelet-relay> client: (finished: must succeed: cat /tmp/restart.out, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: systemctl is-active app.service container-test-run-flakelet-relay> agent: (finished: must succeed: systemctl is-active app.service, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: agent restart mid-run reattaches to the unit, in 8.92 seconds) container-test-run-flakelet-relay> subtest: relay restart mid-run, push resumes via /v1/jobs container-test-run-flakelet-relay> agent: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json container-test-run-flakelet-relay> agent: (finished: must succeed: jq '.services.app.prebuilt="/nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow"' /etc/flakelet/config.json > /tmp/config.json && cp --remove-destination /tmp/config.json /etc/flakelet/config.json, in 0.01 seconds) container-test-run-flakelet-relay> agent: must succeed: date +%s container-test-run-flakelet-relay> agent: (finished: must succeed: date +%s, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy agent/app > /tmp/resume.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> agent: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1789041772 | grep -q 'app-slow' container-test-run-flakelet-relay> relay # [ 1691.490262] relay flakelet-relay[400]: {"timestamp":"2026-09-10T12:02:52.984982Z","level":"INFO","message":"deploy accepted","job":"d998b680dd01e7ca1a4edf90d3b4033c","caller":"admin@example.org","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1691.490653] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:02:52.985356Z","level":"INFO","message":"start","id":"7a644d35b6196c70d1c75b02be562458","flakelet":"app","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1691.490998] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:02:52.985717Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"7a644d35b6196c70d1c75b02be562458\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1691.530314] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1691.548737] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1691.553207] agent flakelet[3378]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent # [ 1691.553928] agent flakelet[3378]: app: activating generation 9 container-test-run-flakelet-relay> agent # [ 1691.575049] agent systemd[1]: Stopping app slow2... container-test-run-flakelet-relay> agent # [ 1691.575550] agent systemd[1]: app.service: Deactivated successfully. container-test-run-flakelet-relay> agent # [ 1691.575891] agent systemd[1]: Stopped app slow2. container-test-run-flakelet-relay> agent # [ 1691.597093] agent systemd[1]: Reload requested from client PID 3385 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1691.597181] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1691.946286] agent systemd[1]: Reloading finished in 348 ms. container-test-run-flakelet-relay> agent # [ 1691.996491] agent systemd[1]: Reload requested from client PID 3415 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1691.996539] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1692.338308] agent systemd[1]: Reloading finished in 341 ms. container-test-run-flakelet-relay> agent: (finished: waiting for success: journalctl -u flakelet-relay-job-app.service --since=@1789041772 | grep -q 'app-slow', in 1.03 seconds) container-test-run-flakelet-relay> relay: must succeed: systemctl restart flakelet-relay container-test-run-flakelet-relay> agent # [ 1692.385474] agent systemd[1]: Reload requested from client PID 3447 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1692.385523] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1692.517580] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:02:54.012307Z","level":"INFO","message":"disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay # [ 1692.517276] relay systemd[1]: Stopping flakelet-relay... container-test-run-flakelet-relay> relay # [ 1692.547785] relay systemd[1]: flakelet-relay.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 1692.548366] relay systemd[1]: Stopped flakelet-relay. container-test-run-flakelet-relay> relay # [ 1692.548409] relay systemd[1]: flakelet-relay.service: Consumed 2.150s CPU time over 1min 6.773s wall clock time. container-test-run-flakelet-relay> relay # [ 1692.585047] relay systemd[1]: Starting flakelet-relay... container-test-run-flakelet-relay> agent # [ 1692.738185] agent systemd[1]: Reloading finished in 352 ms. container-test-run-flakelet-relay> agent # [ 1692.807442] agent systemd[1]: Reload requested from client PID 3482 ('systemctl') (unit flakelet-relay-job-app.service)... container-test-run-flakelet-relay> agent # [ 1692.807479] agent systemd[1]: Reloading... container-test-run-flakelet-relay> agent # [ 1693.155514] agent systemd[1]: Reloading finished in 347 ms. container-test-run-flakelet-relay> agent # [ 1693.220276] agent systemd[1]: Starting app slow... container-test-run-flakelet-relay> agent # [ 1693.520877] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:02:55.015559Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.53 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q '» ok' /tmp/resume.out container-test-run-flakelet-relay> relay # [ 1694.029517] relay flakelet-relay[932]: {"timestamp":"2026-09-10T12:02:55.524203Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 1694.030358] relay flakelet-relay[932]: {"timestamp":"2026-09-10T12:02:55.524621Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 1694.030104] relay systemd[1]: Started flakelet-relay. container-test-run-flakelet-relay> relay # [ 1695.533283] relay flakelet-relay[932]: {"timestamp":"2026-09-10T12:02:57.028007Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(8), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 1695.533186] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:02:57.027859Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1699.266525] agent systemd[1]: Started app slow. container-test-run-flakelet-relay> agent # [ 1699.274670] agent flakelet[3378]: app: updated to generation 9 container-test-run-flakelet-relay> agent # [ 1699.278147] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 1699.538268] relay flakelet-relay[932]: {"timestamp":"2026-09-10T12:03:01.032992Z","level":"INFO","message":"job reattached","job":"d998b680dd01e7ca1a4edf90d3b4033c","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1700.391215] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:01.885905Z","level":"INFO","message":"update finished","flakelet":"app","status":"Updated","generation":"Some(9)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q '» ok' /tmp/resume.out, in 7.09 seconds) container-test-run-flakelet-relay> client: must succeed: cat /tmp/resume.out container-test-run-flakelet-relay> client: (finished: must succeed: cat /tmp/resume.out, in 0.01 seconds) container-test-run-flakelet-relay> (finished: subtest: relay restart mid-run, push resumes via /v1/jobs, in 9.69 seconds) container-test-run-flakelet-relay> subtest: job history comes from the agents and survives a relay restart container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1 container-test-run-flakelet-relay> relay # [ 1701.156557] relay flakelet-relay[932]: {"timestamp":"2026-09-10T12:03:02.651249Z","level":"INFO","message":"deploy accepted","job":"188b06c4636b65849b3ba8daac22dc7c","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1701.157073] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:02.651747Z","level":"INFO","message":"start","id":"5be20c693e5c0b60e3f85779794dfb86","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1701.157707] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:02.652465Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5be20c693e5c0b60e3f85779794dfb86\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1701.206870] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 1701.225443] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 1701.230534] agent flakelet[3556]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 1701.231337] agent flakelet[3556]: other: up to date container-test-run-flakelet-relay> agent # [ 1701.234562] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id hist1 agent/other 2>&1, in 0.65 seconds) container-test-run-flakelet-relay> relay: must succeed: systemctl restart flakelet-relay container-test-run-flakelet-relay> relay # [ 1701.778087] relay flakelet-relay[932]: {"timestamp":"2026-09-10T12:03:03.272762Z","level":"INFO","message":"deploy finished","job":"188b06c4636b65849b3ba8daac22dc7c","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1701.794148] relay systemd[1]: Stopping flakelet-relay... container-test-run-flakelet-relay> relay # [ 1701.842362] relay systemd[1]: flakelet-relay.service: Deactivated successfully. container-test-run-flakelet-relay> relay # [ 1701.842908] relay systemd[1]: Stopped flakelet-relay. container-test-run-flakelet-relay> relay # [ 1701.842958] relay systemd[1]: flakelet-relay.service: Consumed 1.743s CPU time over 9.257s wall clock time. container-test-run-flakelet-relay> relay # [ 1701.879493] relay systemd[1]: Starting flakelet-relay... container-test-run-flakelet-relay> agent # [ 1701.776667] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:03.271363Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1701.794391] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:03.289148Z","level":"INFO","message":"disconnected: IO error: peer closed connection without sending TLS close_notify: https://docs.rs/rustls/latest/rustls/manual/_03_howto/index.html#unexpected-eof","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1702.797918] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:04.292596Z","level":"WARN","message":"connect failed: connect relay:7443: Connection refused (os error 111)","relay":"https://relay:7443","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: must succeed: systemctl restart flakelet-relay, in 1.53 seconds) container-test-run-flakelet-relay> relay: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1' container-test-run-flakelet-relay> relay # [ 1703.304598] relay flakelet-relay[1322]: {"timestamp":"2026-09-10T12:03:04.799320Z","level":"INFO","message":"listening on 127.0.0.1:7400","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 1703.305472] relay flakelet-relay[1322]: {"timestamp":"2026-09-10T12:03:04.799778Z","level":"INFO","message":"listening on [::]:7443","target":"flakelet_relay::relay::server"} container-test-run-flakelet-relay> relay # [ 1703.305169] relay systemd[1]: Started flakelet-relay. container-test-run-flakelet-relay> relay # [ 1704.812179] relay flakelet-relay[1322]: {"timestamp":"2026-09-10T12:03:06.306853Z","level":"INFO","message":"agent connected","host":"agent","version":"0.1.0","flakelets":"[Named { name: \"app\", generation: Some(9), revision: Some(\"prebuilt:app\") }, Named { name: \"flakelet-agent\", generation: Some(1), revision: Some(\"prebuilt:flakelet-agent\") }, Named { name: \"other\", generation: Some(1), revision: Some(\"prebuilt:other\") }]","target":"flakelet_relay::relay::agent_conn"} container-test-run-flakelet-relay> agent # [ 1704.812027] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:06.306690Z","level":"INFO","message":"connected","relay":"https://relay:7443","relay_name":"relay","relay_version":"0.1.0","host":"agent","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> relay: (finished: waiting for success: curl -sf http://127.0.0.1:7400/metrics | grep -q 'agent_up{host="agent"} 1', in 2.06 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem jobs, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: echo '{"groups": [], "repository": "example/app"}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32) container-test-run-flakelet-relay> client: (finished: must succeed: echo '{"groups": [], "repository": "example/app"}' | step crypto jwt sign --key /nix/store/r7sclamg09v434w8zjlfnrcrn1w79wh6-flakelet-relay-test-issuer/jwk.json --iss https://relay:8443 --aud flakelet-relay --sub 'repo:github:example/app:ref:refs/heads/main' --exp $(( $(date +%s) + 300 )) --jti $(head -c8 /dev/urandom | base32), in 0.05 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjA4NiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg5MDQxNzg2LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI0MkNSVDVIUlNKM1pZPT09IiwibmJmIjoxNzg5MDQxNzg2LCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.egrH8DB3RHkTlRtWGPri4hc7hCTRJpnvJzVySAoRlja1o5_vrpQd_AzkMV9o5HEp0OoPL7TEIb2hBD3btczXBg' push --relay https://relay:7443 deploy --id hist2 agent/app container-test-run-flakelet-relay> » job 6a239dbf87cfec796e49404c351d787f via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> relay # [ 1705.458326] relay flakelet-relay[1322]: {"timestamp":"2026-09-10T12:03:06.953019Z","level":"INFO","message":"deploy accepted","job":"6a239dbf87cfec796e49404c351d787f","caller":"example/app","targets":"[\"agent/app\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1705.458712] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:06.953394Z","level":"INFO","message":"start","id":"dce6faec8455f85321e72ee634888126","flakelet":"app","rule":"ci","relay":"relay","caller_name":"\"example/app\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1705.459298] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:06.954062Z","level":"INFO","message":"update starting","flakelet":"app","ids":"[\"dce6faec8455f85321e72ee634888126\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1705.509227] agent systemd[1]: Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent # [ 1705.526786] agent systemd[1]: Started flakelet update app (via relay). container-test-run-flakelet-relay> agent # [ 1705.532504] agent flakelet[3584]: app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent # [ 1705.533266] agent flakelet[3584]: app: up to date container-test-run-flakelet-relay> agent # [ 1705.535644] agent systemd[1]: flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent/app | app: up to date container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: unchanged (generation 9) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjA4NiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg5MDQxNzg2LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI0MkNSVDVIUlNKM1pZPT09IiwibmJmIjoxNzg5MDQxNzg2LCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.egrH8DB3RHkTlRtWGPri4hc7hCTRJpnvJzVySAoRlja1o5_vrpQd_AzkMV9o5HEp0OoPL7TEIb2hBD3btczXBg' push --relay https://relay:7443 deploy --id hist2 agent/app, in 0.65 seconds) container-test-run-flakelet-relay> client: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjA4NiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg5MDQxNzg2LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI0MkNSVDVIUlNKM1pZPT09IiwibmJmIjoxNzg5MDQxNzg2LCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.egrH8DB3RHkTlRtWGPri4hc7hCTRJpnvJzVySAoRlja1o5_vrpQd_AzkMV9o5HEp0OoPL7TEIb2hBD3btczXBg' push --relay https://relay:7443 jobs container-test-run-flakelet-relay> client: (finished: must succeed: FLAKELET_RELAY_TOKEN_COMMAND='echo eyJhbGciOiJFZERTQSIsImtpZCI6ImsxIiwidHlwIjoiSldUIn0.eyJhdWQiOiJmbGFrZWxldC1yZWxheSIsImV4cCI6MTc4OTA0MjA4NiwiZ3JvdXBzIjpbXSwiaWF0IjoxNzg5MDQxNzg2LCJpc3MiOiJodHRwczovL3JlbGF5Ojg0NDMiLCJqdGkiOiI0MkNSVDVIUlNKM1pZPT09IiwibmJmIjoxNzg5MDQxNzg2LCJyZXBvc2l0b3J5IjoiZXhhbXBsZS9hcHAiLCJzdWIiOiJyZXBvOmdpdGh1YjpleGFtcGxlL2FwcDpyZWY6cmVmcy9oZWFkcy9tYWluIn0.egrH8DB3RHkTlRtWGPri4hc7hCTRJpnvJzVySAoRlja1o5_vrpQd_AzkMV9o5HEp0OoPL7TEIb2hBD3btczXBg' push --relay https://relay:7443 jobs, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: job history comes from the agents and survives a relay restart, in 4.97 seconds) container-test-run-flakelet-relay> subtest: dashboard login via authorization code flow container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code} %{redirect_url}' https://relay:7443/ui/ | grep -q '303 https://relay:7443/ui/login', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -L https://relay:7443/ui/login, in 0.08 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist1 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -f https://relay:7443/v1/jobs | grep -q hist1, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 10 https://relay:7443/ui/jobs/hist1/events || true, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 403 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -X POST 'https://relay:7443/ui/deploy?arg=other' | grep -q 403, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -D - -o /dev/null -H 'HX-Request: true' -X POST 'https://relay:7443/ui/deploy?arg=other', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/ed9a2598452720b558370b3d9a3c271e/events || true container-test-run-flakelet-relay> agent # [ 1706.080685] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:07.575373Z","level":"INFO","message":"update finished","flakelet":"app","status":"Unchanged","generation":"Some(9)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1706.309219] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:07.803935Z","level":"INFO","message":"start","id":"599c402b985e8915fa334f320fa46333","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"dev@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1706.309760] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:07.804481Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"599c402b985e8915fa334f320fa46333\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1706.358484] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> relay # [ 1706.082495] relay flakelet-relay[1322]: {"timestamp":"2026-09-10T12:03:07.577121Z","level":"INFO","message":"deploy finished","job":"6a239dbf87cfec796e49404c351d787f","ok":true,"target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1706.158029] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [10/Sep/2026 12:03:07] "GET /authorize?response_type=code&client_id=dashboard&redirect_uri=https%3A%2F%2Frelay%3A7443%2Fui%2Fcallback&scope=openid%20profile%20email%20groups&state=kK1zPBOuK38Oe9PyUnXS7VHB6YP-K4esOLMdOCvgCrc&code_challenge=fjWu1_YxIkP1-GuuoPk1lyH4_78nlp60wBgQo4D-OXk&code_challenge_method=S256 HTTP/1.1" 302 - container-test-run-flakelet-relay> relay # [ 1706.202862] relay 93sn3sv24fj26ksccpppzwg6kbf10s4w-device-mock[185]: 127.0.0.1 - - [10/Sep/2026 12:03:07] "POST /token HTTP/1.1" 200 - container-test-run-flakelet-relay> relay # [ 1706.203870] relay flakelet-relay[1322]: {"timestamp":"2026-09-10T12:03:07.698613Z","level":"INFO","message":"login","name":"dev@example.org","principals":"[\"oidc:mock:someone\", \"oidc:mock:groups:wheel\"]","target":"flakelet_relay::relay::login"} container-test-run-flakelet-relay> relay # [ 1706.268888] relay flakelet-relay[1322]: {"timestamp":"2026-09-10T12:03:07.763569Z","level":"INFO","message":"job reattached","job":"188b06c4636b65849b3ba8daac22dc7c","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1706.308785] relay flakelet-relay[1322]: {"timestamp":"2026-09-10T12:03:07.803469Z","level":"INFO","message":"deploy accepted","job":"62c4c4e990a9c69f16e5efd282b20e1c","caller":"dev@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> relay # [ 1706.329661] relay flakelet-relay[1322]: {"timestamp":"2026-09-10T12:03:07.824393Z","level":"INFO","message":"job reattached","job":"62c4c4e990a9c69f16e5efd282b20e1c","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1706.373483] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 1706.377379] agent flakelet[3608]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 1706.378127] agent flakelet[3608]: other: up to date container-test-run-flakelet-relay> agent # [ 1706.380960] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 30 https://relay:7443/ui/jobs/ed9a2598452720b558370b3d9a3c271e/events || true, in 0.62 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/ed9a2598452720b558370b3d9a3c271e container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/jobs/ed9a2598452720b558370b3d9a3c271e, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -sf -o /dev/null https://relay:7443/ui/static/htmx.min.js, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/?q=status%3Ahealthy+oth', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar https://relay:7443/ui/flakelets/other, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected' container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar 'https://relay:7443/ui/hosts?q=status%3Adisconnected', in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=ed9a2598452720b558370b3d9a3c271e' | grep -q 400 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' -H 'HX-Request: true' -X POST 'https://relay:7443/ui/retry?arg=ed9a2598452720b558370b3d9a3c271e' | grep -q 400, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 & container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -N --max-time 15 'https://relay:7443/ui/events?path=jobs' > /tmp/ev.out 2>&1 &, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other container-test-run-flakelet-relay> » job 38796a7ba508eadfe82a1cd5def000bc via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/other | Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent/other | Started flakelet update other (via relay). container-test-run-flakelet-relay> agent/other | other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent/other | other: up to date container-test-run-flakelet-relay> relay # [ 1707.080016] relay flakelet-relay[1322]: {"timestamp":"2026-09-10T12:03:08.574739Z","level":"INFO","message":"deploy accepted","job":"38796a7ba508eadfe82a1cd5def000bc","caller":"admin@example.org","targets":"[\"agent/other\"]","target":"flakelet_relay::relay::api"} container-test-run-flakelet-relay> agent # [ 1706.923288] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:08.417980Z","level":"INFO","message":"update finished","flakelet":"other","status":"Unchanged","generation":"Some(1)","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1707.080480] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:08.575128Z","level":"INFO","message":"start","id":"5e317fc57863c2a7c03ebe1bdacd1356","flakelet":"other","rule":"admins","relay":"relay","caller_name":"\"admin@example.org\"","target":"flakelet_relay::agent::conn"} container-test-run-flakelet-relay> agent # [ 1707.080897] agent flakelet-agent[2932]: {"timestamp":"2026-09-10T12:03:08.575659Z","level":"INFO","message":"update starting","flakelet":"other","ids":"[\"5e317fc57863c2a7c03ebe1bdacd1356\"]","target":"flakelet_relay::agent::jobs"} container-test-run-flakelet-relay> agent # [ 1707.123000] agent systemd[1]: Starting flakelet update other (via relay)... container-test-run-flakelet-relay> agent # [ 1707.141623] agent systemd[1]: Started flakelet update other (via relay). container-test-run-flakelet-relay> agent # [ 1707.146431] agent flakelet[3628]: other: using prebuilt artifact /nix/store/hmr990n0b4v6rpzrcpyyw738r9xi7z95-flakelet-other-v1 container-test-run-flakelet-relay> agent # [ 1707.147169] agent flakelet[3628]: other: up to date container-test-run-flakelet-relay> agent # [ 1707.150214] agent systemd[1]: flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> agent/other | flakelet-relay-job-other.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/other: unchanged (generation 1) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> client: (finished: must succeed: push --relay https://relay:7443 --cert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin.pem --key /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/admin-key.pem deploy --id live1 agent/other, in 0.63 seconds) container-test-run-flakelet-relay> client: waiting for success: grep -q live1 /tmp/ev.out container-test-run-flakelet-relay> client: (finished: waiting for success: grep -q live1 /tmp/ev.out, in 0.01 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -X POST -o /dev/null https://relay:7443/ui/logout, in 0.02 seconds) container-test-run-flakelet-relay> client: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 303 container-test-run-flakelet-relay> client: (finished: must succeed: curl -sS --cacert /nix/store/ydql3jgw8j7khsad67k605wlnywsd36n-flakelet-relay-test-certs/ca.pem -b /tmp/jar -c /tmp/jar -o /dev/null -w '%{http_code}' https://relay:7443/ui/ | grep -q 303, in 0.02 seconds) container-test-run-flakelet-relay> (finished: subtest: dashboard login via authorization code flow, in 1.64 seconds) container-test-run-flakelet-relay> (finished: run the VM test script, in 85.30 seconds) container-test-run-flakelet-relay> test script finished in 85.33s container-test-run-flakelet-relay> cleanup container-test-run-flakelet-relay> kill NspawnMachine (pid 52) container-test-run-flakelet-relay> kill NspawnMachine (pid 53) container-test-run-flakelet-relay> Container agent terminated by signal KILL. container-test-run-flakelet-relay> kill NspawnMachine (pid 54) container-test-run-flakelet-relay> Container client terminated by signal KILL. container-test-run-flakelet-relay> (finished: cleanup, in 0.29 seconds) container-test-run-flakelet-relay> additionally exposed symbols: container-test-run-flakelet-relay> agent, client, relay, container-test-run-flakelet-relay> vlan1, container-test-run-flakelet-relay> start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh container-test-run-flakelet-relay> » job 978eca48bdbce97b00a2d9536c36e2a6 via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/6ili1vxjlag9d7dy0bxrbxk6bpi5qh9p-flakelet-app-v2 container-test-run-flakelet-relay> agent/app | app: activating generation 2 container-test-run-flakelet-relay> agent/app | app: updated to generation 2 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 2) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job f5f1dad339c76008e9cec33ef9e59bf5 via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/8282rnbvyk847q4l4zby3zwcq3jpzrvw-flakelet-app-broken container-test-run-flakelet-relay> agent/app | app: activating generation 4 container-test-run-flakelet-relay> agent/app | app: deploy failed, rolled back: systemctl start app.service failed: container-test-run-flakelet-relay> agent/app | failed units: app.service. See journalctl -u app.service container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Main process exited, code=exited, status=1/FAILURE container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> » agent/app: rolled-back (generation 3) container-test-run-flakelet-relay> agent/app │ Starting app v1... container-test-run-flakelet-relay> agent/app │ Started app v1. container-test-run-flakelet-relay> agent/app │ Stopping app v1... container-test-run-flakelet-relay> agent/app │ app.service: Deactivated successfully. container-test-run-flakelet-relay> agent/app │ Stopped app v1. container-test-run-flakelet-relay> agent/app │ Starting app v2... container-test-run-flakelet-relay> agent/app │ Started app v2. container-test-run-flakelet-relay> agent/app │ Stopping app v2... container-test-run-flakelet-relay> agent/app │ app.service: Deactivated successfully. container-test-run-flakelet-relay> agent/app │ Stopped app v2. container-test-run-flakelet-relay> agent/app │ Starting app v1... container-test-run-flakelet-relay> agent/app │ Started app v1. container-test-run-flakelet-relay> agent/app │ Stopping app v1... container-test-run-flakelet-relay> agent/app │ app.service: Deactivated successfully. container-test-run-flakelet-relay> agent/app │ Stopped app v1. container-test-run-flakelet-relay> agent/app │ Starting app broken... container-test-run-flakelet-relay> agent/app │ app.service: Unable to locate executable '/nonexistent': No such file or directory container-test-run-flakelet-relay> agent/app │ app.service: Failed at step EXEC spawning /nonexistent: No such file or directory container-test-run-flakelet-relay> agent/app │ app.service: Main process exited, code=exited, status=203/EXEC container-test-run-flakelet-relay> agent/app │ app.service: Failed with result 'exit-code'. container-test-run-flakelet-relay> agent/app │ Failed to start app broken. container-test-run-flakelet-relay> agent/app │ Starting app v1... container-test-run-flakelet-relay> agent/app │ Started app v1. container-test-run-flakelet-relay> » skipped: agent/other container-test-run-flakelet-relay> » failed container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job 21a442279068855740f433f05738da0d via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent/app | app: activating generation 7 container-test-run-flakelet-relay> agent/app | app: updated to generation 7 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 7) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job 9cdec76f5ab11b04823202bcd0df9fa5 via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/ln47rsd5km8a04hd5zlkz4q1v352zqh3-flakelet-app-slow2 container-test-run-flakelet-relay> agent/app | app: activating generation 8 container-test-run-flakelet-relay> agent/app | app: updated to generation 8 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 8) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> » job d998b680dd01e7ca1a4edf90d3b4033c via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | Starting flakelet update app (via relay)... container-test-run-flakelet-relay> agent/app | Started flakelet update app (via relay). container-test-run-flakelet-relay> agent/app | app: using prebuilt artifact /nix/store/c67jj8kx3m50nyj874aqmdqf21w5iznd-flakelet-app-slow container-test-run-flakelet-relay> agent/app | app: activating generation 9 container-test-run-flakelet-relay> flakelet-push: stream: error reading a body from connection, resuming job 9eed4ee7412d9ff60191c86e04262c72 container-test-run-flakelet-relay> flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 1s container-test-run-flakelet-relay> flakelet-push: https://relay:7443: connect relay:7443: Connection refused (os error 111), retrying in 2s container-test-run-flakelet-relay> flakelet-push: https://relay:7443: 404 Not Found: unknown_job: no connected agent knows this job, retrying in 4s container-test-run-flakelet-relay> » job d998b680dd01e7ca1a4edf90d3b4033c via relay 0.1.0 (agents: agent 0.1.0) container-test-run-flakelet-relay> » wave 0 container-test-run-flakelet-relay> agent/app | app: updated to generation 9 container-test-run-flakelet-relay> agent/app | flakelet-relay-job-app.service: Deactivated successfully. container-test-run-flakelet-relay> » agent/app: updated (generation 9) container-test-run-flakelet-relay> » ok container-test-run-flakelet-relay> container-test-run-flakelet-relay> 1789041782 hist1 admin@example.org agent/other:unchanged container-test-run-flakelet-relay> 1789041772 9eed4ee7412d9ff60191c86e04262c72 admin@example.org agent/app:updated container-test-run-flakelet-relay> 1789041764 2ff2e1c15ea6e7a773548279d8d492d1 admin@example.org agent/app:updated container-test-run-flakelet-relay> 1789041747 6672034ab722eb2a6fb9ef43af021244 admin@example.org agent/app:updated container-test-run-flakelet-relay> 1789041745 local-app-6-1789041745 root (shell) agent/app:updated container-test-run-flakelet-relay> 1789041741 local-app-5-1789041741 root (shell) agent/app:updated container-test-run-flakelet-relay> 1789041738 db49626071bb1b082f164e5b0a212109 admin@example.org agent/other:unchanged container-test-run-flakelet-relay> 1789041727 2143d277873afc760c28a173cda3691d admin@example.org agent/app:unchanged container-test-run-flakelet-relay> 1789041727 b3a45468336253997d9c414b5612c7d9 admin@example.org agent/app:updated container-test-run-flakelet-relay> 1789041726 948efdbe336e0d9e6287543748869e25 admin@example.org agent/app:unchanged container-test-run-flakelet-relay> 1789041725 558860a51fcf7e146aabb1e840bac408 admin@example.org agent/app:unchanged container-test-run-flakelet-relay> 1789041721 7b54b7139a18d7d7dd9c2b5cbcbb1590 admin@example.org agent/app:rolled-back container-test-run-flakelet-relay> 1789041721 e909af6a659ccc6a568ceeda8c78830b dev@example.org agent/other:unchanged container-test-run-flakelet-relay> 1789041720 b283918217af2bf4e7d424360250d69c dev@example.org agent/other:unchanged container-test-run-flakelet-relay> 1789041717 f6fd794ecaa6ebcdeaa0ec33f3e5da76 someone agent/other:unchanged container-test-run-flakelet-relay> 1789041714 462fb9cd6c3d53a7acffb98373ef71be repo:github:example/app:ref:refs/heads/main agent/app:updated container-test-run-flakelet-relay> 1789041711 4f271a188d63f9df2e5e92b23a09fc05 admin@example.org agent/app:updated container-test-run-flakelet-relay> 1789041709 local-app-1-1789041709 host activation agent/app:updated container-test-run-flakelet-relay> 1789041709 local-flakelet-agent-1-1789041709 host activation agent/flakelet-agent:updated container-test-run-flakelet-relay> 1789041709 local-other-1-1789041709 host activation agent/other:updated container-test-run-flakelet-relay> container-test-run-flakelet-relay> Container relay terminated by signal KILL. post-build step Upload coverage to codecov: ok Skipping codecov: project=Mic92/flakelet-relay attr=checks.x86_64-linux.nixos-test