Skip to main content

Drive the desktop with a prompt

The coding agents of the sandbox drive the same screen that you stream. Each harness on a sandbox has built-in computer tools. These tools take screenshots, click, type, scroll and start apps. You only send a prompt:
A prompt needs a connected AI key or subscription first. Without it, the API returns 409 provider_not_configured. Read Keys and subscriptions. Open a stream in one window. Watch the agent work in it.
  • You install nothing.
  • You register nothing.
  • Each harness already has the tools.
For the full tool list, the tool names per harness and the health check, read Computer use.

Mix shell commands and prompts

Shell commands also work on the same screen. You can use them together with prompts. For example, open a page yourself, then give the sandbox a visual task:
A sandbox has one screen. Each conversation on the sandbox drives that same screen. If two agents click at the same time, they interfere with each other. Give each parallel GUI task its own sandbox, or run the tasks one after the other.

Record the screen

ascii-record-desktop records the live desktop to an MP4 from inside the sandbox. Use it to make a demo or to keep evidence of a GUI run.
  • Stop the recording before you download the file. Until then, the MP4 is not complete.
  • Run ascii-record-desktop status to see if a recording runs.
  • The tool keeps its old name, ascii-record-desktop.
To share a recording without a download, serve its folder from the sandbox. Then expose the folder with a URL that needs a token: