Interface ActionAI

The background of the UI action to perform. The purpose of background is to let the action executor to understand the context of why the instruction is given including important previous actions and observations

Direct instruction of the UI action to perform (e.g., 'click the login button', 'input username in the email field', 'scroll down', 'swipe left')

AI action settings

Whether to stream progress events using Server-Sent Events (SSE). When true, the API returns an event stream. When false or omitted, the API returns a normal JSON response.