Class Actions

Simulates a click action on the box.

Get the clipboard content

Set the clipboard content

Simulates a drag gesture, moving from a start point to an end point over a set duration. Supports simple start/end coordinates, multi-point drag paths, and natural-language targets.

Detect and identify interactive UI elements in the current screen. Note: This feature currently only supports element detection within a running browser. If the browser is not running, the Elements array will be empty.

Extract data from the UI interface using a JSON schema.

Perform a long press action at specified coordinates for a specified duration. Useful for triggering context menus, drag operations, or other long-press interactions.

Moves the focus to a specific coordinate on the box without performing a click or tap. Use this endpoint to position the cursor, hover over elements, or prepare for chained actions such as drag or swipe.

Press device buttons like power, volume, home, back, etc.

Simulates pressing a specific key by triggering the complete keyboard key event chain (keydown, keypress, keyup). Use this to activate keyboard key event listeners such as shortcuts or form submissions.

Start recording the box screen. Only one recording can be active at a time. If a recording is already in progress, starting a new recording will stop the previous one and keep only the latest recording.

Stop recording the box screen

Disable the device's background screen rewind recording.

Enable the device's background screen rewind recording.

Rewind and capture the device's background screen recording from a specified time period.

Get the current structured screen layout information. This endpoint returns detailed structural information about the UI elements currently displayed on the screen, which can be used for UI automation, element analysis, and accessibility purposes. The format varies by box type: Android boxes return XML format with detailed UI hierarchy information including element bounds, text content, resource IDs, and properties, while other box types may return different structured formats.

Rotates the screen orientation. Note that even after rotating the screen, applications or system layouts may not automatically adapt to the gravity sensor changes, so visual changes may not always occur.

Captures a screenshot of the current box screen

Performs a scroll action. Supports both advanced scroll with coordinates and simple scroll with direction.

Get the action settings for the box

Resets the box settings to default

Update the action settings for the box

Performs a swipe in the specified direction

Tap action for Android devices using ADB input tap command

Performs more advanced touch gestures. Use this endpoint to simulate realistic behaviors.

Directly inputs text content without triggering physical key events (keydown, etc.), ideal for quickly filling large amounts of text when intermediate input events aren't needed.