AskUI

AskUI is a platform designed to deploy and manage computer-use agents that operate across a wide range of devices, including real desktop environments, embedded HMIs (Human-Machine Interfaces), and physical hardware. The core technology, called AgentOS, provides a runtime environment where agents can be configured with custom prompts, connected to various tools, and routed through different AI models before being shipped to production. The platform supports multiple operating systems—macOS, Windows, and Linux—and offers both a free tier and on-premises deployment options for organizations with strict data residency or security requirements. The agents themselves are capable of performing complex tasks by observing the screen, interpreting visual context, and executing actions such as clicking, typing, and reading display content. For example, a user can define a task like “cash transaction with 7% tax” and instruct the agent to verify the checkout process, capture evidence (screenshots), and generate a structured report. The system logs every step with timestamps, showing details like screen detection delay, observation time, and action execution duration. A built-in execution log provides transparency by recording all calls made to tools (e.g., screenshots and input operations) and the current device state, including which display is active and what front-end is being targeted. AskUI also allows users to chain multiple tools and models within a single agent workflow. Developers can configure prompts that guide the agent’s behavior, connect external APIs or databases as tools, and choose from different AI backends (e.g., vision-language models) to handle image recognition and decision-making. The platform is particularly useful for automating repetitive UI tasks, testin