However, when you start a game, the mouse input is automatically captured in the virtual machine so that you couldn't move the mouse to macOS by mistake and automatically released when you quit the game. If you're working with a guest OS application, the mouse moves freely between the guest operating system and macOS. If you play games in a virtual machine, the Mouse menu allows you to set how to use a mouse: To open these settings, choose Actions > Configure > Hardware, then click Mouse & Keyboard. In the Mouse & Keyboard pane, you can view and configure the mouse- and keyboard-related settings. You can configure the Send keys action to send the CTRL + A keyboard shortcut that selects all the text on the web page or application.Mouse & Keyboard Settings Mouse & Keyboard Settings

To store a text in the clipboard, highlight the text using either the Send keys or the Send mouse click action. To retrieve text from the screen and store it into a variable, deploy either the clipboard actions or the Extract text with OCR action. To navigate through the web page or application and interact with its components, use the mouse and keyboard actions.įor example, deploy the Send keys action to use the available keyboard shortcuts, or the Move mouse to image and Move mouse to text on screen (OCR) actions to move the cursor to a specific image or text, respectively. Use the Wait action to wait for a set amount of time, the Wait for image action to wait for an image to appear/disappear, or the Wait for text on screen (OCR) action to wait for a text to appear/disappear. If you need to wait for specific components to load before running an action, use the wait group of actions. In both alternatives described above, the best way to navigate is using mouse clicks and keystrokes which are explained in the actions reference.īefore building your automation, ensure that the appropriate window is focused and maximized using the Focus window and Set window state actions. Information on OCR capabilities can be found in the respective actions reference. Read more on how to automate using images in this topic.Ĭonversely, for cases that an image can't be used as a point of reference, consider using the OCR capabilities to navigate through the screen. Image-based automation can be either recorded by the image-based recorder or developed manually. The image method, captures sections of the screen which are then used as references to perform clicks, send text and mouse clicks.

For cases that a user isn’t able to access the UI elements of web or UI applications and thus can’t automate using Browser or UI actions or the recorders, it’s strongly recommended to use alternative methods of automation such as the use of Images or mouse and keyboard.

Automatic mouse and keyboard guide