Smart Mobile Recorder

With the Smart Mobile Recorder, you build flows one robust step at a time by clicking on user interface elements/images, selecting an action from a smart suggestion list, and entering the data needed – after which the action is immediately performed. After performing the desired number of steps, the Smart Mobile Recorder will then construct the flow with the right building blocks for you.

Using the Smart Mobile Recorder

Starting the Smart Mobile Recorder is just like adding a new building block. Simply pull the green connector from an existing building block or right-click the design canvas and select "Start Mobile Recorder". The recording can start from any building block, so it can be used to add actions and building blocks to an existing flow or to start up a new flow:

When the Smart Mobile Recorder starts, Leapwork minimizes and the Smart Mobile Recorder Widget is visible. You can see Recorder in the lower left corner of the screen:

On the top right corner of Mobile Recorder Widget, you can find the toggle button which helps you to switch between Element mode and Image mode.

Element mode:

Image mode:

When the red dot is blinking and the status says "Recording", we can start capturing elements/images in one or more applications.

Starting an application

Typically, the first action using the Smart Mobile Recorder is to start an application. When the the Smart Mobile Recorder widget is hovered, a few more options shows:

When the "plus sign" is clicked, you can select the following options:

Based on the selection a wizard dialog will help to gather the needed data for this action. For example selecting the Start Mobile Application option you can launch any mobile application.

Adding actions to a flow

Once the application under automation is running, we can start automating the process. Simply select the element/image in the mobile application that we want to interact with:

In the above example we will search "Iphone14". To add an action to this element, left-click the mouse, and Leapwork will present an intelligent list of available actions for the selected element. We select an element, so the suggested actions are the most relevant to a selected element on a mobile application: Tap (element), Set Mobile Text (element), Get Mobile Text (element) etc.

Select the "Set Mobile Text" option, the new dialogue box appears to configure the selected action:

When "Apply" is clicked, two thing happens:

1. The action and the configuration is added to the recording. 

2. The Smart Mobile Recorder will perform the action inside the actual application, making both the recording and the application under automation ready for the next action.

Set Mobile text will type the value as configured and accordingly display the results:

Commit the recording

When the desired actions is added to the recording, the recording is committed by hovering the Smart Mobile Recorder widget and clicking the "check mark"

The Smart Mobile Recorder will now stop, and focus is moved back into Leapwork, where the actions - expressed as building blocks - is added to the flow:

Pause the recording

In some cases it is necessary to manipulate the application under automation or find relevant data to add to a flow while the recording is ongoing. Use the "Pause" button in the Smart Mobile Recorder widget to pause the recording.

To resume the recording, click the "Play" button in the Smart Mobile Recorder widget.

Both the pause and resume recording can be done using keyboard short cuts:

Clear the recording

To clear an ongoing recording to either restart the Smart Mobile Recording or simply skip it, hover the Smart Mobile Recorder widget and click on the "cross". This will clear the recording, close the Smart Mobile Recorder and move focus back into Leapwork.