Automate Forms and Fields on Virtual Desktops

Kasper Fehrend

Senior Product Evangelist at Leapwork

This tutorial shows an example of filling a form with data-driven automation in a virtual desktop application.

Learn how to: 

  • Read labels and values from an Excel sheet to be used in your automation flow
  • Add the values to a form in a virtual desktop application
  • Submit the form

Automation of virtual desktop applications running in Citrix, Remote Desktop, etc. is based on image and text recognition, which can be a challenge when it comes to forms and fields.

Please note that the tutorial video involves an older version of the LEAPWORK Automation Platform (formerly called LEAPTEST), but the principles shown are still valid.



The basic principle of this automation use case is to find the fields in a form by using the label in front of the fields. These labels are typically static, so they can be identified using the built-in OCR engine in LEAPWORK.

Once the label is found, it is possible to use positions and offsets to set focus in the corresponding field. When focus is on a field, a value can then be applied to the field.

The example shown relies on an Excel sheet containing the list of labels and values. Using the Read Excel block, it is easy to iterate through all labels and values and this way create a low-maintenance, robust automation flow.

Go back to tutorials for virtual desktop automation.