General
The Vision Sensor enables UI Interaction with elements that cannot be indicated or communicated using other automation libraries such as UI Automation, Selenium, Java, or SAP Scripting.
The Vision Sensor, as the name implies, works with the visual representation of the user interface, which is exactly what the user can see. Therefore, it is important that the elements that are to be indicated or interacted with are actually visible on the user interface. When indicating, an image of the highlighted element is taken, which is then found at runtime with template matching.
It also determines the other properties, left, top, index, count, excludetext, original scale, multi-line, context, contextlabel, and the border properties, all of which can be used at runtime to control the search for the element.
Using the Vision Sensor, the elements are found by the following properties including OCR for content recognition.