Remediate element selection

Learn how to remediate element selection when the AI is not confident that it can accurately identify elements due to complex layout or overlapping elements. Remediation ensures that all test steps are correct, improving the reliability and success rate of automated test runs.

What is element selection remediation?

When you complete the baseline session, Kobiton’s AI Engine analyzes the performed actions and identifies which visual elements were interacted with. However, there are cases where multiple visual elements overlap, causing the AI Engine to return low confidence in selecting the correct element.

In these cases, the AI requires user input to select the correct element.

You can only remediate steps with Touch action.
Element selection remediation is optional but recommended. Without remediation, the AI may select the wrong element during a test run, decreasing the likelihood of success.

Before you start

  • Create a baseline session.

  • Convert the baseline session to test case.

Remediate element selection

After converting a session to a test case, if any steps needs remediation, the following message appears next to Test Steps:

Remediation required message with warning that a specific number of steps require remediation

Select the Remediate test steps button.

The Element Selection Remediation popup appears as shown for steps with touch action:

Steps with touch action

In this popup, you are provided with the following tools to assist in remediating:

  • Navigation buttons to switch between test step:

remediation remediate element selection naigation steps

  • The element inspector with element hierarchy and attributes:

element inspector with element hierarchy and attributes

  • Screenshot of the test step with the selected element highlighted, and the dot showing the coordinates of the touch action:

dot showing the coordinates of the touch action

To remediate a test step:

  1. Navigate to the test step using the navigation buttons.

  2. Select an element from either the element hierarchy or the screenshot. Refer to the remediation guidelines when selecting the element.

    You can hover the mouse over the screenshot to highlight the element closest to it.

  3. When finished, select Submit.

    Once you submit, you cannot remediate the same test step again. Proceed with caution.

Repeat these steps for all test steps that need remediation. Once all test steps have been remediated, the following message will appear:

Remediation steps completion popup, success message

Select the Save button to save the changes to a new test case version.

Changes will not be automatically saved.

At this point, the test case is fully prepared and ready for test runs.

Remediation guidelines

When remediating, follow these guidelines:

  • Select the element that is as low in the hierarchy as possible, while ensuring it is still the correct element.

  • Chose the element closest to the original touch action.

  • Whenever possible, select an element with a unique attribute.