Secondary Navigation
Welocme to Experior
Contact us
Home >  Blog >  Automated Regression Testing With Ranorex

Automated Regression Testing With Ranorex

Posted on 11 February 2016

This blog post will explain the term regression testing and how Ranorex test automation supports functional regression testing.  The blog post will also cover prioritization of test cases for regression testing including a strategy to manage it.

What is Regression Testing

When developing software, every modification of or addition to the existing code might lead to an inoperative state or to an error condition within the existing functionality. These side effects caused by code modifications are called regressions. To determine a regression it's necessary to re-test already existing and tested parts of a program every time the code has changed.
That's what regression testing is all about.

How Ranorex can help

Regression testing is not done to expose new defects but to verify the functionality of the existing parts of a program. Testing the same parts of a program after every change in code sounds a little boring and time consuming when doing manually not to say it is impossible when being performed for every build. For this reason it makes sense to automate regression testing using Ranorex Studio as the ROI of automated regression testing is very high.

Prioritize your tests

Even helping yourself with automated regression tests still does nothing about the fact that there is never enough time to run all test cases.

To minimize risks it is absolutely essential to construct subsets of test cases which have to be executed for every build, test cases which should be executed for every build and test cases which could be executed if there is time left

After designing your test cases it is time to break them down into the following categories:

  1. Smoke Tests: The test set which should be executed very first. These tests will determine whether the build is even testable. Smoke tests typically cover a wide but shallow range of functionality.
  2. High Priority Tests: The test set which is executed most often. These tests ensure that the functionality is stable, intended behaviors and capabilities are working, and important negative tests and boundaries are tested.
  3. Medium Priority Tests: The set in this category will test the given functional areas and features in a more detailed manner. Additional most of functional specifications are examined including boundary, negative and configuration tests.
  4. Low Priority Tests: The test set which will be executed least often (e.g. check for error messages, stress tests, UI glitches, etc.).

The most important question that arises is how to figure out which test fits in which category. Following the approach described in the blog post "Rapid Test Case Prioritization" provides a smart and fast way to fulfill this mission.

  1. Categorize all functional verification tests also known as happy day scenario tests as high prior tests.
  2. Categorize all negative, boundary or validation tests as medium prior tests.
  3. Categorize all non-functional verification tests as low priority tests.

Now you have a rough division into the three categories. The next steps will refine the selection.

  1. Divide all functional verification tests into high and low importance tests
  2. Categorize all low importance functional test as medium priority tests
  3. Divide all negative and boundary tests into high and low importance tests
  4. Categorize all high importance negative and boundary tests as high priority tests
  5. Divide all non-functional verification tests into high and low importance tests
  6. Categorize all high importance non-functional verification tests as medium priority tests
  7. Repeat the steps above until there will be no more changes

After doing so, the smoke tests have to be identified.

  1. Divide all high priority tests into critical and important tests
  2. Categorize all critical tests as smoke tests.


Using Ranorex to automate your regression tests will dramatically increase the efficiency of your testing. However, you've got to give some thought about how to prioritize your test cases and then approach described above might help you in successfully implementing this process.

For more information on this topic or Ranorex contact us at your local office or email


Tags: Ranorex Test Automation
Welocme to ExperiorBookmarkPrintShare this pageContact Us