Potential benefits of using Software Test Automation tools include:
- 1. Repetitive work is reduced (e.g. running regression tests, re-entering the same test data, and checking against coding standards).
- 2. Greater consistency and repeatability (e.g. tests executed by a tool, and tests derived from requirements).
- 3. Objective assessment (e.g. static measures, coverage and system behaviour).
- 4. Ease of access to information about tests or testing (e.g. statistics and graphs about test progress, incident rates and performance).
Risks of using Software Test Automation tools include:
- Unrealistic expectations for the tool (including functionality and ease of use).
- Underestimating the time, cost and effort for the initial introduction of a tool (including training and external expertise).
- Underestimating the time and effort needed to achieve significant and continuing benefits from the tool (including the need for changes in the testing process and continuous improvement of the way the tool is used).
- Underestimating the effort required to maintain the test assets generated by the tool.
- Over-reliance on the tool (replacement for test design or where manual testing would be better).