RTH
The documentation for this product is incomplete and the user experience is not great. It appears to work as expected but it’s not always clear what to expect. If this were to be ranked agains Testopia, it would need additional evaluation to rank them, but it does not appear to be as complete as the TestLink option. There was some tweaking needed to get everythign installed.
http://sourceforge.net/projects/rth/
TestLinkThis system has relatively good built-in reports and access to data. This system would best be used by those that would use it on a daily basis and is not suitable for occasional users because executing tests and reporting is not very usable. Integration with external bug tracking system requires additional tools to be built or purchased. Overall, this seems to fit our needs best, given our constraints.
http://www.teamst.org/
Testopia:
While test result tracking 'in flight' is easy to track, test results tracking and anaysis over time will likely require customized reports and possibly customized code. This system would best be used by those that would use it on a daily basis and is not suitable for occasional users because executing tests and reporting is not very usable (or would require lots of customization that may not be supported when upgraded). In some cases, actions performed did not persist between sessions, so it has a sense of being unreliable. Installation was difficult.
http://landfill.mozilla.org/testopia2/testopia/doc/Manual.pdf
Others available, but not considered for my use
- XQUAL http://www.xqual.com/qa/tools.html - There is a free version that looks good, but since that free version is ad-based, it was not considered for our use.
- Salome TMF - https://wiki.ow2.org/salome-tmf/ - I was not able to get this running after mucking around with it for some time. I didn't go looking for assistance and it may work well, I just don't know.
- Oracle Application Test Suite - This looked promising, but there is a license required, so it wasn't evaluated.
