For every completed test in a collection, DTM performs
the following steps:
1. Compares the result file to the benchmark file, if
any
2. Saves the comparison status for the test
3. Saves any differences in a difference file
4. Deletes the result file if it matches the benchmark
DTM will not automatically complete the comparison
process if any of the following conditions exist:
o You chose the option not to compare when you created
the collection
o A test in the collection is only partially run
o Some of the tests in the collection do not run
In each of these cases, you need to manually initiate
the comparison of test results before you can review
the results.
1 – man_compare
To manually compare test results, perform the following steps: 1. Pull down the Testing menu. 2. Choose the Compare... menu item. The Compare dialog box enables you to choose the type of test comparison, the differences format, and special characters that DTM should ignore during a comparison.
2 – compare_status
DTM reports one of the following comparison states for
a test in a view window:
Comparison
Status Meaning
Comparisons Comparison could not be completed
aborted
New test Test lacks a benchmark file
Not run Test did not run during a partially run
collection
Successful Benchmark and result files match
Unsuccessful Benchmark and result files do not match
Updated Benchmark file updated after the
comparison for a collection