Test Results

The Test results form can be viewed by navigating to Lasernet > Test and performance suite > Test > Test results.

This form is divided into four sections:

• Test execution

• Log

• Checkpoint archives

• Test result archives

Note

The test results can also be viewed by navigating to Lasernet > Test and performance suite > Test > Test checkpoints. Refer to the Test checkpoint form section of this guide for more information.

Test Execution

An overview of the Test run is displayed here for each execution/run, which contains the following data:

• User ID – The user that ran the test.

• Test flow – The name of the Test flow if a Test flow was used.

• Checkpoint – The name of the Test checkpoint.

• Report name – The name of the report.

• Result – defines the test as a Pass or Fail.

  • The XML files need to be identical to get a Pass result.

  • If Compare to PDF is set to Yes, the XML and PDF files need to be identical to get a Pass result.

• Start date/time of the test run.

• End date/time of the test run.

Log

The Log FastTab displays detailed information about the test result.

The following is an example of a Fail test result where the XML files are different, but the PDF files are identical.

Note

Some data in the JobInfo section of the XML file is different for each time a report is generated. For example, the ExecutionId. However, these elements are not checked as part of the test comparison, as these are expected to be different. Therefore, these are not mentioned in the Log and if only these elements are different, then the test will be a Pass. This is applicable even when Skip ‘JobInfo’ and ‘Report’ section is set to No.

Note

If you are testing a Lasernet replacement for an SSRS report, you may get a Fail result even after no changes have been made to the report. For example, the RecIds are different on the temporary tables, on the PurchPurchaseOrderReplacement, as these are different for each time the report is run. To avoid confusion, these elements can be skipped for testing. Refer to the Test exceptions section of this guide for more information on skipping elements for a test run.

Checkpoint Archives

The Checkpoint archives section shows Checkpoint archive records. Note that a single report run might have one or more archives (for instance, separate archives are generated for each destination).

This record is used as the point of comparison when checking test results.

The Preview button can be used to open the XML or PDF (if saved in the archive) files for this Test checkpoint.

The Details button opens the Lasernet Archive record linked with this Test checkpoint.

Test Result Archives

The Test result archives section shows archive records for the test result selected in the Test results archive FastTab. Note that a single report run result might have one or more archives.

The Preview button can be used to open the XML or PDF (if saved in the archive) files for this test result.

The Details button opens the Lasernet Archive record linked with this test result.

The Set as checkpoint button can be used to update the Checkpoint archive record on the Test checkpoint with this test result. This is useful as you can use this test result as the Test checkpoint for future test runs. When updating a Test checkpoint, you will be prompted by a message:

The updated record in the Checkpoint archive can be seen by navigating to the Test checkpoint form.