Error Distribution
Last updated
Was this helpful?
Last updated
Was this helpful?
This analysis method allows you to view the error distribution of a group and compare it with other groups.
The error distribution is always calculated in groups in two steps: 1st stage: The "Result" entry of an execution is considered, i.e. the overall result of an execution Step 2: The "Status" entry of a test step is considered, i.e. the partial result of an execution
The following figure shows the start page of the "Error Distribution" analysis method
The error distribution of the executions (1st level) of each group is displayed in a diagram. If you click on a diagram, you get to the Details view and get the additional information about the error distribution of the test steps (2nd level). In addition, the failures between the groups can then be compared.
Note: With the Import Filter, test steps can be filtered from an execution. Thereby it can happen that a test step with the status "Fail" is removed and only "Pass" entries are left. However, the overall result is not changed by the Report Analyzer, so it remains on "Fail".
The detail view of the error distribution is structured as follows:
On the left is the selection of the group to be viewed
In the middle you see an overview of all test steps ("Measurements")
Below you can switch between two panels: "Diagrams" and "Executions".
This panel lists all test steps contained in the test executions of the respective group. The measurement ID, the step name and the description are displayed. It is also possible to see how often a step was performed and the status "Pass", "Fail", "Error" or "Terminated". This value is also set in relation to the total number of steps performed and displayed as a percentage value.
An important value for root cause analysis is the "First error" column or its percentage value. This indicates in how many test executions this measurement was the first failed step. With a filter > 0 on this column and descending sorting, it is very easy to create a list of the top causes of failure in each group:
Please note in this context: The first failed test step is not necessarily the step that led to the overall result or termination, even if this is normally the case. Similarly, "Failed" steps do not necessarily lead to a failed overall result of the test execution. This depends on the respective step settings and cannot be seen from the report.
The tables can be sorted and filtered, and conditional formatting can also be defined. Most of these settings are also used for the export.
When selecting a row in "Measurements", the affected test executions are displayed in the "Executions" table and the corresponding diagrams are updated.
This panel is divided into three areas. In the left area, a diagram is displayed which shows the status of all steps performed (as shown in the "Measurements"). In the middle, the results of all defined groups are compared in percent. Each group is displayed as a separate bar, so that a comparison across groups is quickly possible. If you move the mouse pointer over a bar, the group name and further information is displayed. The right area is identical to the middle area, but the values are shown in absolute numbers instead of percentages. This also allows you to quickly determine whether, for example, groups have the same workload or whether errors occur group-specifically or across groups.
If the operator is not only interested in the distribution but also wants to take a closer look at the logs, which are e.g. failed, he can do this in the panel "Executions". This panel lists all executed executions that have executed the selected test step. The operator gets various information displayed, such as the serial number. The test report can be opened and viewed by double clicking on a line. In the case of repeated measurements, it is thus possible to determine, for example, whether a failure occurs only with a single assembly or batch.
There are three possibilities to export the analysis data of the error distribution:
Report Wizard
Table export
Windows clipboard
Report wizard
Select the desired groups and measurements which should be included in the report:
Click on preview
A preview is then automatically generated for each selected group, which contains the following information:
Complete overview of all executions (1st part)
Complete overview of all currently visible test steps per selected group (2nd part)
As soon as the preview is completely generated, the report can be saved in various formats. This can be done with the button "Export..." or the arrow below the button.
Report current view
The overview of all test steps is exported in the same way as the "Measurements" table is displayed in the Report Analyzer. I.e. filter, sorting and conditional formatting is taken 1:1 from the display.
Table Export
The user selects in the displayed dialog which groups and test steps are to be exported. This export method saves the table entries of the "Measurements" panel for each selected measurement line by line in a text file. This can then be opened in Excel, for example, and further processed as required. In addition, it can configure the following settings:
File extension
column separator
Decimal point separator
Output folder
File name Click on "Export" to create the desired file.
Windows clipboard
In each table, the operator has the possibility to select cells or rows and copy them to the Windows clipboard by pressing CTRL+C. The data can then be pasted into a text file or Excel spreadsheet. With the shortcut CTRL+A the complete table can be selected. For example, the data can be exported from the panel "Executions".
