Skip to content

Report Analyzer - Release Notes

[1.8.0] - unreleased

Added

  • Report Viewer: A new "Profiler" dialog displays the chronological sequence of a test graphically and also shows gaps in the report. It is provided as an additional tab in the report viewer dialog.
  • Report Viewer: Now allows to switch between loaded (in memory) and original content (in case content was modified by import options or filters)
  • Current X-axis settings are now adopted in the history report. It now also supports SerialNr and TimeStamp XAxis mode.
  • A new "1st Failure" column in the error distribution shows how often the measurement was the first failure (or error) in the test. Sorting or filtering by this column allows much better analysis of the cause of the test failure.
  • Active import options are now indicated by a small "warning" icon in all file import dialogs
  • Import file browser directory scan can now be aborted by pressing ESC
  • New import option to merge repeated (indexed) mesaurements by removing the index from measurement id
  • New XAxis Type IndexMeasurement in history chart (required in case of multiple identical measurements in same execution)

Changed

  • BREAKING CHANGE: Analysis is now always based on ALL loaded measurements, including NaN values. In previous versions, NaN values were ignored in some statistical calculations. This might lead to more invalid values and different calculations compared to previous versions
  • TrendAnalysis now uses IndexMeasurement instead of IndexGroup as XAxis for graph
  • History & Statistics Report Wizard: Measurement selection is now kept if the search field is used, allowing incremental selection
  • Re-Importing existing reports will now replace the loaded data (also in groups) instead of skipping it. This allows to reload already filtered data.
  • Improve stylesheet of report viewer
  • ReportAnalyer.exe is now signed

Fixed

  • File Import: Fixed empty list of failed imports Dialog
  • File Import: Pressing Cancel after completed import caused an exception
  • Graph comparison: table did ignore global formatting (number of significant digits)
  • Error Distribution: List of measurements was not refreshed when group was changed and a non matching filter was active
  • History & Statistics: LSL was not marked with *) even when it used a substituted value
  • Page "Grouping" was empty in case of duplicate or invalid entries in report header
  • Fix error in graph comparison if the measurement of an existing graph was filtered out, then an execution was deleted from the group and the data was recalculated
  • Removing all executions from a group caused an error if the group was selected in a module. Empty groups are now automatically removed

[1.7.0] - 2023-09-11

Added

New import options for all import plugins - filter by date - remove steps by status (done / passed / failed / error) - keep first failed or error step - remove additional results - remove infotext - add custom header data

Grouping - Grouping: Selected tests (use checkbox) can now be added to existing groups via Drag & Drop - Grouping: Selected tests (use checkbox) can now be added to existing groups via new 'Add to Group' button

Group Statistics - New module/tab 'Group Statistics' with statistics about FPY, all contained test executions, steps and attributes. Reporting possible via context menu - New context menu "Show statistics" for manual selection of test executions in many views (Import, Grouping, Error Distribution) - New statistics for whole data set on start page

Changed

  • Changed initial size of some dialogs to fit also for smaller displays or higher scaling values
  • Changed target framework to .NET 4.8! Note that .NET 4.8 must installed to run this version of report analyzer
  • Update used IRS reporting DLL to 1.46.6

Fixed

  • Statistics report settings did not work properly (number of measurements selection)
  • Multiple user options (export type, separators etc.) were not correctly evaluated in measurement and statistics table export due to a change of the dialog type
  • Zero-values caused a division by zero in certain cases in table export when rounding to significant digits, resulting in a NAN value instead of 0

[1.6.2] - 2022-12-14

Fixed

  • Fixed an issue where application would hang when grouping by a column which contains colons ":" in its values, while the application setting "use simplified group names" is activated (affects all previous versions)

Changed

  • Updated reporting dll to 1.46.4. Now supports single sided limits and treats PassFail tests as numeric (0/1)

[1.6.1] - 2022-12-05

Changed

  • New installer type, now offering options to select import plugins. It is recommended to uninstall older versions before! Settings will be kept!
  • Startup speed improvement
  • Significant speed improvement in group assignments dialog for large data sets
  • Significant speed improvements in group management page for large data sets (create groups, delete executions from groups)
  • Speed improvement for graph creation in case of very large data sets
  • Speed improvement in error distribution calculation
  • Speed improvement in all status count calculations
  • Limit strip generation significantly improved
  • One sided limits can now be displayed
  • Non-constant or modified limits are now displayed as a dashed line ingraph

Added

  • Export context menu: Almost any visible table content can now be exported into various formats or to the clipboard using the context menu
  • Remove selected executions directly from measurement values table
  • Remove selected execution directly from measurement info panel (graph)
  • Predefined conditional formatting of Cg,Cgk, Cp and Cpk columns (see documentation how to customize this)
  • New "Deviated Limits" column in analysis table to identify and filter rows with inconsistent od modified limits (hidden by default)
  • History & Statistics: Group name and measurement ID are now added to graph title

Fixed

  • Fixed disfunctional dialog for column selection when too many attributes were found. Buttons did not work
  • Fixed dialog function for measurement group management
  • Fixed wrong calculation of alternative limits when limits are inconsistent and new USL would be less than LSL
  • fixed wrong display "loading..." when saving a data set
  • fixed wrong order of measurements in trend analysis value tables when including failed measurements
  • Plugins directory was evaluated wrong when the working directory was different to application directory
  • XY and YY comparison graphs could crash when no data was assinged and a group was deleted or updated

Removed

  • Fill Limit Strips: this option is no longer available due to new limit draw method

[1.5.4] - 2021-11-25

Fixed

  • Fixed a bug where recalculating the measurement lists caused a crash when the number of measurements was reduced after removing existing executions

[1.5.3] - 2021-11-18

Fixed

  • (Re-)Enabled resizing of fixed size report viewer dialogand support for multiple (non-modal) report viewer dialogs

[1.5.2] - 2021-11-09

Fixed

  • Can't open multiple instances of report analyzer
  • Calling Cleanup in grouping causes an application error
  • Fixed dialog handling. Dialogs now stay correctly in front of the application when switching back to ReportAnalyzer
  • Only measurements that are available in the respective group are now listed in the groups

Changed

  • Updated Reporting DLL to 1.46.3
  • Updated Licensing DLL to 2.1.1
  • Updated NLog package to 4.7.11

[1.5.1] - 2021-03-23

Fixed

  • Fixed wrong order of measurements in analysis report export and "Group First" view
  • Measurement list is now cleaned up from measurements which are no longer part of any execution after deleting executions
  • Fixed wrong font in Avg and Unit column of analysis report export

Changed

  • Huge performance improvement when deleting test executions which are contained in existing groups

[1.5.0] - 2021-03-01

Added

Import

  • New import module "NI TestStand" adds ability to directly read standard TestStand XML, ATML5 and ATML6 reports! With auto format detection!
  • New import dialog: Report directories are now displayed in a File Explorer like tree structure
  • Executions can now be added and removed from Import page without causing the deletion of all groups. Measurements are recalculated, groups and graphs are kept where possible
  • Allow grouping on import page
  • Added "# Steps" column
  • Improved performance when deleting executions
  • New PDF export of loaded executions.Multiple executions can now be exported as a single report file with preview and various export formats

Grouping

  • Grouping is now possible with almost any field in grouping view
  • Now supports selective adding of current view by checkboxes. Groups or even executions can be selected individually. It is no longer required to add the whole view (but still possible)
  • Added "# Steps" column
  • Executions can now be removed from a group, measurements are automatically recalculated. Graphs are kept where possible
  • New user comment feature for groups. The comment is also optionally added (default:true) to PDF export as a group description
  • Removed groups now correctly trigger updates in all analysis pages
  • Removing groups no longer deletes all graphs

Analysis Engine

  • Restructured and optimized MeasurementAnalysis Engine
  • Improved calculation performance
  • Added support for almost all existing TestStand comparison operators including all EQT types (except inverted style limits)
  • Allowed more data types in report than just "Numeric"

History and Statistics

  • Analysis tab pages are now initially disabled until a valid grouping exists
  • Support for inconsistent limits in measurements. In this case now the most narrow of all valid measurement limits (LSL.max ... USL.min) are used as a "worst case surrogate" instead of displaying "NaN"
  • Highlighting of values calculated from modified limits in views and PDF report (due to manual modifications or usage of surrogate values)
  • MeasurementValues: Added "Status" column and color formatting
  • MeasurementValues: Added "Unit" property to MeasurementValue
  • New "CountValid" column in MeasurementAnalysis table
  • Added missing formulas to report appendix
  • Changed header names in history and analysis group data table (%EV, %K, %RE)
  • Renamed limit columns to USL and LSL
  • Changed report default measurement count from All to First100
  • Improved default layouts and default displayed columns

History & Statistics: Histogram

  • New logic now creates a valid histogram in almost any situation
  • Now each bar also displays status count (pass/fail) for each group
  • Improved display of axis labels, crosshair label, value labels
  • Number of history bars now supports auto calculation when set to 0
  • Changed default bar range to Mean +/- 6 Sigma
  • Added special bars for "out-of-range" values capturing everything beyond mean +/- 7*sigma range
  • Added support for inconsistent limits using vertical strips in histogram
  • Overall performance improvements

History & Statistics: Graph

  • New resampling logic to support larger number of points (tested with ~80.000 executions)
  • Enabled zooming history graph even when in stacked view
  • Enabled scrollbars for history graph
  • Enabled checkboxes in legend for all multi-chart modes to enable/disable individual graphs
  • Keep graph checkbox selection in legend when changing measurement
  • Now contains PartNumber information in tooltip display
  • Now displays scrollbars with zooming capabilities
  • Limits display is automatically switched off for series with more than 5.000 points for performance reasons

Watchlist

  • A notifier is shown as feedback when a new entry is added
  • Allowed checkboxes for multiple charts modes to disable single series
  • Added index property to TestExecutionGroup (allows explicit filtering of single groups)

Error Distribution

  • Selected group now stays in visible area
  • Immediate recalculation when changing test execution collection or groups
  • Fixed and error in export

Graph Comparison

  • Graphs are updated automatically when executions of used groups are deleted
  • Series use dynamic resampling for large numbers of measurements to improve performance

Similarity Analysis

  • Improved performance
  • changed single color and fixed threshold formatting to a 2-color scale, honoring also negative correlations in red color
  • Disabled sorting in similarity analysis correlation matrix

General

  • Improved startup speed
  • Improved logging
  • Added local documentation as pdf instead of zipped html page
  • Improved documentation, added missing chapters and many screenshots
  • PDF help file now available in german and english language
  • Added FilterPanel to many tables
  • Added sample sequence files and reports to demonstrate how to optimize reports for IRS Report Analyzer
  • Loading and saving data sets no longer uses a temp file which dramatically can improve performance in certain situations
  • PDF properties for current view exports are now preconfigured
  • Removed ExecOffset column from all views (internal field, not relevant for user)
  • Added ExecTime column in all test execution related tables
  • Added OrderId column

Fixed

  • Fixed handling of invalid or missing export paths
  • NaN values are now ignored for %RE calculation
  • Histogram: Fixed view range of histogram and allowed zooming
  • Histogram: fixed bar width calculation
  • Fixed several redundant refresh issues which could have performance impacts
  • Fixed a bug where additional columns dialog would appear in an endless loop
  • Added missing reprocessing of existing group data after loading of data set (.gz)
  • Fixed wrong calculation of Bi (inverted sign)
  • Fixed potential performance issue with NLog (target was not async)
  • Fixed various table update/refreshing issues
  • Warning dialog when loading a saved dataset now only appears if any execution exists in analysis group
  • Fixed performance issues in similarity analysis when correlation value was NaN (now uses 0)

[1.4.3] - 2020-06-19

Fixed

  • grouping was ignoring the filtering of columns

[1.4.2] - 2020-06-09

Fixed

  • The XSL import plugin was missing from the previous release

[1.4.1] - 2020-05-25

Fixed

  • File import dialog did not load when recently used directory doesn't exist anymore
  • Inconsistent third party reference led to a crash on application start

[1.4.0] - 2020-05-20

Added

  • Execution View: added a button to open a preview window where a specific execution can be exported to a PDF file
  • Import View: added a button to bulk export all selected test executions to a PDF file
  • Added unit to measurement list view and the default report overview page

Fixed

  • Minor bugfix for the new group by user-defined header feature

Changed

  • Graph Comparison: Only the selected graph can be exported to PDF

[1.3.0] - 2020-04-17

Changed

  • The splash screen can be minimized
  • Updated irs licensing
  • Set properties by default on Export as PDF

Added

  • It is now also possible to filter and group data by user-defined header fields
  • Added support for multiple folders and subfolders when doing drag & drop import

[1.2.5] - 2019-06-11

Added

  • Files can be added to the import dialog via drag&drop
  • Added a new setting to allow a more compact default group naming
  • Added a new setting to use the group name for the default graph title

Fixed

  • Deleting a group could occasionally crash the application
  • Reset measurement search string after each new analysis to fix binding issues (history & statistics)
  • Improved selection mechanism for history diagram steps
  • Fixed the "Show report"- and "Add to Watchlist"-button with the history & statistics step view

Changed

  • Show "missing groups"-alert only once for each view

Removed

  • Removed "Prefer 32-bit"

[1.2.4] - 2019-04-29

Added

  • Added plugins to start view
  • Added execution time to grouping view

Changed

  • Updated irs licensing
  • Updated reporting dll

[1.2.3] - 2019-04-09

Changed

  • Updated irs licensing
  • Set result to "unknown" for executions where the result is null
  • Max visual group value can be configured at the settings

Fixed

  • Fixed filtering for several views (select first visible item when a filter changed)
  • Refresh measurements grid control when a group changed (trend analysis)

Added

  • Error distributions now has a column for "Done"
  • Added execution time to history & statistics
  • Added appendix to default history & statistics export
  • Added product ids to default history & statistics export

[1.2.2] - 2018-12-09

Changed

  • Enhanced selection for data grids

[1.2.1] - 2018-10-25

Changed

  • Changed "WinUI" message box to "DX" message box
  • Trend analysis: reselect previously selected measurement after calculation
  • Updated IRS licensing

Fixed

  • Floating mean did not filter according to test step selection

Removed

  • License key from startup view

[1.2.0] - 2018-09-21

Added

  • Import XML data with XSL transformation
  • Import LLT data from csv files or from database
  • Refresh file import dialog with F5

Fixed

  • Minor bugfixes

Changed

  • Minor UI enhancements

[1.1.1] - 2018-06-11

Added

  • Similarity analysis export

Changed

  • Minor UI enhancements

[1.1.0] - 2018-05-14

Added

  • New export: error distribution default export
  • New export: error distribution group comparison
  • New analysis value: % RE
  • Separate dialog for export settings
  • History & statistics default export: show/hide IDs
  • History & statistics default export: new parameter to add additional custom information
  • Measurement filter can now already be applied during import

Changed

  • Moved significant digits from view settings to app settings
  • Optimizations for chart coloring
  • Better visibility of the import status at file import view

Removed

  • Export path and logo path from history & statistics default export (can only be set at export settings now)

[1.0.1] - 2018-04-19

Changed

  • Updated licensing DLL

Fixed

  • Installer

[1.0.0] - 2018-04-19

Added

  • Load recently used datasets from home screen
  • App settings: separate default path for each export
  • History and statistics default export can be generated via command line
  • Graph comparison default export

Changed

  • Using significant digits from settings at the reports

Fixed

  • Several fixes

[0.3.0] - 2018-03-07

Added

  • Table headers to every report page in case a table spreads over multiple pages
  • Save button to app settings and app view settings
  • History & Statistics: Export Table

Changed

  • Restructured grouping layout
  • Grouping: moved save and load filter-set buttons to toolbar

Fixed

  • Wrong axis color at graph comparison when limits are shown
  • Opening a new analysis dataset didn't work properly when there was already loaded another dataset before
  • Ignoring NaN measurements at graph comparison

Removed

  • Navigation buttons from graph comparison charts

[0.2.0] - 2018-02-22

Added

  • Light theme
  • Custom window for unhandled exceptions which allows the user to save an error log
  • Translations for enums
  • Saving and loading of analysis datasets
  • History & Statistics: Export Current

Changed

  • Overworked navigation and toolbar
  • Overworked start screen
  • Resetting custom layout when the application was updated
  • Several icons

Fixed

  • Several fixes and improvements

Removed

  • Unused references

[0.1.0] - 2018-02-01

Initial Release