forked from BilalY/Rasagar
13 KiB
13 KiB
Changelog
[3.0.3] - 2023-09-11
Fixed
- Fixed issue where exception in OnTestEnded callback would result in EndTest method not finalising properly
Changed
- Temporarily removed "Open Script" from Performance Benchmark Window
- Some clarifications in documentation were added ("Extension" naming changed to "Package", Package limitations clarified)
[3.0.2] - 2023-06-29
Changed
- Added additional InternalsVisibleTo attribute for internal test assembly
[3.0.1] - 2023-06-23
Changed
- Removed false "unityRelease" field from package.json
[3.0.0] - 2023-06-05
Added
- "Open Source Code" menu item to test results
- Test Filter to filter results by test name
Changed
- Items in test results are grouped by classname
- Make Sample Groups to be shown only when clicking on items with them
- "New Data available" label re-located
- Replaced CamelCase headers with regular text headers in csv report
- Replaced TRUE/FALSE with Yes/No in the "Increase Is Better" column in csv report
- Renamed the default report name to PerformanceTestResults
- Documentation updates to reflect API changes
Fixed
- Median calculation in case of even number of samples
- Deviation division by zero
- Exception thrown after clicking Cancel button (during Test Result export)
- The issue where the last column was always empty in csv report
[3.0.0-pre.2] - 2023-04-06
Added
- Help button, which redirects the user to documentation website
- Clear Results button, which clears all Performance test results
- Updated CI to support more Unity versions and expand test coverage
Changed
- Updated the style of toolbar buttons to match that of the Test Runner window for consistency
- Export button is now disabled instead of hidden when there are no Performance test results
- Made AutoRefresh toggle retain its state after closing and reopening the window
- Moved the Performance Test Report from 'Window/Analysis' to 'Window/General' near Test Runner for better accessibility
Removed
- Build project from CI
Fixed
- Issue where running tests with the Test Report window open would cause the error message "The object of type 'Material' has been destroyed" to appear
- Issues where incorrect labels were displayed at certain scenarios
- Issues flagged by SonarQube
[3.0.0-pre.1] - 2023-03-02
Added
- Merged 2.8.1 changes that weren't reflected in 2.10.0 release
Fixed
- Fixing issues from SonarQube check
- Updating obsolete API's that stopped working with recent Unity versions
- Clarified how to add package in Unity project in documentation
[2.10.0] - 2021-11-01
Added
- Support for dynamic measurement count in Measure.Method and Measure.Frames
[2.9.0] - 2021-04-14
Added
- Support for overriding measurement count
[2.8.1] - 2021-03-16
Removed
- Setting up date when building player. It will set up at the beginning of the run.
[2.8.0] - 2021-03-16
Added
- Overloads to measurements for overriding sample unit
Fixed
- Cases where cleanup throws an exception
[2.7.0] - 2021-02-19
Changed
- Reduce metadata overhead when running locally by caching dependencies
- Restructured documentation
Removed
- The need for link.xml
Fixed
- Method measurement IterationsPerMeasurement
[2.6.0] - 2021-01-12
Added
- Build configuration support
[2.5.1] - 2021-01-05
Fixed
- Serialization for Performance Test Report window
[2.5.0] - 2020-12-29
Added
- Domain reload support
Changed
- Switched from Newtonsoft.Json to Unity json module
[2.4.1] - 2020-11-05
Changed
- Metadata collection was made public
[2.4.0] - 2020-09-16
Added
Performance Test Report window updates:
- CSV export option.
- Monitoring of results file timestamp to support auto refresh when a new file is found.
- Display of timestamp of last loaded results file.
- Option to sort test report window by order the tests ran in (index). This is now the default.
- Min and max to the table.
- Improved titles and tooltips on columns
Changed
- Upgraded json dependency to release version
- Reduced overhead introduced when running tests
[2.3.1] - 2020-07-01
Fixed
- Overhead introduced with Measure.Method no longer calculates execution time of Setup and Cleanup changes
[2.3.0] - 2020-06-17
Fixed
- Measure.Method overhead
- Measure.Method no longer calculates execution time of Setup and Cleanup
- Overwritten test name will be displayed with method name in Test Result viewer
[2.2.0] - 2020-05-26
Added
- Support for custom metadata
[2.1.0] - 2020-05-14
Added
- Flexible horizontal splitter for report window
Fixed
- Date format
[2.0.9] - 2020-03-23
Fixed
- Profiler measurements for method measurements
- Throw exceptions when measuring NaN
[2.0.8] - 2020-02-20
Fixed
- Fix profiler marker capture when changing scenes in editor tests
- Only shift samplegroups for UI
[2.0.7] - 2020-02-14
Fixed
- Results parsing
[2.0.6] - 2020-01-13
Fixed
- Development player field
[2.0.5] - 2020-01-13
Changed
- Disallow multiple performance attributes
- Disallow empty samplegroup name
- Assign samplegroup name to frames measurements
[2.0.4] - 2019-12-05
Changed
- Update json package to support AOT platforms
[2.0.3] - 2019-11-20
Added
- New fields to data format BuildTarget, StereoRenderingPath
[2.0.2] - 2019-11-20
Changed
- Increased test serialization version
[2.0.1] - 2019-11-20
Fixed
- Player callbacks when no tests were executed
[2.0.0] - 2019-11-19
Added
- Tests to package testables
Changed
- Refactored data format, reduced nesting
- Slight refactor on measurement API
- Shift sample units when printing results
- Switched to newtosoft json package
Removed
- Unused fields
- Deprecated attributes
Fixed
- Resources cleanup meta files
[1.3.1] - 2019-11-05
Fixed
- Warning after cleaning resources
- Test suite when running in the editor
[1.3.0] - 2019-08-26
Changed
- Switch to errors from exceptions when parsing results
- Increase minimum unity version to 2019.3
Removed
- Metadata collectors tests
[1.2.6] - 2019-08-22
Changed
- Categorize performance tests as performance
- ProfilerMarkers can now be called with string params
- Switch measuring frames and methods to stopwatch
Removed
- Profiler section on docs as the feature was removed
[1.2.5] - 2019-06-17
Added
- Test publish for CI
[1.2.4] - 2019-06-17
Added
- Test publish for CI
[1.2.3] - 2019-06-14
Changed
- Updated changelog
[1.2.2] - 2019-06-13
Added
- Support for domain reload
[1.2.1] - 2019-06-07
Fixed
- Bug that would cause player build failures
[1.2.0] - 2019-05-23
Changed
- Increase unity version to 2019.2
[1.1.0] - 2019-05-22
Changed
- Update assembly definition formats to avoid testables in package manifest
[1.0.9] - 2019-05-21
Changed
- Update scripting runtime setting for 2019.3
[1.0.8] - 2019-03-08
Added
- Automation test deploy
[1.0.7] - 2019-03-08
Added
- Automation test deploy
[1.0.6] - 2019-03-04
Changed
- Updated changelog
[1.0.5] - 2019-03-04
Added
- Conditional support for 2019.1
[1.0.4] - 2019-02-18
Removed
- Unnecessary meta files
[1.0.3] - 2019-02-18
Changed
- package.json update
[1.0.2] - 2019-02-18
Changed
- package.json update
[1.0.1] - 2019-02-18
Changed
- Updated Documentation to reflect breaking changes
[1.0.0] - 2019-02-15
Changed
- Refactor attributes
[0.1.50] - 2019-01-15
Changed
- Results paths to persistent data
[0.1.49] - 2018-12-04
Changed
- Revert changes to profiler and GC
[0.1.48] - 2018-11-22
Changed
- Doc updates and ignore GC api in editor due to api issues
[0.1.47] - 2018-11-14
Removed
- Debug logs
[0.1.46] - 2018-11-14
Fixed
- Breaking changes introduced by testrunner API rename
[0.1.45] - 2018-11-08
Fixed
- Breaking changes to data submodule
[0.1.44] - 2018-11-08
Changed
- Disable GC and update API to work around warning
[0.1.43] - 2018-10-30
Fixed
- Method measurements setup and cleanup
[0.1.42] - 2018-10-15
Added
- Button on report window to open profiler output for test
- Save profiler output on perf tests
Removed
- Unsupported features for legacy scripting runtime
- Unnecessary assembly definition
Fixed
- Version attribute for test cases
[0.1.41] - 2018-10-02
Added
- Test report graph
[0.1.40] - 2018-09-17
Changed
- Update documentation
[0.1.39] - 2018-09-14
Removed
- Duplicate module from docs
[0.1.38] - 2018-09-14
Changed
- Updated documentation
[0.1.36] - 2018-08-27
Changed
- ProfilerMarkers now take params as arguments
[0.1.35] - 2018-08-27
Added
Measure.Method improvements:
- Add GC allocation to Measure.Method
- Add setup/cleanup for Measure.Method
- Move order of calls for Measure.Scope
[0.1.34] - 2018-08-16
Fixed
- Obsolete warnings
[0.1.33] - 2018-08-03
Fixed
- Obsolete warnings, doc update with modules and internals, ValueSource fix
[0.1.32] - 2018-07-09
Added
- Method and Frames measurements can now specify custom warmup, measurement and iteration counts
[0.1.31] - 2018-07-04
Changed
- Marked metadata tests with performance category
[0.1.30] - 2018-06-27
Fixed
- Method measurement
[0.1.29] - 2018-06-12
Changed
- Moving back to json in xml due to multiple instabilities
[0.1.28] - 2018-06-01
Removed
- json printing from output
[0.1.27] - 2018-05-31
Added
- Meta files to npm ignore
[0.1.26] - 2018-05-31
Changed
Preparing package for moving to public registry:
- Inversed changelog order
- Excluded CI files from published package
[0.1.25] - 2018-05-31
Removed
- Missing meta files
[0.1.24] - 2018-05-31
Changed
- Print out json to xml by default for backwards compatability
[0.1.23] - 2018-05-30
Fixed
- Issues with packman, bumping up version
[0.1.22] - 2018-05-29
Added
- Option to specify custom Measure.Method Execution and Warmup count
[0.1.21] - 2018-05-25
Fixed
- Issues introduced by .18 fix
[0.1.19] - 2018-05-24
Changed
- Package has been renamed to
com.unity.test-framework.performance
to match test framework
[0.1.18] - 2018-05-24
Fixed
- Fix SetUp and TearDown for 2018.1
[0.1.17] - 2018-05-23
Changed
- Refactor Method and Frames measurements
- Metadata collected using internal test runner API and player connection for 2018.3+
[0.1.16] - 2018-05-09
Fixed
- Bug fix regarding measureme methods being disposed twice
[0.1.15] - 2018-05-02
Fixed
- Metadata test, the test was failing if a json file was missing for playmode tests
[0.1.14] - 2018-04-30
Added
- Addition of measuring a method or frames for certain amount of times or for duration
- Introduced SampleGroupDefinition
Changed
- Refactored measuring methods
Removed
- Removes linq usage for due to issues with AOT platforms
[0.1.13] - 2018-04-15
Added
- Added total, std and sample count aggregations
- Added sample unit to multi sample groups
Removed
- Removed totaltime from frametime measurements
Fixed
- Fixed android metadata collecting
[0.1.12] - 2018-04-11
Changed
- Naming
Fixed
- json serialization
[0.1.11] - 2018-04-09
Fixed
- 2018.1 internal namespaces
[0.1.10] - 2018-04-09
Added
- Added editmode and playmode tests that collect metadata
Changed
- Change fields to UpperCamelCase
[0.1.9] - 2018-04-06
Added
- json output for 2018.1 which will be printed after test run
[0.1.8] - 2018-04-03
Fixed
- Fix an exception on 2018.1
[0.1.7] - 2018-04-03
Changed
- Changed some of the names to match new convention
- Addressed typos in docs
- Multiple overloads replaced by using default arguments
[0.1.6] - 2018-03-28
Added
- Measure.Custom got a new overload with SampleGroup
- Readme now includes installation and more examples
[0.1.5] - 2018-03-20
Added
- Checks for usage outside of Performance tests
[0.1.4] - 2018-03-20
Added
- System info to performance test output
- Preparing for reporting test data
[0.1.3] - 2018-03-14
Removed
- Temporarily removing tests from the package into separate repo
[0.1.2] - 2018-03-14
Fixed
- Update for a missing bracket
[0.1.1] - 2018-03-14
Added
- Test output now includes json that can be used to parse performance data from TestResults.xml
- Added defines to be compatible with 2018.1 and newer
- Measurement methods can now take in SampleGroup as argument
Removed
- Removed unnecessary overloads for measurements due to introduction of SampleGroup
[0.1.0] - 2018-02-27
This is the first release of Unity Package performancetesting.
Initial version.