Change Log

v 0.13.64

Added:

1. Added Service Config Options:

   • SHOULD_KEEP_RUNNER_AFTER_TEST_COMPLETION: if yes, keeping runners up after test completion.

Changed:

1. "Last Test Run" heading changed to "Days Since Last Test Run" in Central Dashboard Home Page.

Fixed:

1. Bug fix for no roles found when user has group mapping

2. Incident Breakup chart rendering fix in Test Results

3. Creating analytics for services that have no errors, even if some services encounter errors, in central dashboard.

4. Creating reports for TIMED_OUT sessions also.

Deprecated:

Removed:

Security:

v 0.13.63

Added:

1. Home Page in central dashboard, here is the list of analytics for last 30 days :

   • API Coverage

   • Regression Severity

   • Last Test Run

   • Open Issues

   • Traffic Mirroring Status

2. Added First Seen & Last Seen search filters in API Page and feature to download filtered Swagger.

Changed:

Fixed:

1. Blocking Request Regex fix for exact API match

2. underscores_in_headers set in nginx

Deprecated:

Removed:

Security:

v 0.13.62

Added:

1. Added new Middleware:

   • Before Test Create: middleware includes only callback function to write the custom functioning that we want to implement before creation of the test.

2. Added Service Config Options:

   • SHOULD_USE_CONTENT_ENCODING_HEADER: if yes, use accept-encoding header if found in request headers.

   • SHOULD_ADD_OUTPUT_SCHEMA_HASHES: if yes, will add output schema hash in database.

3. Nginx status check for background service

Changed:

Fixed:

1. In Retest, when request of Base URL 1 or 2 are incomplete, will retest the copy of original request.

2. Content Type fix in Load Test

3. For API Response, fixed large response in "Parsed JSON" view, rendering json if number of keys are less than 10000.

4. Handling of (string or array) types in Request Body

Deprecated:

Removed:

Security:

v 0.13.61

Added:

1. Link of selected incident on Failure Details page for Jira Issues

2. Support for GITLAB, GITHUB & BITBUCKET config from CI variables also

 Github:
     GITHUB_CONFIG_REPO_URL
     GITHUB_CONFIG_INSTALLATION_ID
 Gitlab:
    GITLAB_CONFIG_BASE_URL
    GITLAB_CONFIG_PROJECT_ID
    GITLAB_CONFIG_ACCESS_TOKEN
 Bitbucket:
    BITBUCKET_CONFIG_WORKSPACE
    BITBUCKET_CONFIG_REPO_SLUG
    BITBUCKET_CONFIG_USER_NAME
    BITBUCKET_CONFIG_APP_PASSWORD

1. Escape HTML elements option for Parsed JSON response (Escape HTML checkbox in top right of Response section)

Changed:

Fixed:

Deprecated:

Removed:

Security:

v 0.13.60

Added:

1. JWT encoding and verify token support in middlewares

Changed:

Fixed:

1. UI Fix: scroll to error

2. UI Fix: All services in Add Role dropdown

3. UI Fix: Ignored requests filtering for Session Count and Request Count in test stats

4. Cookie URI encoding fix

Deprecated:

Removed:

Security:

v 0.13.59

Added:

Changed:

1. License validity increased to 24 August

Fixed:

1. Delete Session UI input fix

Deprecated:

Removed:

1. Removed all extra pages from old-dashboard

Security:

v 0.13.58

Added:

1. Added Graphql Query Parser in middlewares

2. Added API Load Testing feature on requests page.

3. Added config "MAX_RESPONSE_BODY_SIZE_MB" with default value of 5MB.

4. Rabbitmq dashboard available on /rabbimq/ path.

Changed:

Fixed:

1. Escaping identifiers from strings using pg format.

2. Error handling for connection refused in Retest Request.

3. Disabling mouse clicks when selecting text.

4. Save multipart files for the saved requests.

5. UI bug fixes

Deprecated:

Removed:

Security:

v 0.13.57

Added:

1. HTTP Protocol for base dns in central config.

2. Config settings from Central Dashboard:

   • Default Config settings from Central Dashboard.

   • Test and force update one or more Service's Config by 5 given actions:

     1. Add if not present

     2. Replace if present

     3. Append

     4. Add / Replace

     5. Remove if present

Changed:

1. In All Sessions page, default test window size to start a new test is changed with the 'TEST_WINDOW_SIZE' in service config.

Fixed:

1. Bug fix for getting empty row when calculating request and session percent passed.

2. Max depth of JSON data increased to 1000.

Deprecated:

Removed:

Security:

v 0.13.56

Added:

1. Added new Middleware:

   • "AfterDifferenceCalculation" middleware includes "ctx.ignoreDifference" function that ignore the differences from the calculated "ctx.differenceMatrix". It accepts:

     • FilterFunction: javascript array filter function

     • shouldIgnoreManualAssertions: a boolean value to ignore manual assertions.

2. Added Service Config Options:

   • "SHOULD_CREATE_PERFORMANCE_REPORT", default is "no", set to "yes" for generating performance report while you run tests.

3. Storing Content-Type for multipart requests.

4. Feature to add new API Aggregation on API Page.

Changed:

1. In Middlewares Script (Beta):

   • MongoTypings changes to include ObjectId

2. In custom start test, Filtering Specific APIs list on the basis of all other selections taken to start a test.

3. In "View Details", highlighting the incident selected from the Regression Report.

4. Replaced url encoded chars for cluster path by {text}.

5. UI is now responsive. Viewable in all screen resolutions.

Fixed:

1. Bug fix for navigate to an incident when also has noise on the same difference path.

2. Bug fix for showing response instance on requests page that matches with the filtered criteria.

Deprecated:

Removed:

1. UI bug fixes.

2. Removed Service Config "PENDING_SIGNOFF_NOTIFICATION_INTERVAL_MINUTES".

3. API Search filter from test sessions has been removed.

Security:

v 0.13.55

Added:

1. In middleware scripts added two libraries to npm packages, available via "ht.npmPackages":

   • faker-js: for better randomization of parameters of a request.

   • url-pattern: for matching request path against a pattern and extracting various path parameters

2. Support for replacing all occurrences of a substring within different components of a request. Introduced replaceAll function for headers, query, body, verb, and path(non-string data types are stringified).

   The function takes two input parameters:

   • Search string: This is the substring that you want to search for and replace in the given string. It can be either a string or a regular expression.

   • Replace string: This is the string that you want to replace the occurrences of the search string with. It can also be either a string or a function that returns a string.

Changed:

1. Now pending sign-off notifications will only be sent after completion of a test, not every 10 mins.

2. Now serializing query parameters before making an API request to handle array/repeated values.

3. In middleware scripts now all the base URLs would be available via "ctx.baseURL" .e.g., primary, candidate, and current(equal to the current instance of request: primary/candidate).

Fixed:

1. UI bug fixes.

2. Bug fix for unicode error while downloading swagger doc.

3. Bug fix for retest request dialog, the left side of the dialog was blank.

Deprecated:

Removed:

Security:

v 0.13.55-11(Beta)

Added:

1. Now displaying storage usage information on the home page.

2. Support for Ignoring/Blocking/Deleting multiple APIs at once from the APIs Page.

3. Support for removing tags of sessions from the All Sessions Page, the user can also choose to delete the said tag from all the sessions.

4. Support for starting tests from the All Sessions Page, User needs to switch to "Select Sessions to Start Test" mode and select the sessions they want to test and also provide an initial and final timestamp window for the test.

5. Support for caching unsaved changes on Middleware Scripts. Whenever a user makes changes to an existing script and doesn't save it then a local copy of the changes is kept and upon returning to the scripts user will be prompted with a dialog where they can choose to keep the unsaved changes or discard them.

6. Support for comparing changes made to the Middleare Scripts. A compare button has been added to the code editor, on clicking it the user will get a diff view between the saved script and the current unsaved changes.

7. Support for bypassing exceptions in test runs occurring from HyperTest's HTTP Client, e.g., If the API under test doesn't respond within 60 seconds then the client throws a timeout exception. You can catch this exception and continue executing the rest of the requests. A new service config option "HTTP_CLIENT_ERROR_CODES_TO_CATCH" has been added where you need to pass a list of error codes, for catching timeout exception "ECONNABORTED" should be given.

Changed:

1. Remodeled Jira integration to UI-based integration for seamless reporting of bugs, this provides the reporter more control over the Jira issues he/she creates. On click of the "Report to Jira" button, a new window with the user's Jira Dashboard opens up where they can manually update issue details or add any custom field of their choice.

2. For the Regression report now "Detailed Regression" is the default view.

3. Changed container image registry.

4. Moved analytics collection from UI to backend.

Fixed:

1. Bug fixes for old migration scripts.

2. User Management bug fix for automatic login to distributed services.

3. Fixed the Last Mirrored Request Information on Left Navigation Panel for fresh installations.

4. Fixed navigation for Test Results and Regression Reports.

5. Fixes for pagination of the User Management sections on the Central Dashboard.

6. Bug fix for non-responsive ignore incident button on the Regression report and the Requests page.

Deprecated:

Removed:

Security:

v 0.13.54

Added:

Changed:

1. Updated default SMTP server for email notifications.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.53

Added:

1. Introduced User Management & mechanism(Role Based Access Control) for HyperTest K8s deployments.

2. Introduced Middleware Scripts, which provides a more flexible way to write and organize middleware logic.

   Imporvements vs old middlewares:

   1. Better code organization, and separation of logic based on APIs.

   2. Reusability, allows reusing code/functions across multiple middlewares.

   3. Improved type checking, using typescript for type checking.

   4. Utility APIs and helpers are provided out of the box.

3. Support for viewing HTML responses in full-screen mode.

4. Support for saving a test case with filtered requests based on timestamp range.

5. Support for filtering API performance metrics based on status codes.

6. Now showing timestamp for last mirrored request on the left navigation panel.

7. Added UI utility for accessing kubectl terminal restricted to Hypertest namespace.

Changed:

1. Improved display of error on UI, now displaying short-lived snack bars.

2. Flows is now an opt-in feature. By default, flows related coverage and filters won't be shown on the dashboard. Users can choose to view them by setting the service config option "SHOULD_SHOW_FLOWS" to "yes".

3. Improved error handling for test runner service, added health check for backend before starting runner service.

Fixed:

1. Minor UI fixes.

2. Bug fix for retest request functionality.

3. Bug fix for adding new request functionality.

4. Bug fix for exception while running test, multiple exceptions were generated for the same request.

5. Fixes for order of errors in regression report.

Deprecated:

Removed:

Security:

v 0.13.52

Added:

1. Added revamped API page on the new dashboard.

2. Added Service Config options:

   • "DEFAULT_REQUEST_DEDUPLICATION_LEVEL", this default deduplication level will be used if not provided while starting a test from UI/CLI.

   • "AUTO_REMOVE_DUPLICATES_CONFIG", use this config to automatically delete duplicate requests.

   • "SHOULD_GENERATE_RESPONSE_SCHEMA", default is "no", set to "yes" for generating response schema of APIs while you run tests, these will be used to generate response schemas for Swagger Doc.

3. New filter option for starting a new test, now users can select specific HTTP methods of requests to test.

4. Option to view Ignored/Blocked APIs on the APIs page of the Old Dashboard.

5. On the Backup and Restore page for restoring a backup added options to either provide a download URL or upload a file, also added a progress bar for restore.

6. Added HTTP Status Code Breakups in TEST COMPLETED email and ci reports.

7. Added option to word wrap content in text editor across UI.

8. On Central Dashboard added an option to view storage usage of a deployed HyperTest instance.

9. Option(Checkbox) to turn off the auto-update of test stats on the start new test dialog.

10. Added check for VCS(version control system) specific CI variables while running CI-triggered test from CLI.

11. Added two new incident types ARRAY_ITEMS_ADDED, and ARRAY_ITEMS_REMOVED.

12. Added API for adding new request clusters.

Changed:

1. Updated session filter option for starting a new test, now user can select bookmarked sessions or can select custom sessions from the dropdown.

2. Updated usage analytics.

3. Renamed "Custom Status Code Breakup Rules" to "HTTP Status Code Breakup Rules".

4. Updated temporary rule default validity to "60 Days" from "14 Days".

5. On the service dashboard, the left menu is now collapsible.

6. Updated logic of the cron tab for HyperTest's background service.

7. Now showing request timestamp in locale date format.

Fixed:

1. Minor UI fixes.

2. Regression report UI pagination order fix.

3. Bug fix for the copy as curl functionality on the session requests page.

4. Bug fix for frozen UI whenever an error occurs.

5. Bug fix for Blocked APIs and Requests.

Deprecated:

Removed:

Security:

v 0.13.51

Added:

1. Support for Identifying/Weed out known API Status Code issues at test runtime. We have introduced "Custom Status Code Breakup Rules" on the settings page where users can write their rules for status codes, default rules are also provided, such as Potential New APIs, Rate Limit, Redirection, Server Error, and Authorization error, and users can choose to disable them. Users can view the results of these rules for a test in the API Coverage report.

2. Support for getting request deduplication suggestions for APIs. On the APIs page, an option has been added to view a ranked list of payload candidates for the deduplication of requests of a particular API. Based on this data users can gain insights for better deduplication to reduce the no. of requests to run in a test while covering all major scenarios(combination of payloads).

3. Option to save a Session with filtered requests. Now users can choose requests with provided filters and save that Session, on the save session dialog a checkbox has been added "Save Filtered Requests".

4. Option to Block/Ignore(While running test) APIs from the APIs page. On the APIs page UI, Users will have to filter the APIs using the search filter then they can choose to Block or Ignore them.

5. Option to apply API and HTTP Method filters while downloading swagger doc.

6. Docker-Compose version check before installation, required version is v1.

7. Now collecting HyperTest Usage data for a better Customer Service Experience. Metrics gathered: No. of test runs, No. of regressions, Total duration of tests, and Incidents Reported.

Changed:

1. Revamped bitbucket CI integration with HyperTest.

2. Revamped Jira Integration. Now users can report Issues to Jira from HyperTest itself. To integrate users will have to provide Jira Configuration in the Settings Page, then they can report bugs from the Bug Tracker page using the "Report To Jira" button. HyperTest will create the issue with the label "BUG_HYPERTEST" which helps us to track bugs identified by the user, in case the reported issue was not a bug but a desired change then users should remove this label to let Hypertest know that it was desired change and it will create a temporary rule for ignoring this change in future test reports, do not remove that label if you're not sure.

3. While generating a sample config in the Service Config Settings page, now only required configurations are provided, you can also view the full sample config by clicking on the drop-down button.

Fixed:

1. Minor UI fixes.

Deprecated:

Removed:

Security:

v 0.13.50

Added:

1. Support of customized health checks where you can write your logic for the readiness of your application, these checks have the option to be executed hourly or before starting a test. Added a new section under settings called Custom Health Checks.

2. Support for easy manipulation of cookies in Middlewares, a new input parameter called "cookies" of type Object has been added to middlewares which contains all the cookies of that particular request, for modifying cookies users have to pass "cookies" Object with updated values.

3. Support creating and searching for Flows on the All Session page.

4. For k8s deployments, added API to fetch storage information for a particular instance of Hypertest.

5. Added new CI env variable "HT_PR"(Pull request number), useful in case you manually trigger CI jobs and use Gitlab or Bitbucket as your VCS.

6. Support for creating/updating helper functions on the Manual Assertion page.

Changed:

1. Those tests which are auto-terminated because of frozen progress now will be marked as "Timed Out" instead of "Terminated".

2. Made revamped dashboard default, the old dashboard is still accessible for the Main Navigation panel.

Fixed:

1. In k8s deployments, now deleting Hypertest's Logger Ingress whenever a service is deleted.

2. Bug fix for reporting false positives for incidents KEY_REMOVED, KEY_ADDED in case of responses having an array of objects.

Deprecated:

Removed:

Security:

v 0.13.49

Added:

Changed:

1. Changed usage of Test Run Variables in Pre Session Middlewares, now only a non-empty object returned in test run variables will be set from Pre Session Middlewares. This is to avoid resetting test run variables at the start of every session.

Fixed:

1. In k8s deployments, now deleting Hypertest's Logger Ingress whenever a service is deleted.

2. Bug fix for adding new input schemas of APIs.

Deprecated:

Removed:

Security:

v 0.13.48

Added:

Changed:

1. In k8s deployments, whenever a user deletes a service, the PVC(Persisted Volume Claim) for it is also deleted.

Fixed:

1. Bug fix for non-responsive APIs on the dashboard.

Deprecated:

Removed:

Security:

v 0.13.47

Added:

1. Now showing test-related meta information on the new dashboard. On the Test Results page, by selecting a test result on the left-hand side, users can click on view more details present on the right-hand side of the page to view information like:

   I. Candidate Branch Id

   II. CI Environment Variables

   II. Test Description

2. Support for adding tags to sessions in the new dashboard. Users can add tags for sessions from the All Sessions Page or from the detailed Requests Page for a particular session.

Changed:

1. Minor UI changes in the new dashboard.

Fixed:

1. Minor UI fixes.

Deprecated:

Removed:

Security:

v 0.13.46

Added

1. Support for writing custom helper functions for middlewares, now users can write modular and reusable code for middlewares. A new "Helpers" tab has been added to the middleware code editor, where users can define their custom functions and they will be available across all middlewares. This will help reduce middleware scripts' size and make them more readable.

Changed:

Fixed:

1. Bug fix for migration script(for updating hashes) released in 0.13.45.

Deprecated:

Removed:

Security:

v 0.13.45

Added:

1. Support for applying deduplication rules on the request's input schema, earlier rules were only applied on request parameters.

2. Support for providing branch name env variable manually to HyperTest CLI, "HT_BRANCH" should be set in env and HyperTest will use it as branch name for CI integrations.

3. Support for advanced start test feature in the new dashboard, added options for selecting request deduplication level and running specific APIs in a test.

4. Support for signing-off tests from the new dashboard.

5. Added pagination and filter params on new dashboard routes, this will help with sharing the URL with exact filters.

6. In the new dashboard, In case the service config is not complete then users will be prompted to complete it, a new dialog has been added for that.

7. Support for filtering test results on the new dashboard, now users can filter test results based on signoff state or test id.

Changed:

Fixed:

1. Bug fix for HT_EXCEPTION in test results due to improper handling of null values in arrays inside nested JSON API responses.

2. Bug fix for request deduplication level, level selections from UI were not being included in HTTP calls due to a change in the request deduplication level drop-down UI component.

Deprecated:

Removed:

Security:

v 0.13.44

Added:

1. Added Settings and Bug tracker section in the new dashboard.

2. Added Requests page in the new dashboard for having a detailed view of a Session.

3. Added Response page in the new dashboard for a detailed view of an APIs response from the performance report.

4. Product tours for a better onboarding experience.

5. Support for running a test for a specific set of APIs. In the start new test dialog, under advanced options, a drop-down has been added to select a set of APIs.

Changed:

1. Minor nomenclature changes in the old and new dashboards.

2. Revamped CI reports and test completed email.

Fixed:

1. Bug fixes for the new dashboard.

2. Bug fix for STATUS_CODE_CHANGED difference path. Fixed logic for handling status code changes noise.

Deprecated:

Removed:

Security:

v 0.13.43

Added:

Changed:

Fixed:

1. Bug fix for HT_EXCEPTION while using manual assertion in a test run.

2. Bug fix for ignoring status code changes using permanent rules. Status code changes were reported even after creating rule for ignoring it in permanent rules.

Deprecated:

Removed:

Security:

v 0.13.42

Added:

1. Added sign-off comments provided by the user in completed sign-off notifications.

Changed:

Fixed:

1. Bug fix for the frozen test runs even when all test cases have finished running.

2. Bug fix for multipart form requests having values with null data type which caused HT_EXCEPTION while test run.

3. Bug fix for request deduplication level in start new test CLI command.

4. Bug fix for highlighting errors on failure report(detailed response diff page).

Deprecated:

Removed:

Security:

v 0.13.41

Added:

1. Preview of the revamped dashboard. New UI is still in development, but core features such as starting a test, test results, regression and performance report and detailed API response diff page are accessible.

2. Support for integrating Gitlab and Bitbucket CI check runs with HyperTest. Users would have to set up the following configuration in the service config:

I. Gitlab: Gitlab base URL(required if Gitlab server is custom hosted), the id of the project which contains the repo, and GitLab personal access token(with API level scope).

II. Bitbucket: workspace name, repo name, username, and app password(with pull request and pipelines scopes).

3. Support for viewing the coverage status of a flow on the Flows page. A new column called "Is Covered" has been added to the flows table, which indicates if the given flow is being covered in any of the test cases captured by HyperTest, to refresh this coverage status on demand a new refresh button has also been added in the actions column of the table.

Changed:

1. Updated documentation for self-managed k8s cluster.

2. Middleware helper functions for encryption/decryption that were added in the last release namely: cryptr, base64Encode, and base64Decode are being replaced by new helper functions with similar functionality.

Now we have two collections that are provided inside middlewares:

I. npmPackages(collection of selected npm modules, currently contains CryptoJs(JavaScript library of crypto standards) which will be helpful for encryption/decryption of data)

II. htHelperFunctions(collection of helper functions provided by HyperTest, contains: base64Encode, base64Decode)

Fixed:

1. Bug fix for duplicate errors in regression report.

2. Bug fix for downloading Excel reports.

3. Bug fix for the update of flow coverage status in the background job.

4. Bug fix for a max limit of 25 on the test sessions page.

5. Bug fix for empty difference path for VALUE_MODIFIED when the data type of body changes.

Deprecated:

Removed:

Security:

v 0.13.40

Added:

1. Support for checking the existence of the flow while creating it. A button has been added on the create flow dialog, by clicking on it users can get to know if the current flow is being covered in any of the test cases.

2. Support for encryption/decryption and encoding/decoding(base64) of data inside middleware. Following helper functions have been added to all the middleware: I. cryptr(collection of encryption, decryption helper functions for popular algorithms e.g., aes-256-cbc),

II. base64Encode(creates a Base64 encoded string),

III. base64Decode(decodes a string of data that has been encoded using Base64 encoding).

3. Added list of top 10 slowest APIs in TEST_COMPLETED notification.

Changed:

1. For STATUS_CODE_CHANGED error, now only candidate status code will be included in the difference path, this is to reduce the number of difference aggregations generated for reporting. Users can opt to include the primary status code in difference path by setting INCLUDE_PRIMARY_STATUS_CODE_IN_DIFF_PATH to "yes" in the service config.

Fixed:

1. Bug fix for HT_EXCEPTION while running a test, fixed logic for checking the content type of a response that was causing this exception.

2. Bug fix for sorting in the Performance report, rows with NA value were shown on top when sorted in descending order.

Deprecated:

Removed:

Security:

v 0.13.39

Added:

Changed:

1. Updated GitHub checks report. Made test info collapsible.

Fixed:

1. Bug fix for ignoring errors from regression report, users were getting an unhandled error while ignoring an error.

Deprecated:

Removed:

Security:

v 0.13.38

Added:

1. Support for integrating Github check runs with HyperTest. To set up check runs users would have to install HyperTest's Github App on their repo and provide the repo URL and installation id in the Service config. Whenever a test is started via CLI the commit id is picked from the environment variables and a check run is created. The check run is completed when the test gets signed off as REJECTED or ACCEPTED.

2. Support for downloading Swagger doc 3.0 from the dashboard. A button has been added to the APIs page.

3. Support for updating the response of a request during a test. Now users can pass updated response object in the output of POST RESPONSE middleware.

Changed:

1. By default, HTML response errors won't be reported by HyperTest, users can change this by setting SHOULD_REPORT_ERRORS_FOR_HTML_RESPONSES to "yes" in the service config.

2. Plain text response errors will be reported.

3. Old sign-offs for tests will be automatically rejected if a new test with the same candidate branch id has been created.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.37

Added:

1. Support for customizing error types that are reported by HyperTest. A new section under settings has been added, from their users can choose which errors to report and define their severities.

2. Support for downloading Swagger doc 3.0 from the dashboard. A button has been added to the APIs page.

3. Support for providing test case ids in the start test CLI command.

4. Support for downloading Test's HTML report from Dashboard.

Changed:

1. Pushed deadline for deprecating docker-based HyperTest installations from 1 Sep 2022 to 31 Mar 2023.

2. Updated documentation for setting up self-managed K8s cluster for HyperTest with Microk8s, Longhorn, and Prometheus.

3. Enhanced temporary rule matching algorithm for better performance while running tests.

4. By default, HTML response errors won't be reported by HyperTest, users can change this by setting SHOULD_REPORT_ERRORS_FOR_HTML_RESPONSES to "yes" in the service config.

5. Plain text response errors will be reported.

6. Old sign-offs for tests will be automatically rejected if a new test with the same candidate branch id has been created.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.36

Added:

1. Added support(Backend) for revisiting changes made to HyperTest's configurations/settings(e.g., Service Config, Middlewares, Manual Assertions, Permanent & Temporary Rules, Deduplication Rules).

UI support for this feature is in development.

2. Added support for defining Flows(test scenarios e.g., login, payment) for application under test. Flows are an ordered set of APIs that represents a user scenario.

A new section for flows has been on the side navigation bar. Users can check for coverage of flows before starting a test and after the test has been completed just like API coverage.

3. Added support for adding user-defined annotations to HyperTest's Ingress deployments with the help of config-map.

Changed:

1. Enhanced reporting for VALUE_MODIFIED errors by omitting common known false positives e.g., changed access-tokens/URLs in the body. Users can turn off this enhancement by setting AUTO_IGNORE_COMMON_VALUE_MODIFICATIONS to "no" in the service config.

2. Improved error reporting when the content type of responses changes. CONTENT_TYPE_CHANGED difference will only be reported if the subtype of content-type has changed e.g., JSON to XML, in such scenarios differences for the body will not be reported.

3. Updated Last Mirrored Request dialog on the Home page, now using Monaco editor to display last mirrored request payload.

4. Changed the icon for adding a new request in a test case.

5. Changed action for updating/restarting HyperTest's Central Service(K8s), now users can do cmmd+click on the dashboard version to open up the dialog.

6. Now service description is a required field while adding new service from HyperTest's Central Service(K8s).

Fixed:

1. Bug fix for secrets when a user tries to save a middleware.

2. Bug fix for performance report, write APIs(e.g., PUT, POST, PATCH) were not included in the performance report if config option SHOULD_TEST_WRITE_REQUESTS is set to "no".

Now write APIs performance stats will be reported for primary application if SHOULD_TEST_WRITE_REQUESTS is set to "no".

3. Bug Fix for service config editor height and scroll.

Deprecated:

Removed:

Security:

v 0.13.35

Added:

1. Support for scheduling a test while HyperTest is busy running another test. Users will be prompted to choose if they want to schedule a test with the selected test configuration when there's already a test in the running state.

2. Support for storing credentials in a secure way for using inside middlewares. A new section called Secrets under settings has been added where users can provide credentials which will be encrypted and stored in the database, these secrets will be accessible inside middlewares. While testing a middleware with secrets users will be asked to provide the secrets which will be stored locally on their browser for easy testing in the future.

3. Support for updating and restarting HyperTest's central dashboard service. Users can do ctrl+click on the central dashboard's version and can choose from a dialog whether they want to update or restart the central service.

Changed:

1. New editor for service config.

Fixed:

Deprecated:

Removed:

1. Removed option for creating a permanent rule with all fields selected as ANY, this would have resulted in ignoring all the differences detected in a test.

2. Option to provide exact match value while creating a permanent rule. Now users can provide a regular expression for matching a value or select ANY while creating a rule.

Security:

v 0.13.34

Added:

1. Support for giving access to your HyperTest instance to external users by creating a short-lived shareable link. A new section for link sharing has been added under settings where users can create or find an active link.

2. Support for downloading database backups and restoring a backup. A new section for back and restore has been added under settings where users can download a backup file and restore a backup file that was previously downloaded.

3. New pop-up notification calling for version upgrade. Users will be notified on the UI whenever a new stable version of HyperTest is available.

4. Support for making Postgres queries inside middlewares. A new connector for Postgres has been added to all the middleware available.

5. Support for sharing variables between sessions at test run time. A new memory store called testRunVariables has been added to the following middlewares: PRE_SESSION, PRE_REQUEST, POST_RESPONSE, POST_SESSION.

This will help while testing a scenario where a user can log in only once and would have to use the newly generated token in every other session in that test case, now you can store this token inside testRunVariables and it will be available to all other subsequent sessions.

6. New API for generating Swagger(3.0.0) documentation. UI support for this feature is in development.

Changed:

1. Revamped API schema dialog on APIs page. Made the user experience resemble Swagger Doc.

Fixed:

1. Resolved error on saving a test case.

2. Resolved errors on Home Page.

3. Fixed autocomplete/suggestions for connectors inside middleware code editor.

4. Fixed logic for deduplication.

5. Fixed APIs for backing up sessions, config, and restoring.

Deprecated:

Removed:

Security:

v 0.13.33

Added:

1. New section added for analytics/troubleshooting, now being served as home page for HyperTest.

2. New notifications for test start failure and pending sign-offs.

3. Option to turn off deduplication for an API from the deduplication rules page. Selectively turning deduplication off for login APIs would help running tests with requests deduplication on where login APIs are called multiple times.

4. New API for creating a tunnel connection with HyperTest's tunnel server to expose your HyperTest instance by generating a public URL.

5. Option to delete multiple rules on the temporary rules page.

Changed:

1. Now storing session tags with unique tag names. The latest tag value will be kept for a tag name in a session.

2. Changed name for Kubernetes ingress service name for HyperTest's logger service, for better DNS resolution of logger service.

3. Made all searches on UI case insensitive.

4. Revamped UI for API page.

5. Minor UI changes for chat widget and tab title.

Fixed:

1. Redundant API calls from UI on pagination.

2. Fresh installation errors on HyperTest's backend caused by migrations.

3. Fixed copy as curl functionality for PUT/POST requests.

Deprecated:

Removed:

Security:

v 0.13.32

Added:

1. New MEDIUM severity assertion(ARRAY_ORDER_DATA_TYPE_CHANGED) has been added for detecting data type changes when the order of an array has also changed.

Changed:

1. Revamped middlewares UI/UX. New console for logging messages from middleware code for better debugging.

Fixed:

1. Error at starting HyperTest backend caused by migration script for updating request hashes.

Deprecated:

Removed:

Security:

v 0.13.31

Added:

1. Option to view only those APIs which have failed in a user journey.

2. Run more than one health check before starting a new test.

Added a service configuration option called ADDITIONAL_HEALTH_CHECKS to provide API path, verb, and acceptable status codes for these health checks.

Changed:

1. Admin privilege not required for deploying HyperTest on Kubernetes.

Fixed:

1. Bugfix for saving a test case, the bug was introduced in 0.13.29.

2. Removing a middleware did not take immediate effect.

3. In middlewares fixed handling of requests with content-type 'application/x-www-form-urlencoded'.

Deprecated:

Removed:

Security:

v 0.13.30

Added:

1. New APIs page, lists all the APIs and their unique input schemas captured by HyperTest.

2. Rerun test button, which loads the configuration of a previous test for running that same test again.

3. Response page for the API performance report. Users can view all the responses for a particular API and filter based on the range of status code, response time, and response size and can also do regular expression searches on headers and body.

4. Now storing time taken by HyperTest to calculate differences in API responses and generate reports, currently not visible on UI.

5. New output parameter for middlewares: oneTimeSessionVariables. Keys and values passed in the oneTimeSessionVariables object will be copied to session variables of all the instances, which helps in situations where an auth token or OTP can/should be generated only once.

6. Service configuration option for setting a threshold in minutes(calculated from the completion of a test) after which sing-offs for tests will be automatically rejected.

7. Option for selecting 'ANY' API path or by matching against a regular expression while adding permanent rules for ignoring errors.

8. Service configuration option for reporting noise and unexplained errors. Users can choose to report these errors, by default they will not be reported.

9. Option to select minimum error severity threshold while starting a new test. Only errors that have greater or equal severity to the mentioned threshold will be shown in the regression report.

10. On searching by an API in all test cases page, the searched API path will be highlighted in the Interactions page of the respective test.

Changed:

1. Upgraded version of HTTP client Axios.

2. In the regression report now showing the count of regressions reported based on best-explained errors,

earlier total differences found were shown.

3. Now in case the content type of an API response is changed then instead of reporting both HEADER_MODIFIED and CONTENT_TYPE_CHANGED

only the CONTENT_TYPE_CHANGED error will be reported.

Fixed:

1. Handling of requests with content-type 'application/x-www-form-urlencoded' while running test.

Deprecated:

Removed:

1. From the start new test dialog removed the option for stopping the test on the first failure and running the smoke test.

Security:

v 0.13.28

Added:

1. Option to provide SMTP configuration for sending out HyperTest notifications.

2. A new mind map section, which is a visual representation of APIs relationships with one another. Users can search for one or more APIs and can gain insights into their relations.

3. Option to report an issue on JIRA. Users will be redirected to their JIRA project dashboard with issue details auto-filled.

4. Option to scale logger consumer service of HyperTest from service configuration. Scaling of logger consumers would improve performance while logging requests.

5. POST SESSION middleware, which will be executed after completing the test for a session. Users will be provided with the session's metavariables, axios(HTTP client), and the environment variables and would be expected to return post-session metavariables which will be stored in the session test analysis. This is helpful on [erforming cleanup steps after a session has been run completely

6. Added search filters in the bug tracker. Users will be able to search for issues based on: id, name, comments, status, severity, API path, method, difference type, and difference path.

7. Added webhook payload description in the notification section.

Changed:

1. Improved HyperTest's performance while logging a request by updating logic for handling request tags.

Fixed:

1. Test progress refresh bug.

2. Now merging duplicate sessions based on a common session differentiator by executing a background job in HyperTest's backend.

This was an issue for high traffic environments \

Deprecated:

Removed:

Security:

v 0.13.27

Added:\

Changed:

1. Disabled encoding of cookies in headers of requests while running a test.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.26

Added:

Changed:

1. Improved HyperTest's performance by updating logic for clustering of APIs.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.25

Added:

1. Introduced a new difference type DATA_TYPE_CHANGED(change in the data type of a property in the API response).

2. Introduced an option to sign off/approve all the reported differences in a test. Now teams can easily sign off CI pipeline builds with HyperTest.

3. Option to skip a request at runtime with the help of PRE_REQUEST middleware. Added an optional output parameter shouldSkipRequest for PRE_REQUEST middleware.

4. Option to add permanent rules from regression report with Ctrl + Left Click on any reported changes.

5. Now showing the severity of reported differences in the regression report.

Changed:

1. Updated default function bodies for respective middlewares.

2. Updated database migration logic for faster bootup.

3. Updated documentation for HyperTest cli.

Fixed:

1. Fixed logic for handling cookies.

Deprecated:

Removed:

Security:

v 0.13.24

Added:

Changed:

Fixed:

1. Logic for calculating difference paths for API responses containing arrays of arrays.

Deprecated:

Removed:

Security:

v 0.13.23

Added:

Changed:

1. Improved Hypertests capability of handling large amounts of incoming requests.

Introduced an option to handle scaling and load balancing of HyperTest's logger service with Nginx.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.22

Added:

1. Support for Kubernetes.

2. Option to sort performance report by average latency change(%).

3. Option to expose your service to third-party services with a static URL.

Added a HyperTest CLI command to create a tunnel connection with HyperTest's tunnel server to expose your service by generating a public URL.

Changed:

1. Now by default performance report will be sorted by average latency change(absolute value).

2. Duplicate manual assertion failures across various instances of a candidate's response won't be reported.

Helps in reducing error count in the regression report.

3. Now Request count for APIs in the API coverage dialog can be enabled/disabled on the toggle of a switch.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.21

Added:

1. Now you can inspect all the APIs which would be played in a test, from the API coverage section in the start new test dialog. API Coverage report will include all the documented and undocumented APIs, only undocumented APIs will be shown in case swagger is not available.

Changed:

Fixed:

Deprecated:

Removed:

Security:

v 0.13.20

Added:

Changed:

1. Now default Primary and Candidate URLs are available in the restest option on the test case interactions page.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.19

Added:

1. Option to run tests on multiple environments.

Environments will be identified by x-ht-env or x-real-host headers.

Changed:

1. Simplified whitelisting of changes. Now you can ignore desired changes with one click from the regression report.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.18

Added:

Changed:

Fixed:

1. VALUE_MODIFIED_EXCEPTIONS to work only on strings.

Deprecated:

Removed:

Security:

v 0.13.17

Added:

1. 10 min cron job to terminate stuck test analysis.

2. VALUE_MODIFIED_EXCEPTIONS in config to avoid reporting differences for certain strings.

Changed:

1. API performance report-related UI changes.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.16

Added:

Changed:

1. Now showing primary and candidate URLs in health check errors.

2. Logger queue messages will no longer be persisted to disk for better performance.

Fixed:

Deprecated:

Removed:

Security:

v 0.13.15

Added:

1. API performance report.

2. Slack notification webhook.

Changed:

1. Middlewares UI.

Fixed:

1. CI issue for not being able to start the test.

Deprecated:

Removed:

Security:

v 0.13.14

Added:

1. Maintenance page link in the dashboard.

Changed:

1. Navigation drawer expand collapse button.

Fixed:

1. Frontend state-related issues.

Deprecated:

Removed:

Security:

v 0.13.13

Added:

Changed:

Fixed:

1. URL validation.

2. Middleware bug.

Deprecated:

Removed:

Security:

v 0.13.12

Added:

1. Option to download test report in excel format from the dashboard and build report.

2. Diff view in responses page.

3. Now using Monaco editor for manual assertion.

4. Feedback widget in UI.

5. Middlewares info page.

6. Common and advanced use cases of middlewares in docs.

Changed:

1. Cron job docs.

2. Now not showing NOT_RUN requests in test results.

Fixed:

1. Saved sessions related bug in Test stats at start new test dialog.

Deprecated:

Removed:

1. OVERRIDE_SESSION_REQUESTS_V1 middleware.

Security:

v 0.13.11

Added:

1. Native cli for CI integration.

3. CI docs.

2. MIDDLEWARE_ENV to htConfig, which will be provided inside middlewares.

3. baseURL for REQUEST_MODIFIER_V1, POST_RESPONSE_SESSION_VARIABLES_V1 and PRE_SESSION_V1 Middlewares.

Changed:

1. UI for test stat at start new test.

2. Now Showing Open Issues count for a test on the dashboard, earlier Total Issues count was displayed.

3. Now Using Monaco editor for Middlewares.

Fixed:

1. Pre Migration Script.

Deprecated:

Removed:

Security:

v 0.13.10

Added:

Changed:

Fixed:

1. PRE_SESSION_V1 Middleware.

Deprecated:

Removed:

Security:

v 0.13.9

Added:

1. Option to deduplicate sessions for a test.

2. Displaying total and unique requests for a test and a user session in stats.

3. PRE_SESSION_V1 Middleware.

4. Running mode config (ONE_DB or TWO_DBS).

5. Warning in the weekly report for missing HT_DASHBOARD_URL.

Changed:

Fixed:

Deprecated:

Removed:

Security:

v 0.13.8

Added:

1. API for CI integration (isTestCompleted)

2. Middleware expected output schema in middleware page

3. Interactions page pagination reversed(now starting from the last page)

4. Difference type information and navigation on interactions page

5. Pre-session middleware

Changed:

1. Build report is being generated after terminating the test

Fixed:

1. Empty sessions issue by filtering sessions before starting a new test

2. Pre-migration script updated

Deprecated:

Removed:

Security:

v 0.13.7

Added:

1. Option to deduplicate requests while running a test

Changed:

Fixed:

Deprecated:

Removed:

Security:

v 0.13.6

Added:

1. Option to ignore errors by retesting from interactions page

2. Option to select the fast mode for tests in HyperTest configuration(Hits requests three times instead of six times)

3. Option to add a description to a test while creating it

4. Option to check test stats in start new test dialog(total session and request count for selected time period and additional test options)

5. API for backup and restore("GET {HYPERTEST_URL}/api/backupConfig", "GET {HYPERTEST_URL}/api/backupSessions", "POST {HYPERTEST_URL}/api/restore")

6. Documentation for starting HyperTest via cron.

7. HyperTest dashboard URL in config for attaching build report URL in test notification email

Changed:

Fixed:

Deprecated:

Removed:

Security:

v 0.13.5

Added:

1. Search test cases by API paths (even without swagger/Open API spec)

2. Option to add a delay before executing requests while retesting

Changed:

Fixed:

Deprecated:

Removed:

Security:

v 0.13.4

Added:

1. Manual Assertions

Changed:

Fixed:

Deprecated:

Removed:

Security:

v 0.13.3

Added:

1. Protobuf support added

2. Option to add a delay before executing requests in a test case

Changed:

1. Coverage report includes past request data as well now

Fixed:

Deprecated:

Removed:

Security:

v 0.13.2

Added:

1. File upload (Multipart) support added

Changed:

Fixed:

Deprecated:

Removed:

Security:

v 0.13.1

Added:

Changed:

Fixed:

1. Autodeletion logic fixed to not delete old saved test cases

Deprecated:

Removed:

Security:

v 0.13.0

Added:

Changed:

1. Probabilistic array comparisons to support data coming from 2 DBs

2. Old path, new path merge into a single diff Path (writing rules will become simpler, 50% less time to query results) (Backwards compatible)

Fixed:

Deprecated:

Removed:

Security:

v 0.12.36

Added:

Changed:

Fixed:

1. autodelete old requests used to delete all test cases older than x days. Now it just deletes requests older than x days

Deprecated:

Removed:

Security:

v 0.12.35

Added:

Maintenance UI: Accessed via /maintenance/

1. Update HyperTest: Downloads a new version if available

2. Restart HyperTest: Restarts all the HyperTest services.

3. Restart Nginx: Restarts the Nginx container.

Changed:

1. issue tracker: status field added. It can be 'Open' or 'Resolved'

2. 15x faster array comparisons

Fixed:

1. array order change false positives handled

Deprecated:

Removed:

Security: