Nextmv Docs

A new feature was added to scenario tests that allows you to download all of the outputs of the runs made for the scenario test. You could always go to each individual run and download the output file, but this could be tedious if your scenario test had a lot of runs. Now with the click of a button all the run outputs are collected into a single ZIP file and downloaded to your local machine.

Downloaded run outputs will be grouped into directories based on the individual scenarios within the scenario test. Note that only successful runs will be downloaded. If one or more run outputs could not be downloaded for whatever reason, a notice.txt file will be included in the ZIP file that lists the IDs of the run outputs that could not be downloaded.

You now have the ability to delete instances, inputs, and input sets in Nextmv Console. To delete an entity, navigate to the edit view and in the lower right of the page, in the footer, there will be a Delete button. Click this Delete button and then confirm the delete action in the next step.

After clicking this final delete button, the entity will be deleted and you will return to the list view. Note that an instance set as an app’s default instance cannot be deleted in Console. It must first be unset as the app’s default instance, and then it can be deleted.

The delete operation is available to Operator, Developer, and Admin roles. Viewer roles cannot delete entities.

A new Clone scenario button has been added to the create scenario test view that enables cloning individual scenarios within a scenario test. This new feature allows you to quickly create new scenarios within a scenario test that are based on a scenario you have already defined. A cloned scenario carries over the full definition of its source scenario and then can be further adjusted as needed.

Decision workflows are now available in Nextmv Console. You can create a new workflow from the UI and then manage the workflow like you would an application. A workflow has all of the same views as an application, except that the workflow run details includes an extra Flow view that displays a directed acyclic graph (DAG) of the workflow run.

Read more about decision workflows and how to use them in the dedicated Decision workflows section in Nextmv Docs.

Prior to this update, when you logged in to Nextmv Console, after being authenticated, you would be directed to your root account. If you wanted to switch to another team you would need to select the team from the dropdown in the header. This pattern could be laborious if you were doing most of your work in a team other than your root account.

Now, Nextmv Console will remember your last-visited team and you will be automatically redirected to this team when you log in.

Applications can write custom metrics to the run output file using the standard Statistics convention. These custom metrics live under the top-level statistics property of the run output and are extracted and displayed in the run details view in Nextmv Console.

These metrics were displayed in a technical manner using their full data path as the name of the metric. For example, if a custom metric tracking total waste was named total_waste and was a property of the custom object which in turn was a property of the result object, the name of this metric would be displayed as result.custom.total_waste.

These object data paths were obscuring the meaningful parts of the metric names, and the end user often only cares about the metric and its value, not where it’s stored in the output JSON file. For these reasons, the metrics are now displayed without the data paths and also are presented with a more human-friendly title casing.

Before

After

When creating a new acceptance test you can now specify a tolerance level for the pass/fail rules. Prior to this, you were only able to set hard rules on how a test would pass or fail. When setting the tolerance, you can define it as an absolute value (specific number) or as a relative value (percentage-based).

This tolerance will be reflected in the final chart visuals as well.