24 Orchestrating Recovery Scenarios
The Recovery Scenarios feature allows N2W Software users to design an object that will automatically coordinate a sequence of recoveries for several or all backup targets of a single policy during one recovery session.
- A Recovery Scenario object is created with the saved configurations of successful backups for the particular policy.
- The user will save the recovery configuration for each selected backup target and add it to the Recovery Scenario object.
- At runtime, the user selects a successful backup record to use in the recovery.
Following are the options for executing a Recovery Scenario:
- Test the success of the Recovery Scenario configuration using the Dry Run command.
- Execute an ad hoc run of the Recovery Scenario using the Run Scenario command.
- Execute the Recovery Scenario on a schedule. The last successful backup is automatically selected as input. Assign or create a schedule in the Recovery Scenario Details tab.
- During the Recovery Process:
- All Recovery Scenario targets share the same destination account and destination region, which are set as part of the Recovery Scenario parameters.
- Recovery Scenarios can have pre and post-scripts which will run, respectively, prior to recovery execution and subsequent to recovery completion.
- In case of a pre-script failure, the Recovery Scenario will not execute.
- In case of a Recovery Scenario failure or pre-script failure, the post-script will not run.
- Every Recovery Scenario target has a sequential Recovery Order value within the Recovery Scenario which determines the order in which each target is recovered.
- Execution of a target recovery within the recovery scenario is sequenced using the target's Recovery Order value. The target with the lowest Recovery Order value runs first.
- All recovery targets sharing the same Recovery Order value will run in an arbitrary sequence.
- If the recovery of a target fails, the targets next in sequential order will not run, unless Recovery Scenario’s Continue recovering ignoring failures parameter is enabled.
- Testing: You can verify the Recovery Scenario input parameters, such as key pair, security groups, and VPC, by selecting theDry Run link. You will be prompted to select a successful backup for the Dry Run just as with an actual Run Scenario.
To add the details for a recovery scenario:
- 1.Select the Recovery Scenarios tab, and then selectNew.
- 2.In the Recovery Scenario Details tab, complete the fields as follows:
- Name - Enter a unique name.
- User, Account, Policy - Select from the lists or selectNew. After the addition, selectRefresh. Select the policy for which the Recovery Scenario is defined.
- Recovery Destination Account and Recovery Destination Region - Select from the lists.
- AWS Credentials - Select Use account AWS Credentials or Provide Alternate AWS Credentials.
- Schedule - Optionally select a schedule from the list, or selectNew to create a new schedule, for running the Recovery Scenario.
- Recipients - Enter the email addresses of users to receive notification of Scenario Run Scenario / Dry Run status.
- Enable Agent Scripts – Select if the Recovery Scenario will be run by a custom script. The default is not to run user scripts. See section 24.7.
- Select Agent Script Timeout in seconds from the list. When the timeout is reached, N2WS will skip the script and continue with the recovery scenario.
- Collect Script Output – Whether to collect script output in a log. Default is to collect.
- Continue recovering ignoring failures – Whether to continue the sequence of recoveries in the scenario if there is a failure. The default is to not continue the script on the failure of recovery.
- 1.Select Save.
To add the recovery targets:
- 1.Select the Recovery Targets tab.
- 2.In the Add Recovery Targets menu, select a resource type from the target policy to add to the scenario. Reminder: S3 Bucket Sync is not an option since it is not a backup action.
- 3.In the Add resource type screen, select one or more Recovery Targets for the resource type, and then select Add selected.
4. To change the Recovery Source or Recovery Order for a target, select a value from its list.
When all details are complete, select Save in the Create Recovery Scenario screen.
The Configuration screen opens with additional tabs:
- Basic Options
- A tab for the resource type, such as Volumes
- Advanced Options
For each data item in the configuration tabs, assign the appropriate value. In each tab, you can customize a setting by turning off its Auto assigned toggle. Depending on the data item, you can:
- Select a different value from the Custom drop-down list.
- Enable or disable a feature.
- Enter a new value.
When finished with each tab, select Close.
In the Basic Options tab, you can configure basic recovery actions, such as whether to launch from a snapshot or image, which key pair to use, and network placement.
In the Volumes tab, you can configure device information, such as capacity, type, and whether to preserve tags and delete on termination. To expand the configuration section for a volume, select the right arrow
In the Advanced Options tab for an instance, you can customize recovery target features, such as architecture, shutdown behaviour, whether to enable ENA and user data.
The Dry Run option allows you to determine whether the input parameters, such as key pair, security groups, and VPC, are correct for the recovery.
To test a Recovery Scenario:
- 1.In the Recovery Scenarios tab, select a Recovery Scenario and then selectDry Run.
- 2.In the list of successful backups, select one backup to perform the test with, and then select Dry Run.
- 3.Open the Recovery Scenario Monitor.
- 4.In the Status column for the Recovery Scenario, you will see a success message for the test:
- 5.SelectingRecoveries brings you to the regular Recovery Monitor.
To manage a Recovery Scenario object:
- 1.In the Recovery Scenarios tab, select a scenario.
- 2.SelectEdit,Delete,Run Scenario, orDry Run, as needed.
To manage targets in the scenario:
- 1.In the Recovery Scenarios tab, select a scenario, and then selectEdit.
- 2.To delete a target, select the Recovery Targets tab, select a target, and then selectRemove from List.
- 3.Depending on the resource type, the actionConfigure is available. Configure opens tabs for Basic Options, resource type details, and Advanced Options.
- 1.In the Recovery Scenarios tab, select a Recovery Scenario and then selectRun Scenario. A list of backups, successful and unsuccessful, opens.
2. Select one successful backup to recover from and then select Recover. The started message opens in the top right corner:
3. To open the Recovery Scenario Monitor, select the link, or select the Recovery Scenario Monitor tab.
- A Status of ‘Recovery succeeded’ with a test tube symbolnext to it indicates that the recovery was a Dry Run.
4. To view details of the recovery in the Run Log, select a Recovery Scenario and then select
5. To delete a run record, select a scenario, and then select
6. To view a live recovery, in the Recovery Scenario Monitor, select a scenario, and then select
Recoveries. The Recovery Monitor opens.
When Enable Agent Scripts is set in the Recovery Scenario Details tab, N2WS will run two scripts, one before and one after the recovery run:
A file extension is optional and, if added, may be for any interpreter.
These scripts must be located on the N2WS server in the following folders:
- For root user:
- For non-root user: /
The before script passes the following parameters, in the following order:
The after script passes the same parameters as the before with the addition of parameters for the scenario’s recovery targets:
Following is an example of an
after_script for a Recovery Scenario that was defined with 2 targets: an EC2-instance and an EC2-volume. The
after_script passes 6 parameters, 2 of which are for the targets. In the following example, the instance recovery target was not recovered: