Reports
Report Concepts
This section describes Ops Center Protector's reporting features.
For further information, refer to:
About reports
Ops Center Protector is able to generate a number of reports viewable both within the UI and exportable in various formats: The reports are split in to 3 different groups:
- Jobs:
- Jobs Report - An ongoing report listing all completed and/or failed backup, restore and other jobs.
- RPO Report - Generated when accessing the report page and also generated on a daily basis, lists operations that met and/or failed to meet their specified RPO.
- Block Storage:
- HORCM Count Report - An ongoing report listing the actual temporary and current HORCM instances for each Block Storage Device.
- Pool Usage Report - An ongoing report listing used and available pool capacities and thresholds for each Block Storage Device.
- Journal Usage Report- An ongoing report listing used and available journal capacities for each replication policy on each Block Storage Device.
- Network Transfer Report - An ongoing report listing last, in-flight and last-received Q markers and transfer times for each replication policy on each Block Storage Device.
- All Pairs - This report provides a list of all the replication pairs. There is no grouping. If multiple LDEVs are part of replication setup in Protector or they were together in a HRCM file, each individual LDEV will be shown as a replication. See About Global Replication reports for more information.
- Pairs by Storage Record - This report shows replication grouped by Protector record groups. This would be the replications shown inside a Protector dataflows. See About Global Replication reports for more information.
- Pairs by Consistency Group - This report shows replications grouped by Array Consistency Group. See About Global Replication reports for more information.
- Pairs by Copy Group - This report shows replications grouped by Array Copy Groups. See About Global Replication reports for more information.
- Pairs by Snapshot Group - This report shows snapshots grouped by Snapshot Groups. See About Global Replication reports for more information.
- Host Based Storage:
- Repository Usage Report - An ongoing report listing used size and total size, deduplication queue and tier queue lengths for each repository.
- HCP Usage Report - An ongoing report listing used size, capacity and object count for each HCP node.
- HCP Cloud Scale Report - An ongoing report listing used size, capacity and object count for each HCP Cloud Scale node.
- Amazon S3 Usage Report - An ongoing report listing used size for each Amazon S3 node.
- Backup Report - An ongoing report listing many parameters relating to repository, HCP and Amazon S3 backups. Each backup’s session logs can be viewed from the summary report.
About Global Replication reports
The Global Replication Reports provide a method of giving a complete list of all replications on the arrays including replications that are not managed by Protector. This feature works by interfacing to Ops Center CM-REST which provides an inventory of replications on individual arrays. Protector caches the result from CM-REST and aggregates the results.
- Report on all replications on arrays
- Includes both replications that are managed by Protector and replications that are not
- Provide a list of individual replications pairs or grouped replication report Group replication reports include
- Pairs by Storage Record report - List of replications and snapshots that are managed by Protector and have a replication or snapshot record
- Pairs by Consistency Group report - List of replications and snapshots that have a common consistency group
- Pairs by Copy Group report - List of replications that have a common copy group
- Pairs by Snapshot Groups report - List of snapshots that have a common snapshot group
- Reports have predefined filters and an advanced filter.
- Ability to drill down on a replication / snapshot listing and view further details (Detail View).
To provide the reports, Protector queries Ops Center CM-REST. Consequently it is a requirement that CM-REST is configured for every array where the report is required. When setting up the Protector Block Node, there is now an additional section where you can specify the connection and credentials details for the REST interface on CM-REST.
When setting up a Block Node, it is optional to add the CM-REST information. You cannot however have a Block Node configured to use the CM-REST interface only.
Ops Center CM-REST can be configured to manage multiple arrays in the same way that a Protector node might manage multiple array. However it is not a requirement that Protector and CM-REST are configured symmetrically each dividing up the management the same way. It is also possible for CM-REST and Protector be installed on the same machine or on different systems.
Note that if CM-REST and Protector reside on the same array and are configured to use Fibre Channel Command device, they must be configured to uses different array accounts. In the configuration where CM-REST and Protector both reside on the same host, if Protector and CM-REST share the same array account credentials there will be unpredictable behaviour and failures will occur.Each host that services a Protector Block Node, eg array, has a database to store the replication information for that array. Protector queries CM-REST every 1 hour by default to get the inventory of all replications for a configured array and stores the result in the database. When the user creates a report, the Protector Master will query each of the nodes that manage the block host to query their databases. The results will then be merged to provide the federated results into a single report. Because replications are frequently across two arrays, it is possible to get the result from both sides of the replications (eg from the P-VOL and from the S-VOL array). In that situation, Protector will choose the result that had the newest refresh. In the extended view of the report, the field "Cache Updated" gives an indication of how recently the database had been updated for that record.
There are multiple choices of reports split into how the replications should be grouped. By default the reports will report across all replications on all arrays. Each report has extensive filtering capabilities that allow the reports to be more manageable in size and targeted towards the users needs. Note that the maximum number of return values is capped by default to 1000 rows. When returning to a report in the UI, the last search result will automatically be cached.
All Pairs
This report provides a list of all the replication pairs. There is no grouping. If multiple LDEVs are part of replication setup in Protector or they were together in a HRCM file, each individual LDEV will be shown as a replication.
Pairs by Storage Record
This report shows replication grouped by Protector record groups. This would be the replications shown inside a Protector dataflows.
Pairs by Consistency Group
This report shows replications grouped by Array Consistency Group.
Pairs by Copy Group
This report shows replications grouped by Array Copy Groups.
Pairs by Snapshot Group
This report shows snapshots grouped by Snapshot Groups.
Reports UI Reference
This section describes the Reports UI, accessed via the Main Banner.
For further information, refer to:
Reports Dashboard
The Reports Dashboard displays the various report types generated by Protector.
Control | Description |
RPO | Select to view the RPO Report. |
Repository Usage | Select to view the Repository Usage Report. |
Pool Usage | Select to view the Pool Usage Report. |
Journal Usage | Select to view the Journal Usage Report. |
Network Transfer | Select to view the Network Transfer Report. |
Backup | Select to view the Backup Report. |
Jobs | Select to view the Jobs Report. |
HORCM Count | Select to view the HORCM Count Report |
HCP Usage | Select to view the HCP Usage Report |
HCP for Cloud Scale Usage | Select to view the HCP Cloud Scale Usage Report |
S3 Usage | Select to view the S3 Usage Report |
All Pairs | Select to view the Report Choices |
Pairs by Storage Record | Select to view the Report Choices |
Pairs by Consistency Group | Select to view the Report Choices |
Pairs by Copy Group | Select to view the Report Choices |
Pairs by Snapshot Group | Select to view the Report Choices |
RPO Report
The RPO Report page shows the RPO report for all active operations. This can then be filtered using the filter controls.
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
Trigger Operation | Triggers the selected operations from the table below. |
More Actions | Displays a menu that provides access to UI pages relating to the selected RPO report entry. |
Status | This table entry indicates when the policy operation is in or out of its RPO. Policy operations using continuous movers are show as not tracked. |
Filter on Recovery Point Objective Date | Select a date and time for RPO. The Status column of the table will then indicate whether each policy operation meets that RPO date and time. Select Now for the current date and time. |
Filter on User Tags | Filters the displayed results based on Tags. |
Filter on Recovery Point Objective | Can be one of:
|
Filter on Policy | Filters the report so that only entries with the specified policy are displayed. |
Filter on Operation Type | Filters the report so that only entries with the selected operations are displayed. Can be one or more of:
|
Filter on Operation Name | Filters the report so that only entries with the specified Operation Name are displayed. |
Filter on Data Flow | Filters the report so that only entries with the specified data flow are displayed. |
Filter on Source Node | Filters the report so that only entries with the specified Source Node name are displayed. |
Filter on Destination Node | Filters the report so that only entries with the specified Destination Node name are displayed. |
Filter on Destination Store | Filters the report so that only entries with the specified Destination Store are displayed. |
Jobs Report
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
Filter on Type | Filters the report so that only entries for the specified Job Type are displayed. |
Filter on Status | Filters the report so that only entries for the specified Status are displayed. |
Filter on Node | Filters the report so that only entries for the specified Node are displayed. |
Filter on Subsystem | Filters the report so that only entries for the specified Subsystem are displayed. |
Filter on Operation | The Subsystem filter term must be selected to enable this control. Filters the report so that only entries for the specified Operation are displayed. |
Repository Usage Report
This page shows you the details of the Repository Usage.
After a large set of data has been manually deleted, a large number of snapshots have expired, or a number of stores became inactive and were deleted from the repository, you will need to check the repository’s status and remove the unused space. See Reducing repository size for more information.
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
Used Size | The actual logical size of the repository at any point in time. Typically this value will show rapid initial growth which rapidly reduces as the data change rate falls off. |
Total Size | The allocated capacity of a repository. As this space is used thisvalue steps up by preset increments (100Gb by default).The total size will always be greater than or equal to the usedsize. When data is removed from a repository it will not shrink, new data will use the free space in the repoisitory before growing in size. |
Deduplication Queue | Shows the frequency and duration of I/O activity for file-level deduplication within the repository. |
Tier Queue | Shows the frequency and duration of I/O activity for file-level archiving within the repository. |
Filter on Repository | Filters the report so that only entries for the specified repository are displayed. |
Filter on Date Range | Filters the all report so that only entries within the specified date range are displayed. Opens the Date Time Range Picker. |
Backup Report
The Backup report shows a history of all repository, HCP , HCP Cloud Scale and Amazon S3 based resynchronizations that have taken place within Protector. This list of sessions can be filtered in a similar method to Log Manager to find a specific session or range of sessions. It is also possible to View Session details (as in the Logs Inventory) by selecting an entry in the report.
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
View Session | Click on the Session icon to display all log messages that pertain to that session. The Session Log Details is displayed. |
Filter on Date Range | Filters the report so that only entries within the specified date range are displayed. Opens the Date Time Range Picker. |
Filter on Status | Filter the report by the status of the operations listed. |
Filter on Policy | Filter the report by the Policy. |
Filter on Operation Type | Filters the report so that only entries with the selected Operation Type are displayed. |
Filter on Operation Name | Filters the report so that only entries with the specified Operation Name are displayed. |
Filter on Source Node | Filters the report so that only entries with the specified Source Node name are displayed. |
Filter on Destination Node | Filters the report so that only entries with the specified Destination Node name are displayed. |
Filter on Destination Store Type | Filters the report so that only entries with the specified Destination Store Type are displayed. |
Pool Usage Report
This page shows you the details of the Pool Usage.
The Block Device Pool Usage report displays a list of Block pools currently containing records associated with Protector, their usage levels and configured warning and high watermark thresholds. Pools that have been allocated for use by Protector are only displayed and updated while snapshots or replications are held within them. A full list of pools is available in the Storage Navigator UI where the warning and high watermark (depletion) thresholds can be configured.
Entries are added to the report every 10 minutes (configurable) or whenever a snapshot or resynchronization event occurs. Used and free values may appear unchanged if the allocation has increased by less than the displayed resolution.
For dynamic pools, if the warning or high water threshold is reached then the entry is highlighted.
For snapshot (Thin Image) pools the warning threshold is not configurable. Snapshot pools will enter an error state when usage reaches a level of 5% below the high water threshold.
For dynamic pools, the replications that use the pool are put into an error state and will refuse to accept additional data. Manual intervention is required before the pool can be used again.
For snapshot pools, the data in the pool will become corrupted, invalidating any and all snapshots stored within (hence a fixed 5% margin is defined to prevent this).
It is highly recommended that email notifications are set up to alert systems administrators when pool threshold events are logged. This can be done in the Hitachi Block Device Monitoring tab of the Notification Wizard
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
Filter on Storage Serial Number | Filters the report so that only entries for Storage devices with the specified serial number are displayed. |
Filter on Date Range | Filters the report so that only entries within the specified date range are displayed. Opens the Date Time Range Picker. |
Filter on Pool Name | Filters the report so that only entries for the specified Pool names are displayed. |
Filter on Pool Type | Filters the report so that only entries for the specified Pool Types are displayed. |
Journal Usage Report
The Block Device Journal Usage Report displays a list of all UR replication policies, showing the source and destination journal usage. The list is updated at regular intervals. Search terms can be constructed, based on the field names in the report, using the Filter controls.
Email notifications may be set up to alert systems administrators when the journal usage rises above a predetermined threshold. This can be done using the Hitachi Block Device Monitoring tab of the Notification Wizard.
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
Filter on Storage Serial Number | Filters the report so that only entries for Storage devices with the specified serial number are displayed. |
Filter on Date Range | Filters the report so that only entries within the specified Date Range are displayed. Opens the Date Time Range Picker. |
Filter on Journal ID | Filters the report so that only entries for the specified Journal ID are displayed. |
Filter on Journal Status | Filters the report so that only entries for the specified Journal Status are displayed. |
Filter on Journal Used Percentage | Filters the report so that only entries for journals which have exceeded the specified Journal Usage Percentage are displayed. |
Filter on Policy | Filters the report so that only entries for the specified Policy are displayed. |
Filter on Operation Name | Filters the report so that only entries for the specified Operation Name are displayed. |
Filter on Source Node | Filters the report so that only entries for the specified Source Node are displayed. |
Filter on Destination Node | Filters the report so that only entries for the specified Destination Node are displayed. |
Network Transfer Report
The Network Transfer Time Report displays a list of all UR replication policies, showing the network transfer time (defined as the time taken for the data to be transferred from the source journal to the destination journal). Entries are added to the report every 1 minute. Search terms can be constructed, based on the field names in the report, using the Filter controls.
Email notifications may be set up to alert systems administrators when the network transfer time rises above a predetermined threshold. This can be done using the Hitachi Block Device Monitoring tab of the Notification Wizard.
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
Filter on Storage Serial Number | Filters the report so that only entries for Storage devices with the specified serial number are displayed. |
Filter on Date Range | Filters the report so that only entries within the specified Date Range are displayed. Opens the Date Time Range Picker. |
Filter on Average Transfer Time | Filters the report so that only entries which have exceeded the specified Average Transfer Time number are displayed. |
Filter on Policy | Filters the report so that only entries for the specified Policy are displayed. |
Filter on Operation Name | Filters the report so that only entries for the specified Operation Name are displayed. |
Filter on Source Node | Filters the report so that only entries for the specified Source Node are displayed. |
Filter on Destination Node | Filters the report so that only entries for the specified Destination Node are displayed. |
HORCM Count Report
The HORCM Count Report displays a count of HORCM instances (actual, temporary and current) for each in-band and out-of-band (IP) command device attached to each block storage device. The report is updated every hour (configurable). Search terms can be constructed, based on the field names in the report, using the Filter controls.
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
Filter on Storage Serial Number | Filters the report so that only entries for Storage devices with the specified serial number are displayed. |
Filter on Date Time Range | Filters the report so that only entries within the specified Date Range are displayed. Opens the Date Time Range Picker. |
HCP Usage Report
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
Filter on Node | Filters the report so that only entries for the specified Node are displayed. |
Filter on Date Range | Filters the report so that only entries within the specified date range are displayed. Opens the Date Time Picker. |
HCP Cloud Scale Usage Report
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
Filter on Node | Filters the report so that only entries for the specified Node are displayed. |
Filter on Date Range | Filters the report so that only entries within the specified date range are displayed. Opens the Date Time Picker. |
S3 Usage Report
Control | Description |
Export | Launches the Export Report Dialog to export the report in the chosen file format. |
Filter on Node | Filters the report so that only entries for the specified Node are displayed. |
Filter on Date Range | Filtersthe report so that only entries within the specified date range are displayed. Opens the Date Time Picker. |
Global Replication Reports
The reports that make up the Global replication reports are all very similar in style only varying by the columns of data.
Each report has a condensed or expanded view. Expanded view will display all the fields for a replication / snapshot while condensed view will display the more commonly sought after information. Each report displays custom fields that are pertinent to that report.
In many columns for a given row in the replication reports, there are two values, one above the other. The first value represents the entry for the primary, the second represents the entry the secondary. So for instance, for the column "Array", the first entry is the array that the PVOLs resides, and the second entry is the array which hosts the SVOLs. Note that this is how the array interprets the source and destination volumes which may differ from Protector which always maintains the source and destination as the way it is drawn on the dataflow.
If the replication or the storage is one that is managed by Protector then additional actions are available. This is will be evident by the vertical expansion control at the end of the row. Selecting this control will provide the user with further options allow them to view with Protector:
- Storage Record - This will take you to the storage record for that replication / Snapshot. This is only available if the replication is defined in a Dataflow.
- Primary Storage - This will take you to the Storage Node details screen for that replication's primary storage. This is only available if that storage was configured in Protector.
- Secondary Storage -This will take you to the Storage Node details screen for that replication's secondary storage. This is only available if that storage was configured in Protector.
- Policy - This will take you to the Policy definition for that replication . This is only available if the replication is defined in a Dataflow.
- Dataflow - This will take you to the Dataflow configuration for that replication. This is only available if the replication is defined in a Dataflow.
- Monitor - This will take to the Monitor screen for that replication. This is only available if the replication is defined in a Dataflow.
Report Filters
Each report comes with multiple filters that can help to manage the size of the report and be targeted to the users needs. The filters are grouped into three sections: Common, Primary, Secondary. These groups can be expanded to expose the filter attributes for that section . Common filter refers to attributes that are common to both the Primary and the Secondary side of a replication. Primary filter are attributes specific to the Primary side of a replication. Likewise, Secondary filter are attributes specific to the Secondary side of a replication. The filters can be used in conjunction to provide more targeted reports.
For Example:
- To view all replications going from one array to another, enter the primary array serial number in the Primary section and the secondary array serial number in the Secondary section.
- To view all replications coming into or going out of an array, enter the array serial number in the Common section.
Export Report Dialog
This dialog is displayed when downloading a report.
- The report will be downloaded to a location determined by the web browser's settings.
- Any filtering applied when viewing the report will also be applied to the exported report.
- Exporting reports in HTML and PDF will have times exported in the same time zone as the Master node. Exporting in CSV or JSON will result in times being exported in UTC.
Control | Description |
Export Format | Select the desired format to export the report in. Can be one
of:
|
Export | Click to begin the export process. The dialog will display progress of the export process and the export file will automatically be downloaded when ready. The export will be automatically downloaded even if the dialog is closed. |
Report Tasks
For further information, refer to:
How to view a report
Ops Center Protector generates a number of different reports which can be viewed as follows:
Procedure
Click Reports on the Main Banner to open the Reports Dashboard.
Select one the report type you want to view by clicking the corresponding button on the dashboard.
The selected report is displayed.From a report page, click on the Export button in the top right to open the Export Report Dialog which enables the report to be exported in various formats.