Set Up Data Quality Rules

View Data Quality Rules

You can view all available data quality rules and their components in the Data Quality Rule workspace.

To view data quality rules:

From the Performance Center window, click Setup and click Data Quality Rules in the left navigation. You see the available data quality rules in the workspace.

Create Data Quality Rules

You can create a data quality rule by associating validation rules with specific entities, performance models, and frequencies. Data quality rules use data quality validation rules or calculation status validation rules to test the validity of performance calculations and reference data. For more information, see About Validation Rules.

To create a data quality rule:

1. From the Performance Center window, click Setup and click Data Quality Rules in the left navigation.
   You see the available data quality rules in the workspace.

2. Click Create New on the ribbon.
   You see the Creating New Data Quality Rule workspace.

3. Enter a Name and a Description.

4. To create a list of entities used by the rule, click the List lookup icon and select the entities. Or, click the ellipsis to conduct a search of entities.

5. Click the Performance Model drop-down list and select the performance models used by the rule.
   NOTE:  This is a required field for data quality and reference data if no source rule is chosen. When no source rule is selected, the source rule associated with the performance model is used for cash activity and positions. The Model is always required for Data Quality rules with Calculation Status validations.

6. Click the Frequency drop-down list and select a frequency.
   Options include:
   –  Daily
   –  Monthly
   –  Quarterly 
   NOTE: For data quality validations, the frequency defines the days in a range for running the validations. For calculation status validations, the frequency limits the performance calculation that runs the calculation status validations in the data quality rule.

7. Click the Source Rule drop-down list and select a source rule to override the source rule in the selected performance model.

8. Check the Retain History check box to store history of each time you run the rule for the same effective date multiple times. Uncheck the box to store only the most recent results for the rule each time you run it for the same effective date.

9. Click the Return Type and select the Strategy option based on which you want to validate the Performance data.
   NOTE:  This is a required field for data quality when the selected validation rule for Data Quality is process stage and Performance data is stage detail. When the Data Quality/Performance data type validation is not selected, then the return type option selected in the DQM rule is not considered during the validation process. 

10. Check the Use Business Calendar check box to limit the validations to business dates when you have selected a date range.

11. Configure Validation Checks, by selecting the validation rules you want to associate with the data quality rule from the Existing Validation Rules to Apply drop-down list.
    You see the name of the selected rule and its logic.

12. Click Add Selected Validation Rules to make the validation rules available for use by the data quality rule.
    You see the selected rules in the bottom section. Click the X next to a rule to remove it from the list. Click the pencil icon to edit the rule. You can set up a new validation rule by clicking Create New Validation Rule. See Set Up Validation Rules for more information.

13. Click Save.
    You see a message confirming that the data quality rule was saved.

Data Quality Rules for Individual Portfolios

You can run data quality rules for individual portfolios or composites from both the Performance Calculation report and Automation Center using the Data Quality Monitor Engine. Composites are treated as individual portfolios and not enumerated to their membership. The portfolio or composite must be assigned to an enabled data quality rule or be a member of a list which is assigned to a data quality rule. You can run the rules for both Data Quality and Calculation Status process stage validations.

• Data Quality Process Stage Validations. Automation Center allows you to run data quality rules for individual portfolios or composites for data quality validations. You can build a Data Quality Monitor event for the portfolio/composite or submit an existing event with an override entity. The Data Quality Monitor engine finds enabled data quality rules for that portfolio/composite or for lists with the portfolio/composite as a member and runs validations for the portfolio lists with the entity as a member. For more information, see Schedule a Rule in Automation Center.

• Calculation Status Process Stage Validations. You can build a Performance Calculation report to run Data Quality Rules for individual portfolios/composites for calculation status validations. You can define a Performance Calculation report for a portfolio/composite or submit an existing Performance Calculation report with an override entity. The Performance Calculation engine finds enabled data quality rules and runs validations for the portfolio/composite or for the lists with the portfolio/composite as members.

Manage Data Quality Rules

While viewing a heat map, you can create a new data quality rule. When you select an individual result at the lowest drill down level, you can also view and edit the underlying data quality rule.

To edit a data quality rule:

1. From the Performance Center window, click Setup and click Data Quality Rules in the left navigation.
   You see the Data Quality Rule workspace in a new tab.

2. Search for a different heat map if desired.

3. In the heat map, select an individual result at the lowest drill down level and then select Edit from the ribbon.
   You see the Data Quality Rule workspace in a new tab with the data quality rule data and the associated validation rules.

4. Change the fields as needed.

5. Click Save.
   You see a message confirming that the data quality rule was changed.