Data Rules Implementation Process

Owned by Olga Galis (Deactivated)
Last updated: Jul 03, 2024 by Pamela Totas (Deactivated)
1 min read

Onboarding Process to Data Rules is by Request

Onboarding is a required step and performed by R&D/Data Rules team for every required tenant.

Supported use cases:

  1. Eagle clients, that will use Core Resources with no customizations

  2. Eagle clients, that will use Core Resources + Extensions off Core Resources or Eagle tables

  3. Custom Oracle and Snowflake tables

Data Rules Core implementation - Is required for Eagle Clients, who want to move their data to Vault. See Data Rules Resource Availability

All Core Inflow resources are available after Dara Rules deployment to specific tenant via Metadata API:

https://apps.sd.dev.az.eagleinvsys.com/api/vault/metadata/api/doc#/full-update/fullupdate

  • DYNSQL models are deployed by request to specific tenant via Metadata API:

https://apps.sd.dev.az.eagleinvsys.com/api/vault/metadata/api/doc#/data-model/executeDYNSQLLDM

Data Rules Core implementation + Extensions

Data Rules Core deployment is required: https://apps.sd.dev.az.eagleinvsys.com/api/vault/metadata/api/doc#/full-update/fullupdate

Data Rules Core deployment is required: https://apps.sd.dev.az.eagleinvsys.com/api/vault/metadata/api/doc#/full-update/fullupdate

Data Rules Extensions: A Step-by-Step Guide

  • Define metadata/ontology based on Eagle data for extension on Eagle/Oracle side

  • Generate Processing rules

  • Create Extension of Core Resource for Vault tenant

  • Generate DDL

  • Generate Processing Rules

Custom Implementation

Data Rules Core deployment is required: https://apps.sd.dev.az.eagleinvsys.com/api/vault/metadata/api/doc#/full-update/fullupdate

Data Rules Core deployment is required: https://apps.sd.dev.az.eagleinvsys.com/api/vault/metadata/api/doc#/full-update/fullupdate

  • Create a custom EDS object in Eagle

  • Run EDS extract in Eagle

  • Use Schema Drift functionality in AUTO_APPROVE mode - new resource will be created automatically in Vault and the following steps will be executed:

    • generate ontology for new resource

    • generate processing rule

    • execute DDL

    • publish data models

    • load data into new table

Schema Drift