The process for XML feed is composed of two steps.
Step 1 - Preprocessing Logic
First step is the preprocess logic for transforming XML data to CSV data for selected models in Raw Service:
For example, if we select 5 models in the our XML feed then Raw Service will generate (it generates those diagrams automatically) 5 sequence logics for transforming each models to xmldbapi format for load this data into Data Base and each model will call the own load process.
Step 2 - Default Load Workflow
Second step is the default load Raw Service workflow:
There are four steps:
- Raw_data_header_load – load model (structure) in Data Base with unique Batch_id. Global columns loads in this step as well;
- Raw_data_load – load incoming data in XMLDBAPI format;
- Raw_create_view – step of create view tables for loaded data by loaded structure;
- Raw_create_dimension_table – create dimension table for current batch_id
This diagram you can see in the EJM Monitoring Tool after run your feed:
0 Comments