Generic Load is able to unpack and transform files immediately after they are received, without waiting for download queues. Files for load should be sent via eagle_ml-2-0_default_cm_ndfa
In this page:
Configure Profiling for Generic Load
First of all, create a profile in the EJM Monitoring Tool
Fill and save parameters in the pop-up window
where:
profileName is the profile name used to generate names of new workflow and other files - must be unique for each profile;
workflowName is the source workflow name used to generate new workflow;
inMask{number} describe incoming file masks. Must be coherent and start with number 1. Each record should contain the following values, separated by “|”:
- incoming file mask;
- translator for incoming mask (if you do not want to use a translator, specify empty string). Must match transform_pairs.inc;
- comma-separated feed types for load available for this translator (should not contain duplicates).
Configure Decompress-Transform
To add custom translator you should create a pair of mask file name and translator stream name. Pairs are represented with a variable matching the following pattern:
:pair{pair_number}: := ‘{file_mask_without_wildcards|tranlation_stream_name}’
Important:
- Pair variables list must be coherent and start with number 1.
- Files mask values can not include wildcards.
- Only the first file matching the mask will be transformed.
Example of setting five pairs:
$ESTAR_HOME/tpe/dynamic/msgcenter/customer/transform_pairs.inc
<CODE> :pair1: := '_SRM__PROFILED_LOAD_TST|_srm_tr'; :pair2: := '_FUND_PROFILED_LOAD_TST|_fund_profile_5_tr'; :pair3: := '_FUND_ALT_ID_PROFILED_LOAD_TST|_fund_profile_alt_id_tsk'; :pair4: := '_HOLDING_PROFILED_LOAD_TST|_wh_pos_tr'; :pair5: := '_TRANS_PROFILED_LOAD_TST|_wh_cash_activity_tr'; </CODE>
Create Schedule Event
Please note, that the schedule described below is time-based. This means that incoming files are expected to arrive within the time interval specified. If the files were not received on time, the cycle of pending for them is reset.
Create workflow_restart stream (must be created once for a region)
1. Open Message Center Editor in Eagle shell
2. Open Message Center Streams tab
3. Streams -> Add Stream
4. Set the following parameters:
5. Reinitialize MC cache 2 -3 times
Create a Schedule Event
1. Open Automation Center
2. Create New -> Schedule
3. Find the stream you created
4. Define tab
5. Time tab
6. Run Parameters tab
- 1166 – profile file name
- 1176 – target workflow name (in workflow name replace ‘eagle’ to profile name)(example for workflow name ‘eagle_wrf_generic_load’ and profile name ‘***_feed’, target workflow name ‘***_feed_wrf_generic_load’)
- 1178 – ‘EnableWrfCreating’
7. Dependency tab - default values
8. Notification tab - default values
9. Click Save&Finish
Add Comment