Generic Load is able to unpack and transform files immediately after they are received, without waiting for download queues.
In this page:
Configure Generic Load
First of all, create a profile in the EJM Monitoring Tool
Fill and save parameters in the pop-up window
where:
profileName is the profile name used to generate names of new workflow and other files - must be unique for each profile;
workflowName is the source workflow name used to generate new workflow;
inMask{number} describe incoming file masks. Must be coherent and start with number 1. Each record should contain the following values, separated by “|”:
- file mask;
- incoming file maskTranslator for incoming mask (if you do not want to use a translator, specify empty string). Must match transform_pairs.inc;
- comma-separated feed types for load available for this translator (should not contain duplicates).
Configure Decompress-Transform
To add custom translator you should create a pair of mask file name and translator stream name. Pairs are represented with a variable matching the following pattern:
:pair{pair_number}: := ‘{file_mask_without_wildcards|tranlation_stream_name}’
Important:
- Pair variables list must be coherent and start with number 1.
- Files mask values can not include wildcards.
- Only the first file matching the mask will be transformed.
Example of setting five pairs:
$ESTAR_HOME/tpe/dynamic/msgcenter/customer/transform_pairs.inc
<CODE> :pair1: := '_SRM__PROFILED_LOAD_TST|_srm_tr'; :pair2: := '_FUND_PROFILED_LOAD_TST|_fund_profile_5_tr'; :pair3: := '_FUND_ALT_ID_PROFILED_LOAD_TST|_fund_profile_alt_id_tsk'; :pair4: := '_HOLDING_PROFILED_LOAD_TST|_wh_pos_tr'; :pair5: := '_TRANS_PROFILED_LOAD_TST|_wh_cash_activity_tr'; </CODE>
Create Schedule Event
Create workflow_restart stream (must be created for region once)
1. Open Message Center Editor in Eagle shell
2. Open Message Center Streams tab
3. Streams -> Add Stream
4. Set the following parameters:
5. Reinitialize MC cache 2 -3 times
Create a Schedule Event
1. Open Automation Center
2. Create New -> Schedule
3. Find the stream you created
4. Define tab
5. Time tab
6. Run Parameters tab
- 1166 – filename profile
- 1176 – target workflow name (in workflow name replace ‘eagle’ to profile name)(example for workflow name ‘eagle_wrf_generic_load’ and profile name ‘***_feed’, target workflow name ‘***_feed_wrf_generic_load’)
- 1178 – ‘EnableWrfCreating’
7. Dependency tab - default values
8. Notification tab - default values
9. Click Save&Finish
Add Comment