Enable Profiling for Generic Load

Generic Load is able to unpack and transform files immediately after they are received, without waiting for download queues.

In this page:

Configure Generic Load

First of all, create a profile in the EJM Monitoring Tool

Fill and save parameters in the pop-up window

where:

profileName is the profile name used to generate names of new workflow and other files - must be unique for each profile;
workflowName is the source workflow name used to generate new workflow;
inMask{number} describe incoming file masks. Must be coherent and start with number 1. Each record should contain the following values, separated by “|”:

• file mask;
• incoming file maskTranslator for incoming mask (if you do not want to use a translator, specify empty string). Must match transform_pairs.inc;
• comma-separated feed types for load available for this translator (should not contain duplicates).

Configure Decompress-Transform

To add custom translator you should create a pair of mask file name and translator stream name. Pairs are represented with a variable matching the following pattern:

:pair{pair_number}: :=  ‘{file_mask_without_wildcards|tranlation_stream_name}’

Important:

• Pair variables list must be coherent and start with number 1.
• Files mask values can not include wildcards.
• Only the first file matching the mask will be transformed.

Example of setting five pairs:
$ESTAR_HOME/tpe/dynamic/msgcenter/customer/transform_pairs.inc

<CODE>
  :pair1: := '_SRM__PROFILED_LOAD_TST|_srm_tr';
  :pair2: := '_FUND_PROFILED_LOAD_TST|_fund_profile_5_tr';
  :pair3: := '_FUND_ALT_ID_PROFILED_LOAD_TST|_fund_profile_alt_id_tsk';
  :pair4: := '_HOLDING_PROFILED_LOAD_TST|_wh_pos_tr';
  :pair5: := '_TRANS_PROFILED_LOAD_TST|_wh_cash_activity_tr';
</CODE>

Create Schedule Event

Create workflow_restart stream (must be created once for a region)

1. Open Message Center Editor in Eagle shell

2. Open Message Center Streams tab

3. Streams -> Add Stream

4. Set the following parameters:

5. Reinitialize MC cache 2 -3 times

Create a Schedule Event

1. Open Automation Center

2. Create New -> Schedule

3. Find the stream you created

4. Define tab

5. Time tab

6. Run Parameters tab

• 1166 – profile file name
• 1176 – target workflow name (in workflow name replace ‘eagle’ to profile name)(example for workflow name ‘eagle_wrf_generic_load’ and profile name ‘***_feed’, target workflow name ‘***_feed_wrf_generic_load’)
• 1178 – ‘EnableWrfCreating’

7. Dependency tab - default values

8. Notification tab - default values

9. Click Save&Finish