Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 5 Next »

Generic Load is able to unpack and transform files immediately after they are received, without waiting for download queues. Files for load should be sent via eagle_ml-2-0_default_cm_ndfa 

In this page:

Configure Profiling for Generic Load

First of all, create a profile in the EJM Monitoring Tool

Fill and save parameters in the pop-up window

where:

profileName is the profile name used to generate names of new workflow and other files - must be unique for each profile;
workflowName is the source workflow name used to generate new workflow;
inMask{number} describe incoming file masks. Must be coherent and start with number 1. Each record should contain the following values, separated by “|”:

  • incoming file mask;
  • translator for incoming mask (if you do not want to use a translator, specify empty string). Must match transform_pairs.inc;
  • comma-separated feed types for load available for this translator (should not contain duplicates).

Configure Decompress-Transform

To add custom translator you should create a pair of mask file name and translator stream name. Pairs are represented with a variable matching the following pattern:

:pair{pair_number}: :=  ‘{file_mask_without_wildcards|tranlation_stream_name}’

Important:

  • Pair variables list must be coherent and start with number 1.
  • Files mask values can not include wildcards.
  • Only the first file matching the mask will be transformed.

Example of setting five pairs:
$ESTAR_HOME/tpe/dynamic/msgcenter/customer/transform_pairs.inc

<CODE>
  :pair1: := '_SRM__PROFILED_LOAD_TST|_srm_tr';
  :pair2: := '_FUND_PROFILED_LOAD_TST|_fund_profile_5_tr';
  :pair3: := '_FUND_ALT_ID_PROFILED_LOAD_TST|_fund_profile_alt_id_tsk';
  :pair4: := '_HOLDING_PROFILED_LOAD_TST|_wh_pos_tr';
  :pair5: := '_TRANS_PROFILED_LOAD_TST|_wh_cash_activity_tr';
</CODE>

Create Schedule Event

Please note, that the schedule described below is time-based. This means that incoming files are expected to arrive within the time interval specified. If the files were not received on time, the cycle of pending for them is reset.

Create workflow_restart stream (must be created once for a region)

1. Open Message Center Editor in Eagle shell

2. Open Message Center Streams tab

3. Streams -> Add Stream

4. Set the following parameters:

5. Reinitialize MC cache 2 -3 times

Create a Schedule Event

1. Open Automation Center

2. Create New -> Schedule

3. Find the stream you created

4. Define tab

5. Time tab

6. Run Parameters tab

  • 1166 – profile file name
  • 1176 – target workflow name (in workflow name replace ‘eagle’ to profile name)(example for workflow name ‘eagle_wrf_generic_load’ and profile name ‘***_feed’, target workflow name ‘***_feed_wrf_generic_load’)
  • 1178 – ‘EnableWrfCreating’

7. Dependency tab - default values

8. Notification tab - default values

9. Click Save&Finish


  • No labels