Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

In this page:

Table of Contents

Generic Load is capable of unpacking and transforming files immediately after they are received, without waiting for download queues. Files for load should be sent via eagle_ml-2-0_default_cm_ndfa 

Configure Profiling for Generic Load

First of all, create a profile in the EJM Monitoring Tool

Image Removed

Fill and save parameters in the pop-up window

Image Removed

where:

profileName is the profile name used to generate names of new workflow and other files - must be unique for each profile;
workflowName is the source workflow name used to generate new workflow;
inMask{number} describe incoming file masks. Must be coherent and start with number 1. Each record should contain the following values, separated by “|”:

  • incoming file mask;
  • translator for incoming mask (if you do not want to use a translator, specify empty string). Must match transform_pairs.inc;
  • comma-separated feed types for load available for this translator (should not contain duplicates).

Configure Decompress-Transform

To add custom translator you should create a pair of mask file name and translator stream name. Pairs are represented with a variable matching the following pattern:

:pair{pair_number}: :=  ‘{file_mask_without_wildcards|tranlation_stream_name}’

Important:

  • Pair variables list must be coherent and start with number 1.
  • Files mask values can not include wildcards.
  • Only the first file matching the mask will be transformed.

Example of setting five pairs:
$ESTAR_HOME/tpe/dynamic/msgcenter/customer/transform_pairs.inc

Code Block
languagexml
<CODE>
  :pair1: := '_SRM__PROFILED_LOAD_TST|_srm_tr';
  :pair2: := '_FUND_PROFILED_LOAD_TST|_fund_profile_5_tr';
  :pair3: := '_FUND_ALT_ID_PROFILED_LOAD_TST|_fund_profile_alt_id_tsk';
  :pair4: := '_HOLDING_PROFILED_LOAD_TST|_wh_pos_tr';
  :pair5: := '_TRANS_PROFILED_LOAD_TST|_wh_cash_activity_tr';
</CODE>

Create Schedule Event

Info

Please note, that the schedule described below is time-based. This means that incoming files are expected to arrive within the time interval specified. If the files were not received on time, the cycle of pending for them is reset.

Create workflow_restart stream (must be created once for a region)

1. Open Message Center Editor in Eagle shell

Image Removed

2. Open Message Center Streams tab

Image Removed

3. Streams -> Add Stream

Image Removed

4. Set the following parameters:

Image Removed

5. Reinitialize MC cache 2 -3 times

Image Removed

Create a Schedule Event

1. Open Automation Center

Image Removed

2. Create New -> Schedule

Image Removed

3. Find the stream you created

Image Removed

Image Removed

4. Define tab

Image Removed

5. Time tab

Image Removed

6. Run Parameters tab

  • 1166 – profile file name
  • 1176 – target workflow name (in workflow name replace ‘eagle’ to profile name)(example for workflow name ‘eagle_wrf_generic_load’ and profile name ‘***_feed’, target workflow name ‘***_feed_wrf_generic_load’)
  • 1178 – ‘EnableWrfCreating’

Image Removed

7. Dependency tab - default values

8. Notification tab - default values

...

This section provides details on configure polling for generic load.

In this section

Child pages (Children Display)