Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 7 Next »

In this page:

Creating Generic Load Profile

Overview

Configuring Profiled Generic Load through EJM MT allows user:

  • to use a more plain form;
  • to generate profiled generic load configuration files here-and-now on Publish;
  • to avoid re-generating profiled generic load configuration files on each profile execution;
  • to use different EJM profiles for the same profiled generic load instance;
  • to escape the need to change customer/filesets.inc and customer/transform_pairs.inc includes manually;
  • to have only workflow name as a mandatory schedule execution parameter.

Required Steps

To create Profiled Generic Load:

  1. Open EJM Monitoring Tool (MT) and choose Activities tab
  2. Under drop-down menu choose Add Generic Load Profile option
  3. Enter required parameters.
  4. Press Publish button to publish the profile.

Configuring Profile Name

Profile name is set in the field between Workflow Name and _wrf_generic_load. Please be informed that profile name will be used as a prefix for profiled generic load, thus it is redundant to add profile extension or word “profile” in this field.

Configuring Data Files Processing

Add File

To add files to the workflow user can click Add File button.

Remove File

To remove a file from the profile use Remove File button with focus set on the row you want to remove.

Please be advised that order of files does not affect processing order or order of load. Files will be consumed by profile executor on arrival to the region and results of translation will be loaded according to dependencies that are determined by eagle_wrf_generic_load workflow.

Configuring file processing options

File mask in File Mask field (please be advised that wildcards are not needed and are not supported. Date rules are supported. Anything after @ symbol is considered as date rule and will be handled accordingly on processing

Name of translator in Translator field. It drops down a list allowing to choose a specific translator from existing list of streams on the region.

Feed type or feed types that are expected as result of translation of incoming file by the specified translator. Please be advised that there is a menu under the three dots symbol which allows to add common EagleML objects.

But user is free to just type in EagleML object names in the Feed Types field. This may be useful for cases when user needs to add EBD files ({EagleML feed type}EDB_DATA, {EagleML feed type}EDB_KEYS) or Cancel ({Feed type group}CANCEL{Feed type name} such as WarehouseCancelTrade, WarehouseCANCELCashActivity) files.

Configuring Post-processing

Post-processing tab allows user to determine steps that should happen after data files load. User is free to configure any post-processing step or sequence of steps.

Step Type – type of post processing. Possible options are: CM, subprocess or task.

Step Name – name of translator/task /workflow which will be used for post-processing.

        If step type is CM – step name will be used as name of stream that should be triggered by control message

        If step type is task – step name will be used as name of stream for which trigger file will be sent through eagle_ml-2-0_default_cm_control_message stream

        If step type is subprocess – step name will be used as name of workflow that should be launched as subprocess.

Condition To Execute – condition when Post Processing step should be executed. Value can be configured to be evaluated on runtime, use EXPR# prefix to set expression.

Parameters – incoming parameters for Post Processing step. Use EXPR# to set parameter values that should be evaluated on runtime based on workflow launch parameters.

Example:

Configuring Custom Parameters

Provides the ability to setup specific parameters for the workflow.

Parameter names can be dynamic. To set dynamic parameters use EXPR# prefix before expressions to evaluate.

Configuring customer/transform_pairs.inc

Publishing Profiled Generic Load definition does not require user actions to fix customer/transform_pairs.inc

EJM MT adds transform pair or pairs required for configured profiled generic load automatically on publish.

Configuring customer/filesets.inc

Publishing Profiled Generic Load definition does not require user actions to fix customer/filesets.inc

EJM MT adds code to customer/filesets.inc if it is required for configured profiled generic load automatically on publish.

Scheduling Generic Load Profile on Eagle17 regions

To configure scheduled execution of profiled generic load use following steps:

If you already have schedule or schedules that are used for profiled generic load – duplicate one of existing schedules and go to step 5.

  1. Open Automation Center and create new event based on workflow_restart rule and workflow_restart sch file.
  2. Event Type field should be set manually (Message Stream Process) or chosen from the expand list;
  3. Enter an Event Name.
  4. Choose the found event and click OK
  5. Enter a schedule name and click Next
    If you want to turn on your schedule tick Enabled
  6. Setup run time and days for workflow schedule and click Next
  7. Add tag 1166 with value
         {name of created profile}_wrf_generic_load
    This is required to start profiled generic load workflow on schedule execution.

    Other parameters are optional.

    You can use any profile name with tag 1166 (do not forget profile extension .profile in this case) to use execution parameters from the profile to be applied to profiled generic load workflow execution. Using profiled generic load profile is not mandatory and should be skipped because profiled generic load instance is created on profile publish in EJM MT.
    Thus the same profiled generic load once created may be executed with any other EJM profile


  8. Set dependencies if needed.
  9. Set Notifications if needed.
  10. Enable schedule.


  • No labels