The eagle_wrf_cloud_extract workflow was created to periodically execute ebs EBS extracts periodically.
The workflow contains one ExecuteCM task only. The task runs eagle_wrf_generic_extract_mc2 workflow with following pre-selected parameters:
| Parameter | Value |
|---|---|
| ebs:default:DeltaBased |
...
| Y to extract delta only | |
| ebs:default:DeltaBasedUID |
...
| AZURE_ |
...
| CLOUD unique uid for delta |
| ebs:default:OutputFormat |
...
| EagleJSON - to extract in EagleJson format | |
| ebs:default:TargetSinkType |
...
| azureblob - to publish extract data to azure | |
| DisableDistributionStep |
...
| Y - to skip distribution step in mc2 workflow | |
| FeedType |
...
| ebs:warehouseposition, ebs:warehouseperformance, ebs:warehousenav, ebs:exchangeprice,ebs:smf,ebs:genericentity, ebs:codevalue, ebs:issuefxrate,ebs:warehousetrade, ebs:issueprice,ebs:errordefinition | |
FeedType and ebs:default:TargetSinkType Values can be overridden by the following variables in w_config_custom.inc:
...
w_ebs_cloud_targetsink
For instance, to extract smf SMF interface only and to disable distribution to azure we should Azure, define the parameters as shown below:
| Code Block | ||
|---|---|---|
| ||
<CODE> |
...
:w_ebs_cloud_interfaces: := 'ebs:smf'; |
...
:w_ebs_cloud_targetsink: := ' '; |
...
</CODE> |
The The workflow can be executed periodically using schedule rule/events.
How to add new interface.
For example you have to add new interface mycustomsmfextract.
First way.
We can override
Add New Interface
There are two methods for adding a new interface, for example an interface called mycustomsmfextract.
Method One
You can override the default feedtype value using the w_ebs_cloud_interfaces variable.
- Open tpe\dynamic\msgcenter\eagle_ml-2-0_custom_cm\w_config_custom.inc
- Add/modify w_ebs_cloud_interfaces value.
<CODE>
:w_ebs_cloud_interfaces: := 'ebs:smf,ebs:mycustomsmfextract';
...
- Save the file
- Re-init classic MC cache
Second way.
We can add the new interface in IWS
...
tpe\dynamic\msgcenter\eis\ejmwf\eagle_wrf_cloud_extract.ejmwf
...
Add New Task Parameter for EBS
...
Extracts
Adding common parameter for all ebs extracts.
Common parameter name has ‘ebs:default:’ prefix.
For instance we have example, to reduce extracts and should apply maxrows=100 to all ebs extracts.
- Open eagle_wrf_cloud_extract in IWS.
- Expand CustomCMParams for execute_ebs_extracts.
- Add a new parameter with the name ebs\5C3Adefault\5C3Amaxrows and value of 100.
...
Note: IWS
...
- does not replace the colon with \5C3A for
...
- parameter names automatically, so
...
- you must write \5C3A
...
- in place of colon in the parameter name.
...
- Save
...
- and publish the solution.
- Re-
...
- initialize the classic MC cache.
- To save changes in
...
- Bitbucket, commit the following files:
...
- tpe\dynamic\msgcenter\eagle_ml-2-0_workflows\eagle_wrf_cloud_extract.wrf
...
- tpe\dynamic\msgcenter\eis\ejmwf\eagle_wrf_cloud_extract.ejmwf
...
Add EBS Extract Specific Parameter
Extract specific parameter name has ‘ebs:[interface name]:’ prefix.
...
tpe\dynamic\msgcenter\eis\ejmwf\eagle_wrf_cloud_extract.ejmwf
Using Profile to run the workflow
To support custom parameters we decided to use workflow profile for eagle_wrf_cloud_extract workflow.
...