Tutorial: Using Custom T Streams in Data Extracts

If the output format needs differ from the EagleML, that should be specified in the RTR too, using the OutputFormat parameter.

Let's consider the example of using custom T stream star_to_fixed_demo_t which has the output format FIXED. In the RTR, the output format should be defined as TagValue.

Example with star_to_fixed_demo_t T stream

RTR Control Message for run:

<EagleML
    xmlns="http://www.eagleinvsys.com/2011/EagleML-2-0"
    xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xsi:type="RunTaskRequest"
    eaglemlVersion="2-0"
    xsi:schemaLocation="http://www.eagleinvsys.com/2011/EagleML-2-0 eagleml-main-2-0.xsd"
    eaglemlType="RunTaskRequest">
    <header>
        <messageId>1SAJZDC19GHFMIG9</messageId>
        <sentBy>http://www.eagleinvsys.com</sentBy>
        <sendTo>http://www.eagleinvsys.com</sendTo>
        <creationTimestamp></creationTimestamp>
    </header>
    <taskIdentifier>
        <correlationId correlationIdScheme="correlationIdScheme">dkISSUEPRICEEXTRACT7</correlationId>
        <businessTaskId correlationIdScheme="businessTaskIdScheme">ISSUEPRICEEXTRACT7</businessTaskId>
    </taskIdentifier>
    <taskTypeEnum>NEW</taskTypeEnum>
    <taskParameters>
        <taskParameter>
            <name>StreamName</name>
            <dataType>S</dataType>
            <value>eagle_ml-2-0_default_out_q</value>
        </taskParameter>
        <taskParameter>
            <name>ActionType</name>
            <dataType>S</dataType>
            <value>EXTRACT</value>
        </taskParameter>
        <taskParameter>
            <name>FeedType</name>
            <dataType>S</dataType>
            <value>ISSUEPRICEEXTRACT</value>
        </taskParameter>
        <taskParameter>
            <name>maxrows</name>
            <dataType>S</dataType>
            <value>500</value>
        </taskParameter>
        <taskParameter>
            <name>todate</name>
            <dataType>S</dataType>
            <value>2014-12-31 15-00-00</value>
        </taskParameter>
        <taskParameter>
            <name>fromdate</name>
            <dataType>S</dataType>
            <value>2005-01-20 00-00-00</value>
        </taskParameter>
        <taskParameter>
            <name>OutputFormat</name>
            <dataType>S</dataType>
            <value>TagValue</value>
        </taskParameter>
        <taskParameter>
            <name>T_StreamName</name>
            <dataType>S</dataType>
            <value>star_to_fixed_demo_t</value>
        </taskParameter>
    </taskParameters>
</EagleML>

Run

In Eagle, open the Message Center Console Application.
Find the stream eagle_ml-2-0_default_cm_control_message in Message Streams list and send RTR Control Message by clicking on the stream and choosing Send data:

Message Center Console Application

Correlation Id parameter in RTR has to be unique for each run!

Next, go to the EJM Tasks Tab and enter as Search filter Correlation Id which was used in RTR.
The Extract Steps have been displayed in the grid below.

The star_to_fixed_demo_t has been called as the transformation stream for extracted data.
Double click on necessary row in Steps grid to see stream details.
The Incoming and Outgoing messages of star_to_fixed_demo_t are presented below:
Message Details

Message Details
The extracted and transformed data will be copied to the /cmw/extracts/ app directory.

Run Task Request

Example with star_to_fixed_demo_t T stream

Run

0 Comments