Manage the Data Extract Process

The extract process follows a consistent model regardless of the type of data being requested for output. The process is made up of two steps; Q (Query) and T (Transform+Transport), these are described below.

Step

Stream Name

Description

Q-stream

eagle_ml-2-0_default_out_q

Q-stream makes SQL queries and extracts data from Database tables

T-stream

Standard

eagle_ml-2-0_default_out_t

This step prepares the structure of the resulting data file and writes this file to disk. T-step is performed either by the standard T-stream or its improved streaming variant.

The streaming version is always used by default, if it is available for the feedtype selected
Code improvements let it process files several times faster compared to the standard stream, which is especially valuable when you perform volume extracts. Yet, it has several restrictions on the Message Center version you are using:

for 12.* version >= '12.1.5.22'
for 13.* version >= '13.1.2.17'
for 15.* version >= '15.2.2'

Streaming

eagle_ml-2-0_default_out_streaming_t

Both streams (Q and T) have rules appropriate to each object, that can possibly be processed. The rule is chosen by a router of the rules (named an RSF rule) basing on FeedType value set in the Control Message.