Page Comparison

EagleML and EJM require a series of infrastructure message streams. This page describes how to verify in Message Center Console that all required streams are installed and enabled and which message streams are required.

Info

title	Note

The first time you install the monthly EagleML package In an environment, you should perform this check. It is not required for subsequent installs. This is applicable to both automated and manual install processes.

While this step is optional on subsequent installs, you may choose to do it after each install as an added verification point for manual installs.

In this page:

...

This stream uses a preprocessor rule file (*.prf), to sequentially execute transformation step from CSV to EagleML(XMLDBAPI)[SINGLE mode] and send a result message to the load step to the streameagle_ml-2-0_default_in_xml_warehouse or eagle_ml-2-0_default_in_xml_warehouse_preproc

Stream Count

Stream Category

Count

EIS2EGL_EAGLEML2

EGL_EJM

63

125
EGL_EagleML	27
EGL_

Generic

ExtractService

8

5

EGL_

SSC

IWS

1

18

EGL_

IWS

Generic

18

16

EGL_

ExtractService

SSC

2

1

MC_INSTALL

19Other71

22

TOTAL

213

214

Anchor

	Streams
	Streams

Stream ID

Stream Title

Stream Category

Description----

MC2 Related	Description
	eagle_default_bbca_helper

----eagle_

EGL_Generic		This stream performs Bloomberg Corporate Actions to TagValue transformation.
	eagle_default_csv_raw_data_load

----

	EGL_Generic		This stream is used to load Global Values (Columns)
	eagle_default_deploy_demand	MC_INSTALL

----

	This stream is used to run deploy services manually
	eagle_default_deploy_restart_

demand

mc	MC_INSTALL

----

	Stream is designed to restart MC services when deploying a snapshot or a release
	eagle_default_deploy_

monitoring----

service	MC_INSTALL		This stream is used to deploy services
	eagle_default_deploy_

restart_mc----eagle_default_deploy_service----

support

MC_INSTALL

----eagle_default_deploy_support

The stream is intended for auxiliary operations during installation. For example: stopping MCCOMMANDEXECUTOR, checking the installed version of the component, checking free disk space
	eagle_default_extractor_demand	EGL_EJM

----

	This stream is used to run data extraction manually
	eagle_default_file_

distribution

move_or_copy

EGL_

EJM----eagle_default_file_indexerEGL_EJMThe stream finds all the references between different kinds of rules and builds dependency tree for internal use in EBS/IWS/MT----eagle_default_file_move_or_copyEGL_IWS

IWS		This stream is used to move the file to uploader working directory
-1148	eagle_default_in_csv_warehouse	EGL_Generic		This stream uses a preprocessor rule file (*.prf), to sequentially execute transformation from CSV to EagleML(XMLDBAPI)[BATCH mode] and send a result message to the load to the stream

eagle_ml-2-0_default_in_xml_

warehouse

warehouse or eagle_ml-2-0_default_in_xml_warehouse_preproc
-1153	eagle_default_in_csv_warehouse_sm

EGL_Generic-1149eagle_default_in_csv_warehouse_t

EGL_Generic

This stream

performs transformation from CSV to EagleML(XMLDBAPI).-1154eagle_default_in_csv_warehouse_upsertEGL_GenericThis stream uses a

uses a preprocessor rule file (*.prf), to sequentially execute the transformation from CSV to EagleML (XMLDBAPI) [

UPSERT

SINGLE mode]
and send a result message to the stream for load

to the stream

eagle_ml-2-0_default_in_xml_

warehouse

warehouse or eagle_ml-2-0_default_in_xml_warehouse_preproc

-

---

1149	eagle_default_in_csv_warehouse_t	EGL_Generic		This stream performs transformation from CSV to EagleML(XMLDBAPI).
-1154	eagle_default_in_csv_

pipe

warehouse_

performanceCLP

upsert

EGL_Generic

This stream uses a preprocessor rule file (*.prf), to sequentially execute transformation

step

from

PIPE Performance

CSV to EagleML

and

(XMLDBAPI)[UPSERT mode] and send a result message to the load

step

to the stream

eagle_ml-2-0_default_in_xml_warehouse or eagle_

preproc

ml-2-

--eagle

0_default_in_

pipe

xml_

performanceCLP_tEGL_GenericThis stream performs PIPE Performance to EagleML transformation.----

warehouse_preproc
	eagle_default_in_pipe_

pos

performanceCLP

EGL_Generic

This stream uses a preprocessor rule file (*.prf), to sequentially execute transformation step from PIPE

Position

Performance to EagleML and send a result message to the load step to the stream

eagle_ml-2-0_default_in_xml_warehouse_preproc

----


	eagle_default_in_pipe_

pos

performanceCLP_t

EGL_Generic

This stream performs PIPE

Position

Performance to EagleML transformation.

----


	eagle_default_in_

nuggetizer

pipe_

restart

pos

EGL_

EJM----eagle_default_raw_common_values_load----eagle_default_raw_create_table----

Generic		This stream uses a preprocessor rule file (*.prf), to sequentially execute transformation step from PIPE Position to EagleML and send a result message to the load step to the stream eagle_ml-2-0_default_in_xml_warehouse_preproc
	eagle_default_

raw_create_view----

in_pipe_pos_t	EGL_Generic		This stream performs PIPE Position to EagleML transformation.
	eagle_default_

raw

nuggetizer_

data_header_load----eagle_default_rollback----eagle_default_ruleserviceEGL_ExtractService----

restart	EGL_EJM		This stream is used to restart Eagle Nuggetizer. Eagle Nuggetizer is a schedule-based workflow and is run by a defined schedule. Eagle Nuggetizer Workflow runs the ‘eagle_ml-2-0_default_cm_nuggetizer’ stream, which collects EagleML files, concatenates them into nuggets and sends it for further processing.
	eagle_default_

secmaster_resolution

raw_common_values_load

EGL_

EagleML----eagle_iws_cache

Generic		This stream is used to load Global Values (Columns)
	eagle_default_raw_create_table	EGL_

IWS

Generic

This stream is used to

cache IWS resources.-1810eagle_iws_delete_file

load Global Values (Columns)
	eagle_default_raw_create_view	EGL_

IWS

Generic

This stream

deletes IWS files due IWS execution.-1813eagle_iws_eagleml_panelEGL_IWSIWS uses this stream when it works with xpanels.-1807eagle_iws_export_solutionEGL_IWSThis stream compiles IWS solutions with the Java tool on back-end. -1808eagle_iws_export_solution_mcpkgEGL_IWSThis stream compiles IWS solutions and sends pkg files for processed IWS solution.-1816eagle_iws_find_and_get_fileEGL_IWSIWS uses this stream to find files.-1812eagle_iws_get_fileEGL_IWSIWS uses this stream to download files.-1811eagle_iws_import_streamEGL_IWSThis stream installs streams while migrating MC packages. -1805eagle_iws_import_stream_requestEGL_IWSIWS uses this stream to start import processes.-1806eagle_iws_import_stream_wEGL_IWSThis stream uses files processed by eagle_iws_import_stream_request and starts the process of the stream installation.----eagle_iws_infoEGL_IWSThis is the IWS authorization stream.-1801eagle_iws_list_filesEGL_IWSIWS uses this stream to download the list of files for a specific directory.-1815eagle_iws_monitoring_apiEGL_IWSEJM Monitoring Tool uses this stream to download task statistics.-1809eagle_iws_rename

is used to load Global Values (Columns)
	eagle_default_raw_data_header_load	EGL_Generic		This stream is used to load Global Values (Columns)
	eagle_default_rollback	MC_INSTALL		The stream is designed to roll back to a later version after installing an earlier version. For the case when the previous version of EagleML is installed the files in the package are compared by the manifest. If there are no such files in the installed package, they are deleted from the backend.
	eagle_default_secmaster_resolution	EGL_EagleML		This stream is used to translate non-standard identifiers in the requestor file into vendor accepted identifiers, so that the vendor can identify security.
	eagle_default_ruleservice	EGL_ExtractService	MC2	This stream are used to execute requests in pyruleservice. It executes mc2_service_client.py Python script that uses the RTR sent to the stream and creates a TSR. It also saves the RTR and TSR information in orchestration tables so that it shows as a EJM task
	eagle_iws_ruleservice	EGL_ExtractService	MC2
	eagle_iws_cache	EGL_IWS		This stream is used to cache IWS resources.
-1810	eagle_iws_delete_file	EGL_IWS		This stream is used by IWS to remove local files
-1813	eagle_iws_eagleml_panel	EGL_IWS		IWS uses this stream when it works with xpanels.
-1807	eagle_iws_export_solution	EGL_IWS		This stream compiles IWS solutions with the Java tool on back-end.
-1808	eagle_iws_export_solution_mcpkg	EGL_IWS		This stream compiles IWS solutions and sends pkg files for processed IWS solution.
-1816	eagle_iws_find_and_get_file	EGL_IWS		IWS uses this stream to

rename solution

find files.

-

1802

1812	eagle_iws_

save

get_file

EGL_IWS

IWS uses this stream to

upload files to the box

download files.

-

1804

1811	eagle_iws_import_

server

stream

EGL_

installerMC_INSTALL

IWS		This stream installs streams while migrating MC packages.
-1805	eagle_iws_import_stream

_w uses this stream to install processed streams

_request	EGL_IWS		IWS uses this stream to start import processes.
-

1803

1806	eagle_iws_

server

import_

support

stream_w

MC

EGL_

INSTALL

IWS

This stream uses files processed by eagle_iws_import_stream_

w uses this stream to copy source files for installing streams.----

request and starts the process of the stream installation.
	eagle_iws_

service_data_emptyEISIWS uses this stream to install IWS solutions source files

info	EGL_IWS		This is the IWS authorization stream.
-

1814

1801	eagle_iws_list_

shell

files

EGL_IWS

This is the

IWS

utils stream

uses this stream to download the list of files for a specific directory.

-

---

1815

eagle_

mc

iws_monitoring_

alerts

api

EGL_

EagleML

IWS		EJM Monitoring Tool uses this stream to download task statistics.
-

---

1809

eagle_

mc

iws_

import

rename_

stream

file

EGL_

requestMC_INSTALL----

IWS		IWS uses this stream to rename solution files.
-1802	eagle_

mc

iws_

import

save_

stream

file

EGL_

wMC_INSTALL----

IWS		IWS uses this stream to upload files to the box.
-1804	eagle_

mc

iws_

import

server_

support_data

installer

MC_INSTALL

----

eagle_

mc

iws_

server

import_

installerMC_INSTALL----

stream_w uses this stream to install processed streams.
-1803	eagle_

mc

iws_server_

installer_ftp

support

MC_INSTALL

----

eagle_

mc

iws_

server

import_

installer_mqMC_INSTALL----

stream_w uses this stream to copy source files for installing streams.
	eagle_

mc

iws_

server

service_

installer

data_

mq_decoder

empty

MC

EGL_

INSTALL----eagle_mc_server_supportMC_INSTALL----eagle_mc_server_support_amq_monitorMC_INSTALL----

EJM		This stream is used to group rule and include files that do not require an execution stream.
-1814	eagle_iws_shell	EGL_IWS	This is the IWS utils stream.
	eagle_mc_

server_support_import_dataflow----

alerts	EGL_EagleML		This stream is used to send email alerts by MsgDetailId
	eagle_mc_

server_support_----

import_stream_request

MC_INSTALL

----eagle_mc_server_support_jmsMC_INSTALL

This stream is used to send a combined zip with a .files.b64 and a .pkg.b64 files to the mc_import_stream_w stream
	eagle_mc_

server

import_

support

stream_

jms_exec

w

MC_INSTALL

This stream is used to import streams. The incoming file is a ZIP which has two types of files:

----

.files.b64 - a base64 encoded ZIP with files to be installed, starting from estar/ .pkg.b64 - a base64 encoded ZIP with *.pkg files to create the streams. We'll first copy the files then run the installation scripts for .pkg
	eagle_mc_

server

import_support_

reporter

data	MC_INSTALL

----

	This stream is used to load sources/code categories/ code values/code transaction object.
	eagle_mc_

stream

server_installer

MC_INSTALL

-1704

	This stream is used to deploy a snapshot or a release
	eagle_

ml-2-0_default_cm_acquire_dataEGL_EJMThe stream receives the information provided to the control message, adds the end of workflow trigger file and delivers all details the Load Flow Control stream to orchestrate data loads.----eagle_ml-2-0_default_cm_concatEGL_EJMConcatenates several incoming file into one outgoing with a set name.-1734eagle_ml-2-0_default_cm_construct_requestEGL_EJMThis stream generates the requestor file from EagleML Generic SMF identifiers to load the details from Bloomberg. Used in ‘generic_load_enrichment’ workflow.-1707eagle_ml-2-0_default_cm_control_messageEGL_EJMThis stream receives and parses control messages. The control message is an XML-formatted input message that EJM recognizes and processes as a command to execute a specific message stream, STAR event, or PACE event.----eagle_ml-2-0_default_cm_control_process-1735eagle_ml-2-0_default_cm_data_file_splitterEGL_EJMThe main purpose of the developed stream is to increase the performance of the incoming GICSV formatted file's loading by splitting incoming file into several smaller and distributing files into Message Center processes in order to run parallel processing.-1708eagle_ml-2-0_default_cm_data_load_cmw_inEGL_EJMThis is a helper stream used by the Message Center Console to deliver data files to the incoming folder (/cmw/in).-1721eagle_ml-2-0_default_cm_datafile_controlEGL_EJMThis stream reads the trigger file from eagle_ml-2-0_default_cm_datafile_task makes a specified copy in the staging folder and then moves to the specified stream for processing.-1722eagle_ml-2-0_default_cm_datafile_taskEGL_EJMThis stream creates trigger file with necessary information(stream name, file name, source stream name etc.) and send it to the stream eagle_ml-2-0_default_cm_datafile_control----eagle_ml-2-0_default_cm_dfaEGL_EJM----

mc_server_installer_ftp	MC_INSTALL		This stream is used to deploy a snapshot or a release from FTP
	eagle_mc_server_installer_mq	MC_INSTALL		This stream is used to read JMS/MQ and send file to stream
	eagle_mc_server_installer_mq_decoder	MC_INSTALL		This stream is used to decode base64 file to zip archive and send zip to eagle_mc_server_installer
	eagle_mc_server_support	MC_INSTALL		This stream is used to perform basic comands during deployment. For example CHMOD, MKDIR, REINIT etc.
	eagle_mc_server_support_amq_monitor	MC_INSTALL		This stream is used to send email notifications about actuall stream information. The stream is out of date. We have to keep it for backward compatibility
	eagle_mc_server_support_import_dataflow	MC_INSTALL		This stream is used to install Data Vendor Console dataflows
	eagle_mc_server_support_import_stream	MC_INSTALL		This stream is used to apply stream
	eagle_mc_server_support_jms	MC_INSTALL		This stream is used to perform basic comands for jms using broadcast. This stream also performs eagle_mc_server_support_jms_exec in all instanses
	eagle_mc_server_support_jms_exec	MC_INSTALL		This stream is used to perform basic comands for jms. For example: JMSSTATUS, JMSLIST, JMSSTOP, JMSSTART, JMSPROCINFO etc.
	eagle_mc_server_support_reporter	MC_INSTALL		This stream is used to send Outbound Topic of Build Installation LOG files
	eagle_mc_stream_installer	MC_INSTALL		Stream is used to install streams from zip archive. It is the old version of stream installer
-1704	eagle_ml-2-0_default_cm_

dishub

acquire_

client

data

EGL_EJM

----

	The stream receives the information provided to the control message, adds the end of workflow trigger file and delivers all details the Load Flow Control stream to orchestrate data loads.
	eagle_ml-2-0_default_cm_

dishub2spoke_client

concat	EGL_EJM		Concatenates several incoming file into one outgoing with a set name.
-

1732

1734	eagle_ml-2-0_default_cm_

disribute

construct_

to_nuggetizer

request

EGL_EJM

This stream

sends

generates the

incoming file into the nuggetizer folder, configured by W_NGTZR_DIST_FOLDER setting.----

requestor file from EagleML Generic SMF identifiers to load the details from Bloomberg. Used in ‘generic_load_enrichment’ workflow.
-1707	eagle_ml-2-0_default_cm_

ea

control_

ftp_reader-1737

message

EGL_EJM

This stream performs the following tasks:
   - Sends a request to the database SITESEE about the files received on the FTP
   - Gets files from the FTP
   - Updates the status in SITESEE database about the files
   - Sends the files for processing to the eagle_ml-2-0_default_cm_control_message stream

This stream receives and parses control messages. The control message is an XML-formatted input message that EJM recognizes and processes as a command to execute a specific message stream, STAR event, or PACE event.
	eagle_ml-2-0_default_cm_control_process	EGL_EJM	This stream is used to stop / kill workflows or MC streams
-1735	eagle_ml-2-0_default_cm_

eas

data_file_

distribution----

splitter

EGL_EJM

This stream gets EAS alerts as TSR message, convert TSR to format in accordance with the list of templates and send alerts via mail.

The main purpose of the developed stream is to increase the performance of the incoming GICSV formatted file's loading by splitting incoming file into several smaller and distributing files into Message Center processes in order to run parallel processing.
-1708	eagle_ml-2-0_default_cm_data_load_

ejm

cmw_

reporter

in	EGL_EJM		This is a helper stream used by the Message Center Console to deliver data files to the incoming folder (/cmw/in).
-

1716

1721	eagle_ml-2-0_default_cm_

email

datafile_

distribution

control

EGL_EJM

This stream

receives the EJM Notifications for sending and send notifications via email.-1701eagle_ml-2

reads the trigger file from eagle_ml-2-0_default_cm_

eofwEGL_EJMThis stream is last in the execution sequence (Load Flow Control Rule), reporting the processing status of the completed workflow as a success or a failure; this stream also triggers final reporting to an external system by dropping a trigger file into the /REP folder.-1705

datafile_task makes a specified copy in the staging folder and then moves to the specified stream for processing.
-1722	eagle_ml-2-0_default_cm_

execute

datafile_

pace_event

task

EGL_EJM

This stream

is used to invoke a specific PACE event by name.-1714

creates trigger file with necessary information(stream name, file name, source stream name etc.) and send it to the stream eagle_ml-2-0_default_cm_

execute_star_eventEGL_EJMThis stream is used to invoke a specific STAR Accounting event by name.-1720

datafile_control
	eagle_ml-2-0_default_cm_

execwkfl

dfa

EGL_EJM

MC2

This

is the main stream in

stream receives data files for MC2 workflow execution.

----


	eagle_ml-2-0_default_cm_

file

dishub2spoke_

distribution

client

EGL_EJM

-1706

	These are EagleAccessFTP streams used by i2i delivery
	These are EagleAccessFTP streams used by i2i delivery	eagle_ml-2-0_default_cm_

load

dishub_

flow_control

client

EGL_EJM

This stream uses a preprocessor rule file (*.prf), to sequentially execute a set of data loads in logical database order, launching the appropriate supported message stream interface for each available input file.-1738


-1732	eagle_ml-2-0_default_cm_disribute_to_

monitoring

nuggetizer

EGL_EJM

This stream

is monitoring ALERTS and sends a notification to the eagle_ml-2-0_default_cm_email_distribution stream if an alert happened.-1718

sends the incoming file into the nuggetizer folder, configured by W_NGTZR_DIST_FOLDER setting.
	eagle_ml-2-0_default_cm_ea_ftp_

ndfa

reader

EGL_EJM

This stream

receives data files for workflow execution.-1719

performs the following tasks: Sends a request to the database SITESEE about the files received on the FTP, Gets files from the FTP, Updates the status in SITESEE database about the files, Sends the files for processing to the eagle_ml-2-0_default_cm_control_message stream
-1737	eagle_ml-2-0_default_cm_

ndfa

eas_

exec

distribution

EGL_EJM

This stream

determines for which workflow incoming data file is intended and generates an event for this workflow.-1736

gets EAS alerts as TSR message, convert TSR to format in accordance with the list of templates and send alerts via mail.
	eagle_ml-2-0_default_cm_

notif

ejm_

email

reporter

EGL_EJM

MC2

This

stream transform TSR to plain text format and send it via email. -1733eagle_ml-2-0_default_cm_nuggetizerEGL_EJMThis stream collects EagleML files, concatenates them into nuggets and sends it for further processing. Used in 'eagle_nuggetizer_workflow’ workflow.----

MC2 stream generates acknowledgement and task status reply messages. Task statuses are SUCCESS, FAILED, and NO_DATA (for a data extract that found no database records). This stream is also the last one in the execution sequence (Load Flow Control Rule), posting the processing status of the completed workflow as a success or a failure; this stream also triggers final reporting to the external system by dropping a trigger file to the /REP folder.)
-1716	eagle_ml-2-0_default_cm_email_distribution	EGL_EJM	This stream receives the EJM Notifications for sending and send notifications via email.
-1701	eagle_ml-2-0_default_cm_

nuggetizer_recover

eofw

EGL_EJM

This stream is

used in troubleshooting for eagle_nuggetizer_workflow. Also purges generic_load_enrichment.----

last in the execution sequence (Load Flow Control Rule), reporting the processing status of the completed workflow as a success or a failure; this stream also triggers final reporting to an external system by dropping a trigger file into the /REP folder.
	eagle_ml-2-0_default_cm

_pacepoll

_execebs	EGL_ExtractService	MC2	This stream is used to execute EBS requests
-

1730

1705	eagle_ml-2-0_default_cm_execute_pace_

packer

event

EGL_EJM

This stream is used to

compress files to ZIP archive

invoke a specific PACE event by name.

-

---

1714	eagle_ml-2-0_default_cm_execute_

parallel

star_

exec

event

EGL_EJM

This stream is

involved into loading files in parallel

used to invoke a specific STAR Accounting event by name.

-

1728

1720	eagle_ml-2-0_default_cm_

purge_archive

execwkfl

EGL_EJM

This

stream is used to purge or archive files from local and FTP folders.-1709

is the main stream in workflow execution.
	eagle_ml-2-0_default_cm_

queue

file_

poster

distribution

EGL_EJM

This stream is used to

add information to the queue.----

deliver files. For example, for i2i workflow
-1706	eagle_ml-2-0_default_cm_

realtime

load_

ejm

flow_

stat

control

EGL_EJM

----

	This stream uses a preprocessor rule file (*.prf), to sequentially execute a set of data loads in logical database order, launching the appropriate supported message stream interface for each available input file.
	eagle_ml-2-0_default_cm_

refresh

mc2_

engine_cache

healthcheck

EGL_

EagleML----

EJM		This stream is used by Extract Service (MC2).One of the inner streams.
-1738	eagle_ml-2-0_default_cm_

self_system_check

monitoring

EGL_

SSC----

EJM

This stream is monitoring ALERTS and sends a notification to the eagle_ml-2-0_default_cm_

send_to_wrfEGL_EJM-1723

email_distribution stream if an alert happened.
-1718	eagle_ml-2-0_default_cm_

sequencer

ndfa

EGL_EJM

The stream is used to check whether to process the message in queue

	This stream receives data files for workflow execution.
-

1724

1719	eagle_ml-2-0_default_cm_

sequencer

ndfa_

cleanup

exec

EGL_EJM

This stream

is used to clean up all the message in the queue for a workflow and to remove current workflow from the queue.-1725

determines for which workflow incoming data file is intended and generates an event for this workflow.
-1736	eagle_ml-2-0_default_cm_

sequencer

notif_

sch

email

EGL_EJM

The

This stream

is used to check messages in the queue and send messages for processing

transform TSR to plain text format and send it via email.

-

1702

1733	eagle_ml-2-0_default_cm_

task_executor

nuggetizer

EGL_EJM

This stream

receives dataflow state from DB and stops processing if the workflow status is negative acknowledgement (NACK). This stream derives the stream name to execute, using the task type and feed type, and triggers execution using an ACQUIRE style message stream.-1703

collects EagleML files, concatenates them into nuggets and sends it for further processing. Used in 'eagle_nuggetizer_workflow’ workflow.
	eagle_ml-2-0_default_cm_

task

nuggetizer_

reporter

recover

EGL_EJM

This stream

generates acknowledgement and task status reply messages. Task statuses are SUCCESS, FAILED, and NO_DATA (for a data extract that found no database records.) Also this stream is last in the execution sequence (Load Flow Control Rule), posting the processing status of the completed workflow as a success or a failure; this stream also triggers final reporting to the external system by dropping a trigger file to the /REP folder.)----

is used in troubleshooting for eagle_nuggetizer_workflow. Also purges generic_load_enrichment.
	eagle_ml-2-0_default_cm_pacepoll	EGL_EJM	MC2	This stream is used to poll-check status of Pace reports
-1730	eagle_ml-2-0_default_cm_packer	EGL_EJM		This stream is used to compress files to ZIP archive.
	eagle_ml-2-0_default_cm_parallel_exec	EGL_EJM		This stream is involved into loading files in parallel.
-1728	eagle_ml-2-0_default_cm_purge_archive	EGL_EJM		This stream is used to purge or archive files from local and FTP folders.
-1709	eagle_ml-2-0_default_cm_queue_poster	EGL_EJM		This stream is used to add information to the queue.
	eagle_ml-2-0_default_cm_realtime_ejm_stat	EGL_EJM		This stream is used to display information in the EJM task tab correctly and check if the data was processed for the received RTR.
	eagle_ml-2-0_default_cm_refresh_engine_cache	EGL_EagleML		This stream is used to automate engine cache clearing during runtime
	eagle_ml-2-0_default_cm_self_system_check	EGL_SSC		This stream is used to self-check the configuration
	eagle_ml-2-0_default_cm_send_to_wrf	EGL_EJM		This stream is used to send data files to workflow loader when profiled generic load is used
-1723	eagle_ml-2-0_default_cm_sequencer	EGL_EJM		The stream is used to check whether to process the message in queue.
-1724	eagle_ml-2-0_default_cm_sequencer_cleanup	EGL_EJM		This stream is used to clean up all the message in the queue for a workflow and to remove current workflow from the queue.
-1725	eagle_ml-2-0_default_cm_sequencer_sch	EGL_EJM		The stream is used to check messages in the queue and send messages for processing.
-1702	eagle_ml-2-0_default_cm_task_executor	EGL_EJM		This stream receives dataflow state from DB and stops processing if the workflow status is negative acknowledgement (NACK). This stream derives the stream name to execute, using the task type and feed type, and triggers execution using an ACQUIRE style message stream.
-1703	eagle_ml-2-0_default_cm_task_reporter	EGL_EJM		This stream generates acknowledgement and task status reply messages. Task statuses are SUCCESS, FAILED, and NO_DATA (for a data extract that found no database records.) Also this stream is last in the execution sequence (Load Flow Control Rule), posting the processing status of the completed workflow as a success or a failure; this stream also triggers final reporting to the external system by dropping a trigger file to the /REP folder.)
	eagle_ml-2-0_default_cm_transform_report	EGL_EJM		The stream is used to transform TSR.
-1717	eagle_ml-2-0_default_cm_tsr	EGL_EJM		The stream is used to create and manage dependencies between multiple EJM tasks and oversees fork and join functionality within the stream flow.
-1726	eagle_ml-2-0_default_cm_unpacker	EGL_EJM		This stream is used to decompress files from any archive type (ZIP,GZIP,TARGZIP,TAR).
-1727	eagle_ml-2-0_default_cm_unpacker_exec	EGL_EJM		This stream collects information about extracted files from archive and update workflow state.
	eagle_ml-2-0_default_cm_uploader_dlvr	EGL_EJM		This stream is used to send data files to PACE Uploader for processing
-1713	eagle_ml-2-0_default_cm_user_sync	EGL_EJM		This stream is used to synchronize the userID information defined on Eagle with the credentials required for the MicroStrategy application.
	eagle_ml-2-0_default_cm_validate_by_xsd	EGL_EJM		This stream is used to perform XSD validation of data files
	eagle_ml-2-0_default_cm_w_setup	EGL_EJM		This stream is used to configure environment after the first EagleML installation. It creates cmw folders and sets EagleVersion variable in w_config_version.inc.
	eagle_ml-2-0_default_cm_wrkfl_executor	EGL_EJM	MC2	This stream executes workflow rules
	eagle_ml-2-0_default_cm_wrkfl_listener	EGL_EJM	MC2	This stream receives and parses MC2 control messages. The control message is an XML-formatted input message that EJM recognizes and processes as a command to execute a specific message stream, STAR event, or PACE event.
	eagle_ml-2-0_default_cm_wrkfl_reporter	EGL_EJM		This stream creates a consolidated TSR for ALL workflow.
	eagle_ml-2-0_default_cm_xslt_exceptions_acc	EGL_EJM		The XSLT Exceptions stream can be used in workflows after the XSLT transformation for Warehouse[Accounting\|Entity\|Reference] Transaction object and its main purpose is to catch exceptions generated by XSLT EditChecks from the transformed message and exclude records with exceptions, which are specified as errors.
	eagle_ml-2-0_default_cm_xslt_exceptions_ent	EGL_EJM		The XSLT Exceptions stream can be used in workflows after the XSLT transformation for Warehouse[Accounting\|Entity\|Reference] Transaction object and its main purpose is to catch exceptions generated by XSLT EditChecks from the transformed message and exclude records with exceptions, which are specified as errors.
	eagle_ml-2-0_default_cm_xslt_exceptions_ref	EGL_EJM		The XSLT Exceptions stream can be used in workflows after the XSLT transformation for Warehouse[Accounting\|Entity\|Reference] Transaction object and its main purpose is to catch exceptions generated by XSLT EditChecks from the transformed message and exclude records with exceptions, which are specified as errors.
	eagle_ml-2-0_default_cm_xslt_exceptions_wrh	EGL_EJM		The XSLT Exceptions stream can be used in workflows after the XSLT transformation for Warehouse[Accounting\|Entity\|Reference] Transaction object and its main purpose is to catch exceptions generated by XSLT EditChecks from the transformed message and exclude records with exceptions, which are specified as errors.
-1605	eagle_ml-2-0_default_in_

cm

xml_

transform

acct_

report

cash

EGL_

EJM

EagleML

The

This stream is used to

transform TSR.-1717

load Accounting Cash objects.
	eagle_ml-2-0_default

_cm_tsrEGL_EJMThe stream is used to create and manage dependencies between multiple EJM tasks and oversees fork and join functionality within the stream flow.-1726

_in_xml_acct_cash_no_split	EGL_EagleML		This stream is used to load accounting cash objects.The incoming messages are processed sequentially in the order in which they are in the data file
-1603	eagle_ml-2-0_default_in_

cm

xml_acct_

unpacker

trades

EGL_

EJM

EagleML

This stream is used to

decompress files from any archive type (ZIP,GZIP,TARGZIP,TAR).-1727

load Accounting Trade objects.
	eagle_ml-2-0_default

_cm_unpacker_exec

_in_xml_acct_trades_no_split

EGL_

EJM

EagleML

This stream

collects information about extracted files from archive and update workflow state. ----

is used to load Accounting Cash objects. No split.
	eagle_ml-2-0_default_

cm

in_xml_

uploader

costbasis_

dlvr

adj

EGL_

EJM-1713

EagleML		This stream is used to load the Cost Basis Adjustment object.
	eagle_ml-2-0_default_in_

cm

xml_

user

delete_

sync

objects

EGL_EJM

This

The stream is used to

synchronize the userID information defined on Eagle with the credentials required for the MicroStrategy application.----

delete records from DB. Supported object type groups: SMF, Entity, Warehouse, Reference
	eagle_ml-2-0_default_in_xml_

cm

delete_

validate

splitter_

by

isr_

xsd

mi

EGL_EJM

This stream is used to split Generic Issuer file into several Issuer files and send them to the eagle_ml-

---

2-0_default_in_xml_delete_objects stream
	eagle_ml-2-0_default

_cm_w_setup

_in_xml_delete_splitter_smf_mi

EGL_EJM

This stream is used

to configure environment after the first EagleML installation. It creates cmw folders and sets EagleVersion variable in w_config_version.inc.----

to split Generic SMF file into several Reference and SMF files and send them to the eagle_ml-2-0_default_in_xml_delete_objects stream
	eagle_ml-2-0_default_

cm_wrkfl_executorEGL_EJM----

in_xml_ent_no_split	EGL_EagleML		This stream is used to load Entity objects. No split.
-1604	eagle_ml-2-0_default_

cm

in_

wrkfl

xml_

listener

entity

EGL_

EJM----

EagleML		This stream is used to load Entity objects.
	eagle_ml-2-0_default_

cm

in_

wrkfl

xml_

reporter

impairments

EGL_

EJM

EagleML

This stream

creates a consolidated TSR for ALL workflow

is used to load the Impairments object.

-

---

1614	eagle_ml-2-0_default_

cm

in_

xslt

xml_

exceptions

issuer_

acc

mi

EGL_

EJM----

EagleML

The XSLT Exceptions stream can be used in workflows after the XSLT transformation for Warehouse[Accounting|Entity|Reference] Transaction object and its main purpose is to catch exceptions generated by XSLT EditChecks from the transformed message and exclude records with exceptions, which are specified as errors.

This stream is used to split Generic Issuer file into several Issuer files and send them to the eagle_ml-2-0_default_in_xml_reference stream
	eagle_ml-2-0_default_

cm

in_

xslt

xml_

exceptions

ref_

ent

ext

EGL_

EJM----

EagleML		This stream is used to load extended schedule objects.
	eagle_ml-2-0_default_

cm

in_xml_

xslt

ref_

exceptions

no_

ref

split

EGL_

EJM----

EagleML		This stream is used to load Reference objects.The incoming messages are processed sequentially in the order in which they are in the data file
-1606	eagle_ml-2-0_default_

cm

in_

xslt

xml_

exceptions_wrh

reference

EGL_

EJM-1605

EagleML		This stream is used to load Reference objects.
	eagle_ml-2-0_default_in_xml_

acct

smf_

cash

custom

EGL_EagleML

This stream is used to load

Accounting Cash objects.----

customSMF object. The stream is out of date. We have to keep it for backward compatibility
-1612	eagle_ml-2-0_default_in_xml_

acct_trades_no_split

smf_generic

EGL_EagleML

This stream is used to load

Accounting Cash objects. No split

Generic SMF object.

-

1603

1613	eagle_ml-2-0_default_in_xml_

acct

smf_

trades

mi

EGL_EagleML

This stream is used

to load Accounting Trade objects.----

to split Generic SMF file into several Reference and SMF files and send them to the eagle_ml-2-0_default_in_xml

_acct_trades_no_splitEGL_EagleMLThis stream is used to load Accounting Trade objects. No split.----

_smf_generic and eagle_ml-2-0_default_in_xml_reference streams
	eagle_ml-2-0_default_in_xml_

costbasis_adj

user	EGL_EagleML

This stream

This stream is used to load

the Cost Basis Adjustment object

User objects.

-

---

1608	eagle_ml-2-0_default_in_xml_

delete_objects

warehouse

EGL_

EJM

EagleML

The

This stream is used to

delete records from DB.
Supported object type groups: SMF, Entity, Warehouse, Reference----

load Warehouse objects (XMLDBAPI format).
-1610	eagle_ml-2-0_default_in_xml_

delete_splitter_isr_mi

warehouse_preproc

EGL_

EJM

EagleML

This stream is

used to split Generic Issuer file into several Issuer files and send them to the eagle

used to load Warehouse objects (EagleML format).
	eagle_ml-2-0_default_in_xml_

delete

washsale

EGL_

objects stream ----

EagleML		This stream is used to load accounting washSale object.
	eagle_ml-2-0_default_

in

out_

xml_delete_splitter_smf_mi

extract_service

EGL_

EJM

ExtractService

MC2

This

stream is used to split Generic SMF file into several Reference and SMF files and send them to the eagle

MC2 stream is used to extract data
-1601 or -1711 (depends on box version)	eagle_ml-2-0_default_

in

out_

xml_delete_objects stream-1604

q	EGL_EagleML		This stream is the first stage of data export and manages the query process within the EJM framework.
-1611	eagle_ml-2-0_default_

in

out_

xml

star_

entity

extracts

EGL_EagleML

This stream is used to

load Entity objects.----

extract data in STAR format.
	eagle_ml-2-0_default_

in

out_

xml_ent_no_split

streaming_t

EGL_EagleML

This stream is

used to load Entity objects. No split.----

similar to eagle_ml-2-0_default_

in_xml_impairmentsEGL_EagleMLThis stream is used to load the Impairments object.-1614

out_t, as this stream is the second stage of the data export and manages the transformation process within the EJM framework. It uses new Eagle technology which allows tasks to be executed faster improving throughput.
-1602 or -1712 (depends on box version)	eagle_ml-2-0_default_

in_xml_issuer_mi

out_t

EGL_EagleML

This stream is

used to split Generic Issuer file into several Issuer files and send them to the eagle

the second stage of data export and manages the transformation process within the EJM framework.
	eagle_ml-2-0_default_

in_xml_reference stream----

validatepackage	EGL_EagleML		Validates package integrity.
	eagle_ml-2-0_

default

extract_

in

service_

xml

control_

ref_ext

message

EGL_

EagleML----eagle_ml-2-0_default_in_xml_ref_no_splitEGL_EagleML-1606eagle_ml-2-0_default_in_xml_referenceEGL_EagleMLThis stream is used to load Reference objects.----eagle_ml-2-0_default_in_xml_smf_customEGL_EagleML-1612eagle_ml-2-0_default_in_xml_smf_genericEGL_EagleML-1613eagle_ml-2-0_default_in_xml_smf_miEGL_EagleMLThis stream is used to split Generic SMF file into several Reference and SMF files and send them to the eagle_ml-2-0_default_in_xml_smf_generic and eagle_ml-2-0_default_in_xml_reference streams ----eagle_ml-2-0_default_in_xml_userEGL_EAGLEML-1608eagle_ml-2-0_default_in_xml_warehouseEGL_EagleML-1610eagle_ml-2-0_default_in_xml_warehouse_preprocEGL_EagleML----eagle_ml-2-0_default_in_xml_washsaleEGL_EagleML----eagle_ml-2-0_default_out_extract_serviceEGL_EagleML-1601 or -1711 (depends on box version)eagle_ml-2-0_default_out_qEGL_EagleMLThis stream is the first stage of data export and manages the query process within the EJM framework.-1611eagle_ml-2-0_default_out_star_extractsEGL_EagleMLThis stream is used to extract data in STAR format.----eagle_ml-2-0_default_out_streaming_tEGL_EagleMLThis stream is similar to eagle_ml-2-0_default_out_t, as this stream is the second stage of the data export and manages the transformation process within the EJM framework. It uses new Eagle technology which allows tasks to be executed faster improving throughput.-1602 or -1712 (depends on box version)eagle_ml-2-0_default_out_tEGL_EagleMLThis stream is the second stage of data export and manages the transformation process within the EJM framework.----eagle_ml-2-0_default_validatepackageEGL_EagleMLValidates package integrity.----eagle_ml-2-0_extract_service_control_messageEGL_ExtractService----eagle_service_data_emptyEGL_IWS----eagle_sv_key_inst_distrib----eagle_sv_key_inst_proc----eagle_tba_extract_cons_records----eagle_tba_extract_mgr_alloc_records----eagle_tba_extract_records_1----eagle_tba_extract_t_mgr_alloc----eagle_tba_group_by_position----eagle_tba_run_cons----eagle_tba_run_earnings----eagle_tba_t_consolidated----eagle_tba_t_mgr_alloc----eagle_tba_t_records_1----eagle_tba_update_status_1----eagle_trr_extract_cxl----eagle_trr_extract_qtrr----eagle_trr_t_cxl----eagle_trr_t_qtrr----eagle_trs_common_preproc----eagle_trs_filter_error----eagle_trs_reply_t----eagle_trs_t_csv_trades_eml----eagle_trs_upsize_preproc----eagle_trs_xslt_cost_basis_adj----eagle_wrf_cloud_extract_schd----eagle_wrf_csv_benchmark_returns_tsk----eagle_wrf_csv_calendar_holiday_tsk----eagle_wrf_csv_calendar_tsk----eagle_wrf_csv_entity_generic_tsk----eagle_wrf_csv_entity_to_composite_tsk----eagle_wrf_csv_issue_fx_pc_rate_tsk----eagle_wrf_csv_issue_fx_rate_tsk----eagle_wrf_csv_issue_pc_price_tsk----eagle_wrf_csv_issue_price_tsk----eagle_wrf_csv_issuer_role_tsk----eagle_wrf_csv_position_generic_tsk----eagle_wrf_csv_smf_generic_tsk----eagle_wrf_csv_warehouse_nav_tsk----eagle_wrf_csv_warehouse_openlot_tsk----eagle_wrf_csv_wh_cash_activity_tsk----eagle_wrf_csv_wh_cash_flow_projection_tsk----eagle_wrf_csv_wh_close_lot_tsk----eagle_wrf_csv_wh_gl_balances_tsk----eagle_wrf_csv_wh_nav_month_end_tsk----eagle_wrf_csv_wh_trade_tsk----eagle_wrf_delta_extract_restart----eagle_wrf_ebs_reload_datacache_schd----eagle_wrf_full_extract_restart----eagle_wrf_generic_extract_mc2_schd----eagle_wrf_generic_extract_restartEGL_EJM----eagle_wrf_generic_purge_archive_restartEGL_EJM----eagle_wrf_generic_purge_restart----eagle_wrf_i2i_message_distribution----eagle_wrf_i2i_restart----eagle_wrf_i2i_sec_alias_sync_restart----eagle_wrf_pending_trades_extract----eagle_wrf_pending_trades_restart----eagle_wrf_pending_trades_t----eagle_wrf_tba_approve_restart----eagle_wrf_tba_consolidation_restart----eagle_wrf_tba_mgr_alloc_restart----eagle_wrf_tba_process_restart----eagle_wrf_trr_reset_demandEGL_EJM----eagle_wrf_trr_reset_restart

ExtractService		This stream receives and parses control messages. The control message is an XML-formatted input message that EJM recognizes and processes as a command to execute a specific MC2 events.
	eagle_service_data_empty	EGL_IWS	This stream is used to group rule and include files that do not require an execution stream.
	eagle_sv_key_inst_distrib	EGL_Generic	These streams are Distribution streams using entity and instance folder.
	eagle_sv_key_inst_proc	EGL_Generic
	eagle_tba_extract_cons_records	EGL_EJM	These streams are used to maintain the ”eagle_wrf_tba” workflow. ”eagle_wrf_tba” is a set of five independent workflows that can be run consecutively in straight-through mode or selectively in user/manual execution. The final step of each workflow allows execution of the next logical series of events to be automated. The ”eagle_wrf_tba_approve” workflow is broadly responsible for matching the records that have been placed in the TRADE_CONSOLIDATION table. The ”eagle_wrf_tba_process” workflow is responsible for processing of each record that that matches others by the means of the consolidationFlag. The ”eagle_wrf_tba_mgr_alloc” workflow allocates consolidated records amongst qualified managers so that it is possible to track the payoffs for each manager.
	eagle_tba_extract_mgr_alloc_records	EGL_EJM
	eagle_tba_extract_records_1	EGL_EJM
	eagle_tba_extract_t_mgr_alloc	EGL_EJM
	eagle_tba_group_by_position	EGL_EJM
	eagle_tba_run_cons	EGL_EJM
	eagle_tba_run_earnings	EGL_EJM
	eagle_tba_t_consolidated	EGL_EJM
	eagle_tba_t_mgr_alloc	EGL_EJM
	eagle_tba_t_records_1	EGL_EJM
	eagle_tba_update_status_1	EGL_EJM
	eagle_trr_extract_cxl	EGL_EJM	These streams are used to maintain the "TRR SWAPS CXL RESET" workflow. Where multiple swaps can be targeted to be cancelled based on the swap underlying asset and update the current reset process where multiple swaps can be targeted to reset based on the swap underlying asset id. This process can be triggered thru panels or automated using IWS via control message
	eagle_trr_extract_qtrr	EGL_EJM
	eagle_trr_t_cxl	EGL_EJM
	eagle_trr_t_qtrr	EGL_EJM
	eagle_trs_common_preproc	EGL_EJM	These streams are used to maintain the "eagle_wrf_trs_upsize" workflow
	eagle_trs_filter_error	EGL_EJM
	eagle_trs_reply_t	EGL_EJM
	eagle_trs_t_csv_trades_eml	EGL_EJM
	eagle_trs_upsize_preproc	EGL_EJM
	eagle_trs_xslt_cost_basis_adj	EGL_EJM
	eagle_wrf_cloud_extract_schd	EGL_EJM	This stream is used to restart eagle_wrf_cloud_extract workflow
	eagle_wrf_csv_benchmark_returns_tsk	EGL_EJM	These streams transform CSV to EagleML format using rule service
	eagle_wrf_csv_calendar_holiday_tsk	EGL_EJM
	eagle_wrf_csv_calendar_tsk	EGL_EJM
	eagle_wrf_csv_entity_generic_tsk	EGL_EJM
	eagle_wrf_csv_entity_to_composite_tsk	EGL_EJM
	eagle_wrf_csv_issue_fx_pc_rate_tsk	EGL_EJM
	eagle_wrf_csv_issue_fx_rate_tsk	EGL_EJM
	eagle_wrf_csv_issue_pc_price_tsk	EGL_EJM
	eagle_wrf_csv_issue_price_tsk	EGL_EJM
	eagle_wrf_csv_issuer_role_tsk	EGL_EJM
	eagle_wrf_csv_position_generic_tsk	EGL_EJM
	eagle_wrf_csv_smf_generic_tsk	EGL_EJM
	eagle_wrf_csv_warehouse_nav_tsk	EGL_EJM
	eagle_wrf_csv_warehouse_openlot_tsk	EGL_EJM
	eagle_wrf_csv_wh_cash_activity_tsk	EGL_EJM
	eagle_wrf_csv_wh_cash_flow_projection_tsk	EGL_EJM
	eagle_wrf_csv_wh_close_lot_tsk	EGL_EJM
	eagle_wrf_csv_wh_gl_balances_tsk	EGL_EJM
	eagle_wrf_csv_wh_nav_month_end_tsk	EGL_EJM
	eagle_wrf_csv_wh_trade_tsk	EGL_EJM
	eagle_wrf_ebs_reload_datacache_schd	EGL_EJM
	eagle_wrf_delta_extract_restart	EGL_EJM	This stream is used to restart eagle_wrf_delta_extract workflow
	eagle_wrf_full_extract_restart	EGL_EJM	This stream is used to restart eagle_wrf_full_extract workflow
	eagle_wrf_generic_extract_mc2_schd	EGL_EJM	This stream is used to restart eagle_wrf_generic_extract_mc2 workflow
	eagle_wrf_generic_extract_restart	EGL_EJM	This stream is used to restart eagle_wrf_generic_extract workflow
	eagle_wrf_generic_purge_archive_restart	EGL_EJM	This stream is used to restart eagle_wrf_generic_purge_archive workflow
	eagle_wrf_generic_purge_restart	EGL_EJM	This stream is used to restart eagle_wrf_generic_purge workflow
	eagle_wrf_i2i_message_distribution	EGL_EJM	This stream is used to deliver RTR/TSR/Data files (base64)
	eagle_wrf_i2i_restart	EGL_EJM	This stream is used to restart eagle_wrf_i2i workflow
	eagle_wrf_i2i_sec_alias_sync_restart	EGL_EJM	This stream is used to restart eagle_wrf_i2i_sec_alias_sync workflow
	eagle_wrf_pending_trades_extract	EGL_EJM	These streams are used to maintain the "eagle_wrf_pending_trades" workflow
	eagle_wrf_pending_trades_t	EGL_EJM
	eagle_wrf_pending_trades_restart	EGL_EJM	This stream is used to restart eagle_wrf_pending_trades workflow
	eagle_wrf_tba_approve_restart	EGL_EJM	This stream is used to restart eagle_wrf_tba_approve workflow
	eagle_wrf_tba_consolidation_restart	EGL_EJM	This stream is used to restart eagle_wrf_tba_consolidation workflow
	eagle_wrf_tba_mgr_alloc_restart	EGL_EJM	This stream is used to restart eagle_wrf_tba_mgr_alloc workflow
	eagle_wrf_tba_process_restart	EGL_EJM	This stream is used to restart eagle_wrf_tba_process workflow
	eagle_wrf_trr_reset_restart	EGL_EJM	These streams are used to restart eagle_wrf_trr_reset workflow
	eagle_wrf_trr_reset_demand	EGL_EJM
	reload_datacache_tsk	EGL_EJM	This stream is used to reload EBS cache

Obsolete Streams

Stream ID	Stream Title	Stream Category	MC2 Related	Description
	eagle_ml_file_distribution	EGL_EJM		This stream was used to deliver files to another server. For example, within i2i workflow. The stream is out of date
	eagle_default_file_distribution	EGL_EJM		This stream was used to deliver files to another server.
	eagle_default_deploy_monitoring	MC_INSTALL		This stream was used to install the monitoring
	eagle_default_deploy	MC_INSTALL		Old Eagle installation stream

Versions Compared

Old Version 18

New Version 19

Key

Stream Count

Obsolete Streams