Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 17 Next »

EagleML and EJM require a series of infrastructure message streams. This page describes how to verify in Message Center Console that all required streams are installed and enabled and which message streams are required.

Note

The first time you install the monthly EagleML package In an environment, you should perform this check. It is not required for subsequent installs. This is applicable to both automated and manual install processes.

While this step is optional on subsequent installs, you may choose to do it after each install as an added verification point for manual installs

In this page:

Verify that a Message Stream is Installed and Enabled

  1. Open Message Center Console in your Eagle environment.
  2. Click the Message Streams tab in the Message Center Console main window.
    The Streams Query dialog box will be displayed.
  3. In the Title text box, enter eagle_ml and click SEARCH.
    All the message streams with the name eagle_ml will be displayed.
  4. Check that the required streams are listed.
  5. Check that the Stream Statuses for all required streams are shown as Enabled.


Note

If you are installing the EagleML package for the first time on an environment that has Eagle versions 12.x, 13.x or V15R2.x, the streams will all be disabled and you will need to enable them. 

If a stream is Disabled and you want to turn it on:

  • Select the message stream you want to enable, right-click it and choose Enable Stream.
  • The selected stream is now enabled and available for use.

Note

We recommend setting the Processing Rate parameter of these streams to “1” (if it is not set) to process them with normal priority. Setting “0” stands for low priority: the stream will not be processed by the Message Center until it finishes processing all the tasks in the queue with processing rate  “1”.

If you want to set Processing rate "1" instead of "0":

  • Select the message stream you want to switch to a higher priority and double click it
  • Set Processing Rate to 1 in the pop-up window.
  • Click OK to apply your changes.

Note

 While reviewing the streams, you may also verify want to verify the instance id on the Message Stream properties.

Required Message Streams

The following table lists the stream ID, stream name, and description of the infrastructure streams installed with the EagleML/EJM Monthly Install.

Note

The counts below always represent the latest EagleML monthly release.

 This stream uses a preprocessor rule file (*.prf), to sequentially execute transformation step from CSV to EagleML(XMLDBAPI)[SINGLE mode] and send a result message to the load step to the streameagle_ml-2-0_default_in_xml_warehouse  or eagle_ml-2-0_default_in_xml_warehouse_preproc

Stream Count

Stream CategoryCount
EIS2
EGL_EAGLEML2
EGL_EJM63
EGL_EagleML27
EGL_Generic8
EGL_SSC1
EGL_IWS18
EGL_ExtractService2
MC_INSTALL19
Other71
TOTAL213
Stream IDStream TitleStream CategoryDescription
----eagle_default_bbca_helper

----eagle_default_csv_raw_data_load

----eagle_default_deployMC_INSTALL
----eagle_default_deploy_demandMC_INSTALL
----eagle_default_deploy_monitoring

----eagle_default_deploy_restart_mc

----eagle_default_deploy_serviceMC_INSTALL
----eagle_default_deploy_support

----eagle_default_extractor_demandEGL_EJM
----eagle_default_file_distributionEGL_EJM
----eagle_default_file_move_or_copyEGL_IWS
-1148eagle_default_in_csv_warehouseEGL_GenericThis stream uses a preprocessor rule file (*.prf), to sequentially execute transformation from CSV to EagleML(XMLDBAPI)[BATCH mode] and send a result message to the load to the stream
eagle_ml-2-0_default_in_xml_warehouse  or eagle_ml-2-0_default_in_xml_warehouse_preproc
-1153eagle_default_in_csv_warehouse_smEGL_Generic
-1149eagle_default_in_csv_warehouse_tEGL_GenericThis stream performs transformation from CSV to EagleML(XMLDBAPI).
-1154eagle_default_in_csv_warehouse_upsertEGL_GenericThis stream uses a preprocessor rule file (*.prf), to sequentially execute transformation from CSV to EagleML(XMLDBAPI)[UPSERT mode] and send a result message to the load to the stream
eagle_ml-2-0_default_in_xml_warehouse  or eagle_ml-2-0_default_in_xml_warehouse_preproc
----eagle_default_in_pipe_performanceCLPEGL_GenericThis stream uses a preprocessor rule file (*.prf), to sequentially execute transformation step from PIPE Performance  to EagleML and send a result message to the load step to the stream
eagle_ml-2-0_default_in_xml_warehouse_preproc
----eagle_default_in_pipe_performanceCLP_tEGL_GenericThis stream performs PIPE Performance to EagleML transformation.
----eagle_default_in_pipe_posEGL_GenericThis stream uses a preprocessor rule file (*.prf), to sequentially execute transformation step from PIPE Position  to EagleML and send a result message to the load step to the stream
eagle_ml-2-0_default_in_xml_warehouse_preproc
----eagle_default_in_pipe_pos_tEGL_GenericThis stream performs PIPE Position to EagleML transformation.
----eagle_default_nuggetizer_restartEGL_EJM
----eagle_default_raw_common_values_load

----eagle_default_raw_create_table

----eagle_default_raw_create_view

----eagle_default_raw_data_header_load

----eagle_default_rollback

----eagle_default_ruleserviceEGL_ExtractService
----eagle_default_secmaster_resolutionEGL_EagleML
----eagle_iws_cacheEGL_IWSThis stream is used to cache IWS resources.
-1810eagle_iws_delete_fileEGL_IWSThis stream deletes IWS files due IWS execution.
-1813eagle_iws_eagleml_panelEGL_IWSIWS uses this stream when it works with xpanels.
-1807eagle_iws_export_solutionEGL_IWSThis stream compiles IWS solutions with the Java tool on back-end. 
-1808eagle_iws_export_solution_mcpkgEGL_IWSThis stream compiles IWS solutions and sends pkg files for processed IWS solution.
-1816eagle_iws_find_and_get_fileEGL_IWSIWS uses this stream to find files.
-1812eagle_iws_get_fileEGL_IWSIWS uses this stream to download files.
-1811eagle_iws_import_streamEGL_IWSThis stream installs streams while migrating MC packages. 
-1805eagle_iws_import_stream_requestEGL_IWSIWS uses this stream to start import processes.
-1806eagle_iws_import_stream_wEGL_IWSThis stream uses files processed by eagle_iws_import_stream_request and starts the process of the stream installation.
----eagle_iws_infoEGL_IWSThis is the IWS authorization stream.
-1801eagle_iws_list_filesEGL_IWSIWS uses this stream to download the list of files for a specific directory.
-1815eagle_iws_monitoring_apiEGL_IWSEJM Monitoring Tool uses this stream to download task statistics.
-1809eagle_iws_rename_fileEGL_IWSIWS uses this stream to rename solution files.
-1802eagle_iws_save_fileEGL_IWSIWS uses this stream to upload files to the box.
-1804eagle_iws_server_installerMC_INSTALLeagle_iws_import_stream_w uses this stream to install processed streams.
-1803eagle_iws_server_supportMC_INSTALLeagle_iws_import_stream_w uses this stream to copy source files for installing streams.
----eagle_iws_service_data_emptyEISIWS uses this stream to install IWS solutions source files.
-1814eagle_iws_shellEGL_IWSThis is the IWS utils stream.
----eagle_mc_alertsEGL_EagleML
----eagle_mc_import_stream_requestMC_INSTALL
----eagle_mc_import_stream_wMC_INSTALL
----eagle_mc_import_support_dataMC_INSTALL
----eagle_mc_server_installerMC_INSTALL
----eagle_mc_server_installer_ftpMC_INSTALL
----eagle_mc_server_installer_mqMC_INSTALL
----eagle_mc_server_installer_mq_decoderMC_INSTALL
----eagle_mc_server_supportMC_INSTALL
----eagle_mc_server_support_amq_monitorMC_INSTALL
----eagle_mc_server_support_import_dataflow

----eagle_mc_server_support_import_streamMC_INSTALL
----eagle_mc_server_support_jmsMC_INSTALL
----eagle_mc_server_support_jms_execMC_INSTALL
----eagle_mc_server_support_reporterMC_INSTALL
----eagle_mc_stream_installerMC_INSTALL
-1704eagle_ml-2-0_default_cm_acquire_dataEGL_EJMThe stream receives the information provided to the control message, adds the end of workflow trigger file and delivers all details the Load Flow Control stream to orchestrate data loads.
----eagle_ml-2-0_default_cm_concatEGL_EJMConcatenates several incoming file into one outgoing with a set name.
-1734eagle_ml-2-0_default_cm_construct_requestEGL_EJMThis stream generates the requestor file from EagleML Generic SMF identifiers to load the details from Bloomberg. Used in ‘generic_load_enrichment’ workflow.
-1707eagle_ml-2-0_default_cm_control_messageEGL_EJMThis stream receives and parses control messages. The control message is an XML-formatted input message that EJM recognizes and processes as a command to execute a specific message stream, STAR event, or PACE event.
----eagle_ml-2-0_default_cm_control_process

-1735eagle_ml-2-0_default_cm_data_file_splitterEGL_EJMThe main purpose of the developed stream is to increase the performance of the incoming GICSV formatted file's loading by splitting incoming file into several smaller and distributing files into Message Center processes in order to run parallel processing.
-1708eagle_ml-2-0_default_cm_data_load_cmw_inEGL_EJMThis is a helper stream used by the Message Center Console to deliver data files to the incoming folder (/cmw/in).
-1721eagle_ml-2-0_default_cm_datafile_controlEGL_EJMThis stream reads the trigger file from eagle_ml-2-0_default_cm_datafile_task makes a specified copy in the staging folder and then moves to the specified stream for processing.
-1722eagle_ml-2-0_default_cm_datafile_taskEGL_EJMThis stream creates trigger file with necessary information(stream name, file name, source stream name etc.) and send it to the stream eagle_ml-2-0_default_cm_datafile_control
----eagle_ml-2-0_default_cm_dfaEGL_EJM
----eagle_ml-2-0_default_cm_dishub_clientEGL_EJM
----eagle_ml-2-0_default_cm_dishub2spoke_clientEGL_EJM
-1732eagle_ml-2-0_default_cm_disribute_to_nuggetizerEGL_EJMThis stream sends the incoming file into the nuggetizer folder, configured by W_NGTZR_DIST_FOLDER setting.
----eagle_ml-2-0_default_cm_ea_ftp_readerEGL_EJM This stream performs the following tasks:
   - Sends a request to the database SITESEE about the files received on the FTP
   - Gets files from the FTP
   - Updates the status in SITESEE database about the files
   - Sends the files for processing to the eagle_ml-2-0_default_cm_control_message stream 
-1737eagle_ml-2-0_default_cm_eas_distributionEGL_EJMThis stream gets EAS alerts as TSR message, convert TSR to format in accordance with the list of templates and send alerts via mail.
----eagle_ml-2-0_default_cm_ejm_reporterEGL_EJM
-1716eagle_ml-2-0_default_cm_email_distributionEGL_EJMThis stream receives the EJM Notifications for sending and send notifications via email.
-1701eagle_ml-2-0_default_cm_eofwEGL_EJMThis stream is last in the execution sequence (Load Flow Control Rule), reporting the processing status of the completed workflow as a success or a failure; this stream also triggers final reporting to an external system by dropping a trigger file into the /REP folder.
-1705eagle_ml-2-0_default_cm_execute_pace_eventEGL_EJMThis stream is used to invoke a specific PACE event by name.
-1714eagle_ml-2-0_default_cm_execute_star_eventEGL_EJMThis stream is used to invoke a specific STAR Accounting event by name.
-1720eagle_ml-2-0_default_cm_execwkflEGL_EJMThis is the main stream in workflow execution. 
----eagle_ml-2-0_default_cm_file_distributionEGL_EJM
-1706eagle_ml-2-0_default_cm_load_flow_controlEGL_EJMThis stream uses a preprocessor rule file (*.prf), to sequentially execute a set of data loads in logical database order, launching the appropriate supported message stream interface for each available input file.
-1738eagle_ml-2-0_default_cm_monitoringEGL_EJMThis stream is monitoring ALERTS and sends a notification to the eagle_ml-2-0_default_cm_email_distribution stream if an alert happened.
-1718eagle_ml-2-0_default_cm_ndfaEGL_EJMThis stream receives data files for workflow execution.
-1719eagle_ml-2-0_default_cm_ndfa_execEGL_EJMThis stream determines for which workflow incoming data file is intended and generates an event for this workflow.
-1736eagle_ml-2-0_default_cm_notif_emailEGL_EJMThis stream transform TSR to plain text format and send it via email. 
-1733eagle_ml-2-0_default_cm_nuggetizerEGL_EJMThis stream collects EagleML files, concatenates them into nuggets and sends it for further processing. Used in 'eagle_nuggetizer_workflow’ workflow.
----eagle_ml-2-0_default_cm_nuggetizer_recoverEGL_EJMThis stream is used in troubleshooting for eagle_nuggetizer_workflow. Also purges generic_load_enrichment.
----eagle_ml-2-0_default_cm_pacepoll

-1730eagle_ml-2-0_default_cm_packerEGL_EJMThis stream is used to compress files to ZIP archive.
----eagle_ml-2-0_default_cm_parallel_execEGL_EJMThis stream is involved into loading files in parallel.
-1728eagle_ml-2-0_default_cm_purge_archiveEGL_EJMThis stream is used to purge or archive files from local and FTP folders.
-1709eagle_ml-2-0_default_cm_queue_posterEGL_EJMThis stream is used to add information to the queue.
----eagle_ml-2-0_default_cm_realtime_ejm_statEGL_EJM
----eagle_ml-2-0_default_cm_refresh_engine_cacheEGL_EagleML
----eagle_ml-2-0_default_cm_self_system_checkEGL_SSC
----eagle_ml-2-0_default_cm_send_to_wrfEGL_EJM
-1723eagle_ml-2-0_default_cm_sequencerEGL_EJMThe stream is used to check whether to process the message in queue.
-1724eagle_ml-2-0_default_cm_sequencer_cleanupEGL_EJMThis stream is used to clean up all the message in the queue for a workflow and to remove current workflow from the queue.
-1725eagle_ml-2-0_default_cm_sequencer_schEGL_EJMThe stream is used to check messages in the queue and send messages for processing.
-1702eagle_ml-2-0_default_cm_task_executorEGL_EJMThis stream receives dataflow state from DB and stops processing if the workflow status is negative acknowledgement (NACK). This stream derives the stream name to execute, using the task type and feed type, and triggers execution using an ACQUIRE style message stream.
-1703eagle_ml-2-0_default_cm_task_reporterEGL_EJMThis stream generates acknowledgement and task status reply messages. Task statuses are SUCCESS, FAILED, and NO_DATA (for a data extract that found no database records.) Also this stream is last in the execution sequence (Load Flow Control Rule), posting the processing status of the completed workflow as a success or a failure; this stream also triggers final reporting to the external system by dropping a trigger file to the /REP folder.)
----eagle_ml-2-0_default_cm_transform_reportEGL_EJMThe stream is used to transform TSR.
-1717eagle_ml-2-0_default_cm_tsrEGL_EJMThe stream is used to create and manage dependencies between multiple EJM tasks and oversees fork and join functionality within the stream flow.
-1726eagle_ml-2-0_default_cm_unpackerEGL_EJMThis stream is used to decompress files from any archive type (ZIP,GZIP,TARGZIP,TAR).
-1727eagle_ml-2-0_default_cm_unpacker_execEGL_EJMThis stream collects information about extracted files from archive and update workflow state.  
----eagle_ml-2-0_default_cm_uploader_dlvrEGL_EJM
-1713eagle_ml-2-0_default_cm_user_syncEGL_EJMThis stream is used to synchronize the userID information defined on Eagle with the credentials required for the MicroStrategy application.
----eagle_ml-2-0_default_cm_validate_by_xsdEGL_EJM
----eagle_ml-2-0_default_cm_w_setupEGL_EJMThis stream is used to configure environment after the first EagleML installation. It creates cmw folders and sets EagleVersion variable in w_config_version.inc.
----eagle_ml-2-0_default_cm_wrkfl_executorEGL_EJM
----eagle_ml-2-0_default_cm_wrkfl_listenerEGL_EJM
----eagle_ml-2-0_default_cm_wrkfl_reporterEGL_EJMThis stream creates a consolidated TSR for ALL workflow.
----eagle_ml-2-0_default_cm_xslt_exceptions_accEGL_EJMThe XSLT Exceptions stream can be used in workflows after the XSLT transformation for Warehouse[Accounting|Entity|Reference] Transaction object and its main purpose is to catch exceptions generated by XSLT EditChecks from the transformed message and exclude records with exceptions, which are specified as errors.
----eagle_ml-2-0_default_cm_xslt_exceptions_entEGL_EJM
----eagle_ml-2-0_default_cm_xslt_exceptions_refEGL_EJM
----eagle_ml-2-0_default_cm_xslt_exceptions_wrhEGL_EJM
-1605eagle_ml-2-0_default_in_xml_acct_cashEGL_EagleMLThis stream is used to load Accounting Cash objects.
----eagle_ml-2-0_default_in_xml_acct_trades_no_splitEGL_EagleMLThis stream is used to load Accounting Cash objects. No split.
-1603eagle_ml-2-0_default_in_xml_acct_tradesEGL_EagleMLThis stream is used to load Accounting Trade objects.
----eagle_ml-2-0_default_in_xml_acct_trades_no_splitEGL_EagleMLThis stream is used to load Accounting Trade objects. No split.
----eagle_ml-2-0_default_in_xml_costbasis_adjEGL_EagleMLThis stream is used to load the Cost Basis Adjustment object.
----eagle_ml-2-0_default_in_xml_delete_objectsEGL_EJMThe stream is used to delete records from DB. 
Supported object type groups: SMF, Entity, Warehouse, Reference
----eagle_ml-2-0_default_in_xml_delete_splitter_isr_miEGL_EJMThis stream is used to split Generic Issuer file into several Issuer files and send them to the eagle_ml-2-0_default_in_xml_delete_objects stream 
----eagle_ml-2-0_default_in_xml_delete_splitter_smf_miEGL_EJMThis stream is used to split Generic SMF file into several Reference and SMF files and send them to the eagle_ml-2-0_default_in_xml_delete_objects stream
-1604eagle_ml-2-0_default_in_xml_entityEGL_EagleMLThis stream is used to load Entity objects.
----eagle_ml-2-0_default_in_xml_ent_no_splitEGL_EagleMLThis stream is used to load Entity objects. No split.
----eagle_ml-2-0_default_in_xml_impairmentsEGL_EagleMLThis stream is used to load the Impairments  object.
-1614eagle_ml-2-0_default_in_xml_issuer_miEGL_EagleMLThis stream is used to split Generic Issuer file into several Issuer files and send them to the eagle_ml-2-0_default_in_xml_reference stream
----eagle_ml-2-0_default_in_xml_ref_extEGL_EagleML
----eagle_ml-2-0_default_in_xml_ref_no_splitEGL_EagleML
-1606eagle_ml-2-0_default_in_xml_referenceEGL_EagleMLThis stream is used to load Reference objects.
----eagle_ml-2-0_default_in_xml_smf_customEGL_EagleML
-1612eagle_ml-2-0_default_in_xml_smf_genericEGL_EagleML
-1613eagle_ml-2-0_default_in_xml_smf_miEGL_EagleMLThis stream is used to split Generic SMF file into several Reference and SMF files and send them to the eagle_ml-2-0_default_in_xml_smf_generic and eagle_ml-2-0_default_in_xml_reference streams 
----eagle_ml-2-0_default_in_xml_userEGL_EAGLEML
-1608eagle_ml-2-0_default_in_xml_warehouseEGL_EagleML
-1610eagle_ml-2-0_default_in_xml_warehouse_preprocEGL_EagleML
----eagle_ml-2-0_default_in_xml_washsaleEGL_EagleML
----eagle_ml-2-0_default_out_extract_serviceEGL_EagleML
-1601 or -1711 (depends on box version)eagle_ml-2-0_default_out_qEGL_EagleMLThis stream is the first stage of data export and manages the query process within the EJM framework.
-1611eagle_ml-2-0_default_out_star_extractsEGL_EagleMLThis stream is used to extract data in STAR format.
----eagle_ml-2-0_default_out_streaming_tEGL_EagleMLThis stream is similar to eagle_ml-2-0_default_out_t, as this stream is the second stage of the data export and manages the transformation process within the EJM framework.  It uses new Eagle technology which allows tasks to be executed faster improving throughput.
-1602 or -1712 (depends on box version)eagle_ml-2-0_default_out_tEGL_EagleMLThis stream is the second stage of data export and manages the transformation process within the EJM framework.
----eagle_ml-2-0_default_validatepackageEGL_EagleMLValidates package integrity.
----eagle_ml-2-0_extract_service_control_messageEGL_ExtractService
----eagle_service_data_emptyEGL_IWS
----eagle_sv_key_inst_distrib

----eagle_sv_key_inst_proc

----eagle_tba_extract_cons_records

----eagle_tba_extract_mgr_alloc_records

----eagle_tba_extract_records_1

----eagle_tba_extract_t_mgr_alloc

----eagle_tba_group_by_position

----eagle_tba_run_cons

----eagle_tba_run_earnings

----eagle_tba_t_consolidated

----eagle_tba_t_mgr_alloc

----eagle_tba_t_records_1

----eagle_tba_update_status_1

----eagle_trr_extract_cxl

----eagle_trr_extract_qtrr

----eagle_trr_t_cxl

----eagle_trr_t_qtrr

----eagle_trs_common_preproc

----eagle_trs_filter_error

----eagle_trs_reply_t

----eagle_trs_t_csv_trades_eml

----eagle_trs_upsize_preproc

----eagle_trs_xslt_cost_basis_adj

----eagle_wrf_cloud_extract_schd

----eagle_wrf_csv_benchmark_returns_tsk

----eagle_wrf_csv_calendar_holiday_tsk

----eagle_wrf_csv_calendar_tsk

----eagle_wrf_csv_entity_generic_tsk

----eagle_wrf_csv_entity_to_composite_tsk

----eagle_wrf_csv_issue_fx_pc_rate_tsk

----eagle_wrf_csv_issue_fx_rate_tsk

----eagle_wrf_csv_issue_pc_price_tsk

----eagle_wrf_csv_issue_price_tsk

----eagle_wrf_csv_issuer_role_tsk

----eagle_wrf_csv_position_generic_tsk

----eagle_wrf_csv_smf_generic_tsk

----eagle_wrf_csv_warehouse_nav_tsk

----eagle_wrf_csv_warehouse_openlot_tsk

----eagle_wrf_csv_wh_cash_activity_tsk

----eagle_wrf_csv_wh_cash_flow_projection_tsk

----eagle_wrf_csv_wh_close_lot_tsk

----eagle_wrf_csv_wh_gl_balances_tsk

----eagle_wrf_csv_wh_nav_month_end_tsk

----eagle_wrf_csv_wh_trade_tsk

----eagle_wrf_delta_extract_restart

----eagle_wrf_ebs_reload_datacache_schd

----eagle_wrf_full_extract_restart

----eagle_wrf_generic_extract_mc2_schd

----eagle_wrf_generic_extract_restartEGL_EJM
----eagle_wrf_generic_purge_archive_restartEGL_EJM
----eagle_wrf_generic_purge_restart

----eagle_wrf_i2i_message_distribution

----eagle_wrf_i2i_restart

----eagle_wrf_i2i_sec_alias_sync_restart

----eagle_wrf_pending_trades_extract

----eagle_wrf_pending_trades_restart

----eagle_wrf_pending_trades_t

----eagle_wrf_tba_approve_restart

----eagle_wrf_tba_consolidation_restart

----eagle_wrf_tba_mgr_alloc_restart

----eagle_wrf_tba_process_restart

----eagle_wrf_trr_reset_demandEGL_EJM
----eagle_wrf_trr_reset_restart

  • No labels