Page Comparison

...

The issuePrice has been adjusted that in case of an invalid effectiveDate or sourceName fields in the incoming message. The , the logic has been updated to default to insert mode, instead of update mode as it was before the modification.

...

SDP-14566: Enhance EagleML in the AccountingAssetCash coverage to support mapping of the Cash Event Type - CS0136160 - Inbound MISC Entry negative EML message

The AccountingAssetCash Interface was enhanced to support the cashEventType element for MISC Income and Expense Asset Cash message types (Asset Cash Type = AMISCINC or AMISCEXP).
Possible values of Cash Event Type: DISB, RECPT.
<cashEventType>DISB</cashEventType> or <cashEventType>RECPT</cashEventType>

...

SDP-14318: Duplicate identifier in DB database after SMF update

The problem was that Duplicated A duplicate identifier was posting to the database during SMF updates. The duplicated Xref Identifiers were added to the same security when the Accounting Validation Flag is set to passed with a value of Y.

In In order to resolve the issue, we had to initialize variables the variables are set to be reinitialized in the rule.

Changed files:
eagle_default\in\xml\include\security_resolution_generic.inc

...

Accounting Trade and Multiple Leg Accounting Trade interfaces were enhanced to support the tagNochangecase element. This element is mapped to the tag 4637 in the Trade panels and specifies which tag elements should maintain their original case.

Files changed:

\dynamic\msgcenter\eagle_default\in\include\csv-buy_columns.inc
\dynamic\msgcenter\eagle_default\in\include\csv-cancel_columns.inc
\dynamic\msgcenter\eagle_default\in\include\csv-capfundinvestments_columns.inc
\dynamic\msgcenter\eagle_default\in\include\csv-conversion_columns.inc
\dynamic\msgcenter\eagle_default\in\include\csv-deliver.inc
\dynamic\msgcenter\eagle_default\in\include\csv-fxfwd_columns.inc
\dynamic\msgcenter\eagle_default\in\include\csv-fxspot.inc
\dynamic\msgcenter\eagle_default\in\include\csv-receive.inc
\dynamic\msgcenter\eagle_default\in\include\csv-sell_columns.inc
\dynamic\msgcenter\eagle_default\in\include\trade_aliases.inc
\dynamic\msgcenter\eagle_default\in\xml\xml-accttrade_multipleleg.xml
\dynamic\msgcenter\eagle_default\in\xml\include\multiplelegtrade_aliases.inc
\dynamic\msgcenter\eagle_default\in\xml\include\multiplelegtrade_common_columns.inc

SDP-10683 : Create new EagleML extract to retrieve a listing of AEW events

A new outbound interface was created for the new ControlCenterEventLog EagleML object.

Feed type: CONTROLCENTEREVENTLOGEXTRACT
Main table: CTRLCTR.EVENT_GROUP
Additional tables: CTRLCTR.EVENT_GROUP_DETAILS, CTRLCTR.QUERY_EVENT_GROUP_TAGS

Supported date filter for extract:
- UpdateDate
Supported own filters for extract:
- eventgroupname (filters on the 'eventGroupName' field, DB field name: EVENT_GROUP.EVENT_NAME)
- eventtaskid (filters on the 'eventTaskId' field, DB field name: EVENT_GROUP.TASK_ID)
- activeflag (filters on the 'activeFlag' field, DB field name: EVENT_GROUP.ACTIVE_FLAG)
- completedflag (filters on the 'completedFlag' field, DB field name: EVENT_GROUP.COMPLETED_FLAG)
- coregroup (filters on the 'coreGroup' field, DB field name: EVENT_GROUP.CORE_GROUP)
- statisticcategory (filters on the 'statisticCategory' field, DB field name: EVENT_GROUP.STATISTICS_CATEGORY)
- statisticname (filters on the 'statisticName' field, DB field name: EVENT_GROUP.STATISTICS_NAME)
- statistictype (filters on the 'statisticType' field, DB field name: EVENT_GROUP.STATISTICS_TYPE)
- businessprocessinggroup (filters on the 'businessProcessingGroup' field, DB field name: EVENT_GROUP.BUS_PROCESS_GRP)

The extract has been added to the eagle_wrf_generic_extract workflow.Sample RTR:

<EagleML xsi:type="AccountingTransactionMessage" eaglemlVersion="2-0" eaglemlType="AccountingTransactionMessage" xsi:schemaLocation="http://www.eagleinvsys.com/2011/EagleML-2-0 eagleml-main-2-0.xsd" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.eagleinvsys.com/2011/EagleML-2-0">
<header>
<messageId>EML-In_TRADE</messageId>
<sentBy>user</sentBy>
<sendTo>http://www.eagleinvsys.com/eagle_ml-2-0_default_cm_control_message</sendTo>
</header>
<taskIdentifier>
<correlationId>EML-In_Conversion_{GUID}</correlationId>
<businessTaskId>EML-In_TRADE</businessTaskId>
</taskIdentifier>
<accountingTransaction>
<header>
<identifier>
<transactionId>ticket4</transactionId>
</identifier>
<objectType>AccountingTrade</objectType>
</header>
<accountingTrade>
<accountingValidationFlag>Y</accountingValidationFlag>
<buySellIndicator>BUY</buySellIndicator>
<mcModeSwitch>N</mcModeSwitch>
<entityId>SMPLE001</entityId>
<accountingBasis>USTAX</accountingBasis>
<primaryAssetId>EQJNZ5516</primaryAssetId>
<primaryAssetType>INTERNAL</primaryAssetType>
<assetResolutionOption>MATCH_ALL</assetResolutionOption>
<tradeDate>20190102</tradeDate>
<settlementDate>20190102</settlementDate>
<sharesParQuantity>300000.0</sharesParQuantity>
<price>100.00</price>
<brokerCode>EAGLE</brokerCode>
<originalTradeTicketNumber>ticketAaBb</originalTradeTicketNumber>
<longShortIndicator>L</longShortIndicator>
<calculateLocalAmountsFlag>Y</calculateLocalAmountsFlag>
<calculateBaseAmountsFlag>Y</calculateBaseAmountsFlag>
<settleInstructions1>xsettleontrade</settleInstructions1>
<tagNochangecase>5032,26,457</tagNochangecase>
</accountingTrade>
</accountingTransaction>
</EagleML>

Files changed:

\dynamic\msgcenter\eagle_default\in\include\csv-buy_columns.inc
\dynamic\msgcenter\eagle_default\in\include\csv-cancel_columns.inc
\dynamic\msgcenter\eagle_default\in\include\csv-capfundinvestments_columns.inc
\dynamic\msgcenter\eagle_default\in\include\csv-conversion_columns.inc
\dynamic\msgcenter\eagle_default\in\include\csv-deliver.inc
\dynamic\msgcenter\eagle_default\in\include\csv-fxfwd_columns.inc
\dynamic\msgcenter\eagle_default\in\include\csv-fxspot.inc
\dynamic\msgcenter\eagle_default\in\include\csv-receive.inc
\dynamic\msgcenter\eagle_default\in\include\csv-sell_columns.inc
\dynamic\msgcenter\eagle_default\in\include\trade_aliases.inc
\dynamic\msgcenter\eagle_default\in\xml\xml-accttrade_multipleleg.xml
\dynamic\msgcenter\eagle_default\in\xml\include\multiplelegtrade_aliases.inc
\dynamic\msgcenter\eagle_default\in\xml\include\multiplelegtrade_common_columns.inc

SDP-10683: Create new EagleML extract to retrieve a listing of AEW events

A new outbound interface was created for the new ControlCenterEventLog EagleML object.

Feed type: CONTROLCENTEREVENTLOGEXTRACT
Main table: CTRLCTR.EVENT_GROUP
Additional tables: CTRLCTR.EVENT_GROUP_DETAILS, CTRLCTR.QUERY_EVENT_GROUP_TAGS

Supported date filter for extract:
- UpdateDate
Supported own filters for extract:
- eventgroupname (filters on the 'eventGroupName' field, DB field name: EVENT_GROUP.EVENT_NAME)
- eventtaskid (filters on the 'eventTaskId' field, DB field name: EVENT_GROUP.TASK_ID)
- activeflag (filters on the 'activeFlag' field, DB field name: EVENT_GROUP.ACTIVE_FLAG)
- completedflag (filters on the 'completedFlag' field, DB field name: EVENT_GROUP.COMPLETED_FLAG)
- coregroup (filters on the 'coreGroup' field, DB field name: EVENT_GROUP.CORE_GROUP)
- statisticcategory (filters on the 'statisticCategory' field, DB field name: EVENT_GROUP.STATISTICS_CATEGORY)
- statisticname (filters on the 'statisticName' field, DB field name: EVENT_GROUP.STATISTICS_NAME)
- statistictype (filters on the 'statisticType' field, DB field name: EVENT_GROUP.STATISTICS_TYPE)
- businessprocessinggroup (filters on the 'businessProcessingGroup' field, DB field name: EVENT_GROUP.BUS_PROCESS_GRP)

The extract has been added to the eagle_wrf_generic_extract workflow.

Sample RTR:

<EagleML xsi:type="RunTaskRequestSync" eaglemlType="RunTaskRequest" eaglemlVersion="2.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<header>
<messageId>CC59ADD40E1E069</messageId>
<sentBy>http://www.client.com</sentBy>
<sendTo>http://www.eagleinvsys.com/eagle_ml-2-0_default_cm_control_message</sendTo>
<replyTo>http://www.client.com/Eagle Control Messages</replyTo>
</header>
<taskIdentifier>
<correlationId>SDP10683_CCE_EXTRACT_${=import java.text.SimpleDateFormat ; new SimpleDateFormat("YYMMddHHmmssS").format(new Date())}</correlationId>
<businessTaskId>AEW_Extract_SC_ALL</businessTaskId>
</taskIdentifier>
<taskTypeEnum>LOAD</taskTypeEnum>
<synchronousExecution>no</synchronousExecution>
<taskParameters>
<taskParameter>
<name>ActionType</name>
<dataType>S</dataType>
<value>EXTRACT</value>
</taskParameter>
<taskParameter>
<name>StreamName</name>
<dataType>S</dataType>
<value>eagle_ml-2-0_default_out_q</value>
</taskParameter>
<taskParameter>
<name>FeedType</name>
<dataType>S</dataType>
<value>CONTROLCENTEREVENTLOGEXTRACT</value>
</taskParameter>

<taskParameter>
<name>eventgroupname</name>
<dataType>S</dataType>
<value>CC-COST-INC-CHG-EXCP-PROCESS</value>
</taskParameter>





<taskParameter>
<name>completedflag</name>
<dataType>S</dataType>
<value>Y</value>
</taskParameter>

<taskParameter>
<name>coregroup</name>
<dataType>S</dataType>
<value>N</value>
</taskParameter>

<taskParameter>
<name>statisticcategory</name>
<dataType>S</dataType>
<value>M-ACCT-PD-CLOSE</value>
</taskParameter>

<taskParameter>
<name>statisticname</name>
<dataType>S</dataType>
<value>RATES</value>
</taskParameter>

<taskParameter>
<name>statistictype</name>
<dataType>S</dataType>
<value>ALL</value>
</taskParameter>

<taskParameter>
<name>businessprocessinggroup</name>
<dataType>S</dataType>
<value>ALL</value>
</taskParameter>
</taskParameters>
</EagleML>

Added files:
extract_int_control_center_event_log.inc
extract_int_control_center_event_log.xml
t_int_control_center_event_log_streaming.inc
t_int_control_center_event_log_streaming.xml

...

SDP-14727: ENTITYENTITLEMENTLISTEXTRACT - Missing ObjectionDescription ObjectDescription in Output for MC Classic

Missing mapping for The objectDescription field has been added in the extract transform rule for EntityEntitlementList.

Changed files:
t_ref_entity_entitlement_list_streaming.xml
t_ref_entity_entitlement_list_streaming.inc

...

SDP-14354: EntityShareClass, EntityStatistics, EntityRating - fix minor output and grouping issues

The ENTITYSHARECLASSEXTRACT, ENTITYSTATISTICEXTRACT and ENTITYRATINGEXTRACT were all updated to correct identified output and to improve the grouping of the data.

ENTITYSHARECLASSEXTRACT - EntityShareClass:
The EntityShareClass extract contained an empty heldAsset node.
Transform The transform rule has been updated to not output produce an empty node if there is no information inside.

EntityRatingENTITYRATINGEXTRACT - Entity Rating:
The EntityRating extract transform rule didn't did not group records by source, as a result invalid by XSD EagleML could be created against what is defined in the XSD.
Source The source field has been added in the grouping for the EntityRating interface in the extract transform rule.

ENTITYSTATISTICEXTRACT - EntityStatistics
EntityStatistics extract The EntityStatistic extract transform rule didn't did not group records by source, as a result invalid by XSD EagleML could be created against what is defined in the XSD.
Also The effectiveDate field didn't have was updated to include mapping.
Source The source field has been added in the grouping for EntityStatistics the EntityStatistic interface in the extract transform rule and added mapping for effectiveDate field.

Changed files:
t_entity_share_class_streaming.inc
t_entity_rating_streaming.inc
t_entity_statistics_streaming.inc

SDP-15920 15920: Workflow_restart stream isn't failed if not failing if the underlying workflow is failed

The issue Logic was enhanced to ensure that the corresponding event and schedule for the schedule-based workflow did not get correct status in case when underlying workflow fails.The issue has been fixed by setting the overall status of the workflow as FAILED in case when CreateConsolidatedTSR is defined as Y and underlying steps have errorsget the correct status when the underlying workflow fails.

Changed files:

task_reporter.xml
workflow_restart.xml

SDP-10820: EJM: Adjust eagle_ml-2-0_default_cm_sequencer to have correct out of order logic

The sequencer logic was enhanced to sort the queue of workflow instances waiting for processing.

This allows processing out of order instances in correct sequence from smaller to biggerlarger.

Modified file:
sequencer_orch.xml

SDP-15048: EagleML: Source interface has an issue with long sourceName

Added logic to check that the value of the sourceName element does not exceed 15 characters during the Source Interface load.

Files changed:
xml-ref_source.xml

SDP-12457 12457: Incorrect error message for WarehousePosition

Wrong security identifiers could be displayed in TSR when When the warehouse position load fails in the Batch mode, incorrect security identifiers may be displayed in the TSR.
Changed errors
The error processing for the batch mode was revised. Error The error returned by from the database will be displayed in the TSR because it has with the correct identifiers.

Modified file:
xml-dbdirect_error_msg.inc

...

SDP-9276: Curl error during moving several extract files

If When split extract file logic is used applied (For example MicroBatchKeyRecordCount parameter) and the deliveryMethod is configured as (S) FTP, several files could may be generated
as a result of the extract. In this case there was a problem that only one file was sent to the destination.

...

SDP-15121: Incorrect dynamic entity list resolution in extracts when the definition includes the Accounting System Description

Extract The extract rules were not correctly resolving dynamic entity lists when the list definition included the Accounting System Description field.

New A new type of EntityList resolution has been added, it uses dynamic query instead of stored procedure.
Added a new value for the parameter 'entityselectiontype' for switching between Entity List resolution modes.

...

There were a number of fields that were missing in the Generic Issue Analytic extract.

The Generic Issue Analytic interface has been updated to extract these fields.

Following The following models were changed:

analyticsUserModel (SECURITY_USER_ANALYTICS table) - userSaChar16 - userSaChar30 were not loaded on MSSQL environments version 2017
Meta information has been updated for this model, to load these fields on MSSQL environments.

ePSEquityModel (SECURITY_EPS_EQUITY table) - only epsEst1X and epsEst2X elements were supported on Oracle environments. The model wasn't was not supported on MSSQL environments.Added processing of ePSEquityModel for MSSQL. Added all fields for the model described in XSD for Oracle and MSSQL to load and extract.

priceEarnEquityModel (SECURITY_PRICE_EARN_EQUITY) - The model wasn't was not supported on MSSQL environments.
Added processing of priceEarnEquityModel for MSSQL.

Changed files:
call_eagleml_dbml_request.inc
eagleml_ref_genericissueanalytic.xml
generate_sp_on_fly.inc
t_generic_issue_analytic.xml
t_generic_issue_analytic_streaming.inc
xml-ref_genericissueanalytic.xml

SDP-12935: provide Provide a possibility to exclude files from WAITEVENTS.DAT queue

Previously user wasn't User were not able to remove records about files waiting to be processed.
Information about waiting workflows and files waiting for the launched workflows stored in WAITEVENTS.DAT file or
in the data base database (if parameter W_WAITEVENTS_DATABASE_MODE = Y in the w_config_custom.inc) are now available.

Functionality to cancel wait event based on the file name (FileName) or WaitEventCorrelationId has been added.
When a user sent sends a RTR with WaitEventCorrelationId or CancelRemoteFileName and , this value match with will wait for the event state record,
then and the waiting file for the workflow will be canceled.

Ability Added the ability to update the file statistic information for the canceled files when the file statistic is available
(W_ENABLE_EXTENDED_FILE_STATISTICS = Y is set in w_config_custom.inc) was added.
if W_WAITEVENTS_DATABASE_MODE = Y then canceled files will be transferred from {workflow_name} _wait_queue (queue for waiting events) to {workflow_name} _error_queue (queue for canceled events)

...

SDP-17577: WRHSOPENLOTEXTRACT and WRHSPOSITIONEXTRACT - MSTARDIRECT source with IncludePortfolioValuation set to Y or ALL failing

When the Source is was passed in as 'MSTARDIRECT', the extract SQL query was generated incorrectly when the IncludePortfolioValuation was included.

Fixed the error of executing of Warehouse Position and OpenLot extracts with parameter 'IncludePortfolioValuation' = Y or ALL and Source filter = 'MSTARDIRECT'.
Changed rules:
- extract_holding_ext_port_valuation_fields.inc

SDP-15207: EagleML: Warehouse Rollback functionality shouldn't should not use the CorrId from the file name(XMLDBAPI)
SDP-15191: EagleML: Warehouse Rollback functionality shouldn't should not use the CorrId from the file name(EagleML)

Roll Up rule handled correlationId value in the incoming file name for the Rollback functionality.
This value was used in the query The usage of the correlation id from the file name for checking which sub batches had failed on the load and run a roll back for the whole batch was proven reliable because the correlationId should be in exact place in the file name.

Only the correlationId in the file name can link key and data files related to the one process instance.
This method was not reliable because correlationId should be in exact place in the file name.process instance.
This approach was replaced by adding correlationId value on the Python transformation step in the files itself.
Now key and data files have an additional value CORRELATION_ID(XMLDBAPI) and taskIdentifier/correlationId (EagleML).
It helps to link key and data files related to the one process more reliable, because each process has a unique correlationId.

Changed files:
include/xml-warehouse_common.inc
xml-dbdirect_invar.xml
xml-dbdirect_invar_rollup.xml
xml-warehouse_v2.xml

...

There was a problem with extension processing when fieldCompareFlag = Y, because the insert\update to into the extension table happens in a separate DB call and as a result database call resulting in the extension and core tables could not be being in sync.

The new implementation allows to extend the core stored procedure to support loading extension fields and which will keep the extension and core tables in sync.
Please note: To activate this logic and switch to the new processing some manual steps are required .
They have to be done only once, please visit confluence page about to be setup as a one time activity. Request additional information located on the confluence page defining extensions.

Changed files:

...

SDP-10059: Issues with EXPENSEACTIVITYEXTRACT

The Expense Activity Extract does did not report any error in case mandatory an error when the required filters reportStartDate and reportEndDate were not specified.

Correct A parameter handling check was added so that appropriate error message is returnedto return an error message if the filters are not part of the request.

File changed:
extract_acct_expense_activity.inc

...

SDP-17578: WRHSOPENLOTEXTRACT and WRHSPOSITIONEXTRACT - Malformed XML

Issue There was an issue identified in grouping in for the Warehouse Position and OpenLot extracts when using the ‘IncludePortfolioValuation’ was with a value set to Y or ALL when more than one price information exists for the specific position.PortfolioValuation . The data appear as an outlier, but to handle this inconsistency, the PortfolioValuation logic has been enhanced and a new repeated node pvAssetPrice was added in the extendedPortValuationModel to address when more than one price / source combination exists for the specific position.

This model will describe all prices which exist for the specific position.

...

Versions Compared

Old Version 6

New Version Current

Key