EagleML Release Notes - February 8, 2024

Enhancements

SDP-81338 The Data Load to EDS Extensions via Core Stored Procedures was Enhanced

The EDS resources that using a core stored procedure for Oracle load didn't support extensions for load. A Code change was applied to support EDS extensions in case a core stored procedure is being used for Oracle load.
The following resources were updated to supported extension for Oracle:

  • warehousecashactivity - the PK for extension table is CASH_IN

  • genericsmf - the PK for composite extension tables is SECURITY_ALIAS and SECURITY_ALIAS, EFFECTIVE_DATE, SRC_INTFC_INST for history extension table

  • genericentity - the PK for composite extension table is ENTITY_ID and ENTITY_ID, EFFECTIVE_DATE for history extension table

Files changed:
src/eagleinvsys/rdf_metadata/rdf_meta_enum.py
src/eagleinvsys/rdf_metadata/rdf_meta_templates_processor.py
src/eagleinvsys/rdf_metadata/rdf_meta_utils.py
metadata/core/ontology/templates/eagle_ent_genericentity_insertupdate.txt
metadata/core/ontology/templates/eagle_ref_genericsmf_insertupdate.txt
metadata/core/ontology/templates/eagle_wrhs_warehousecashactivity_insertupdate.txt
metadata/core/ontology/templates/eagle_wrhs_warehousecashactivity_reinitbatch.oracle.txt

SDP-81336 The Conversion Workflow Queries were corrected for client and entityshareclass resources within EDS

The below changes were applied as part of Conversion Workflow:

  • client resource: unused tables were removed from data conversion query

  • entityshareclass resource: the EFFECTIVE_DATE is used for data conversion query

SDP-80693 The Conversion Workflow was updated with a default parameter called OutputFormatDialect

Default OutputFormatDialect parameter was added to Conversion workflow:

{{{"delimiter": "|", "rowdelimiter": "\n", "hasheader": "Y"}}}

SDP-80004 The status information for true rebook in the AccountingTrade object was improved

Tags 41 and 91 are ignored in Rebook logic when Sink Flag (1780) = N for security. Now this message appeared in statuses in appropriate case:
“Sink Flag in security is not set to Y. Tags 41 and 91 will be ignored in Rebook logic.” Also, if Sink Flag in security is not set to Y, tags 41 and 91 are marked with “diff=1” in comparison status, because they are ignored.

Files changed:
eagle_default/in/include/accttrade_true_rebook.inc

SDP-79878 Signage changes for Closeswap and TRRESET events

The SETTLE_AMOUNT_BASE and SETTLEMENT_AMOUNT signage logic has been changed for the below events. If signage logic is applied these fields will now be shown differently in term of signage.

MTCLOSESNNCLOSESWAPY -RECPT
MTCLOSELNNCLOSESWAPY -DISB
MTCLOSESYNCLOSESWAPCANCELY --RECPT
MTCLOSESNNCLOSESWAPY
TRRESET RECPT
TRRESET DISB

files changed:
tpe/dynamic/msgcenter/eagle_ml-2-0_cm/out/tagvalue/extract_warehouse_trade.inc
tpe/dynamic/msgcenter/eagle_ml-2-0_cm/out/tagvalue/extract_warehouse_washsale_trade.inc
tpe/dynamic/msgcenter/eagle_ml-2-0_cm/out/tagvalue/extract_wrhs_trade_signage_logic.inc

SDP-79670 Reprocessing is available for single record failed on DB step during load

Reprocessing which may have filed in reprocessing is fixed for records which failed on DB insert step. The original line is correctly put into message for reprocessing.

Note: this functionality is provided only for single-record load. In case of multiple records loaded in single incoming message and multiple DB failures, issues can occur. For this fix another item is created:

Files changed:
common_core\descriptor\dbdescriptor.py

SDP-79123 The warehouseperformance resource was enhanced to support data load to Oracle

The warehouseperformance EDS resource has been enhanced to allow load to Oracle using the core stored procedure PERFORMDBO.EGL_GEN_PERFORM.PRF_EGL_GEN_INTERFACE

Files changed:
metadata/core/ontology/templates/db_oper/snowflake/warehouseperformance.reinit_batch_many.sql
metadata/core/ontology/templates/eagle_wrhs_warehouseperformance_reinitbatch.oracle.txt
metadata/core/ontology/templates/eagle_wrhs_warehouseperformance_rollup.oracle.txt
metadata/core/ontology/warehouse/warehouseperformance-models.json metadata/core/ontology/warehouse/warehouseperformance_in.json

Files added:
metadata/core/ontology/templates/eagle_wrhs_warehouseperformance_insertupdate.txt

SDP-79048 Added Share Class and Class Hedging support for AccountingTrade load and extract

New elements Share Class and Class Hedging have been added to AccountingTrade load and extract interfaces for forward and spot trades.

Xpath and tag:
EagleML/accountingTransaction/accountingTrade/shareClass - Tag 34
EagleML/accountingTransaction/accountingTrade/classHedging - Tag 18045

Class Hedging is not stored in database, so only Share Class could be extracted.

Files changed:
eagle_default\in\include\trade_aliases.inc
eagle_default\in\include\csv-fxfwd_columns.inc
eagle_default\in\include\csv-fxspot.inc
eagle_ml-2-0_cm\out\tagvalue\extract_financial_event.inc
eagle_ml-2-0_cm\out\xml\t_accounting_trade_streaming.inc

SDP-77737 The Settlement Amount fields (local and base) in the extract logic for SWAPS for Signage were updated for signage

The signage logic for Settlement Amount Base and Settlement Amount Local was updated in the extract logic to enrich the support of Swaps for signage.
Files changed:
estar/tpe/dynamic/msgcenter/eagle_ml-2-0_cm/out/tagvalue/extract_wrhs_trade_signage_logic.inc

SDP-68673 EDS issuerrating and rating resources mapping was enhanced

The SUBMITTED_DATE field type was changed from Date to DateTime for issuerrating and rating resources. Mapping for sourceName for Oracle load via Stored Procedure was added. Minor issues in parameter names were also corrected.

Files changed:
metadata/core/ontology/eagle-vocab-ref-shared.json
metadata/core/ontology/reference/issuerrating-models.json
metadata/core/ontology/reference/issuerrating_in.json
metadata/core/ontology/reference/rating-models.json
metadata/core/ontology/templates/eagle_ref_issuerrating_insertupdate.txt
dynamic/metadata/core/ontology/templates/eagle_ref_rating_insertupdate.txt

Production Bugs

SDP-82327 AccountingTrade forward fixed to map securityType

The Inbound interface for AccountingTrade was updated to map EagleML/accountingTransaction/accountingTrade/forward/securityType (tag 82) in SECURITYDBO.SECURITY_MASTER.SECURITY_TYPE . It is one of elements which we send to panel while security generation for forwardPrimaryAssetGenerationIndicator=System Generated.

Files changed:
eagle_default\in\include\csv-fxfwd_columns.inc

SDP-82085 Enhanced currency resolution for IssueFxRate Object

The IssueFxRate interface was enhanced to prevent incorrect security alias resolution for currency. If the processingSecurityType is not specified in the data file for fromCurrency and/or toCurrency, it will now use CRCRCR value in resolving as default.

Files changed:
eagle_default/in/xml/xml-ref_fxrate.xml

SDP-81871 Corrected syntax of expression causing tag 5533 to have null mapping value

There was a bad expression in the mapping of tag 5533 which caused the rule file to have empty mapping for the field which could cause errors when processing trades needing tag 5533. The syntax was changed so that upon next deployment the expected logic in tag 5533 will be applied and available in processing.

Files changed:
msgcenter/eagle_default/in/include/csv-buy_columns.inc
msgcenter/eagle_default/in/include/csv-sell_columns.inc
eagle_ml-2-0_cm/out/tagvalue/realtime_ejm_stat.xml

SDP-81046 Updated Preserve Null logic for GenericSMF Stored Procedure mode

The element preserveNull is working now for GenericSMF SP mode when accountingValidationFlag=N.

By default, Preserve Null feature is off for SP mode if you don’t send preserveNull element in a message. A new global configuration was added to change default value for this feature. The config can be set up in w_config_custom.inc file:
<CODE>
:W_PRESERVE_NULL: := 'Y';
</CODE>
If W_PRESERVE_NULL is Y, then Preserve Null is switched on by default if message doesn’t have preserveNull element.

Examples of usage, to set different target nodes to null:
string - null: <userGroupChar1>NULL</userGroupChar1>
numbers - lowest integer: <equityFloat1>-2147483648</equityFloat1>
dates - 0001-01-01: <userGroupDate1>0001-01-01</userGroupDate1>

Files changed:
eagle_default\in\xml\xslt\smf_egl_gen_interface_template.xsl
eagle_default\in\xml\xslt\smf_sector_egl_gen_interface_template.xsl
eagle_default\in\xml\xslt\eagleml_smf_gen_fields.xsl
eagle_default\in\xml\include\generic_smf_fields_logic.inc
eagle_default\in\xml\include\msgxchg_sec_core.inc
eagle_default\in\xml\include\referenceobject.inc

SDP-80258 Tag55 for AccountingTrade is correctly passed into reprocessing

EventType (tag55) is added before entity and security resolutions. This change fixes the issue when event type is not specified in exceptions for failed trade in Automation Center. Prior to this change, the rejection did not contain tag 55 therefore could not be used in rejection reprocessing rules.

Files changed:
eagle_default/in/xml/include/multiplelegtrade_common_columns.inc