...
SDP-38015 Revise 5 EDS Interfaces to have correct EML Elements for Cloud Ingestion
5 interfaces were fixed
Codevalue interface:
"ebsCodeCategoryInstance" and "ebsCodeValueInstance" columns were removed from the codevalue interface.
Genericsmf interface:
It will be fixed when new metadata will be generated.
Reportdictionary interface:
"reportDictionarySrc" and "Type" columns were removed from the reportdictionary interface.
Warehouseperformance interface:
SRC_INTFC_INST srcIntfcInst dictionaeryItemId dictionaryItemId
Also fixed type of dictionaryDetailId and of all above fields as a number.
Issuer interface:
There are columns that were removed from the issuer interface:BOND_DUMMY_1CITY_1EFFECTIVE_DATE_1EQUITY_DUMMY_1FROM_ISSUER_ALIASINSTANCE IRD_CHAR2IRD_UPDATE_SOURCEISSUER_ALIAS_1ISSUER_ALIAS_2ISSUER_ALIAS_3 LEILEI_1PERCENT_OWNED_1RELEASE_DATERELEASE_DATE_1RELEASE_STATUSRELEASE_STATUS_1 ROLE_ALIASROLE_TYPE_1SRC_INTFC_INSTSRC_INTFC_INST_1STATE_1 TO_ISSUER_ALIASUPDATE_DATE_1UPDATE_DATE_2UPDATE_DATE_3UPDATE_SOURCE_1UPDATE_SOURCE_2UPDATE_SOURCE_3UPD_DATEUPD_SOURCE
Renamed fields:
ALPHA_RATING -> alphaRating
COUNTRY_CODE -> countryCode
ENTITY_STATUS -> entityStatus
ID_ASSIGNED_DATE -> idAssignedDateID_CERTIFICATION_STATE -> idCertificationStateID_DISABLED_DATE -> idDisabledDateID_LAST_UPDATE_DATE -> idLastUpdateDateID_RECORD_STATE -> idRecordState
ISSUER_PHONE -> phone
LEGAL_FORM -> legalForm
LEGAL_NAME -> legalName
STREET -> street
ZIP -> zip
ISSUER_PHONE -> phone
...
Add new t-item SourcePreproc in EDS definition. This t-item performs replace of incoming values in specified columns according to specified rules.
Example:"t_items_def": [["source_row_col_value_replace", "subst_values", [{"column": "alpha_", "map":
{"ALPHA1": "ALPHA_#1"}
, "use_expr": false},{"column": "score_", "map":
{"N/A": "-500", "N/R": "-600"}
, "use_expr": false},{"column": "rating", "map":
{"N/A": "-123", "N/R": "-456"}
, "use_expr": false},{"column": "col", "map":
{"N/A": "-888", "N/R": "-999"}
, "use_expr": false}]]],
Make replace in columns with mask alpha_ - replace ALPHA1 by ALPHA_#1Make replace in columns with mask score_ - replace N/A by "-500" and replace N/R by -600 Make replace in columns with mask rating - replace N/A by -123 and replace N/R by -456 Make replace in columns with mask col - replace N/A by -888 and replace N/R by -999
...
Methods for generation JSON\XML output were optimized and logic for calculating nested nodes was moved to initialize step instead of calculating it during processing each row. Now these methods are simpler and slightly faster 10-15% than it was before. Also support of nested nodes was added for JSON output.For CSV output new option in target format dialect was added: encode_header = Y\N ( Default = N)When this option is Y header in CSV file will encode / symbols to _ .<taskParameter><name>OutputFormatDialect</name><value>
{"delimiter":",","rowdelimiter":"\n","hasheader":"Y", "encode_header":"Y"}
</value></taskParameter>
Example:"encode_header":"N"
sourceName,entityId,accountingBasis,market/marketValueLocal,market/marketValueBase"encode_header":"Y"
sourceName,entityId,accountingBasis,market_marketValueLocal,market_marketValueBase
...
SDP-27760 Profile inheritance - getting full profile stack
...
Enabled publishing raw or translated inbound data files from MC Classic Generic Loader.The destinations may be sftp or cloud and are identified in distribution profiles.Details: https://eagledocs.atlassian.net/wiki/spaces/MC2/pages/1389559809/Publishing+Inbound+Data+Files+In+Generic+Loader
...
SDP-35590 EQL requests must have more details in console (DB)
...