MC2 Release Notes - July 27 2023

Component versions

Version to request for All Services install: 2023.07.27.1

EAGLEINSTALLER 2023.07.27.1
EAGLEML 2023.07.27.1
EAGLEML-W-O 2023.07.27.1
EXTRACTSERVICERULES 2023.07.27.1
IMPORTSERVICERULES 2023.07.27.1
MC2 2023.4.2
kafkaservice 2023.3.1
pypy 2022.10.2
pyruleservice 2023.7.30

openjre:
openjdk version "11.0.16" 2022-07-19
OpenJDK Runtime Environment 18.9 (build 11.0.16+8)
OpenJDK 64-Bit Server VM 18.9 (build 11.0.16+8, mixed mode)

pace report service (installed separately):
pace-reportservice-1.0.10.jar

SDP-75727 Regression issue with SDP-68320

Regression issue with EDS accessing data in footer

There was a regression issue in June 2023 MC2 release regarding enhancement made under

SDP-68320 Allow users to access data that is stored in footer

SDP-75671 OLAP REST API - Implement ODBC Driver Upgrade

OLAP REST API upgraded to use ODBC driver

OLAP REST API has to upgrade to ODBC driver ojdbc6-11.2.0.jar which was downloaded through eagle-spring-boot-starter as dependency. Its updated from eagle-spring-boot-starter to cmp-mc2-spring-boot-starter, version: "1.0.11", this version has ojdbc10-19.3.0.0.jar as dependency . There is no functional changes in Pace-reportservice.

SDP-75499 Issue with producing empty output file when using EDS pipe

Enabled empty output files with EDS pipes

Enabled use of allowemptyfiles attribute in custom resource definition for pipes.

This attribute indicates that an empty result file should be produced instead of returning a NO_DATA status.

Example:

"pipes_def":[
["pipe", "STEP", {}, ["ActionType","'EBS'","FeedType","'sdp75499_example_mmap_custom'","OutputFormat","'EagleML'",
"allowemptyfiles","'y'",
"OutputFormatDialect","'

{\"delimiter\":\"|\",\"rowdelimiter\":\"\\\\n\",\"hasheader\":\"Y\"}

'"],["True"]]
]

SDP-75102 Enable ontology to handle forward slash in source field name

Forward slash escaping logic was enhanced

For columns with / in the name escaping logic was enhanced

Escaping logic was added to the taxonomy of the transparent rules, so in case of transparent rule column will be correctly mapped to the column with the escaped name

Escaping char was changed from | to ~ to prevent issues with the mapping, as data rules use 2 | symbols, e.g. |column_name|, to separate one column name from another in the processing rule, so third | char in the middle of the column name was breaking column names parsing logic

SDP-50438 Improve error message when vendor_credentials.json file is missing

Returning informative error message in case of missing vendor credentials