SDP-41679 Change the EQL endpoint to use Kafka to communicate with EDS directly from MC2 LoadBalancer
Add ability for MC2 to process EQL endpoint REST requests through kafka
Added the ability for MC2 to process EQL endpoint REST requests directly through kafka for improved throughput.
Performance tests indicate a 5x improvement in performance of EDS requests via the EQL REST endpoint.
Note: REST requests to the EQL endpoint will no longer be visible in EJM Tasks tab as the message detail is no longer written to database.
The new functionality may be fully reverted by adding to or creating estar/tpe/dynamic/mc2/cfg/extractservice.yml with the below and restarting extractservicelb:
---
spring:
profiles: extractservice-lb
application:
name: extractservice-lb
eagle.eaglemlrestapi.services.EQL.directexecution: false
...
SDP-44624 Asynchronous Task update does not remove the task information from REDIS, leading to a memory leak
...
- estar/tpe/dynamic/metadata/core/ontology/entity/entityshareclass.json
- estar/tpe/dynamic/metadata/core/ontology/warehouse/entityshareclass-models.json
- estar/tpe/dynamic/metadata/core/ontology/warehouse/entityshareclass_in.json
SDP-41679 Change the EQL endpoint to use Kafka to communicate with EDS directly from MC2 LoadBalancer
Add ability for MC2 to process EQL endpoint REST requests through kafka
...
...
SDP-37394 Python XML2XML: Add possibility to use incoming value from parameter outfilepattern in settings of the additional destination
...