Background:
Map files are used by NDFA stream (eagle_ml-2-0_default_cm_ndfa) to find correct workflow for incoming file based on the file mask.
Map files are automatically created when you publish a bundle-based workflow which contains data artifact shapes for external data.
Map files for IWS workflows and for profiled loader workflows are stored in tpe/dynamic/msgcenter/eagle_ml-2-0_workflows and tpe/dynamic/msgcenter/profile/loads folders correspondingly
Challenge
With large number of bundle-based processes and loader profiles it becomes increasingly difficult to manage the map files –to ensure proper routing and avoid any conflicts in wild cards.
Feature
To make map file management easier, we created new screen, where all the mappings can be viewed and researched in one place.
To access this form, open EJM Monitoring Tool and go to "Maintenance -> EJM Map Files"
The form shows you the list of maps in the order how they would be searched/applied when a data file arrives to NDFA stream.
You can filter the list by providing the following values (or parts of them):
- File Mask,
- Target Workflow name
- Map file name (one map file can have multiple maps defined inside)
Another very useful feature is ability to 'dry-run' the routing. It allows to you to determine which file mask would apply to specific file name, and to which workflow it would be redirected.
Just paste the file name into the "Routing Check" edit box, and the grid will automatically show only matching file masks.
Note: the masks in the first column of the grid work as if they were enclosed in asterisks.
In our specific example, file name prior_nav_data_20210506.txt would match the mask nav_date and would be routed to am_concat workflow for processing.
If you hover the mouse pointer over a line, pop-up hint window will display the content of the map file for you.
Using context menu on the grid will allow you to copy one of the following values into exchange buffer:
- File Data – full content of map file
- Map File Name
- Mask
From the same context menu you can Disable or Enable a specific mask.
After such change, it is not necessary to restart any services or even refresh Message Center cache.
The changes take effect immediately.
Add Comment