draft - Upload CSV Data File into a Region

There are several ways to upload (ingest) your data file into the region. We are going to cover two of them in this article.

Option 1: Using Run button.

1. Click Run button in the ribbon.

2. Select data file from a local folder by pressing ellipsis button (...) in the Run dialog

       3. Click Run button in the dialog.

4. View load details in the EJM Processes tab.

After you click Run button, a new tab "EJM Processes" will automatically appear. It will contain the processing details of the solution.

You may need to click "refresh" button to update the information during the execution.

You will be able to access this information later by running Monitoring Tool application. It can be launched from Solution ribbon in IWS.

Option 2. Using file name in the Run Task Request (RTR) message.

Option 1, described above is very useful for testing the workflow in development stages.

After your workflow was developed, tested and deployed to PROD region, the way you deliver data to your application will change.

It is expected that data files will be uploaded to the region automatically, and then the load gets triggered by sending a control message (a.k.a Run Task Request message) to Message Center.

The default location for data files in this case is tpe/data/msgcenter/cmw/in ,

To upload your data file into this folder you can use helper stream eagle_ml-2-0_default_cm_data_load_cmw_in in Automation Center:

Message Center stream, which processes RTR messages is eagle_ml-2-0_default_cm_control_message

To upload your CSV data file to a region, you can use the "eagle_ml-2-0_default_cm_data_load_cmw_in" stream.

Follow these steps:

1. Open Message Center Editor.
2. Find the stream "eagle_ml-2-0_default_cm_data_load_cmw_in" , right click on the stream and select "Send Data…".
   

3. Select your file in dialog window and click send. And after those actions your file will be uploaded on the region.

   Run the Load process for XML only from IWS. Do not start it from Message Center!

4. After the Publish click  "Run" in a top menu area under the Raw Service tab:
   

5. You can set the parameters of load process. 

   Delivery method – where is your data file:
   FILE – on current region (should be located in "/cmw/in/" folder);
   FTP/SFTP – on FTP/SFTP server (should be located in folder which was set in parameter: FTP_FILES_LOCATION/SFTP_FILES_LOCATION in "w_config_custom.inc" file).
   File Name – name of data file.

   

6. Click "Run" at the bottom.
   The Load processes will be run for all Models. 1 Load Process loads 1 Model.
7. You can run your feed and with file from your machine.
   Switch to tab "Data File":
   
8. Select your file and click "Run":