...

Streaming translators are used for big source files (100Mb 100MB or more) and work faster than classic translators. The main benefit is significantly smaller memory consumption. Streaming allows not to load the whole file or even any sizeable chunk into memory.

...

Icon of the streaming translator:

Here is an example of setting up a streaming translator:

1. Open IWS and create a simple solution with Task Translator:
   
2. Create new transformation (for example, CSV2STAR) in task translator:
   

3. Add simple data for both source Source and Destination and select “streaming” in Streaming at the top of the window:
   

   Info
   title Note
   Oonce u select Once you have selected a streaming translator? , you cant cannot change it. Also, if you did not select "streaming" in current phase you cant change have not toggled Streaming as shown, you will not be able to change it later

   
   

4. Click “Apply” Apply.
   
   
   

   It’s the “mapping” worksheet.

5. For the streaming translators we able to you can use “Preproc” worksheet (for example we can , to add a debug status for testing). Logic in the “Preproc” tab is executed before the incoming file is processed:
   

   Note

   Info
   title
   This worksheet already have has the “Data Query” Data Query shape created for handling incoming parameters. It’s It is created automatically

   
   

6. Also, we You can also use the “Postproc” feature on of the worksheet (for example, to add a status shape for debugging). It is analogue of works like “Result Output translation” for regular translators:
   

Python Translators

Prerequisites (this items should be please make sure these items are installed on box):

1. MC square
2. PyRuleService

Currently a , python translator translators are under development, but it is they are the only way to create a translator for incoming source files exceeding 2 GB2GB.

Restrictions for python translation:

1. Currently available only CSV2EagleML translations.
2. Available only Only direct mapping available

For turn on python translator user need turn on the “Python Translation” checkboxpython translators you should switch to “Python Translation” when you create the translator: