Guides

Modeling Dataflows - NEW! 🚀

Suggest Edits

Modeling a dataflow means to enrich it with specific information so that it becomes more meaningful to business users.

Modeling features include:

  1. labeling of specific business flows so that they are recognized for a function
  2. management of the arrival of files
  3. processing of files on specific nodes through cut-offs
  4. definition of dataflow matching rules

Going to Design > Dataflow Models, the list of existing Models will appear.

🚀 This page lists existing dataflow models, together with the indication of whether they are a Master or a Draft version, the number of matching criteria they have, dataflow and cut-off notifications and their status.

If you are looking for specific dataflow models, use the Filters panel on the right to run a query with specific criteria. E.g., the name of the Model, the notification status (ON or OFF), the name of the node where the Model was created, the type of node (Data One, Spazio, FTP, SFTP, etc.) or the dataflow attribute.

By clicking the 3 dots icon on the right of the row, a menu will appear with options to enable or disable Dataflow/Cut-off notifications or view the model in the Dataflow Modeler page.

Note that the status of the Dataflow or Cut-off notifications can be enabled or disabled also when having multiple models selected. In this case, go to the Select drop-down list and choose the option you need.

To create a new model, click the NEW button. The Dataflow Modeler will be displayed:

The Dataflow Modeler toolbar

At the top of the Dataflow Modeler board there is a toolbar with these options:

The NEW button
The NEW button is used to... open a portal to a parallel universe. No, we are kidding, the NEW button unsurprisingly creates a new Model from scratch.

The LOAD button
Check out how to retrieve already existing Models here.

The RELOAD button
We know you would never make mistakes, but if you do, use the RELOAD button to restore the Model to the last saved version.

The SAVE button
Never forget to save your Models! Click on the SAVE button and choose whether to save the Model as Draft or, once you have saved it at least once, promote it to Master. What are you waiting for? Save now!

The SECURITY button
The SECURITY button is used to authorize specific Users or Groups to access Models. See Authorizing Users or Groups to access models.

The TOOLS button
The TOOLS button allows you to access these options:

  • Enable/Disable Model
  • Export Model
  • Upload Model

Enabling and disabling master version models
A master version model cannot be deleted but it can be disabled selecting TOOLS > Enable/Disable Model.
The model status is shown in the Dataflow Properties panel.

Details about the Master version can be found at the page Dataflow Model lifecycle.

Exporting models
To export a model, follow these steps:

  1. Go to Design > Dataflow Models > NEW and click the LOAD option.
  2. Load a model from those listed.
  3. Click the TOOLS menu and select EXPORT MODEL.
  4. The model will be download as .txt file on your local disk.

Uploading models
To upload a model, follow these steps:

  1. Go to Design > Dataflow Modeler and click the TOOLS > UPLOAD MODEL option.
  2. Click the UPLOAD button.
  3. Browse your local drive to locate the model (it must be a .txt file) and upload it.
  4. Click the CONFIRM button to proceed with the upload.

Warning!

It is recommended importing only models previously exported by Primeur Data Watcher.

The VIEW button
Use the VIEW button to zoom on your Model.

Details about the Dataflow Model lifecycle, how to create a data model from scratch, how to retrieve existing flow models and restore a flow model are available in the following pages, together with Dataflow and Node Properties panels.

Dataflow Properties panel

The Dataflow Modeler board is provided with a Dataflow Properties panel on the right.

This panel has 5 separate sections, which can be accessed clicking these icons:

Click theicon to access the Dataflow details panel listing these options:

  • Business Name: name assigned to the Model.
  • Model Enabled: this option can be changed clicking the Tools icon on the Toolbar.
  • Draft Version: if checked, this model is a Draft Version. This option is read-only and cannot be updated.
  • Dataflow Notifications: use this section to set alerts and their status. Click the ADD button next to Completion and error notifications to create a new alert. In the New notification window enter a name for the alert, select the event you want to be notified about (flow completed and/or flow in error) and choose the channel that will be used for the alert among those listed. For the System Email Notification Channel, at least a valid email address must be entered.

Click the icon to access the Dataflow attributes panel. Dataflow attributes must be configured by Administrators – see Attributes for details.
The asterisk * next to the attribute value means that the attribute is mandatory: at least one value must be specified or selected.
If the attribute is an Open type, you will be able to add new values when filling in this Dataflow Modeler section – refer to Attributes for details about Open and Close attributes. To add a new value, type the value in the edit box and select the Add option.
When selecting a value, the list of existing values will be shown.

Click theicon to access the Matching criteria panel. If you want to know more about Matching Criteria follow this link. Learn how to set them here.

Capt. Eddie to ground control:

"Remember that at least one Matching Criteria is required to create a Model!"

Click theicon to access the Dataflow cut-off panel. You can learn more about cut-offs here.

Click theicon to access the Dataflow Interface settings panel listing these options:

  • Resizable nodes: if checked, the node can be resized.
  • Draggable nodes: if checked, you can drag the node.

Updated 4 months ago