Primeur Online Docs
Data Shaper
Data Shaper
  • 🚀GETTING STARTED
    • What is Primeur Data Shaper
      • What is the Data Shaper Designer
      • What is the Data Shaper Server
      • What is the Data Shaper Cluster
    • How does the Data Shaper Designer work
      • Designer Views and Graphs
      • Data Shaper Graphs
      • Designer Projects and Sandboxes
      • Data Shaper Designer Reference
    • How do the Data Shaper Server and Cluster work
      • Data Shaper Server and Cluster
      • Data Shaper Server Reference
    • VFS Graph Components
      • DataOneFileDescriptor (DOFD) metadata
      • Passing parameters from Data One Contract to Data Shaper graph
      • Inheriting Data One context attributes in Data Shaper graph
  • DATA SHAPER DESIGNER
    • Configuration
      • Runtime configuration
        • Logging
        • Master Password
        • User Classpath
      • Data Shaper Server Integration
      • Execution monitoring
      • Java configuration
      • Engine configuration
      • Refresh Operation
    • Designer User Interface
      • Graph Editor with Palette of Components
      • Project Explorer Pane
      • Outline Pane
      • Tabs Pane
      • Execution Tab
      • Keyboard Shortcuts
    • Projects
      • Creating Data Shaper projects
      • Converting Data Shaper projects
      • Structure of Data Shaper projects
      • Versioning of server project content
      • Working with Data Shaper Server Projects
      • Project configuration
    • Graphs
      • Creating an empty graph
      • Creating a simple graph
        • Placing Components
        • Placing Components from Palette
        • Connecting Components with Edges
    • Execution
      • Successful Graph Execution
      • Run configuration
      • Connecting to a running job
      • Graph states
    • Common dialogs
      • URL file dialog
      • Edit Value dialog
      • Open Type dialog
    • Import
      • Import Data Shaper projects
      • Import from Data Shaper server sandbox
      • Import graphs
      • Import metadata
    • Export
      • Export graphs to HTML
      • Export to Data Shaper Server sandbox
      • Export image
      • Export Project as Library
    • Graph tracking
      • Changing record count font size
    • Search functionality
    • Working with Data Shaper server
      • Data Shaper server project basic principles
      • Connecting via HTTP
      • Connecting via HTTPS
      • Connecting via Proxy Server
    • Graph components
      • Adding components
      • Finding components
      • Edit component dialog box
      • Enable/disable component
      • Passing data through disabled component
      • Common properties of components
      • Specific attribute types
      • Metadata templates
    • Edges
      • Connecting Components with Edges
      • Types of Edges
      • Assigning Metadata to Edges
      • Colors of Edges
      • Debugging Edges
      • Edge Memory Allocation
    • Metadata
      • Records and Fields
        • Record Types
        • Data Types in Metadata
        • Data Formats
        • Locale and Locale Sensitivity
        • Time Zone
        • Autofilling Functions
      • Metadata Types
        • Internal Metadata
        • External (Shared) Metadata
        • SQL Query Metadata
        • Reading Metadata from Special Sources
      • Auto-propagated Metadata
        • Sources of Auto-Propagated Metadata
        • Explicitly Propagated Metadata
        • Priorities of Metadata
        • Propagation of SQL Query Metadata
      • Creating Metadata
        • Extracting Metadata from a Flat File
        • Extracting Metadata from an XLS(X) File
        • Extracting Metadata from a Database
        • Extracting Metadata from a DBase File
        • Extracting Metadata from Salesforce
        • SQL Query Metadata
        • User Defined Metadata
      • Merging Existing Metadata
      • Creating Database Table from Metadata and Database Connection
      • Metadata Editor
        • Opening Metadata Editor
        • Basics of Metadata Editor
        • Record Pane
        • Field Name vs. Label vs. Description
        • Details Pane
      • Changing and Defining Delimiters
      • Editing Metadata in the Source Code
      • Multi-value Fields
        • Lists and Maps Support in Components
        • Joining on multivalue fields (Comparison Rules)
    • Connections
      • Database Connections
        • Internal Database Connections
        • External (Shared) Database Connections
        • Database Connections Properties
        • Encryption of Access Password
        • Browsing Database and Extracting Metadata from Database Tables
        • Windows Authentication on Microsoft SQL Server
        • Snowflake Connection
        • Hive Connection
        • Troubleshooting
      • JMS Connections
      • QuickBase Connections
      • Hadoop Connections
      • Kafka Connections
      • OAuth2 Connections
      • MongoDB Connections
      • Salesforce Connections
    • Lookup Tables
      • Lookup Tables in Cluster Environment
      • Internal Lookup Tables
      • External (Shared) Lookup Tables
      • Types of Lookup Tables
    • Sequences
      • Persistent Sequences
      • Non Persistent Sequences
      • Internal Sequences
      • External (Shared) Sequences
      • Editing a Sequence
      • Sequences in Cluster Environment
    • Parameters
      • Internal Parameters
      • External (Shared) Parameters
      • Secure Graph Parameters
      • Graph Parameter Editor
      • Secure Graph Parameters
      • Parameters with CTL2 Expressions (Dynamic Parameters)
      • Environment Variables
      • Canonicalizing File Paths
      • Using Parameters
    • Internal/External Graph Elements
    • Dictionary
      • Creating a Dictionary
      • Using a Dictionary in Graphs
    • Execution Properties
    • Notes in Graphs
      • Placing Notes into Graph
      • Resizing Notes
      • Editing Notes
      • Formatted Text
      • Links from Notes
      • Folding Notes
      • Notes Properties
    • Transformations
      • Defining Transformations
      • Transform Editor
      • Common Java Interfaces
    • Data Partitioning (Parallel Running)
    • Data Partitioning in Cluster
      • High Availability
      • Scalability
      • Graph Allocation Examples
      • Example of Distributed Execution
      • Remote Edges
    • Readers
      • Common Properties of Readers
      • ComplexDataReader
      • DatabaseReader
      • DataGenerator
      • DataOneVFSReader
      • EDIFACTReader
      • FlatFileReader
      • JSONExtract
      • JSONReader
      • LDAPReader
      • MultiLevelReader
      • SpreadsheetDataReader
      • UniversalDataReader
      • X12Reader
      • XMLExtract
      • XMLReader
      • XMLXPathReader
    • Writers
      • Common Properties of Writers
      • DatabaseWriter
      • DataOneVFSWriter
      • EDIFACTWriter
      • FlatFileWriter
      • JSONWriter
      • LDAPWriter
      • SpreadsheetDataWriter
      • HIDDEN StructuredDataWriter
      • HIDDEN TableauWriter
      • Trash
      • UniversalDataWriter
      • X12Writer
      • XMLWriter
    • Transformers
      • Common Properties of Transformers
      • Aggregate
      • Concatenate
      • DataIntersection
      • DataSampler
      • Dedup
      • Denormalizer
      • ExtSort
      • FastSort
      • Filter
      • Map
      • Merge
      • MetaPivot
      • Normalizer
      • Partition
      • Pivot
      • Rollup
      • SimpleCopy
      • SimpleGather
      • SortWithinGroups
      • XSLTransformer
    • Joiners
      • Common Properties of Joiners
      • Combine
      • CrossJoin
      • DBJoin
      • ExtHashJoin
      • ExtMergeJoin
      • LookupJoin
      • RelationalJoin
    • Others
      • Common Properties of Others
      • CheckForeignKey
      • DBExecute
      • HTTPConnector
      • LookupTableReaderWriter
      • WebServiceClient
    • CTL2 - Data Shaper Transformation Language
    • Language Reference
      • Program Structure
      • Comments
      • Import
      • Data Types in CTL2
      • Literals
      • Variables
      • Dictionary in CTL2
      • Operators
      • Simple Statement and Block of Statements
      • Control Statements
      • Error Handling
      • Functions
      • Conditional Fail Expression
      • Accessing Data Records and Fields
      • Mapping
      • Parameters
      • Regular Expressions
    • CTL Debugging
      • Debug Perspective
      • Importing and Exporting Breakpoints
      • Inspecting Variables and Expressions
      • Examples
    • Functions Reference
      • Conversion Functions
      • Date Functions
      • Mathematical Functions
      • String Functions
      • Mapping Functions
      • Container Functions
      • Record Functions (Dynamic Field Access)
      • Miscellaneous Functions
      • Lookup Table Functions
      • Sequence Functions
      • Data Service HTTP Library Functions
      • Custom CTL Functions
      • CTL2 Appendix - List of National-specific Characters
      • HIDDEN Subgraph Functions
    • Tutorial
      • Creating a Transformation Graph
      • Filtering the records
      • Sorting the Records
      • Processing Speed-up with Parallelization
      • Debugging the Java Transformation
  • DATA SHAPER SERVER
    • Introduction
    • Administration
      • Monitoring
    • Using Graphs
      • Job Queue
      • Execution History
      • Job Inspector
    • Cluster
      • Sandboxes in Cluster
      • Troubleshooting
  • Install Data Shaper
    • Install Data Shaper
      • Introduction to Data Shaper installation process
      • Planning Data Shaper installation
      • Data Shaper System Requirements
      • Data Shaper Domain Master Configuration reference
      • Performing Data Shaper initial installation and master configuration
        • Creating database objects for PostgreSQL
        • Creating database objects for Oracle
        • Executing Data Shaper installer
        • Configuring additional firewall rules for Data Shaper
Powered by GitBook
On this page
  • Detailed List of Available Operations
  • Properties of Graph Parameters
  • Graph Parameter Type Editor
  • Simple type
  • Component Binding
  • Edit Parameter Value
  • Edit Parameter CTL2 Value
  • Multiline String Editor
  • File URL
  • Properties
  • Single Field
  • Multiple Fields
  • Field Mapping
  • Join Key
  • Enumeration
  • Character Set
  • Time Zone
  • Field Type
  • Locale
  1. DATA SHAPER DESIGNER
  2. Parameters

Graph Parameter Editor

PreviousSecure Graph ParametersNextSecure Graph Parameters

Last updated 1 month ago

Graph parameters are managed by the Graph parameters editor. The main purpose of this editor is to create, edit and remove internal graph parameters, link and unlink external parameter files and edit particular graph parameters in parameter files.

The Graph parameter editor is available via Outline view. Just double-click on the Graph parameters section.

The editor shows the internal and external parameters of the graph simultaneously. Internal parameters are located at the top level of the tree, while external parameters files are shown indented (e.g. workspace.prm in the figure above).

The order of the parameters in the graph defines the priority of use. If parameter names collide, the parameter that is above the other has a higher priority. The order of the graph parameters can be changed using the drag-and-drop actions available on the left toolbar.

If an error is detected in the graph parameters settings, a yellow exclamation mark icon is displayed on the affected graph parameters and an error message is displayed in a tooltip on the damaged graph parameter.

Detailed List of Available Operations

  • Adding a new graph parameter use To add a new parameter to the end of the list, use in-line editing of Add new parameter cell at the end of each parameter section. To insert a new graph parameter above the current position, use the Plus button on the left side.

  • Name and value editing Edit the name and value of a graph parameter directly in parameters viewer.

  • Changing the order of parameters Use left-side toolbar (Move top, Move up, Move down, Move bottom) or Drag&Drop to move the selected graph parameter. Order of parameter files can be changed as well. Multi-selection is supported.

  • Creating a new parameter file Create a new parameter file using the New parameter file button.

  • Linking an existing parameter file Link an existing parameter file using the Link parameter file button.

  • Filtering parameters Parameters filtering is based on a substring of parameter name and value.

Dialog supports commonly used operations known from graph editor:

  • Copy (Ctrl+C), Cut (Ctrl+X) and Paste (Ctrl+V) operation on selected graph parameters.

  • Undo (Ctrl+Z) and Redo (Ctrl+Y) operations.

Properties of Graph Parameters

  • Name Identifier of the parameter.

  • Value Value of the parameter. The Value field can use different editors to edit the value. The editors are set up using property Editor type.

  • Description Description is user-defined text for a graph parameter or graph parameter file. Unlike the label, the description can be several paragraphs long.

  • Public Not used in this version of Data Shaper Designer.

  • Required Not used in this version of Data Shaper Designer.

  • Label Not used in this version of Data Shaper Designer.

  • Value Hint Not used in this version of Data Shaper Designer.

  • Category Not used in this version of Data Shaper Designer.

  • Editor Type The public parameters can use a type of editor corresponding to the field of the component using the parameter. For example, you can use File URL Editor or Transform Editor. This field is available for all parameters. The editor type is primarily used for public parameters when setting them in parent graph (when configuring a subgraph).

Graph Parameter Type Editor

The Graph Parameter Type Editor is used to set the correct editor for certain graph parameters. You can choose between Simple Type or Component binding. The dialog is opened from the parameter property Editor type in Graph parameters editor.

Simple type

Simple type can be one of:

  • Basic

    • Integer - inline editor, allows you to enter only integers

    • Decimal - inline editor, allows you to enter decimal numbers

    • Boolean - inline editor - user selects true, false or empty value

  • Advanced

    • Date/Time - inline editor, allows you to set the date using the calendar.

  • Metadata Related

  • Enumerations

Note:

Component Binding

Component binding is not used in this version of Data Shaper Designer.

Edit Parameter Value

Edit Parameter Value is used to set a parameter value. The value of the parameter can be converted to the CTL2 code using the Convert to dynamic button.

If the Convert to dynamic button is used, the editor is changed.

See also: Edit Parameter CTL2 Value

Edit Parameter CTL2 Value

The Edit Parameter CTL2 Value dialog is used to place a CTL2 code as a parameter value.

The value can be converted to string using the Convert to static button. If the button is used, the editor changes.

Multiline String Editor

Multiline string parameter type lets you use a multiline string as a parameter value. If the parameter value is in xml or json format, its syntax can be checked.

Use the Validation configuration property to switch on XML or JSON syntax validation.

Note: To enable the support for JSON highlighting, please install the JavaScript Development Tools plugin. Help > Install New Software…​ and choose Luna in the drop-down list and search for JavaScript Development Tools.

File URL

The File URL parameter type lets you configure File URL Dialog.

File Extension makes a File URL dialog to display files with particular suffix. It can be used to display files matching some patterns too. For example, you can display a txt file (*.txt) or XML files whose name starts with "a" (a*.xml).

Selection Mode displays files or directories or files or directories.

The Allow Multiple Selection checkbox lets you deny multiple file selection. If you uncheck the checkbox, you cannot select multiple files.

In the Select Types dialog, tick the file extensions to be available in File URL Dialog.

If a suffix is not available in the list, use the Other extensions field below. The suffix you define should start with an asterisk. If more extensions are defined, separate them with a comma.

Properties

The Properties type lets you use key-value pairs.

Single Field

The Single Field type allows you to choose one metadata field from the list.

Configuration of Single Field specifies a subset of fields of one existing metadata. You can choose one field of the set. The metadata can be either static or referenced from a particular edge of the subgraph. Available metadata fields can be filtered depending on the metadata field type or on the container type.

If you use the parameter, you can choose one field using the following dialog.

Multiple Fields

The Multiple Fields parameter type is used to choose one or more metadata fields from the set.

The available fields are a subset of the existing metadata fields. The fields can be static metadata fields or edge metadata fields. Available metadata fields can be filtered by metadata field type or container type.

To add fields to the list, you can use the arrows or drag and drop.

Field Mapping

The Field Mapping type requires metadata from both sides of the mapping. You specify the fields whose metadata can be mapped using the parameter.

In the Field Mapping dialog, you can define the mapping for the transformation.

Join Key

When you define the Join Key parameter type, you choose which metadata is involved in the join:

The Join Key parameter value specifies joining fields.

Enumeration

The following dialog box is used to set the values available in the Enumeration selection list. The values available in the list are defined in Values. The pipe character is displayed escaped, the semicolon is surrounded by the " character.

User-defined values are allowed using the Allow Custom Value checkbox.

You can choose the value using the inline editor. If more than 10 (ten) values have been defined, you can choose the value using the external dialog box.

Character Set

The Character set parameter type lets you choose one of the available character sets.

Time Zone

Time Zone allows you to choose time zone from a list. Java or Joda time zones can be used.

Field Type

Field Type allows you to choose a field type from a list.

Locale

Locale allows you to set the locale.

Removing a graph parameter Use the Minus button or Delete key to remove selected parameters. Multi-selection is supported. To remove unused graph parameters, use .

Secure The parameter is considered as a Secure parameter. See

String - inline editing or external dialog ( or )

Multiline string - external dialog .

File URL - external dialog (File Url Dialog). A configuration of the dialog is described in File URL. For details on File URL Dialog, see .

Properties - inline editor, used to set up key-value pairs. See .

Single Field - external dialog, allows you to choose one metadata field. See .

Multiple Fields - external dialog, allows you to choose one or more fields. See .

Sort Key - external dialog, allows you to define sort key. See .

Field Mapping - external editor, allows you to set field mapping. See .

Join Key - external editor, allows you to set fields to be joined. See

Enumeration - inline or external editor, allows you to choose one option from a list; you may be allowed to define your own value. See .

Character set - external dialog, for choosing character set. See .

Time Zone - external dialog, for choosing time zone. See .

Field Type - inline editor, for choosing field data type. See .

Locale - external dialog, for choosing locale. See .

To store the password, use secure graph parameters. See .

See also:

See also .

Properties can be parsed with the function .

See also .

See also .

Secure Graph Parameters
URL file dialog
Secure Graph Parameters
URL file dialog
Mapping Functions
Mapping Functions
Edit Parameter Value
Edit Parameter CTL2 Value
Multiline String Editor
Properties
Single Field
Multiple Fields
Field Mapping
Join Key
Enumeration
Character Set
Time Zone
Field Type
Locale
Edit Parameter Value
Sort Key
parseProperties
Cleanup Unused Elements