Primeur Online Docs
Data Mover 1.20
Data Mover 1.20
  • πŸš€GETTING STARTED
    • What is Primeur Data Mover
    • Main features of Primeur Data Mover
    • Primeur Data Mover deployment
    • Navigate through Primeur Data Mover
  • πŸ“šINFRASTRUCTURE
    • STENG, clusters and servers
      • Adding a cluster and a STENG
      • Deleting a STENG
    • DMZ Gateways
      • Blocking users automatically at the DMZ level πŸš€
    • DMZ Clusters
      • Load balancing across active DMZ clusters for outbound file transfers πŸš€
  • πŸ‘₯Actors
    • Who are the actors
    • Create your first actor
    • Configure an actor πŸš€
      • Users Tab
      • Groups Tab
      • VFS Tab
      • File Resource Tab
      • Connection Contract Tab
      • Client Connections Tab
    • Search files by actor
    • Actor Lineage πŸš€
      • Aggregation of flows by protocol πŸš€
      • Lineage with connection contracts πŸš€
      • Lineage with input, mediation and output contracts πŸš€
      • Lineage with any contract type πŸš€
  • πŸ—„οΈVIRTUAL FILE SYSTEMS
    • Virtual File Systems (VFS) πŸš€
      • Creating a VFS πŸš€
      • Configuring a VFS
      • Adding Virtual Paths
      • Modifying and Deleting a VFS
    • Searching files in all VFS
    • Storage Classes πŸš€
      • Storage Class: SMB v3 or later versions πŸš€
      • Storage Class: Azure Blob Storage πŸš€
      • Storage Class: Amazon S3 πŸš€
      • Storage Class: Google Storage πŸš€
      • Storage Class: Local File System πŸš€
    • Retention Classes
  • πŸ“Contracts
    • What is a contract
    • Create your first contract
      • Create an Input Contract
        • Define the contract info
        • Associate the contract with the actor
        • Define the contract actions
        • Set the contract variables
      • Create a Mediation Contract
      • Create an Output Contract
      • Create a Connection Contract
        • Create a contract clause
        • Associate the VFS with file processing rules
        • File Processing Rules
    • Managing contracts πŸš€
    • File Resources
      • Creating File Resources
      • Navigating File Resources
      • How to use File Resources
  • 🧱Workflows
    • What is a workflow
    • Create your first workflow template
    • Trigger types
      • Trigger types for input contracts
      • Trigger types for mediation and output contracts
    • Service tasks
      • Standard service tasks
      • Triggerable service tasks πŸš€
      • Spazio selectors and filebox metadata management
      • Error management
    • Variables
      • Variables in workflows and contracts
      • Handling process variables
    • Workflow templates
      • System workflow templates
        • Workflow templates for input contracts
        • Workflow templates for mediation contracts
        • Workflow templates for output contracts
      • Custom workflow templates
        • Workflow template toolbar
        • Workflow template Shape repository panel
        • Workflow template working area
        • Workflow template BPMN-diagram panel
      • Error workflow templates
    • Editing workflow templates
    • DataFlow Instance Context (DFIC) πŸš€
  • πŸ›ΈTRANSPORT PROTOCOLS AND CONNECTORS
    • Data Mover client and server roles
    • Client Connections
      • Client Connection: FTP
      • Client Connection: FTPS
      • Client Connection: SFTP
      • Client Connection: HTTP
      • Client Connection: HTTPS
      • Client Connection: PESIT
      • Client Connection: SMB v3 or later versions
      • Client Connection: POP3 or IMAP
      • Client Connection: SMTP
      • Client Connection: PR4/PR4S
      • Client Connection: PR5
      • Client Connection: PR5S
      • Client Connection: HDFS
      • Client Connection: HDFSS
      • Client Connection: Amazon S3 πŸš€
      • Client Connection: Google Cloud Storage
        • Credentials
      • Client Connection: Azure Blob Storage
      • Client Connection: IBM Sterling Connect:Direct
      • Appendix
    • Server Connections πŸš€
      • Server Connection: FTP
      • Server Connection: FTPS
      • Server Connection: SFTP
      • Server Connection: HTTP
      • Server Connection: HTTPS
      • Server Connection: PeSIT
      • Server Connection: PR4
      • Server Connection: PR5
      • Server Connection: PR5S πŸš€
      • Server Connection: IBM Sterling Connect:Direct
    • Stopping all servers in one go
  • πŸ’»API
    • HTTP MFT Rest API
    • Job Manager APIs πŸš€
    • SFTP Server sessions APIs πŸš€
    • Audit Logs APIs πŸš€
  • πŸ”“Security
    • Identity and Access Management
    • Users & Groups
      • Setting the password policy
      • Creating Internal Users πŸš€
      • Creating Internal Groups
      • Creating External Users
      • Creating External Groups
    • Key Stores and Trust Stores
      • Key Store πŸš€
        • Creating a Key πŸš€
        • Creating a Certificate πŸš€
        • Importing a Key or a Certificate
        • Creating a Symmetric key
        • Examples
      • Trust Store πŸš€
        • Importing Keys πŸš€
        • Importing Certificates
      • Untrusted Cache πŸš€
      • Trusting Keys and Certificates
      • PGP Key Store and PGP Trust Store
        • PGP Key Store
        • Importing keys into the PGP Trust Store
    • ICAP
      • Configuring ICAP
      • Defining an ICAP rule
  • 🎧FILE EVENT LISTENER
    • What is the File Event Listener
    • Configuring File Event Listeners
      • Setting the File Event Listener Engine
      • Defining a contract for the File Event Listener
      • Setting events to be monitored πŸš€
    • RegEx Rules πŸš€
    • Monitoring File Event Listeners
  • πŸ‘‘FILE MANAGER
    • What is the File Manager
    • Logging into File Manager
    • Managing the File Manager πŸš€
      • The list of results
      • Creating new folders
      • Uploading files
      • Downloading files πŸš€
      • Searching for files and folders
      • Deleting files πŸš€
      • Bulk actions πŸš€
    • File Manager and VFS
    • Customizing File Manager externals
      • The configuration-wui.json file πŸš€
      • How to customize the Login window and the logo
      • How to customize the footer
      • How to configure the Upload with Metadata option
      • How to customize bulk actions πŸš€
  • πŸ§‘β€βš–οΈFILE ROUTING
    • What is File Routing πŸš€
    • Routing Rules
      • The Rules tab
      • The Categories tab
      • The Output tab
    • How to create a rule πŸš€
      • Add metadata πŸš€
      • Select ACTIONS
      • Select OUTPUTS
      • Policy for the selection of metadata rules
    • Configuration of the environment in Data One
      • Set up Storage Classes
      • Set up Retention Classes
      • Configure the Actor
      • Set up File Resources
    • Associate the Routing Rule with a Contract
    • Example
  • πŸ“©NOTIFICATION CHANNELS
    • What are Notification Channels
    • Configuring the default Email Notification Channel
    • Configuring a new Email Notification Channel
    • Trusting Certificates
    • Managing Templates
      • Data Watcher Macros
      • Contract Macros
      • ICAP Macros
      • Central Log Macros
      • Email Templates
      • Editing default templates
      • Loading a new template
  • πŸ’¬LOGS & AUDIT
    • Logs πŸš€
      • Logs options πŸš€
      • Troubleshooting error analysis in Logs
    • Audit Options πŸš€
      • Export audit logs πŸš€
      • List of Audit entity types πŸš€
      • Audit message codes πŸš€
    • Log Notifiers πŸš€
      • FEL message codes
  • πŸ•’MONITORING
    • Jobs
      • Details about Jobs πŸš€
      • jobman.sh CLI
    • Job Manager
    • Job Queues
      • Managing Job Queues
    • File Transfers
      • Ongoing
      • Finished
      • Reports
    • File Transfers Rules
      • Configuring Rules
  • 🧐HOW TO...
    • ... use different DNS names - NEW! πŸš€
    • ... configure a Cron Expression
    • ... configure an application
    • ... customize a header
    • ... run searches in Data Watcher πŸš€
    • ... use Data Shaper graphs in Data Mover contracts
    • ... modify DMCFG and deploy it
    • ... tune Data One data retention
    • ... fine tune Data Mover
  • πŸ—’οΈRELEASE NOTES
    • Data One 1.20.10
    • Data One 1.20.9
    • Data One 1.20.8
    • Data One 1.20.7
      • Data One 1.20.7.1
    • Data One 1.20.6
    • Data One 1.20.5
    • Data One 1.20.4
    • Data One 1.20.3
    • Data One 1.20.2
    • Data One 1.20.1
    • Data One 1.20.0
Powered by GitBook
On this page
  • Splitting file content into JMS messages
  • Aggregating JMS messages into files
  1. TRANSPORT PROTOCOLS AND CONNECTORS
  2. JMS Connector

Message Processing Rules πŸš€

The Message Processing Rule card defines the splitting and aggregation rules applied when a file is split into JMS messages and when multiple JMS messages are aggregated into a single file.

Follow these steps to configure message processing rules:

  1. In Setup β†’ Message Processing Rule, click the NEW button.

  2. In the New Message Processing Rule page, fill in the fields:

    1. Name (*): assign a name to the rule you are creating. Maximum 128 characters are accepted.

    2. Description: (optional) enter a description for the rule you are configuring. Maximum 255 characters are accepted.

    3. Protocol: JMS is already selected.

    4. Type: select File to message if the rule must be applied when a file is split into multiple JMS messages; select Message to file if the rule must be applied when one or more JMS messages are aggregated into a single file.

Splitting file content into JMS messages

By selecting File to message (a file is split into multiple JMS messages) in the Type field, the following options will appear:

  • Splitting strategy:

    • One to one: send the entire file content as the body of a single JMS message.

    • One to many: split the file into multiple JMS messages each containing an individual β€œrecord” from the original file.

  • Max message size: maximum dimension applied to the file or to each split file. If One to one is selected and a file exceeds the specified maximum size, an error will appear and the operation will fail. If One to many is selected, the file is split in chunks according to the specified maximum size.

  • Units: unit if measure of the message size. Select MB or KB according to your needs.

When selecting One to many, the additional Record demarcation policy option appears to set the delimiter to split text files in multiple messages. These are its options:

  • Platform-defined end of record: this option automatically applies the β€œFile EOR” already associated with the file metadata in Data Mover.

  • CR: carriage return.

  • LF: line feed.

  • CRLF: carriage return line feed

Aggregating JMS messages into files

By selecting Message to file (multiple JMS messages are aggregated into a single file) in the Type field, the following option will appear:

  • Aggregation strategy:

    • One to one: each JMS message corresponds to one file. In this case, no aggregation is applied.

    • Many to one: multiple messages are converted into a single file. The number of messages must be specified in the Number field of the File demarcation policy option.

      • File demarcation policy: select Basic thresholds and in the Threshold condition pane enter the condition that must be applied when a new file is released to Data One. At least one of following threshold conditions must be verified:

        • Number: number of messages composing the file.

        • Time: time interval by which, if not all of the messages have arrived, the file containing the messages that have arrived will be created.

Message processing rules are listed on the page as shown in the picture below.

Last updated 7 days ago

πŸ›Έ