Primeur Online Docs
Data Mover 1.20
Data Mover 1.20
  • 🚀GETTING STARTED
    • What is Primeur Data Mover
    • Main features of Primeur Data Mover
    • Primeur Data Mover deployment
    • Navigate through Primeur Data Mover
  • 👥Actors
    • Who are the actors
    • Create your first actor
    • Configure an actor 🚀
      • Users Tab
      • Groups Tab
      • VFS Tab
      • File Resource Tab
      • Connection Contract Tab
      • Client Connections Tab
    • Search files by actor
    • Actor Lineage 🚀
      • Aggregation of flows by protocol 🚀
      • Lineage with connection contracts 🚀
      • Lineage with input, mediation and output contracts 🚀
      • Lineage with any contract type 🚀
  • 🗄️VIRTUAL FILE SYSTEMS
    • Virtual File Systems (VFS) 🚀
      • Creating a VFS 🚀
      • Configuring a VFS
      • Adding Virtual Paths
      • Modifying and Deleting a VFS
    • Searching files in all VFS
    • Storage Classes 🚀
      • Storage Class: SMB v3 or later versions 🚀
      • Storage Class: Azure Blob Storage 🚀
      • Storage Class: Amazon S3 🚀
      • Storage Class: Google Storage 🚀
      • Storage Class: Local File System 🚀
    • Retention Classes
  • 📝Contracts
    • What is a contract
    • Create your first contract
      • Create an Input Contract
        • Define the contract info
        • Associate the contract with the actor
        • Define the contract actions
        • Set the contract variables
      • Create a Mediation Contract
      • Create an Output Contract
      • Create a Connection Contract
        • Create a contract clause
        • Associate the VFS with file processing rules
        • File Processing Rules
    • Managing contracts 🚀
    • File Resources
      • Creating File Resources
      • Navigating File Resources
      • How to use File Resources
  • 🧱Workflows
    • What is a workflow
    • Create your first workflow template
    • Trigger types
      • Trigger types for input contracts
      • Trigger types for mediation and output contracts
    • Service tasks
      • Standard service tasks
      • Triggerable service tasks 🚀
      • Spazio selectors and filebox metadata management
      • Error management
    • Variables
      • Variables in workflows and contracts
      • Handling process variables
    • Workflow templates
      • System workflow templates
        • Workflow templates for input contracts
        • Workflow templates for mediation contracts
        • Workflow templates for output contracts
      • Custom workflow templates
        • Workflow template toolbar
        • Workflow template Shape repository panel
        • Workflow template working area
        • Workflow template BPMN-diagram panel
      • Error workflow templates
    • Editing workflow templates
    • DataFlow Instance Context (DFIC) 🚀
  • 🧑‍⚖️FILE ROUTING
    • What is File Routing 🚀
    • Routing Rules
      • The Rules tab
      • The Categories tab
      • The Output tab
    • How to create a rule 🚀
      • Add metadata 🚀
      • Select ACTIONS
      • Select OUTPUTS
      • Policy for the selection of metadata rules
    • Configuration of the environment in Data One
      • Set up Storage Classes
      • Set up Retention Classes
      • Configure the Actor
      • Set up File Resources
    • Associate the Routing Rule with a Contract
    • Example
  • 🔓Security
    • Identity and Access Management
    • Users & Groups
      • Setting the password policy
      • Creating Internal Users 🚀
      • Creating Internal Groups
      • Creating External Users
      • Creating External Groups
    • Key Stores and Trust Stores
      • Key Store 🚀
        • Creating a Key 🚀
        • Creating a Certificate 🚀
        • Importing a Key or a Certificate
        • Creating a Symmetric key
        • Examples
      • Trust Store 🚀
        • Importing Keys 🚀
        • Importing Certificates
      • Untrusted Cache 🚀
      • Trusting Keys and Certificates
      • PGP Key Store and PGP Trust Store
        • PGP Key Store
        • Importing keys into the PGP Trust Store
    • ICAP
      • Configuring ICAP
      • Defining an ICAP rule
  • 🛸TRANSPORT PROTOCOLS AND CONNECTORS
    • Data Mover client and server roles
    • Client Connections
      • Client Connection: FTP
      • Client Connection: FTPS
      • Client Connection: SFTP
      • Client Connection: HTTP
      • Client Connection: HTTPS
      • Client Connection: PESIT
      • Client Connection: SMB v3 or later versions
      • Client Connection: POP3 or IMAP
      • Client Connection: SMTP
      • Client Connection: PR4/PR4S
      • Client Connection: PR5
      • Client Connection: PR5S
      • Client Connection: HDFS
      • Client Connection: HDFSS
      • Client Connection: Amazon S3 🚀
      • Client Connection: Google Cloud Storage
        • Credentials
      • Client Connection: Azure Blob Storage
      • Client Connection: IBM Sterling Connect:Direct
      • Appendix
    • Server Connections 🚀
      • Server Connection: FTP
      • Server Connection: FTPS
      • Server Connection: SFTP
      • Server Connection: HTTP
      • Server Connection: HTTPS
      • Server Connection: PeSIT
      • Server Connection: PR4
      • Server Connection: PR5
      • Server Connection: PR5S 🚀
      • Server Connection: IBM Sterling Connect:Direct
    • Stopping all servers in one go
  • 🎧FILE EVENT LISTENER
    • What is the File Event Listener
    • Configuring File Event Listeners
      • Setting the File Event Listener Engine
      • Defining a contract for the File Event Listener
      • Setting events to be monitored
    • RegEx Rules 🚀
    • Monitoring File Event Listeners
  • 📚INFRASTRUCTURE
    • STENG, Clusters and Servers
    • Adding a cluster and a STENG
    • Deleting a STENG
    • DMZ Gateways
    • DMZ Clusters
  • 🕒MONITORING
    • Jobs
      • Details about Jobs 🚀
      • jobman.sh CLI
    • Job Manager
    • Job Queues
      • Managing Job Queues
    • File Transfers
      • Ongoing
      • Finished
      • Reports
    • File Transfers Rules
      • Configuring Rules
  • 👑FILE MANAGER
    • What is the File Manager
    • Logging into File Manager
    • Managing the File Manager 🚀
      • The list of results
      • Creating new folders
      • Uploading files
      • Downloading files 🚀
      • Searching for files and folders
      • Deleting files 🚀
      • Bulk actions 🚀
    • File Manager and VFS
    • Customizing File Manager externals
      • The configuration-wui.json file 🚀
      • How to customize the Login window and the logo
      • How to customize the footer
      • How to configure the Upload with Metadata option
      • How to customize bulk actions 🚀
  • 💬LOGS & AUDIT
    • Logs 🚀
      • Logs options 🚀
      • Troubleshooting error analysis in Logs
    • Audit Options 🚀
      • Export audit logs 🚀
      • List of Audit entity types 🚀
      • Audit message codes 🚀
    • Log Notifiers 🚀
      • FEL message codes
  • 📩NOTIFICATION CHANNELS
    • What are Notification Channels
    • Configuring the default Email Notification Channel
    • Configuring a new Email Notification Channel
    • Trusting Certificates
    • Managing Templates
      • Data Watcher Macros
      • Contract Macros
      • ICAP Macros
      • Central Log Macros
      • Email Templates
      • Editing default templates
      • Loading a new template
  • 💻API
    • HTTP MFT Rest API
    • Job Manager APIs 🚀
    • SFTP Server sessions APIs 🚀
    • Audit Logs APIs 🚀
  • 🧐HOW TO...
    • ... use different DNS names - NEW! 🚀
    • ... configure a Cron Expression
    • ... configure an Application
    • ... customize a header
    • ... run searches in Data Watcher 🚀
    • ... use Data Shaper graphs in Data Mover contracts
    • ... modify DMCFG and deploy it
    • ... tune Data One data retention
    • ... fine tune Data Mover
  • 🗒️RELEASE NOTES
    • Data One 1.20.10
    • Data One 1.20.9
    • Data One 1.20.8
    • Data One 1.20.7
      • Data One 1.20.7.1
    • Data One 1.20.6
    • Data One 1.20.5
    • Data One 1.20.4
    • Data One 1.20.3
    • Data One 1.20.2
    • Data One 1.20.1
    • Data One 1.20.0
Powered by GitBook
On this page
  • Flat view
  • Filtering Logs by CorrelationID (LCID)
  • Filtering Logs by Dataflow Instance ID (DFIID)
  • Columns
  • Other filters
  • Options
  • 🚀 Selectively discard INFO messages
  1. LOGS & AUDIT
  2. Logs 🚀

Logs options 🚀

PreviousLogs 🚀NextTroubleshooting error analysis in Logs

Last updated 18 days ago

The Logs section provides a streamlined interface for monitoring and analyzing log files generated by PRIMEUR Data Mover. Logs are presented in a consistent format to facilitate quick identification of issues and verification of events.

Accessing the Logs tab presents all logs in a Flat View, arranged with the most recent entries first. You can streamline your analysis by clicking the Group by LCID (Correlation ID) and Group by DFIID (Dataflow Instance ID) buttons. These options categorize the logs by their respective IDs, facilitating more efficient navigation and in-depth examination of the data.

Flat view

By default, when opening the dashboard, all the logs are shown in a FLAT VIEW, which sorts them starting from the newest. In the Flat view, logs can be sorted in ascending or descending order by clicking the icon on the right of the Timestamp wording. Other columns can be sorted by clicking the icon.

Filtering Logs by CorrelationID (LCID)

To view logs grouped by their Correlation ID, click the Group by LCID (Correlation ID) button available at the top of the screen. The Correlation ID view lists all logs grouped by ID.

Filtering Logs by Dataflow Instance ID (DFIID)

To view logs grouped by their Dataflow Instance ID, simply click the Group by DFIID (Dataflow Instance ID) button available at the top of the screen.

The Dataflow Instance ID flows across all the components of the system (CEMAN, STENG, and Data Watcher). This enables a coherent and consistent troubleshooting experience. E.g., jumping back and forth from technical monitoring in Central Log to business monitoring in Data Watcher.

Columns

These are the columns available in the Logs section of Data One:

  • Timestamp: the time when the event described has occurred.

  • Message code: code assigned to the message written in the Message column. These codes can be used to search for messages or to blacklist specific INFO message codes.

  • LCID: acronym for Log Correlation ID. It is the unique identifier for a Data One work session that may involve multiple Dataflow instances but may not relate to a Dataflow instance (e.g., the system startup).

  • DFIID: acronym for Dataflow Instance ID. It is the unique identifier of all Data One integration flows.

  • Level: level of detail of the log, ERROR, INFO, and WARNING.

  • Message: message of the log.

  • Cluster: name of the cluster involved.

  • Node: name of the node involved.

  • Module: name of the module involved.

  • Contract: name of the contract to which the log message is related.

  • Job: ID of the job involved in the message. If empty, no jobs are involved.

  • Workflow: workflow instance ID. If empty, the log does not refer to the execution of a workflow.

  • 🚀 Data One User: name of the user connected to a server exposed by Data One to perform a transport on any protocols.

  • 🚀 External system User: name of the user connected to a remote system to perform a transport on any protocols.

Other filters

Logs can be filtered in all views by entering the search criteria in the edit box below the column header.

The Timestamp column is the first column on the left and is fixed. It is provided with a FROM – TO calendar where data can be filtered by date and by time. It is also possible to select only an initial date (FROM the specified date to today) or only a final date (all logs up TO the specified date).

Options

Clicking the 3-dot icon on the right of each value listed in the LCID and DFIID columns, a popup menu appears, allowing you to:

  • Copy the value of the cell to the clipboard.

  • Create a New Filter and display only the results of the value of the cell.

  • Add the value to an already applied filter.

  • View the error in Data Watcher.

🚀 Selectively discard INFO messages

Administrators can discard specific INFO messages excluding them from the Central Log, by blacklisting their message codes as explained below. ERROR and WARNING messages cannot be excluded. Message codes starting with FEL and GMS cannot be excluded. For each CEMAN configured, the message "Discarded messages summary: code (n), code (n)" will appear in the Central Log every hour, showing the number of messages intercepted but not displayed in the Central Log. To configure the INFO message codes to be excluded, go to Setup → Advanced settings → ghibli-messages → filters → message-codes and enter the codes in uppercase. Each message code must start with 3 characters, then you can use wildcard characters: ? (to replace one character) and * (to replace multiple characters). Multiple message codes must be separated by a comma. The new property will be applied immediately – no restart of the CEMAN is needed.

💬