Primeur Online Docs
Data Mover 1.20
Data Mover 1.20
  • πŸš€GETTING STARTED
    • What is Primeur Data Mover
    • Main features of Primeur Data Mover
    • Primeur Data Mover deployment
    • Navigate through Primeur Data Mover
  • πŸ‘₯Actors
    • Who are the actors
    • Create your first actor
    • Configure an actor πŸš€
      • Users Tab
      • Groups Tab
      • VFS Tab
      • File Resource Tab
      • Connection Contract Tab
      • Client Connections Tab
    • Search files by actor
    • Actor Lineage πŸš€
      • Aggregation of flows by protocol πŸš€
      • Lineage with connection contracts πŸš€
      • Lineage with input, mediation and output contracts πŸš€
      • Lineage with any contract type πŸš€
  • πŸ—„οΈVIRTUAL FILE SYSTEMS
    • Virtual File Systems (VFS) πŸš€
      • Creating a VFS πŸš€
      • Configuring a VFS
      • Adding Virtual Paths
      • Modifying and Deleting a VFS
    • Searching files in all VFS
    • Storage Classes πŸš€
      • Storage Class: File System πŸš€
      • Storage Class: SMB v3 or later versions πŸš€
      • Storage Class: Amazon S3 πŸš€
      • Storage Class: Google Cloud Storage πŸš€
      • Storage Class: Azure Blob Storage πŸš€
    • Retention Classes
  • πŸ“Contracts
    • What is a contract
    • Create your first contract
      • Create an Input Contract
        • Define the contract info
        • Associate the contract with the actor
        • Define the contract actions
        • Set the contract variables
      • Create a Mediation Contract
      • Create an Output Contract
      • Create a Connection Contract
        • Create a contract clause
        • Associate the VFS with file processing rules
        • File Processing Rules
    • Managing contracts πŸš€
    • File Resources
      • Creating File Resources
      • Navigating File Resources
      • How to use File Resources
  • 🧱Workflows
    • What is a workflow
    • Create your first workflow template
    • Trigger types
      • Trigger types for input contracts
      • Trigger types for mediation and output contracts
    • Service tasks
      • Standard service tasks
      • Triggerable service tasks πŸš€
      • Spazio selectors and filebox metadata management
      • Error management
    • Variables
      • Variables in workflows and contracts
      • Handling process variables
    • Workflow templates
      • System workflow templates
        • Workflow templates for input contracts
        • Workflow templates for mediation contracts
        • Workflow templates for output contracts
      • Custom workflow templates
        • Workflow template toolbar
        • Workflow template Shape repository panel
        • Workflow template working area
        • Workflow template BPMN-diagram panel
      • Error workflow templates
    • Editing workflow templates
    • DataFlow Instance Context (DFIC) πŸš€
  • πŸ§‘β€βš–οΈFILE ROUTING
    • What is File Routing πŸš€
    • Routing Rules
      • The Rules tab
      • The Categories tab
      • The Output tab
    • How to create a rule πŸš€
      • Add metadata πŸš€
      • Select ACTIONS
      • Select OUTPUTS
      • Policy for the selection of metadata rules
    • Configuration of the environment in Data One
      • Set up Storage Classes
      • Set up Retention Classes
      • Configure the Actor
      • Set up File Resources
    • Associate the Routing Rule with a Contract
    • Example
  • πŸ”“Security
    • Identity and Access Management
    • Users & Groups
      • Setting the password policy
      • Creating Internal Users πŸš€
      • Creating Internal Groups
      • Creating External Users
      • Creating External Groups
    • Key Stores and Trust Stores
      • Key Store πŸš€
        • Creating a Key πŸš€
        • Creating a Certificate πŸš€
        • Importing a Key or a Certificate
        • Creating a Symmetric key
        • Examples
      • Trust Store πŸš€
        • Importing Keys πŸš€
        • Importing Certificates
      • Untrusted Cache πŸš€
      • Trusting an element
        • When do I use the Keys tab?
        • When do I use the Certificates tab?
      • PGP Key Store / PGP Trust Store
        • Configuring the PGP Key Store
        • Importing keys into the PGP Trust Store
    • ICAP Engines
      • Configuring an ICAP Engine
      • Defining an ICAP rule
  • πŸ›ΈTRANSPORT PROTOCOLS AND CONNECTORS
    • Data Mover client and server roles
    • Client Connections
      • Client Connection: FTP
      • Client Connection: FTPS
      • Client Connection: SFTP
      • Client Connection: HTTP
      • Client Connection: HTTPS
      • Client Connection: PESIT
      • Client Connection: SMB v3 or later versions
      • Client Connection: POP3 or IMAP
      • Client Connection: SMTP
      • Client Connection: PR4/PR4S
      • Client Connection: PR5
      • Client Connection: PR5S
      • Client Connection: HDFS
      • Client Connection: HDFSS
      • Client Connection: Amazon S3 πŸš€
      • Client Connection: Google Cloud Storage
        • Credentials
      • Client Connection: Azure Blob Storage
      • Client Connection: IBM Sterling Connect:Direct
      • Appendix
    • Server Connections πŸš€
      • Server Connection: FTP
      • Server Connection: FTPS
      • Server Connection: SFTP
      • Server Connection: HTTP
      • Server Connection: HTTPS
      • Server Connection: PeSIT
      • Server Connection: PR4
      • Server Connection: PR5
      • Server Connection: PR5S πŸš€
      • Server Connection: IBM Sterling Connect:Direct
    • Stopping all servers in one go
  • 🎧FILE EVENT LISTENER
    • What is the File Event Listener
    • Configuring File Event Listeners
      • Setting the File Event Listener Engine
      • Defining a contract for the File Event Listener
      • Setting events to be monitored
    • RegEx Rules πŸš€
    • Monitoring File Event Listeners
  • πŸ“šINFRASTRUCTURE
    • STENG, Clusters and Servers
    • Adding a cluster and a STENG
    • Deleting a STENG
    • DMZ Gateways
    • DMZ Clusters
  • πŸ•’MONITORING
    • Jobs
      • Details about Jobs πŸš€
      • jobman.sh CLI
    • Job Manager
    • Job Queues
      • Managing Job Queues
    • File Transfers
      • Ongoing
      • Finished
      • Reports
    • File Transfers Rules
      • Configuring Rules
  • πŸ‘‘FILE MANAGER
    • What is the File Manager
    • Logging into File Manager
    • Managing the File Manager πŸš€
      • The list of results
      • Creating new folders
      • Uploading files
      • Downloading files πŸš€
      • Searching for files and folders
      • Deleting files πŸš€
      • Bulk actions πŸš€
    • File Manager and VFS
    • Customizing File Manager externals
      • The configuration-wui.json file πŸš€
      • How to customize the Login window and the logo
      • How to customize the footer
      • How to configure the Upload with Metadata option
      • How to customize bulk actions πŸš€
  • πŸ’¬LOGS & AUDIT
    • Logs πŸš€
      • Logs options πŸš€
      • Troubleshooting error analysis in Logs
    • Audit Options πŸš€
      • Export audit logs πŸš€
      • List of Audit entity types πŸš€
      • Audit message codes πŸš€
    • Log Notifiers πŸš€
      • FEL message codes
  • πŸ“©NOTIFICATION CHANNELS
    • What are Notification Channels
    • Configuring the default Email Notification Channel
    • Configuring a new Email Notification Channel
    • Trusting Certificates
    • Managing Templates
      • Data Watcher Macros
      • Contract Macros
      • ICAP Macros
      • Central Log Macros
      • Email Templates
      • Editing default templates
      • Loading a new template
  • πŸ’»API
    • HTTP MFT Rest API
    • Job Manager APIs πŸš€
    • SFTP Server sessions APIs πŸš€
    • Audit Logs APIs πŸš€
  • 🧐HOW TO...
    • ... use different DNS names - NEW! πŸš€
    • ... configure a Cron Expression
    • ... configure an Application
    • ... customize a header
    • ... run searches in Data Watcher πŸš€
    • ... use Data Shaper graphs in Data Mover contracts
    • ... modify DMCFG and deploy it
    • ... tune Data One data retention
    • ... fine tune Data Mover
  • πŸ—’οΈRELEASE NOTES
    • Data One 1.20.10
    • Data One 1.20.9
    • Data One 1.20.8
    • Data One 1.20.7
      • Data One 1.20.7.1
    • Data One 1.20.6
    • Data One 1.20.5
    • Data One 1.20.4
    • Data One 1.20.3
    • Data One 1.20.2
    • Data One 1.20.1
    • Data One 1.20.0
Powered by GitBook
On this page
  • Windows / Unix Like
  • zOS
  1. Contracts
  2. File Resources

Creating File Resources

To create a File Resource, go to Setup β†’ File Resources and click the NEW button.

Fill in these fields:

  • Select Actor: select the Actor to which the File Resource will be applied.

  • Name: assign a unique name of the File Resource. These characters are accepted / ! * + ? = " | Blanks are not accepted.

  • Description: enter a description for the File Resource.

  • Reject File: YES or NO (default). Select if a file matching the File Processing Rule associated with this File Resource will be accepted (NO, default) or not (YES).

  • Local Settings have two different configurable platforms where they can operate, with different properties: WINDOWS / UNIX LIKE and zOS. The Remote Settings configuration has the same properties and definitions as the Local Settings.

Windows / Unix Like

FILE FORMAT – CONTENT TYPE

This is the mime type associated with the file; mime is used only to determine if the file is text or binary. Possible values:

APPLICATION_EDI_CONSENT APPLICATION_EDIFACT APPLICATION_EDI_X12 APPLICATION_GZIP APPLICATION_HTTP APPLICATION_JSON APPLICATION_MP4 APPLICATION_MPEG4_GENERIC APPLICATION_MPEG4_IOD APPLICATION_MPEG4_IOD_XMT APPLICATION_PDF APPLICATION_PGP_ENCRYPTED APPLICATION_PGP_SIGNATURE APPLICATION_PKCS7_MIME APPLICATION_PKCS7_SIGNATURE APPLICATION_VND_MS_EXCEL APPLICATION_VND_MS_EXCEL_ADDIN_MACROENABLED_12 APPLICATION_VND_MS_EXCEL_SHEET_BINARY_MACROENABLED_12 APPLICATION_VND_MS_EXCEL_SHEET_MACROENABLED_12 APPLICATION_VND_MS_EXCEL_TEMPLATE_MACROENABLED_12 APPLICATION_VND_MS_POWERPOINT APPLICATION_VND_MS_POWERPOINT_SLIDE_MACROENABLED_12 APPLICATION_VND_MS_POWERPOINT_SLIDESHOW_MACROENABLED_12 APPLICATION_VND_MS_POWERPOINT_TEMPLATE_MACROENABLED_12 APPLICATION_VND_MS_PROJECT APPLICATION_VND_MS_WORD_DOCUMENT_MACROENABLED_12 APPLICATION_VND_MS_WORD_TEMPLATE_MACROENABLED_12 APPLICATION_ZIP APPLICATION_OCTET_STREAM TEXT_CSS TEXT_CSV TEXT_CSV_SCHEMA TEXT_HTML TEXT_JAVASCRIPT TEXT_RTF TEXT_XML TEXT_PLAIN

FILE FORMAT – RECORD FORMAT

The record format:

UF – Windows/”Unix like” Fixed length

The file consists of fixed-length records

UV – Windows/”Unix like” delimited with EOL

The file consists of variable-length text records delimited by a line end an end of line

UVL – Windows/”Unix like” length prefixed variable record (big-endian)

The file consists of records of variable length, and each record is preceded by its length (4 big-endian binary bytes)

NONE – Not Set (default)

The file does not consist of any records

SECURITY – SECURITY TYPE (#)

NONE (default) ENVELOPE OPEN SIGN_AND_ENVELOPE SIGN

COMPRESSION – COMPRESSION TYPE (#)

Compression type where:

SPAZIO2_RUN_LENGTH

Spazio2 compression, only the repeated bytes are compressed

SPAZIO2_ZLIB

zlib Spazio2 compression

LOCATION – FILE POSITION

Flag to set the file as internal or external:

INTERNAL (default)

Create the file as internal file

EXTERNAL

Create the file as external file

LINK

When applicable, the file is the one provided by the user and the Virtual File System refers directly to it

DISPOSITION RULES – PUT DISPOSITION

The disposition applicable only to the external file:

REJECT_IF_EXIST

Create a new file. This operation fails if the file already exists

OVERRIDE (default)

Replace or create a new file if it does not exist

NEW_VERSION

Same as OVERRIDE, it can reuse the space allocation for zOS dataset

REPLACE_NO_CREATE

Replace an old file. This operation fails if the file does not exist

DISPOSITION RULES – GET DISPOSITION

When the platform works as a server, the file can remain on the VFS or can be removed automatically once it is successfully pulled by a client. When the platform works as a client, the file can remain on the VFS or can be removed automatically once it is successfully read to be pushed via a Client Connection. The configuration occurs choosing the option:

LEAVE

The file remains in the VFS

REMOVE (default)

The file is removed from the VFS

In the previous table, fields marked with (#) trigger the following options depending on the value chosen:

SECURITY TYPE:

NONE

No more properties to configure

OPEN

1. Security format: select the encrypted file format: PKCS7 (default) PGP CMS PKCS7_SP2 S_MIME

SIGN

1. Security format: same as OPEN When selecting PGP, the add extension (.pgp) checkbox will appear. 2. Signature key: The key ID to be used for signature operations 3. Signature hash algorithm: select the hash algorithm to be used for signature operations: MD2 MD5 SHA1 SHA256 (default) SHA384 SHA512

ENVELOPE

1. Security format: same as OPEN When selecting PGP, the add extension (.pgp) checkbox will appear. 2. Encryption Cipher Algorithm: select the cipher algorithm to be used for the encryption operations: DES DES_EDE3 (default) AES128 AES192 AES256 RC2 3. Encryption Recipient

SIGN_AND_ENVELOPE

1. Security format: same as OPEN When selecting PGP, the add extension (.pgp) checkbox will appear. 2. Signature key: the key ID to be used for signature operations 3. Signature hash algorithm: same as OPEN 4. Encryption Cipher Algorithm: the cipher algorithm used for the encryption operations; same as ENVELOPE 5. Encryption Recipient

COMPRESSION TYPE:

SPAZIO2_RUN_LENGTH

No more properties to configure

SPAZIO2_ZLIB

1. Compression 64 Mode: ALWAYS (default) NEVER 2. Strategy Level, Zlib compression strategy level: DEFAULT (default) FILTERED HUFFMAN_ONLY 3. Compression Level: Zlib compression level (0-9), (default: 5).

zOS

FILE FORMAT – CONTENT TYPE

The mime type associated with the file; mime is used only to determine if the file is text or binary (see paragraph of Windows/Unix like for values).

FILE FORMAT – RECORD FORMAT

The record format: ZVBM – z/OS Variable, blocked, machine print-control codes ZVS – z/OS Variable, standard ZVSA – z/OS Variable, standard, ASA print-control, characters ZVSM – z/OS Variable, standard, machine print-control codes ZVBS – z/OS Variable, blocked, standard ZVBSA – z/OS Variable, blocked, standard, ASA print-control characters ZVBSM – z/OS Variable, blocked, standard, machine print-control codes NONE – Not Set (default) NOTE: Zxxxx -> where xxxx is the z/OS dataset record format.

FILE FORMAT – RESOURCE BLOCK SIZE

The block size (used when the record format is zOS type).

FILE FORMAT – RECORD LENGTH

Record length: this is mandatory if the record format is ZFxx/ZVxx

FILE ALLOCATION SETTINGS – SPACE TYPE

Use the SPACE parameter to request space for a new data set on a direct access volume: B Byte KB Kilo byte MB Mega Byte GB Giga Byte CYL Cylinders TRK Tracks BLK Blocks

FILE ALLOCATION SETTINGS – PRIMARY SPACE

Specifies the number of tracks, cylinders, blocks, or records to be allocated.

FILE ALLOCATION SETTINGS – SECONDARY SPACE

Specifies the number of additional tracks, cylinders, blocks, or records to be allocated, if more space is needed.

FILE ALLOCATION SETTINGS – UNIT

Use the UNIT parameter to specify a device for an SMS-managed data set.

FILE ALLOCATION SETTINGS – VOLUME LIST

Use the VOLUME parameter to identify the volume or volumes where a data set resides or will reside. Each volume must be separated by commas [ , ].

FILE ALLOCATION SETTINGS – DATA CLASS

Use the DATACLASS parameter to specify a data class for a new data set. The storage administrator at your installation defines the names of the data classes you can code on the DATACLASS parameter.

SECURITY – SECURITY TYPE (#)

NONE (default) OPEN SIGN ENVELOPE SIGN_AND_ENVELOPE

COMPRESSION – COMPRESSION TYPE (#)

SPAZIO2_RUN_LENGTH SPAZIO2_ZLIB

LOCATION – FILE POSITION

INTERNAL (default) EXTERNAL LINK

DISPOSITION RULES – PUT DISPOSITION

REJECT_IF_EXIST

Create a new file; this operation fails if the file already exists.

OVERRIDE (default)

Replace or create a new file if it does not exist.

NEW_VERSION

Same as OVERRIDE, it can reuse the space allocation for zOS dataset.

REPLACE_NO_CREATE

Replace an old file; this operation fails if the file does not exist.

DISPOSITION RULES – GET DISPOSITION

When the platform works as a server, the file can remain on the VFS or can be removed automatically once it is successfully pulled by a client. When the platform works as a client, the file can remain on the VFS or can be removed automatically once it is successfully read to be pushed via a Client Connection. The configuration occurs choosing the option:

LEAVE

The file remains in the VFS.

REMOVE (default)

The file is removed from the VFS.

The SECURITY and COMPRESSION fields are marked with (#) because they trigger additional options that are detailed just before the zOS section.

During the definition of the File Resource, some checks are performed against local and remote settings to assure data consistency. These are the basic rules:

  • Local and Remote content types must both refer to binary or text files. In other words, a binary local content type and a text remote content type cannot be defined.

  • If the content type is text, the Charset name definition is mandatory.

  • If the record format is UV, the content type needs to refer to a text file, and the resource End of Line is mandatory.

  • If the record format refers to a fixed or variable length record, the record length is mandatory, and the resource End of Line is forbidden.

  • If the content type is binary, text-specific attributes cannot be specified, e.g., charset name and resource End of Line.

Once you have created the File Resource, click Save.

File Resources can be created without being associated with an Actor by going to Setup β†’ File Resources β†’ NEW.

PreviousFile ResourcesNextNavigating File Resources

Last updated 16 days ago

πŸ“