Client Connection: Amazon S3 🚀
Fields with the asterisk * are mandatory.
NAME *
Name of the Amazon S3 connection you are creating. The maximum number of characters is 128. Blanks and these special characters: ' " | are not supported.
DESCRIPTION
Description of the Amazon S3 connection you are creating. The maximum number of characters is 2048.
STATUS
Enable or disable the client connection. Possible values:
Enabled (default value)
Disabled
CONNECTION TIMEOUT
Number of seconds without network activity to wait before closing a session due to inactivity. Default value: 60.
AUTHENTICATION TYPE
Select if authentication occurs with Access Key (BASIC) or with Security Token Service (STS):
BASIC (default)
ACCESS KEY ID *
This field appears when BASIC is selected. Enter the AWS access key ID.
SECRET ACCESS KEY *
This field appears when BASIC is selected. Enter the AWS secret access key.
ROLE ARN *
This field appears when STS is selected. Enter the role’s Amazon Resource Name (ARN). Format: arn:partition:service:region:namespace:relative-id
ROLE SESSION NAME *
This field appears when STS is selected. Enter the unique identifier role session name.
BUCKET NAME *
Enter the name of the S3 bucket. The minimum number of characters is 3 and the maximum is 63. Blanks are not supported.
REGION *
Select the Region of the S3 bucket specified in the BUCKET NAME field.
ENDPOINT URL
UPLOAD PART SIZE *
This is the size of each part in a multipart upload. By default, it is set to 5 MB. 🚀 The maximum value is 5000 MB. Multipart upload allows uploading an object (file) as a set of parts. Once uploaded, the object will be available as a unique part. This facilitates the upload, especially in case of pause and resume.
MAX RETRIES
Maximum number of retries. If this field is empty or set to 0, no retries will be executed and the job will be set to Failed if the first attempt is not successful. A high value corresponds to a high number of retrying attempts.
RETRY INTERVAL
This field will appear only if you have set the maximum numbers of retries to 1 or greater. Time (in seconds) waited before retrying executing a job. The lower the value, the more frequent the retrying attempts. If this field is empty or set to 0, no retries will be executed and the job will be set to Failed if the first attempt is not successful.
CONFIGURATION TEST
Understanding and managing Amazon S3 STS authentication STS authentication
STS (Security Token Service) is an authentication mode that gives the user temporary access to use S3 API based on permissions given by another user’s credentials.
For example: user Anne has permission to upload and download a file. If user Bob connects using STS based on Anne’s credentials, Bob will have the same permissions as Anne.
Let’s see the steps to follow to authenticate with STS:
Using the AWS console, add a new role or edit an existing one:
Trust entities that can assume the role and the access conditions for the role. To do so, use the Edit Trust Relationship and configure the role:
Update the existing json with a custom one. Here is an example:
Where:
account_id is the id of the user account in the aws console
user_name is the login of the user in the aws console
In PRIMEUR Data One, update the global configuration adding basic user credential properties on the existing ghibli-speng-centralnode module and create a new s3 section.
Role name and role session name parameters are also needed. The role name is the Amazon Resource Name (ARN) of the role to assume. This information is available in the AWS Console:
The format used is arn:aws:iam::account_id:role/role_name.
Where:
account_id is the id of the user account in the aws console
role_name is the name of the assumed role
The role session name is an identifier for the assumed role session.
Last updated
