import-file-from-s3
Description
import-file-from-s3
adaptor imports a file from an Amazon S3 compatible object storage server.
This Data-flo adaptor accesses files stored on S3, downloads them, and imports them into Data-flo as files, ready for further processing.
The access key
and secret key
of the bucket is required if the ACL of the object is set to private.
Inputs
url
Type: text
Required: Yes
The URL of the file to be imported, e.g., https://s3.region-code.amazonaws.com/bucket-name/key-name. Follow this link for more information about Amazon S3 bucket.
access key
Type: text
Required: No
The access key is the user-id that uniquely identifies your account. Required when the ACL of the object is private.
secret key
Type: text
Required: No
The secret key is the password to your account. Required when the ACL of the object is private.
Outputs
file
Type: file
The downloaded file.
Examples
Example 1: Default behaviour.
Inputs:
url:
https://s3.amazonaws.com/example-bucket/example-folder/demo.nwk
Outputs:
file
: demo.nwk
-> Imported the Newick file demo.nwk
from a public S3 bucket.
Use Cases
Pulling a Newick tree file into Data-flo to become input to
export-to-microreact-project
.Importing a csv file so it can become input to the
import-from-csv-file
adaptor.
Last updated