import-file-from-url

Description

import-file-from-url adaptor imports a file from the web.

Imports a file into Data-flo to make it available for processing. Should be used in conjunction with other adaptors for processing.

Inputs

url Type: text Required: Yes The URL of the file to be imported.

output file name Type: text Required: No The name of the output file. If unspecified, defaults to the remote file name.

Outputs

file Type: file The imported file.

Examples

Example 1: Default behaviour.

Inputs:

url : https://s3.amazonaws.com/example-bucket/example-folder/demo.nwk

output file name : null (empty)

Outputs:

file: demo.nwk

(Bovine:0.69395,(Gibbon:0.0,(Orangutan:0.0,(Gorilla:0.0,(Chimp:0.0,Human:0.0)123:0.0)test:0.06124):0.0):0.54939,Mouse:1.21460);

-> Imported the Newick file demo.nwk from a public S3 bucket.

Use Cases

• Pulling in ‘reports’ that get updated online.

• Enables users to retrieve files from the web for further processing and transformation in Data-flo

• Users are able to pull in ‘reports’ or data files that get updated online or on an online repository (e.g., Github)