Data-flo Docs
  • About Data-flo
    • Data-flo Major Update in April 2024
      • Migrating your workflows into the latest version of Data-flo
        • Streamlined adaptors
        • Deprecated adaptors
        • New and retained adaptors
    • Change Log
    • Privacy and Terms of Service
    • Open source software used by Data-flo
  • Data-flo Basics
    • Account
    • Navigation
    • Terminology
    • Interface Icons
    • Data-flo's building blocks: Adaptors
      • Using adaptors to import data
      • Using adaptors to process data
      • Using adaptors to export data
    • Combining adaptors to create workflows
      • Creating a workflow
        • Building a workflow from scratch
        • Cloning an existing workflow
        • Importing a .dataflo file
      • Testing your workflows
      • Running your workflows
      • Accessing your workflows
  • Adaptor reference guide
    • add-column
    • add-jittering
    • add-value-to-dictionary
    • aggregate-rows
    • append-datatables
    • append-lists
    • append-to-list
    • apply-force-directed-layout
    • calculate-column
    • calculate-time-difference
    • change-column-case
    • compare-columns
    • concatenate-columns
    • concatenate-text
    • convert-date-to-text
    • convert-list-to-datatable
    • convert-text-to-datatable
    • convert-text-to-list
    • create-dictionary-from-datatable
    • create-google-drive-folder
    • create-graph-from-datatable
    • create-graph-from-dot
    • create-list-from-datatable
    • create-text-from-template
    • duplicate-column
    • export-file-to-google-drive
    • export-file-to-smb-share
    • export-graph-to-dot-file
    • export-text-to-file
    • export-to-csv-file
    • export-to-dbf-file
    • export-to-google-sheet
    • export-to-microreact-project
    • export-to-sqlite-file
    • filter-list
    • filter-rows
    • find-value-in-dictionary
    • find-value-in-list
    • format-date-column
    • format-time-column
    • geocoding
    • import-file-from-dropbox
    • import-file-from-figshare
    • import-file-from-google-drive
    • import-file-from-http-request
    • import-file-from-s3
    • import-file-from-smb-share
    • import-file-from-url
    • import-from-csv-file
    • import-from-dbf-file
    • import-from-epicollect-project
    • import-from-excel-file
    • import-from-google-sheet
    • import-from-json-file
    • import-from-microreact-project
    • import-from-mysql
    • import-from-oracle
    • import-from-postgres
    • import-from-spreadsheet-file
    • import-from-sql-server
    • import-from-sqlite
    • import-list-from-text-file
    • import-text-from-file
    • join-datatables
    • list-datatable-columns
    • list-newick-leaf-labels
    • map-column-values
    • prepend-to-list
    • query-datatable
    • remove-columns
    • remove-duplicate-list-values
    • remove-duplicate-rows
    • rename-columns
    • rename-newick-leaf-labels
    • replace-blank-values
    • replace-values-in-columns
    • replace-values-in-list
    • replace-values-in-text
    • reshape-long-to-wide
    • reshape-wide-to-long
    • reverse-geocoding
    • run-openai-model
    • run-replicate-model
    • run-workflow
    • sample-datatable
    • select-columns
    • select-list-values
    • select-rows
    • send-email-message
    • sort-datatable
    • sort-list
    • split-column
    • split-geographical-coordinates
    • split-list
    • summarise-datatable
    • transform-columns
    • workflow-repeater
  • Applying Data-flo
    • Basics in Minutes!
      • Quick Workflow
        • Step 1: Configure a solo adapter to view data.
        • Step 2: Add and link a second adaptor.
        • Step 3: Add a value.
        • Step 4: Complete the workflow.
        • Step 5: Run the workflow.
        • Step 6: Share the workflow.
  • API
    • Data-flo API
    • API Access Tokens
  • Support
    • Contact and Feedback
    • Private Installations
Powered by GitBook
On this page
  • Release Plan
  • Pre-release Phase: from 1 April 2024 to 30 June 2024
  • Release Phase: from 1 July 2024 to 31 march 2025
  • Sunset Phase: from 1 April 2025 onwards
  • Release Notes
  • Highlighted updates:
  • Interface updates
  • Adaptor updates:
  1. About Data-flo

Data-flo Major Update in April 2024

PreviousAbout Data-floNextMigrating your workflows into the latest version of Data-flo

Last updated 11 months ago

Data-flo is continuously evolving as we learn from our community and adapt its features to accommodate new use cases. In July 2024 this version of Data-flo was released to . The legacy version of data-flo is still available at until March 2025 at which point it will be sunsetted. This large-scale upgrade includes significant changes to the user interface, improved ability to process large datasets, additional adaptors, and enhanced sharing permissions.

Release Plan

Pre-release Phase: from 1 April 2024 to 30 June 2024

New version is made available for testing on https://next.data-flo.io/

The current version remains unchanged and available on https://data-flo.io/. A banner is added to https://data-flo.io/ to invite users to try the new version.

Release Phase: from 1 July 2024 to 31 march 2025

The new version ( https://next.data-flo.io/) replaces the current version and replaces https://data-flo.io/.

Workflows on the old version are migrated to the new version. Workflows created on https://next.data-flo.io/ will continue to be available on https://data-flo.io/.

The old version will be available to users on https://legacy.data-flo.io/ until 31 march 2025.

Sunset Phase: from 1 April 2025 onwards

The old version (https://legacy.data-flo.io/)will be turned off.

Release Notes

Highlighted updates:

  2. Adaptor names and descriptions on adaptors: Once an adaptor is added to the canvas, users have the option of adding a custom description. This is displayed under the adaptor name on the canvas, making it easier to track both the adaptor type, and specific use.

  4. Sharing permissions: you can now share your workflows with others selecting one of four different levels of privilege!

Interface updates

  1. Workflow page organization: Your homepage is also called the workflow page where all your saved workflows are stored and displayed. This update of Data-flo allows users to both sort and group their workflows by Name, Date Created, Date updated, and Access Role

  2. Reposition the Add New Step screen: use the icon on the top right of the screen to move the side panel from the bottom to the right side of the screen - your choice!

Adaptor updates:

New adaptors

Adaptor Type
Adaptor Name
Description

Transform

add-jittering

Adds random jittering to specified numeric columns in a datatable.

Transform

aggregate-rows

Aggregates values in specified columns grouped by rows.

Transform

calculate-column

Performs a mathematical calculation on two datatable columns.

Transform

duplicate-column

Duplicates a column in a datatable.

Transform

format-time-column

Formats date/time values in a datatable column.

Import

import-file-from-http-request

Imports a file from an HTTP request.

Import

import-from-excel-file

Imports data from an Excel file in XLSX format.

Import

import-from-json-file

Imports data from a file in JSON format.

Transform

import-list-from-text-file

Imports a list from a text file.

Transform

query-datatable

Runs a RBQL (Rainbow Query Language) on a datatable.

Transform

rename-newick-leaf-labels

Renames leaf labels in a Newick tree.

Transform

run-openai-model

Runs an OpenAI language model.

Transform

run-replicate-model

Runs a Replicate model.

Workflows

run-workflow

Runs another Data-flo workflow.

Transform

sample-datatable

Samples rows in a datatable.

Transform

split-geographical-coordinates

Splits geographical coordinates in a datatable column to a latitude & a longitude columns.

Transform

summarise-datatable

Summarises information about specified columns in a datatable.

Transform

transform-columns

Transforms values in specified columns using an OpenAI language model.

Workflows

workflow-repeater

Runs a data-flo adaptor(s) from another Workflow within the current Workflow. This adaptor applies the reference Workflow adaptors to each row of your current Workflow.

Enhanced workflow description editor: Click the information icon in the top right () which will open the editor. By default you get two side-by-side panels, on the left type your text, and on the right you’ll see the formatted text. This uses markdown language, allowing you to include links, bullets, and even insert images.

Debug mode is now integrated into your workflow. Simply click the run icon () and your adaptors will be outlined in green (no issues!) or red (uh-oh!). If you get a red adaptor, simply select it, and you’ll get more details on why it didn’t run successfully. It’s helpful to click run () often as you’re building your workflow to test each adaptor step by step as you build.

A screenshot of the access permission options in Data-flo including Runner, Editor, Viewer and Manager

See comprehensive list of all adaptors .

here
https://data-flo.io
https://legacy.data-flo.io/
A diagram of Data-flo version 1 compared to the upgraded version of Data-flo.
Comparison of software interface evolution from Data-flo version 1 to the latest version of Data-flo, The image calls out changes to several user interface upgrades, new adaptors, and improved user experience. The diagram highlighting that beta-testing and client feedback have contributed to the updates made.