# Data-flo Major Update in April 2024

Data-flo is continuously evolving as we learn from our community and adapt its features to accommodate new use cases.\
\
In July 2024 this version of Data-flo was released to [https://data-flo.io](https://data.flo.io). \
\
This large-scale upgrade includes significant changes to the user interface, improved ability to process large datasets, additional adaptors, and enhanced sharing permissions.

<figure><img src="https://1969044508-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FVJMuSDp56RPG6HerD2nz%2Fuploads%2F8m9xOrpldr3s0a1IAfJf%2Fimage.png?alt=media&#x26;token=1b21ae1b-7d7c-4462-8b97-59236efee250" alt="Comparison of software interface evolution from Data-flo version 1 to the latest version of Data-flo, The image calls out changes to several user interface upgrades, new adaptors, and improved user experience. The diagram highlighting that beta-testing and client feedback have contributed to the updates made."><figcaption><p>A diagram of Data-flo version 1 compared to the upgraded version of Data-flo.</p></figcaption></figure>

## Release Plan

### Pre-release Phase: from 1 April 2024 to 30 June 2024

New version is made available for testing on `https://next.data-flo.io/`

The current version remains unchanged and available on `https://data-flo.io/`.\
A banner is added to `https://data-flo.io/` to invite users to try the new version.

### Release Phase: from 1 July 2024 to 31 march 2025

The new version ( `https://next.data-flo.io/`) replaces the current version and replaces `https://data-flo.io/`.

Workflows on the old version are migrated to the new version. Workflows created on `https://next.data-flo.io/` will continue to be available on `https://data-flo.io/`.

The old version will be available to users on `https://legacy.data-flo.io/` until 31 march 2025.

### Sunset Phase: from 1 April 2025 onwards

The old version (`https://legacy.data-flo.io/)`will be turned off.

## Release Notes

### Highlighted updates:

1. **Enhanced workflow description editor:** Click the information icon in the top right (<img src="https://lh7-us.googleusercontent.com/Ma2ACb9K5gJADFyGww01cX1y-s1H4NJR56S0jxzESxYOltSbXy7AJEKAHhz3rrhgzv4aZQkXXddvu_Mk2UJorLZfhwj0LRS_3xXwlGjlpPViPPyL7q4eRRNMLv2Jcs_AoAm2QjtVpCXI8AYbQpai5y0" alt="" data-size="line">) which will open the editor. By default you get two side-by-side panels, on the left type your text, and on the right you’ll see the formatted text. This uses markdown language, allowing you to include links, bullets, and even insert images.
2. **Adaptor names and descriptions on adaptors**: Once an adaptor is added to the canvas, users have the option of adding a custom description. This is displayed under the adaptor name on the canvas, making it easier to track both the adaptor type, and specific use.
3. **Debug mode** is now integrated into your workflow. Simply click the run icon (<img src="https://lh7-us.googleusercontent.com/ni93B_UBnivkh9t6A0p4U1ImqPC58XoYmsnT9zBd3oSJWXaOCfGhk2S3wHJxRFVDUcNNcu23a41K8sJT2lOLokK99IMKw1p3KQb4cfu898Uhrfw8Xp31TZUgWKYG5-uK0SgQ9y9E3oO2jXNO3hj8MUs" alt="" data-size="line">) and your adaptors will be outlined in green (no issues!) or red (uh-oh!). If you get a red adaptor, simply select it, and you’ll get more details on why it didn’t run successfully. It’s helpful to click run (<img src="https://lh7-us.googleusercontent.com/ni93B_UBnivkh9t6A0p4U1ImqPC58XoYmsnT9zBd3oSJWXaOCfGhk2S3wHJxRFVDUcNNcu23a41K8sJT2lOLokK99IMKw1p3KQb4cfu898Uhrfw8Xp31TZUgWKYG5-uK0SgQ9y9E3oO2jXNO3hj8MUs" alt="" data-size="line">) often as you’re building your workflow to test each adaptor step by step as you build.
4. **Sharing permissions**: you can now share your workflows with others selecting one of four different levels of privilege!

   ![A screenshot of the access permission options in Data-flo including Runner, Editor, Viewer and Manager](https://lh7-us.googleusercontent.com/5XqCcGgIANKFe_Rc3HKBngeQ0GvqCkMRr2NAjnMaoEEge2Tmai7MARcPFyjSBJqRjczI9umle3RVTBlfsrI7-x9YUo3JDLviZ7yDse_WycLZ5Jzj_df-kN5g5SNLqBWd8SDzoHxDyqzmB8f8Qld2iUE)

### Interface updates

1. **Workflow page organization**: Your homepage is also called the workflow page where all your saved workflows are stored and displayed. This update of Data-flo allows users to both sort and group their workflows by Name, Date Created, Date updated, and Access Role
2. **Reposition the Add New Step screen**: use the icon on the top right of the screen to move the side panel from the bottom to the right side of the screen - your choice!

   ![](https://lh7-us.googleusercontent.com/wM48C6Zn_lWuY9eqT71oW-snVme5YC-HQ6hKqqeQIRGeXYe_g9gQVSNa18Q0TdyeLokJCfhChPr2tUzuDf2B-N1T4QeVNoDyo26qkz2Jexxo6PuOtWLMJKBu6eUKgo8qM8HF_vu3YoXRJaY7t_6XNas) ![](https://lh7-us.googleusercontent.com/2dakFPOgYwpN8mDd9nykzrP06qv4SI4Ij1Rfzd4xeVxWiB1eZSX7Y3Q7Z6PuJxiuvwZVsdHZs4X7D298euBkLztTsMONbNKR00vWyp-ufP-vnW2AYjKzhIQuw5gf_H6hKNBk-EDpDZ5T-mPvE0OQr5A)

### Adaptor updates:

See comprehensive list of all adaptors [here](https://cgps.gitbook.io/data-flo/reference-guide).

#### New adaptors

| Adaptor Type | Adaptor Name                   | Description                                                                                                                                                              |
| ------------ | ------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| Transform    | add-jittering                  | Adds random jittering to specified numeric columns in a datatable.                                                                                                       |
| Transform    | aggregate-rows                 | Aggregates values in specified columns grouped by rows.                                                                                                                  |
| Transform    | calculate-column               | Performs a mathematical calculation on two datatable columns.                                                                                                            |
| Transform    | duplicate-column               | Duplicates a column in a datatable.                                                                                                                                      |
| Transform    | format-time-column             | Formats date/time values in a datatable column.                                                                                                                          |
| Import       | import-file-from-http-request  | Imports a file from an HTTP request.                                                                                                                                     |
| Import       | import-from-excel-file         | Imports data from an Excel file in XLSX format.                                                                                                                          |
| Import       | import-from-json-file          | Imports data from a file in JSON format.                                                                                                                                 |
| Transform    | import-list-from-text-file     | Imports a list from a text file.                                                                                                                                         |
| Transform    | query-datatable                | Runs a RBQL (Rainbow Query Language) on a datatable.                                                                                                                     |
| Transform    | rename-newick-leaf-labels      | Renames leaf labels in a Newick tree.                                                                                                                                    |
| Transform    | run-openai-model               | Runs an OpenAI language model.                                                                                                                                           |
| Transform    | run-replicate-model            | Runs a Replicate model.                                                                                                                                                  |
| Workflows    | run-workflow                   | Runs another Data-flo workflow.                                                                                                                                          |
| Transform    | sample-datatable               | Samples rows in a datatable.                                                                                                                                             |
| Transform    | split-geographical-coordinates | Splits geographical coordinates in a datatable column to a latitude & a longitude columns.                                                                               |
| Transform    | summarise-datatable            | Summarises information about specified columns in a datatable.                                                                                                           |
| Transform    | transform-columns              | Transforms values in specified columns using an OpenAI language model.                                                                                                   |
| Workflows    | workflow-repeater              | Runs a data-flo adaptor(s) from another Workflow within the current Workflow. This adaptor applies the reference Workflow adaptors to each row of your current Workflow. |


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://cgps.gitbook.io/data-flo/readme/new-release.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.