Data-flo Docs
  • About Data-flo
    • Data-flo Major Update in April 2024
      • Migrating your workflows into the latest version of Data-flo
        • Streamlined adaptors
        • Deprecated adaptors
        • New and retained adaptors
    • Change Log
    • Privacy and Terms of Service
    • Open source software used by Data-flo
  • Data-flo Basics
    • Account
    • Navigation
    • Terminology
    • Interface Icons
    • Data-flo's building blocks: Adaptors
      • Using adaptors to import data
      • Using adaptors to process data
      • Using adaptors to export data
    • Combining adaptors to create workflows
      • Creating a workflow
        • Building a workflow from scratch
        • Cloning an existing workflow
        • Importing a .dataflo file
      • Testing your workflows
      • Running your workflows
      • Accessing your workflows
  • Adaptor reference guide
    • add-column
    • add-jittering
    • add-value-to-dictionary
    • aggregate-rows
    • append-datatables
    • append-lists
    • append-to-list
    • apply-force-directed-layout
    • calculate-column
    • calculate-time-difference
    • change-column-case
    • compare-columns
    • concatenate-columns
    • concatenate-text
    • convert-date-to-text
    • convert-list-to-datatable
    • convert-text-to-datatable
    • convert-text-to-list
    • create-dictionary-from-datatable
    • create-google-drive-folder
    • create-graph-from-datatable
    • create-graph-from-dot
    • create-list-from-datatable
    • create-text-from-template
    • duplicate-column
    • export-file-to-google-drive
    • export-file-to-smb-share
    • export-graph-to-dot-file
    • export-text-to-file
    • export-to-csv-file
    • export-to-dbf-file
    • export-to-google-sheet
    • export-to-microreact-project
    • export-to-sqlite-file
    • filter-list
    • filter-rows
    • find-value-in-dictionary
    • find-value-in-list
    • format-date-column
    • format-time-column
    • geocoding
    • import-file-from-dropbox
    • import-file-from-figshare
    • import-file-from-google-drive
    • import-file-from-http-request
    • import-file-from-s3
    • import-file-from-smb-share
    • import-file-from-url
    • import-from-csv-file
    • import-from-dbf-file
    • import-from-epicollect-project
    • import-from-excel-file
    • import-from-google-sheet
    • import-from-json-file
    • import-from-microreact-project
    • import-from-mysql
    • import-from-oracle
    • import-from-postgres
    • import-from-spreadsheet-file
    • import-from-sql-server
    • import-from-sqlite
    • import-list-from-text-file
    • import-text-from-file
    • join-datatables
    • list-datatable-columns
    • list-newick-leaf-labels
    • map-column-values
    • prepend-to-list
    • query-datatable
    • remove-columns
    • remove-duplicate-list-values
    • remove-duplicate-rows
    • rename-columns
    • rename-newick-leaf-labels
    • replace-blank-values
    • replace-values-in-columns
    • replace-values-in-list
    • replace-values-in-text
    • reshape-long-to-wide
    • reshape-wide-to-long
    • reverse-geocoding
    • run-openai-model
    • run-replicate-model
    • run-workflow
    • sample-datatable
    • select-columns
    • select-list-values
    • select-rows
    • send-email-message
    • sort-datatable
    • sort-list
    • split-column
    • split-geographical-coordinates
    • split-list
    • summarise-datatable
    • transform-columns
    • workflow-repeater
  • Applying Data-flo
    • Basics in Minutes!
      • Quick Workflow
        • Step 1: Configure a solo adapter to view data.
        • Step 2: Add and link a second adaptor.
        • Step 3: Add a value.
        • Step 4: Complete the workflow.
        • Step 5: Run the workflow.
        • Step 6: Share the workflow.
  • API
    • Data-flo API
    • API Access Tokens
  • Support
    • Contact and Feedback
    • Private Installations
Powered by GitBook
On this page
  • Description
  • Inputs
  • Outputs
  • Examples
  • Example 1: Default behaviour.
  • Example 2: Remove duplicate values with case sensitive set to true.
  • Use case
  1. Adaptor reference guide

remove-duplicate-list-values

Description

remove-duplicate-list-values adaptor removes duplicate values in a list.

The adaptor removes duplicated list values and provides a list containing only the unique values. The case-sensitive option can be used to treat uppercase and lowercase letters as different or equivalent. The duplicates output will show all removed duplicate values, not a unique list of removed values.

Inputs

list Type: list Required: Yes The list containing duplicate values to be removed.

case sensitive Type: boolean Required: No When set to True, lowercase and uppercase letters are treated as different. When set to False, lowercase and uppercase letters are treated as equivalent. If unspecified, defaults to False

Outputs

list Type: list A list containing unique values.

duplicates Type: list A list containing duplicate values.

Examples

Example 1: Default behaviour.

Inputs:

list:

  1. Bovine

  2. Mouse

  3. Gibbon

  4. Orangutan

  5. bovine

  6. mouse

  7. Bovine

case sensitive: null (empty)

Outputs:

list:

  1. Bovine

  2. Mouse

  3. Gibbon

  4. Orangutan

duplicates:

  1. bovine

  2. mouse

  3. Bovine

-> Removed duplicate values from the list. Note that the first instance of a value is the one retained - in this instance Bovine instead of bovine.

Example 2: Remove duplicate values with case sensitive set to true.

Inputs:

list:

  1. Bovine

  2. Mouse

  3. Gibbon

  4. Orangutan

  5. bovine

  6. mouse

  7. Bovine

case sensitive: True

Outputs:

list:

  1. Bovine

  2. Mouse

  3. Gibbon

  4. Orangutan

  5. bovine

  6. mouse

duplicates:

  1. Bovine

-> Removed case sensitive duplicate values from the list.

Use case

  • Use to create the input for an adaptor requiring a list of options.

  • If a unique list of the removed values is needed, a second remove-duplicate-list-values adaptor could be connected to the duplicates output.

Previousremove-columnsNextremove-duplicate-rows

Last updated 1 year ago

Use after adaptor to identify duplicate values from a datatable column.

create-list-from-datatable