filter.md

Filter

Filter transform plugin

Description

Filter the field.

Options

name	type	required	default value
fields	array	yes

fields [array]

The list of fields that need to be kept. Fields not in the list will be deleted

common options [string]

Transform plugin common parameters, please refer to Transform Plugin for details

Example

The data read from source is a table like this:

name	age	card
Joy Ding	20	123
May Ding	20	123
Kin Dom	20	123
Joy Dom	20	123

We want to delete field age, we can add Filter Transform like this

transform {
  Filter {
    source_table_name = "fake"
    result_table_name = "fake1"
    fields = [name, card]
  }
}

Then the data in result table fake1 will like this

name	card
Joy Ding	123
May Ding	123
Kin Dom	123
Joy Dom	123

Changelog

new version

• Add Filter Transform Connector