Skip to content

Commit

Permalink
doc: hocon
Browse files Browse the repository at this point in the history
  • Loading branch information
xiaochen-zhou committed Apr 30, 2024
1 parent 48eb536 commit b11bc3f
Showing 1 changed file with 20 additions and 54 deletions.
74 changes: 20 additions & 54 deletions docs/en/connector-v2/source/StarRocks.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,6 @@ delivers the query plan as a parameter to BE nodes, and then obtains data result
| password | string | yes | - |
| database | string | yes | - |
| table | string | yes | - |
| table_list | Array | no | - |
| scan_filter | string | no | - |
| schema | config | yes | - |
| request_tablet_size | int | no | Integer.MAX_VALUE |
Expand Down Expand Up @@ -58,17 +57,13 @@ The name of StarRocks database

The name of StarRocks table

### table_list [Array]

The list of tables to be read, you can use this configuration instead of `table` example: ```[{ table = "e2e_table_source"}, {table = "e2e_table_source_3"}]```

### scan_filter [string]

Filter expression of the query, which is transparently transmitted to StarRocks. StarRocks uses this expression to complete source-side data filtering.

e.g.

```hocon
```
"tinyint_1 = 100"
```

Expand All @@ -80,7 +75,7 @@ The schema of the starRocks that you want to generate

e.g.

```hocon
```
schema {
fields {
name = string
Expand Down Expand Up @@ -148,61 +143,32 @@ The parameter of the scan data from be

## Example

```hocon
```
source {
StarRocks {
nodeUrls = ["starrocks_e2e:8030"]
username = root
password = ""
database = "test"
table_list = [
{
table = "e2e_table_source"
schema = {
fields {
BIGINT_COL = BIGINT
LARGEINT_COL = STRING
SMALLINT_COL = SMALLINT
TINYINT_COL = TINYINT
BOOLEAN_COL = BOOLEAN
DECIMAL_COL = "DECIMAL(20, 1)"
DOUBLE_COL = DOUBLE
FLOAT_COL = FLOAT
INT_COL = INT
CHAR_COL = STRING
VARCHAR_11_COL = STRING
STRING_COL = STRING
DATETIME_COL = TIMESTAMP
DATE_COL = DATE
}
},
scan_filter = ""
},
{
table = "e2e_table_source_2"
schema = {
fields {
BIGINT_COL_2 = BIGINT
LARGEINT_COL_2 = STRING
SMALLINT_COL_2 = SMALLINT
TINYINT_COL_2 = TINYINT
BOOLEAN_COL_2 = BOOLEAN
DECIMAL_COL_2 = "DECIMAL(20, 1)"
DOUBLE_COL_2 = DOUBLE
FLOAT_COL_2 = FLOAT
INT_COL_2 = INT
CHAR_COL_2 = STRING
VARCHAR_11_COL_2 = STRING
STRING_COL_2 = STRING
DATETIME_COL_2 = TIMESTAMP
DATE_COL_2 = DATE
}
},
scan_filter = ""
}
]
table = "e2e_table_source"
scan_batch_rows = 10
max_retries = 3
fields {
BIGINT_COL = BIGINT
LARGEINT_COL = STRING
SMALLINT_COL = SMALLINT
TINYINT_COL = TINYINT
BOOLEAN_COL = BOOLEAN
DECIMAL_COL = "DECIMAL(20, 1)"
DOUBLE_COL = DOUBLE
FLOAT_COL = FLOAT
INT_COL = INT
CHAR_COL = STRING
VARCHAR_11_COL = STRING
STRING_COL = STRING
DATETIME_COL = TIMESTAMP
DATE_COL = DATE
}
scan.params.scanner_thread_pool_thread_num = "3"
}
Expand Down

0 comments on commit b11bc3f

Please sign in to comment.