From Elasticsearch
| Type | Parameter | Description | Mandatory | Example Value |
|---|---|---|---|---|
| Basic parameters | Index | It is similar to the schema or name of a relational database. Multiple indexes for entire DB migration are separated by commas (,). You can enter index aliases. You can also enter an expression containing wildcard characters, for example, asterisks (*). If you select multiple indexes, their structure must be the same. This parameter can be configured as a macro variable of date and time and a path name can contain multiple macro variables. When the macro variable of date and time works with a scheduled job, the incremental data can be synchronized periodically. For details, see Incremental Synchronization Using the Macro Variables of Date and Time. NOTE: If you have configured a macro variable of date and time and schedule a CDM job through DataArts Studio DataArts Factory, the system replaces the macro variable of date and time with (Planned start time of the data development job – Offset) rather than (Actual start time of the CDM job – Offset). | Yes | index_sample |
| Type | It is similar to the schema or name of a relational database. Multiple indexes for entire DB migration are separated by commas (,). You can enter index aliases. You can also enter an expression containing wildcard characters, for example, asterisks (*). If you select multiple indexes, their structure must be the same. | Yes | type_example | |
| Advanced attributes | Split Nested Field | Whether to split the JSON content of nested fields, for example, splitting a:{ b:{ c:1, d:{ e:2, f:3 } } } into [a.b.c], [a.b.d.e], and [a.b.d.f]. | No | Yes |
| Filter Conditions | Condition used to filter source data. The q syntax of Elasticsearch is used. | No | last_name:Smith | |
| Meta-field Extraction | Whether to extract meta-fields from the index. Currently, only _index, _type, _id, and _score are supported. Examples: _index, _type, _id, and _score | No | _index | |
| Page Size | Number of records displayed on each page | No | 1000 | |
| ScrollId Time Out | ScrollId timeout duration, which is five minutes by default. | No | 5 | |
| Retries | Number of retries upon a request failure. The maximum number of retries is 10. | No | 3 |
What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot
