From Elasticsearch
Type |
Parameter |
Description |
Mandatory |
Example Value |
---|---|---|---|---|
Basic parameters |
Index |
It is similar to the schema or name of a relational database. Multiple indexes for entire DB migration are separated by commas (,). You can enter index aliases. You can also enter an expression containing wildcard characters, for example, asterisks (*). If you select multiple indexes, their structure must be the same. This parameter can be configured as a macro variable of date and time and a path name can contain multiple macro variables. When the macro variable of date and time works with a scheduled job, the incremental data can be synchronized periodically. For details, see Incremental Synchronization Using the Macro Variables of Date and Time.
NOTE:
If you have configured a macro variable of date and time and schedule a CDM job through DataArts Studio DataArts Factory, the system replaces the macro variable of date and time with (Planned start time of the data development job – Offset) rather than (Actual start time of the CDM job – Offset). |
Yes |
index_sample |
Type |
It is similar to the schema or name of a relational database. Multiple indexes for entire DB migration are separated by commas (,). You can enter index aliases. You can also enter an expression containing wildcard characters, for example, asterisks (*). If you select multiple indexes, their structure must be the same. |
Yes |
type_example |
|
Advanced attributes |
Split Nested Field |
Whether to split the JSON content of nested fields, for example, splitting a:{ b:{ c:1, d:{ e:2, f:3 } } } into [a.b.c], [a.b.d.e], and [a.b.d.f]. |
No |
Yes |
Filter Conditions |
Condition used to filter source data. The q syntax of Elasticsearch is used. |
No |
last_name:Smith |
|
Meta-field Extraction |
Whether to extract meta-fields from the index. Currently, only _index, _type, _id, and _score are supported. Examples: _index, _type, _id, and _score |
No |
_index |
|
Page Size |
Number of records displayed on each page |
No |
1000 |
|
ScrollId Time Out |
ScrollId timeout duration, which is five minutes by default. |
No |
5 |
|
Retries |
Number of retries upon a request failure. The maximum number of retries is 10. |
No |
3 |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.