From Elasticsearch or CSS
If the source link of a job is a link described in Elasticsearch Link Parameters or CSS Link Parameters, configure the source job parameters based on Table 1.
Category |
Parameter |
Description |
Example Value |
---|---|---|---|
Basic parameters |
Index |
Elasticsearch index, which is similar to the name of a relational database. The index name can contain only lowercase letters. |
index |
Type |
Elasticsearch type, which is similar to the table name of a relational database. The type name can contain only lowercase letters.
NOTE:
Elasticsearch 7.x and later versions do not support custom types. Instead, only the _doc type can be used. In this case, this parameter does not take effect even if it is set. |
_doc |
|
Advanced attributes |
Split Nested Field |
(Optional) Whether to split the JSON content of the nested fields. For example, a:{ b:{ c:1, d:{ e:2, f:3 } } } can be split into a.b.c, a.b.d.e, and a.b.d.f. |
No |
Filter Conditions |
(Optional) CDM migrates only the data that meets the filter conditions.
|
last_name:Smith |
|
Extract Meta-field |
Whether to extract index meta-fields. For example, _index, _type, _id, and _score. |
Yes |
|
Page size |
Elasticsearch page size |
1000 |
|
ScrollId Time Out |
During a scroll query using Elasticsearch, a scroll_id is recorded. When the query times out or is complete, the recorded srcoll_id will be cleared. You can set this parameter to specify the timeout duration. |
5 |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.