Skip to main content Skip to complementary content

Reindex from a remote Elasticsearch cluster

You need to reindex your Logstash and Talend ESB indices.

Procedure

  1. Run the following command to see all the existing indices: 
    curl -XGET 'oldhost9200/_cat/indices'
    Replace oldhost with the IP address or the hostname of the Elasticsearch cluster used in 7.2.x.
  2. Reindex your Logstash indices from the remote cluster to pull documents from the index used in 7.3.x into the index used in 8.0.x: 
    curl -XPOST 'localhost:9200/_reindex?pretty' -H 'Content-Type: application/json' -d'
{
  "source": {
    "remote": {
      "host": "http://oldhost:9200"
    },
    "index": "logstash-YYYY.MM.dd"
  },
  "dest": {
    "index": "logstash-YYYY.MM.dd"
  }
}
'
  3. Reindex your Talend ESB indices from the remote cluster to pull documents from the index used in 7.3.x into the index used in 8.0.x: 
    curl -XPOST 'localhost:9200/_reindex?pretty' -H 'Content-Type: application/json' -d'
{
  "source": {
    "remote": {
      "host": "http://oldhost:9200"
    },
    "index": "talendesb-YYYY.MM.dd"
  },
  "dest": {
    "index": "talendesb-YYYY.MM.dd"
  }
}
'
    Information noteNote:

    You must migrate all the logstash-YYYY.MM.dd and talendesb-YYYY.MM.dd indices one by one or choose only the indices you want to migrate.

    If you specify logstash-* as the index name, you will get an error like the following one:

    If you specify logstash-* or talendesb-* as the index name, you will get an error like the following one:

    "failures" : [
{
"index" : "logstash-*",
"type" : "xxxxxxxx",
"id" : "xxxxxxxxxxxxxx",
"cause" : {
"type" : "invalid_index_name_exception",
"reason" : "Invalid index name [logstash-*], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]",
"index_uuid" : "_na_",
"index" : "logstash-*"
},
"status" : 400
},
{
"index" : "logstash-*",
"type" : "xxxxxx",
"id" : "xxxxxxxxxxxxxxx",
"cause" : {
"type" : "invalid_index_name_exception",
"reason" : "Invalid index name [logstash-*], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]",
"index_uuid" : "_na_",
"index" : "logstash-*"
},
"status" : 400
}
]
    For more information, see https://www.elastic.co/guide/en/elasticsearch/reference/current/reindex-upgrade-remote.html.

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – please let us know!

Leave your feedback here