Easy way to continue a failed reindex?
<p>I'm currently trying to reindex a large set of data (around 96 million documents) using the <a href="http://elasticsearch-py.readthedocs.io/en/master/api.html" rel="nofollow">Python API</a>, specifically the <a href="http://elasticsearch-py.readthedocs.io/en/master/helpers.html#reindex" rel="nofollow"><code>reindex</code></a> command.</p>

<p>When running the command I eventually get a timeout error from the <code>bulk</code> command. I've tried setting the <code>bulk_kwargs request_timeout</code> to 24 hours, however it still timesout... after 28 hours and 57 million records loaded.
Re-running the reindex will just delete the existing ones and start over.</p>

<p>Regardless of the reason why the error happens (I think I'm having problems with a disk bottleneck which I can fix. There are no <code>out of memory</code> errors) <strong>is there any easy way to continue the reindex from where it died?</strong></p>

<p>If you're saying that you're deleting the existing ones and start over, then just delete index and create new one and feed it. Will be faster.</p>

<p><strong>OR</strong></p>

<p>If you cannot have empty index, then one by one or using some batch delete items identified by some <code>id</code> and insert updated according to that <code>id</code>.</p>

python elasticsearch