How to run progress bar widget from dask.distributed in a separate thread?
<p>There is an example <a href="http://distributed.readthedocs.io/en/latest/queues.html" rel="nofollow">here</a>, showing insertion of data for processing in a separate thread. I'm interested in reverse, when data are inserted manually and interactively, and background thread submits them to cluster for calculation. </p>

<p>This is already the case.  When you call </p>

<pre><code>client.submit(function, *args, **kwargs)
</code></pre>

<p>This serializes stuff immediately in the local thread (blocking), but then adds a callback to the Tornado IOLoop (running in a separate thread) to manage the actual communication to the scheduler.  This all happens asynchronously to the main thread.</p>

python distributed jupyter-notebook dask