Automated transfer of results of computation on ec2 instance to local client using Python
<p>I'm computing smaller things on a AWS EC2 gpu-instance. Currently I have to find the right parameters, so there are shorter computations I have to analyze and then adjust some parameter to compute again.</p>

<p>For the analysis, I depend on things, which aren't available on my EC2 instance. 
So I'm looking for an convenient way to transfer small amounts of data (not bigger than 2MB) from an EC2 instance directly onto my local computer.
I'm looking for a way, which interferes with my workflow as little as possible, so that I can concentrate on analyzing the data and updating the parameters.
Currently I use the terminal and do it manually via SCP but there has to be a better way-</p>

<p>If you have <code>scp</code> access to your systems then the <code>paramiko</code> library can perform the transfers for you, as detailed in <a href="http://stackoverflow.com/questions/250283/how-to-scp-in-python">this answer</a>. There's an <a href="https://pypi.python.org/pypi/scp" rel="nofollow"><code>scp</code> library</a> that works well with it.</p>

<p>For fuller automation over <code>ssh</code> links consider <a href="http://www.fabfile.org/" rel="nofollow"><code>fabric</code></a>, built to handle single- and multi-system automation tasks.</p>

python amazon-web-services amazon-ec2 file-transfer