Data buffering/storage - Python
<p>I am writing an embedded application that reads data from a set of sensors and uploads to a central server. This application is written in Python and runs on a Rasberry Pi unit. </p>

<p>The data needs to be collected every 1 minute, however, the Internet connection is unstable and I need to buffer the data to a non volatile storage (SD-card) etc. whenever there is no connection. The buffered data should be uploaded as and when the connection comes back.</p>

<p>Presently, I'm thinking about storing the buffered data in a SQLite database and writing a cron job that can read the data from this database continuously and upload.</p>

<p>Is there a python module that can be used for such feature? </p>

<p>This is only database work. You can create a master and slave databases in different locations and if one is not on the network, will run with the last synched info.</p>

<p>And when the connection came back hr merge all the data.</p>

<p>Take a look in this <a href="http://stackoverflow.com/questions/2366018/how-to-re-sync-the-mysql-db-if-master-and-slave-have-different-database-incase-o">answer</a> and search for master and slave database</p>

python offline buffering