How to increment training Theano saved models?
<p>I have a trained model by <a href="http://www.deeplearning.net/software/theano/" rel="nofollow">Theano</a>, and there are new training data I want to increase the mode, How could I do this?</p>

<p>Initialize the model with the pre-trained weights and perform gradient updates for the new examples, but you do have to take care of the learning rate and other parameters (depending on your optimizer). You may also try storing optimizer's parameter as well, initializing the optimizer with those values of parameters to make sure new training data does not drastically change the trained model.</p>

python numpy machine-learning neural-network theano