Online logistic regression model

Question

I have seen wolfram and other few websites which claim that every time we use object detection application and label it with the correct object the image represents, their algorithm uses the data to update their object detection model.

I am working on logistic regression and have implemented it successfully for the datasets that are already available to me. I am now looking forward to make this algorithm work on the fly, i.e whenever I use new dataset (it can be a single input dataset), it should be capable of updating its weight and should not start its training from scratch using the entire dataset.

Do we have any online guide or tutorial or any such material that can give me a good start here. thanks!

Answer 1

What you are looking for is called "online learning". A very thorough overview of how to implement an online logistic regression algorithm is here. This is not the only way to do it, but one way - and the paper provides every detail you need.

Note, however, that this is probably not what those websites are referring to. They do not update their models for every new labeled data point they get. First, they likely have a whole review process to filter out the new data they get to try and minimize noise (ie: miss-labeled data).

After that, they likely are waiting until they have accumulated enough new data that building a new model from scratch becomes worth while. There may be a number of other strategies / work going into deciding when to train again and which data to use for training.