Add another option to an image classifier without retraining the whole network

I am trying to build a program that will classify objects, and I want my clients to be able to add extra objects freely. However, from my knowledge, this requires the retraining of the entire neural network, and this is very expensive.

​

Is there a network where we would be able to add more options to the image classifier without retraining or little training?