Do you have the right space?
Dogs, even small dogs, need space, indoors and out. They also need to go outside regularly for 'bathroom breaks'. With small puppies this will be very often. If you live in an apartment, or do not have a yard, this will be difficult for you.

Ideally, you need a part of the yard that your dog can use as a bathroom and you will need some kind of system for cleaning up after him. Dogs should not be allowed to 'toilet' where children play, as their feces can pass on some horrible parasites.