Three can be good if it's a big adventure (like, I'll never say no to River joining the other Ponds), but on a day-to-day basis there is not enough to do for all of them (see Thirteen's team, or Five's).

And with only one companion it gets very insular.