Prior to the current regenerations the Doctor didn't have precise control over the TARDIS, so while in theory he could visit his companions at anytime, in practice, not so much.

Of course, your hypothesis is still good and just because the Doctor probably couldn't have wrangled the TARDIS into visiting companions whenever he wanted, that doesn't mean he didn't think he could and therefore acted accordingly.