Yep, I think you're spot on about the Ponds. Like the days back with Rose, he tried to find himself a family, only this time he took them along for the ride, and that didn't work either because it messed with their heads too much.