I think Tom Baker's problem in this (and many other stories) is that he couldn't disguise his dislike for the actor alongside him. It's a great performance but the stuff between him and Leela was oddly uncomfortable at times.
While I agree with you to an extent I think the tension between him and Leela was more something that was built up in the stories than something seeping over from personal issues because there are many occasions when they appear to get on extremely well. I think the tension on screen is more to do with their differences and the vastly opposing ways in which they tackle things. That's how I've always seen it
