I believe the polls will determine whether or not he’ll debate her. Kind of the flip side of your point, if he trails in the polls by a margin that doesn’t favor his campaign, I think he debates her. Sort of a “get out of jail” card if you will. Yes, the pun is there. If he is up a comfortable percentage, I could see him saying no to a debate.
However, your last sentence will likely win out.