He probably means what he says. He can't be sure enough of the investor's internal thought processes to know that the investor doesn't respect him. In contrast, he can decide that, given what the investor's conclusions reveal about his thought process, he shouldn't respect the investor.
Shouldn't that be "You disrespect me"?