Mayoral candidate John Tory said Toronto Mayor Rob Ford should resign and place his office above everything else.