His defence of colonialism turned him into a hate figure among the Left. Now he is taking on the ‘nonsensical’ campaign for ...