Do not be afraid of your enemy using negative terms to describe you.
Your credibility with the oppressed will not be damaged by what their oppressor says against you.
It is only upon you to be effective on behalf of the oppressed against the oppressors. If you do this, of course those in power will malign you, but this will only improve your standing with the people.