"It's not the words of my enemies, it's the silence of my friends", what does that mean?

Question

"It's not the words of my enemies, it's the silence of my friends", what does that mean?

Answer 1

The words of his enemies can't bother him or hurt him because he doesn't care what his enemies think or say, they are nothing to him. But, the silence of his friends hurts because he cares about them and what they think.

Answer 2

If an enemy says something bad about you, it is your friends who stick up for you and counter the argument.  If there is no counter-argument, then it is assumed the original statments are true.  

Therefore, It's not the words of my enemies (that bothers me - or that condemns me) but the silence of my friends (that does).

Answer 3

it means that the silence of the persons friends hurts a lot more than the words of his enemies.