But it is used to silence, just differently. Per OP: Noticing privilege is proof of privilege existing in society. Not noticing privilege is proof of privilege and proof of the observer's oblivious-ness.
If all answers are supposedly proof of your claim, that's just another way to silence dissent by invalidating opposing claims and viewpoints.