Like anything else, if they want to use it against you they will. This one just happens to have a higher probability of that happening than some other things, because of its "high visibility"...superficial shit at its finest, and typical WT.
Just an anecdote:
I remember back in 2002 we did a reno of our hall without the RBC, and it took about a month. There were no meetings during that month, other than the abbreviated WT studies. All of the elders, MS, etc. that could grow a beard or goatee did during that month.
I also traveled a lot for work for several years, and often grew a beard when away. I kept it a few times, and always received compliments in the hall for it...especially from the ladies.
d4g