There is certainly nothing wrong with you standing near them outside the library or anywhere else for that matter. And you are right if people knew more about Watchtower's doctrines they would be appalled.
Often when ex JWs do stand near the JWdubs with a placard or flyers they will move on, or even just call it a day.
So go for it.