I'll also add that if there are phrases that most agree are sound sentiment from either the Koran, or the Bagavad Gita or what have you...I wouldn't be oppossed to those being in a public building either.
But would you not be offended if, in a government building there was a monument exhorting you to worship only Allah or Vishnu under pain of death?