A well rounded education is necessary for a good education. Yes, the specialties are needed, but not to the exclusion of learning about history, government, science, math, English. They all come into play in your life regardless of what you eventually choose to focus your studies on.
That being said, a determined person can get that well rounded education without attending a college class. Reading, and traveling, working and learning to lead are all things that can get you a well rounded education without attending the university. It takes a LOT of self determination, goal setting,hard work, and time.