If you like history, Maryland has been here since 1634!
While its capital, Annapolis, was serving as the nation's capital, George Washington resigned his commission as general and the Treaty of Paris was signed, ending the Revolutionary War. The United States' boundary was designated and differentiated from Britain's remaining colonial interests. (ahem..Canada)
Virginia is great for history, too. George Washington lived just across the Potomac River at Mount Vernon. Colonial Williamsburg looks exactly like it did in the early 1700s.
Also, George Washington apparently slept all up and down the east coast. The number of establishments that brag "George Washington slept here." is mind-boggling.
Anyhoo, just plugging the Mid-Atlantic. New England always gets focused on as the cradle of American history, but the Mid-Atlantic has been settled just as long. And we weren't religious weirdos like the Puritans. We were here to make money. The state of Virginia literally started as The Virginia Company.
I'll shut up now. I'm a history nerd and love literally walking the same steps as people did who were settled here 150 years before the United States was formed. Come visit Annapolis, you'll love it if you're into American and British colonial history!