The Capitol Building is open to the public, for free tours or just to have a look around and take pictures. See the website for tour times, hours, etc.
Ryan prefers the Capitol Building in DC, which I can understand, because after all it is the Capitol Capitol. I prefer this one though, just because it feels more accessible and laid back. In DC you can almost feel a homeland security guy staring you down from behind a potted plant.
Posts