Imagine if Germany flew the swastika over its main government building.
That's pretty much analogous to South Carolina flying the Confederate flag over their state capitol building.
Also, the official state flag of Mississippi contains the confederate flag within it. Alabama and Florida have the bars.