Cayce, SC Like its sister suburb West Columbia, Cayce lies across the Congaree River from the state capital of Columbia, and spans into both Richland and Lexington counties. Because both it and the neighboring West Columbia share road names and schools, ... Read more