U.S. Route 51 passes through the center of town, leading north 17 miles (27 km) to Pana and south 13 miles (21 km) to Vandalia, the county seat.

According to the 2021 census gazetteer files, Ramsey has a total area of 1.11 square miles (2.87 km2), of which 1.11 square miles (2.87 km2) (or 100.00%) is land and 0.00 square miles (0.00 km2) (or 0.00%) is water.[5]