All the grandeur and wealth were on display in the main house. The buildings behind, in the courtyard, was where all the work was done, and enslaved people lived.
Some of this was built before the US Civil War, some after.
These images were taken in the upper level living quarters.
Most likely these rooms have not had anything or anyone doing more than walking through and looking for a very long time.
Like many of the old homes in Charleston during the Civil War the owners lost their wealth. This land remained in the family for many years after the war though. What saved the house was the location in town. This building was just far enough inland to miss most of the bombardment on the Charleston peninsula.