What South Carolina city feared a union attack after the fall of Port royal?

The city that feared a union attack after the fall of Port Royal in South Carolina was Charleston.