How safe is southern Africa?

Wife and I are thinking of visiting in September and I've read a number of things saying that violent crimes (muggings, car jackings, etc.) aren't uncommon. What are your experiences?

For reference, we're planning to spend a few days in Cape Town before flying north to Victoria Falls, Hwange NP, and maybe Botswana. Would love itinerary recommendations as well!