The only things I'd say you really need to fear would be unfriendly people, incapacitating injury, unexpected cold weather. Everything else is to be respected for it's ability to cause harm to you if you enter the woods unprepared, but I wouldn't fear it. I've kayaked, backpacked, and climbed in 4 seasons of the Smokeys and unexpected cold and wet were always my greatest enemies. I soon learned that cold and wet were always a possibility in the southern appalachians and from then on I just assumed that the temp could drop while the skys open up. Hypothermia, yech! Been there, did that, would have sold a kidney for a dry T-shirt.
Take care,
Mike