De Villiers has been the subject of much criticism around the rugby world, as much for his public comments as anything else, but Smit was assured in his defence of his coach in Wellington.
"We're in our fourth year with Peter. We haven't seen too many players running away just yet but the stories continue," he said.
"I think the perception is because he is different to what we had before. We needed a different coach to what we had before.
"When we started with Jake [White] he pretty much had to start from ground zero and turn us into something that had some idea of structure and how to play and what our strengths were. And that was drilled into us for a good three or four years leading into the 2007 World Cup."
Smit added: "To be honest coaches in South Africa are always going to be under pressure, it's probably the one job I wouldn't wish on my worst enemy.
"It's frustrating for us as players to keep seeing Peter under pressure. He's very good to us and whenever we've needed something he's provided that and for me in the time we have had with him he has been the guy who has been able to coach us in the appropriate manner.
"I think another coach with a different type of personality would have made things go a little differently in terms of results in the last three or four years."
Gilbert has released a new line of rugby cleats. The Gilbert Virtuo 8S is part of the exciting new product. Check it out.
The Barbarians are one of the top invitational rugby sides with a long history and classic rugby jersey.
The Nike Tiempo is a solid rugby cleat and one of few styles still made from full-grain natural leather.
The Lions get ready for their matches with this green training jersey. It's what the players wear. Get in the Gear!
A cool looking all black rugby cleat with the high performance adidas is known for. Get in the Gear!
Wear the crest of the British and Irish Lions on your t-shirt. A great look for the summer.
The Lions are ready to get their Australia tour underway. They arrive in Perth on Monday.
The New Zealand All Blacks training jersey for 2013/14. Get in the Gear!
The USA Rugby Pro Alternate rugby jersey is perfect for any fan of the Eagles. Get yours to wear during the summer Test matches.
The NEW All Blacks 2013/14 jersey has arrived at World Rugby Shop. Dare to wear the colors of the All Blacks.