I think they're both tough, in different ways. Boxing is more consistant in what is allowed, I'd say wrestling involves more of the body, and a bunch of stuff that'll throw you off like feeling strangled, but it also doesn't have punches to the head.
Different people are going to be stressed different by each individual sport.