Typical instructions are no lifting anything over 10-20# for 1-2 weeks (depends on the doctor). I have read that the necessity of that rule isn't totally backed up in studies, but I would't take my chances without talking to my Doctor. Last thing you want is to give yourself a hernia. You should be gtg for normal activities in a couple of weeks.
It's not common, but you do get some people that develop infections afterwards, I don't know that I would want to be backcountry in the next few days following my surgery. Particularly if your appendix was perforated. Maybe it would be fine, but It would really suck to be 10 miles back, give yourself a hernia, and develop an infection.
Source: am nurse on post-op floor