My suggestion is lighter layers unless it's really cold or fairly cold with wind. A lot of people I have hunted with over years have made the mistake of using heavy layers as their main clothing. I haven't seen it work out well yet.
Learning how your body functions in multiple conditions and different levels of activity is only learned through trial and error.
Having options to get cooler or warmer as needed and learning when to add or subtract layers takes time.
Never get sweaty in cold conditions. If you are sweating and it's cold out, adjust your system.
Sent from my SM-S918U using Tapatalk