You are doing yourself a disservice if you train in the off season just for your hobby.
Your hobby will give you the exercise you need to do your hobby, but the muscular atrophy you're experiencing as you age will hit you hard in your golden years.
Pick up heavy things.