I find that many older backpackers quit not because they cannot walk, but because they start to prefer their creature comforts. Agility dwindles so getting up off the ground and living in a tent gets uncomfortable. And mentally, it just gets easier to stay at home. As you age, your "comfort zone" becomes smaller. So, a goal should be to make backpacking your new "comfort zone". The sooner you get started the better!