I was about 7 when I went on my first backpacking trip in the Sierras. This was right after WW-II. Unfortunately, my dad had decided we were going to go over roughly 12,000' Kearsarge Pass for my first trip. I was only carrying a sleeping bag and clothes but got tired quickly and didn't have too much fun. Subsequent trips, which were easier, rekindled my love of getting out though, to the point where I did a solo thru hike of the JMT when I was just shy of 16.

If you keep the trips short, easy, non-buggy and non-boring you could start taking your son, I presume his name Is Dylan, this coming summer. Don't tell your wife I said this though smile.
_________________________
May I walk in beauty.