Handgun? I'd say in college. Rifle definitely when they are young.
I don't know that there is a hard and fast rule on a particular age. It all depends on the maturity level of your kid. I had a pistol when I was around his age but my dad kept it with his guns and I only got to shoot it when we went out to shoot together. I couldn't just go get it whenever I wanted and go shoot.