Would it be a bad idea to try to pay off my mortgage at this time?

Background: 31 years old, just purchased a condo in December. Will probably get married in the next year. No kids but expect some within 5 years. No debt (besides mortgage), give a good % to my employer that matches, max out Roth yearly.

So I want to retire as soon as I can (novel concept I know), maybe early 50s at best, but don't make a frick ton of money, but am comfortable and put as much towards retirement now as I am comfortable with. I'm only 6 months into my first home purchase but the thought occurred to me to be super aggressive and put everythign I have towards paying it off. I see one potential con and 3 major pros:

[disclosure: my current percentage taken out from work and my annual Roth max will NOT change, that is a constant from here on out]

Con: In the ~8 to 10 years it would take, that's 8-10 years I could be putting extra money towards some sort of retirement vehicle. Taht could be a good bit of lost savings.

Pros:

1) After it's paid off everythign I get in my paychecks is essentially free to do whatever I want with it. Be it saving up for my next (and last) home purchase, resume putting "extra" towards retirement, starting a 529 plan, whatever.

2) Beign that I won't have multiple millions saved at retirement time, I basically HAVE to have a good passive income stream. I could potentially be around 40ish and have a monthly rental income until whenever I decide not to. I like that.

3) Whenever the day comes (maybe in my 60s) that I'm done renting it I can sell it and get all of the profit.


Am I off base here? I know the common mindset is to never put more towards the mortgage that you have to unless you're gonna stay for a while, or potentially stay forever. But when I think about wanting to retire early I just can't get around the fact I'll need income still coming in and this seems like a great avenue for that.

Any thoughts?