Whole lot of fuzzy information in this. Here is what I see.
1. Most important is you are self-employed.
a. You also lost money last year from the prior year, so that is a flag also.
b. You have to make actual money and the returns have to show it. They will average the last two years from your schedule E, add back certain deductions and that is your income.
C. They will look at what you claimed and wrote off. This is a killer. Paying big truck notes on the business, and other things, still count as debt, if you are a sole proprietor,you are responsible.
2. Rates are low, historically low and any rate below 8% is a "good rate", if you can lower yours by 2% and plan on being in the home for more than 5 years, it is worth the cost to refi. Your parents borrowed at 12-18, so don't complain about 3-4.
3. I understand there are a lot of people quoting rates here, but brokers almost always have better rates than banks, if yours doesn't offer you a lower rate, then they are not shopping your loan or just trying to make a lot of money. Banks don't have to disclose as much, their fees could be lower (sometimes not the case), and are limited in their offerings.
A broker is basically a wholesaler. They can and should offer you a lower rate than a bank, if not call someone else.
3. You have equity, but from your posts, you either know you have a low score or have had issues. The score they tell you on FreeCreditReport.com is not the same rate lenders use. It is also not the same report. You may get a better score,or could get worse. The rate adjustments are not huge, some are "pricing" adjustments; meaning adjustments to what a bank/broker makes, so they have to offer a higher rate to make the same money. The other is to the rate, meaning the risk factors at that credit profile are so strong you are being charged a premium to get a loan,thus a higher rate, you don't pay points,you just get a higher rate.
4. If you score is below a 640, no one will touch you with a FNMA/FHLMC loan. So you will have to go to a local bank who will keep your loan in house, they usually offer a 5 year balloon/ with 15 or 30 year amortization. Meaning your loan will have to be redone at the prevailing rate every 5 years. They are usually harder to get than FHA/FNMA/FHLMC. That is old school where they go in front of the bank's board to get approval. You could also look at credit unions. Sometime their criteria is lower, but their rate are usually a little higher, fees can be lower also.
What Hawk isn't telling you is that all banks are just big brokers, they don't keep the loans either. Chase/CapOne, etc.;still sell the loan,sometime to a different company under the same name or a different division, they just retain servicing, but still sell the bonds. The local broker puts you with a bank that will do the exact same thing. Selling your loan isn't bad, the terms don't change, just where you send your payment.
Overall if you want to save, now is the time to try. You may be able to do a HARP loan and not have to prove income or have an appraisal. If your current loan is a FNMA, then you should meet the criteria. You may have more leeway on a HARP.
Also, HARP rates are lower than standard Conventional products because there are less hits to the rate for credit, etc.
Look up the criteria for a HARP loan and you can tell if you qualify.
Now is the time to refi, income may be a problem, but you should have options unless you have major credit issues. If you can refi, do it, because even with rate adjustments for credit, income, etc.; you would still be better than 7%, especially on a 15 or 20.