Fence dispute help… Long

Never had to deal with this before so seeing what y’all think. Will try to make long story short. Neighbor fence co changed fence line and now trying to change our fence to match.

Hurricane laura 2020 damaged all fences on property, blew up parts of it. Our insurance company would only pay for 3 sides since neighbor said that side was his. We offered to help pay at the time but he didn’t want to fix it yet. His side was leaning in portions and had missing boards but did not completely fall down.

We rebuild the fences that insurance company paid for. The gate portion of our fence on the driveway, ended with a metal pole and one more board that edged right up against the existing fence but didn’t tie into it.

Old neighbor moved, new neighbor came/left and didn’t fix it. Now the 3rd owner finally decides to fix it but didn’t give us any warning. The workers come while we are at work today, pull into our driveway without permisssion (not a big deal) to do the work. Neighbor courtesy would have been nice. Then they replant the poles and concreted them already… went from 4x4’s to metal poles but seemed to have not accounted for that size difference and changed the line.

So instead of just making the line to match the end of our fence like the old fence did; they remove one of our boards and then tell my wife that they will have to saw our posts some, alter our metal brackets to match this new magical line that encroaches past the old fence line. All my wife did was to ask them not to tie into our fence and they said they would have to alter our fence in order to do that… after they already removed one of our boards.

Another way I know they altered the line is that there were border rocks all against the fence line. Now it looks like at least 1/3 of the rocks will be on their side of the fence when before there were no rocks on their side.

I don’t have a survey of property lines done but I have lot dimensions from when I bought the house. Shouldn’t I be able to say you can not touch our fence until there is a formal survey in place? That they can build the fence right up against ours like it used to be but can’t tie into it or certainly remove any of it without permission? Seems to me for now I have the fence people for trespassing and destructing private property.

Going to try to talk to neighbor, all they have to do is change the line a couple of inches to butt against our board. If not then I will have to get a survey done and say you can’t touch our fence until formal boundaries are drawn?

What say you?