re: Neurologist said he is considering filing with a judge to remove my FIL from his finances

I think it's not so much the doctor forcing the issue. It's the judge who would make the decision based on a doctor's recommendation. But it would be better if you could get your FIL to sign POA before it got to that point. Try to get it done ASAP. You never had as much time as you think you will have.