Doesn't sound like the rest of your crew has the same interest as you do though, so you may have to relocate if it matters that much to you. It's gotta be pretty rough hunting with a group who does not think the same as you, regardless of who thinks what.
This is the bottom line, everybody has to have the same goals, for some people it is how many deer can I shot in a year, others is trophy deer only. It is much easier finding a place with people that have same goals as you than to try and change the way people think.
I understand your frustration, as it appears the place you hunt has tons of potential to produce some monsters.