I think that they're four sides in this

Obviously there were white supremacists who had their own agenda in Charlottesville. There are a group of people, like me, who don't want to take down the statues because they are a reminder of an important history. On the other side, there are groups of people like many of BLM who want to take down statues because any person associated with slavery must never be honored in any form. And of course there are ANTIFA people who look like they came out of their parent's basement wielding baseball bats. I disagree with their reasoning, because it becomes a slippery slope for obvious reasons. But there is a fourth side that views memorials for Confederate soldiers as a memorial for people who were "losers."

I'll contend that most politicians have simplified this all as two sided. Either you're a nazi sympathizer or an unpatriotic person who wants Washington's Jefferson's monuments taken down. Times like this remind me how the media and politicians love to divide us. It really does win elections.

TL;Dr Version: Not everything is black and white in this.