Why do Anti-Mormons not like being called "Anti-Mormon", when that's what they are?

If Mormon is identified with the people, anti-Mormon implies prejudice. Many who question the Mormon religion are not against the individuals and so the "anti" label can be insulting.