Antisemitism specifically refers to hatred of Jews. It doesn't matter whether it's the most accurate term given that it's anti-semitism; that's still what the term means.