Anti-Zionism does not accuse all Jews of being racist. It only accuses the Israeli state of adopting racist and prejudiced policies. To assume Israel represents all Jews is incorrect. Many oppose it and explicitly denounce its policies.
To automatically assume all Jews are Zionist and are politically aligned with Israel is to fall into the same trap of generalisation and stereotyping that racists and anti-Semites do.