Yes, it matters. The protest dogs that bark only for Israel and Jews are anti-semitic according to these parts of the widely accepted working definition of this global prejudice:

"Applying double standards by requiring of it a behavior not expected or demanded of any other democratic nation.

Drawing comparisons of contemporary Israeli policy to that of the Nazis.

Holding Jews collectively responsible for actions of the state of Israel."

If you're criticizing or protesting Israeli policies and behavior you are anti-semitic by omission--your deafening silence about identical or worse behavior by Muslim on Muslim murders in Syria, Darfur, Kurdistan, Yemen. Demanding that Jews meet laws of war and human rights standards unmet by and not demanded of the Saudis, Iraqis, Syrians and Sudanese falls under the IHRA's double standards definition of anti-semitism.

The barking dogs you choose to be silent about vs those you complain about tell lots more about you than about the barks of the dogs.