Why do some people blame those of Faith for the wrongs of those who came before them?

Most of us here have never backed or been in a Crusade, Jihad, or Incuisition have we? Why are we being judged by those things?