Do atheists, because they lack a soul, also lack a conscience?

That's a common fiction among religious people, but it's usually they who ask atheists, "Why aren't you out there pillaging and raping and murdering? If *I* didn't follow my God, I'd be out there doing that because, why not? There's no higher power to answer to." Needless to say, that's more than a little bit terrifying.