Only the loudest, worst-read believers think any holy book is the "infallible word of God". Scholars see them as books, but books which serve as the foundation/constitution of the religions.

Religions can not grow up without critics growing up too. If critics (Atheists in particular) would stop using the religious extremes as a straw man for religion as a whole, the extremists would have lost their voice and credibility a long time ago and the voice of the scholars and our common sense would be heard.