I think it's MUCH
safer to stay at home (simply because it's too difficult to know which "church", whether Catholic or Protestant or even "Eastern Orthodox", is non-corrupt since many of them are corrupt) and read the Bible, preferably the King James Version:
http://www.kingjamesbibleonline.org
And especially focus on the New Testament, if you're really interested in Christianity:
http://www.kingjamesbibleonline.org/Bible-Books
If that's too much to read, then just focus on the four Gospels, i.e. the first four books of the New Testament, which are the only books in the entire Bible that contain actual words from the mouth of Jesus Christ...
If even those 4 books are still too much, then just read the Gospel according to Mark:
http://www.sacred-texts.com/bib/kjv/mar.htm
simply because it's the shortest and, therefore, most concise.
Finally, although I'm also NOT a baptized Christian, I'm ironically attracted to some of its teachings...