We don't care if you want to have Bible studies in your home or to go to church. You don't need a devout Supreme Justice though to practice your faith nor a display of the 10 Commandments in every courthouse.
In John Adams' day, it was thought that religion served a useful role in society. Before the revolution, you had to be a member of certain churches to be eligible for government office.