I found the following John Tyler quote. I think it is worth reproducing here:
The United States has adventured upon a great and noble experiment, which is believed to have been hazarded in the absence of all previous precedent — that of total separation of Church and State. No religious establishment by law exists among us. The conscience is left free from all restraint and each is permitted to worship his Maker after his own judgment. The offices of the Government are open alike to all. No tithes are levied to support an established Hierarchy, nor is the fallible judgment of man set up as the sure and infallible creed of faith. The Mohammedan, if he will to come among us would have the privilege guaranteed to him by the Constitution to worship according to the Koran; and the East Indian might erect a shrine to Brahma if it so pleased him. Such is the spirit of toleration inculcated by our political institutions… The Hebrew persecuted and down trodden in other regions takes up his abode among us with none to make him afraid… and the Aegis of the government is over him to defend and protect him. Such is the great experiment which we have tried, and such are the happy fruits which have resulted from it; our system of free government would be imperfect without it.
My source is Wikipedia. There is no note on where it was found other than it was from a letter dated July 10th, 1843 to Joseph Simpson.