...several of the first presidents, including Jefferson and Madison, generally refused to issue public prayers, despite importunings to do so. Under pressure, Madison relented in the War Of 1812, but held to his belief that chaplains shouldn't be appointed to the military or be allowed to open Congress.
