A province that contains a Temple yields 2 extra gold pieces in taxes each turn.

For most players, this means that a Temple will pay for itself in three or four turns. Particularly in the early game, if you have money to spare, you may wish to consider building a Temple. The Celestial Empire does so frequently, as its main strength lies in its tax base.