Clermont is irregular in shape. It extends from the Hudson River on the west, south along the Dutchess County line and east to the southernmost bend of the Roeloff Jansen Kill. The town borders Gallatin on the east and Livingston on the east and north. It is bounded on this east and north border by the same Roeliff Jansens Kill. The town line is bounded by Germantown on the northwest.Some towns are famous for their natural beauty and some as the birthplace of famous people, Clermont possesses both of these qualities. Its beauty of nature in its undulating hills and dales, its wooded areas near the Hudson River, and its position opposite the Catskill Mountains make it a spot of striking beauty. Most of the land is arable but there are some swamps and marshes forming small waste areas. There are small brooks and streams. The soil varies from a sandy loam to a mixture of clay and sand. The town is noted for its agricultural products and fruits - pears, apples, plums, berries, and grapes.