Built in the height of the Middle Age the castle was part of a larger defense network. It was destroyed during the 17th century, some towers are still remaining today. Parts of the castle were newly built in the 18th century. It offers a stunning view on the valley.
Perched on the promontory north of Ray is the castle, rebuilt around 1700 in Louis XIV style. The three wings of this complex are arranged in a U-shape, with the main wing facing the Saône valley flanked by two medieval towers. The castle, which is surrounded by an English park, houses a museum displaying exhibits from the reign of Ray.