Protected by the eastern city wall and the oldest tower in the city, dating from the 11th century, the Retreat Garden was originally the property of the cathedral canons. In 1854, the Ursuline nuns settled on Rue Verdelet, and it was in their courtyard that the gardens were laid out, which then surrounded the ramparts and the Névet Tower. In 1911, the Ursulines gave way to the seminary, which existed until 1932. Afterwards, the Order of the Ladies of the Retreat opened an educational establishment. When the building closed in 1977, the city purchased it.
The garden is composed of three parts:
The palm garden, which still bears the original traces of a priest's garden.
The subtropical garden, with broad-leaved plants.
The dry garden - with plants acclimatized from Chile and New Zealand. It also contains a chestnut tree dating back to the time of the Ursuline nuns.