A hermit, that is, a monk living alone, was already living at Wachet when, in 1559, the reorganization of ecclesiastical structures in the Spanish Netherlands led to the creation of the Diocese of Namur. Wachet was part of the new diocese. A document from that same year attests to this.
A new chapel, with adjoining rooms for the resident hermit, was built during the second half of the 17th century. The chapel was consecrated in 1678 (as evidenced by the dated niche above the entrance door). It was dedicated to Our Lady of Refuge. Hermits continued to live there without interruption until 1783, when the religious reform of the 'enlightened despot', Joseph II, abolished the so-called 'useless' monasteries and convents (i.e., anything related to contemplative religious life) in the Austrian Netherlands. The hermitage was abolished.
Following the confiscation of church property during the French Revolutionary presence in Belgium, the hermitage was put up for sale as 'national property' in 1800. It is not known whether it was ever purchased. In any case, the hermitage was neglected and virtually abandoned until 1838.
In 1838, a first major restoration took place: the roof, choir, and altar were redone. The chapel was returned to worship. In 1842, 14 Stations of the Cross were erected on the path leading to the chapel of the old hermitage. The premises were inhabited by a family who took charge of its upkeep. At the end of the 19th century, as pilgrimages to 'Our Lady of Refuge' grew, a new Stations of the Cross made of local stone replaced the old one. The stations, fourteen three-meter-high portals, are the work of the stonemasons of Saint-Léger, the Depienne brothers and Joseph Deveaux.
The last inhabitants left Wachet in 1944. The municipality took over the former hermitage. The main living space was converted into a sacristy. Some outbuildings were demolished. Only the Notre-Dame du Refuge chapel and its exterior Stations of the Cross remain. Further restoration work was undertaken in 1950 and 1979. In 1981, the chapel choir and the sacristy were seriously damaged by fire. The damage was quickly repaired.
For about two centuries, on Assumption Day (August 15), a large procession has been held at the Notre-Dame-du-Refuge chapel. The entire complex, chapel and Stations of the Cross, is listed as a monument and heritage site of Wallonia (1992).