The construction of the first castle of Pionsat dates back to the end of the 14th century, in the heart of the Hundred Years' War.
It is probably the work of Guy Aubert, lord of Pionsat (and nephew of Pope Innocent VI), who applied Charles V's edict of 1367 on the fortification of the kingdom, to strengthen the defenses of the Auvergne against English raids. Over the centuries, the castle took the form of an enclosure with several towers (perhaps five) and a keep according to a fairly detailed plan of which there are still remains, in particular part of the main building and a tower. Since 1482, and the purchase by Jacques de Chazeron, first butler of King Louis XI, of the stronghold of PIONSAT where he built a square tower with a Gothic door in the courtyard.