Its history is connected with the mining of metals, mainly silver, to a lesser extent tin and lead. Originally, only the settlement of Nalžova stood here, which was first mentioned as early as 1374. Later, the settlement of Stříbrná Hora was added, founded by German miners from Jáchymov. Mining began in 1521, when Svojše z Velhartic was the owner of the manor. But as it happens in business, regardless of the time, disputes began to arise over the mining rights. The climax was in 1541, when Peter of Rožmberk had the mines flooded. In the middle of the 16th century, there were several unsuccessful attempts to resume mining. After 1718, the estate was acquired by the Counts of Pötting. In 1769, the Irish Taaffe family came to the estate, they were the owners until 1937. This family was one of the most important in Austria. Ludvík Taaffe was the first president of the court and minister of law, and his son Eduard Taaffe became the head of the Austrian government in 1879 and served until 1893. As is often the case in life, Eduard Taaffe got into debt and was forced to sell the castle and the entire estate in sold in 1937. The silver underground was still attractive, so from 1940 to 1946 there were attempts to resume mining, but again without success.