The castle in the Nalžovské Hory has a long and rich history that dates back to the 17th century. It was originally built in the Renaissance style in 1619 by Bedřich Švihovský from Rýzmberk. It has an irregular four-winged plan that was inspired by Italian castles, with corner turrets and courtyard arcades. The arcades were later walled off during rebuilding in the 19th century.
In 1744, the first major reconstruction took place under the leadership of Václav Maria Pötting, who expanded the castle with a castle chapel. Another major reconstruction took place in 1840 under Ludvík Taaffe, who gave the castle its current form with a fourth tower, a balcony and a higher tower with the Taaffe coat of arms. An English park with fountains, flower beds and a tennis court was created around the castle.
During the 20th century, the castle housed a school and served military purposes. The last major repairs took place in the 1980s. Today the castle is privately owned.