The 'Kaiblstein' or also called 'Kaiblloch' was proven to have been a human dwelling in the Neolithic period. Various excavations have been carried out which confirm this claim. The Kaiblloch is located about 10 minutes' walk from the Neu-Nagelberg train station.
There are many other rock formations with names here: Children's Cave, Schlaraffentorte, Granite Block Group...