In the lower part of Borgo Cornello there are the ruins of the oldest residence of the Tasso family.
The palace that stands in the square in front of the museum, frescoed on the main wall with the noble coat of arms, was also a residence of the Tasso.
The construction of the ruined castle dates back to the feudal era and may have hosted the first exponents of the Tasso family, sent to the Brembana Valley as vassals of the feudal lords of Almenno.
Of this fortified building only the foundations remain, part of the retaining walls and an arch.
Originally the castle must have been imposing, as depicted in a seventeenth-century drawing that shows it without a roof, but articulated on different floors.
In other drawings, from the nineteenth century, the building is designed on five levels of windows, with the adjacent terracing structures and roofs still present.
The collapse of the palace is believed to have occurred quite recently.
Between 1986 and 1989 the Province of Bergamo made a recovery of the site and, during the works, ceramic fragments of the fifteenth and subsequent centuries were found.