Lying by the banks of the River Witham, south of the present village, is a double moated area enclosing the site of a probable 13th or 14th century manor house. However, if there was a manor house here, it has since been replaced by what appears to be two fishponds.
The site has never been excavated, the medieval date is derived from artefacts that have been found on the surface. The features in the adjoining rectangular moat to the north appear to be elements of a 16th century ornamental garden, including a possible walkway and ‘prospect mound’ for observing the view.
There are bumps in the area to the west of the dovecote which are thought to represent a later building - Haddington Hall. It is thought that wooden panelling from this building was salvaged for Aubourn Hall when it was demolished in the late 16th century.