Originally a hunting lodge, Annelsey Hall was built in 1156, and William the conqueror granted the Manor of Annesley to a Norman lord named Ralph Fitz-Hubert. The Annesley's of Annesley were lords of the manor until the 15th Century after which the Chaworth family owned the estate. The hall has associations with the poet Lord Byron as it was the home of his childhood sweet-heart, Mary Ann Chaworth, while Lord Byron also had a bedroom at the hall. Mary Chaworth she married John Musters in 1805, and the Chaworth-Musters owned the property until 1973 when it was sold. The Hall was devastated by fire in 1997 and has been owned by a local builder since the 1980s. Paranormal sightings include a black figure of an old man, the ghostly figure of a monk in the graveyard, and a man with a tri-corn hat has been spotted in the Breakfast Room. The apparition of a young girl has also been seen in the old laundry room, possibly related to the story of a young girl who fell pregnant to one of the landed gentry and hung herself. The bones of a pregnant woman have also been found underneath the staircase.