Denham Place in Buckinghamshire, near London, had just seven owners in its 320-year history as well as some remarkable residents.