Estate in the shadow of millionaire's row is a 'ticking time