Harold Tower is a Gothic-style castellated mansion built for James Newton, described in 1836 as "recently completed, romantically situated, and commanding a fine view of the bay and town." It stands on grounds that once formed part of the neighbouring Fort Anne estate, and its hexagonal tower design is set off by castellation, ornamental relief around the entrance and distinctive arched openings. Its name is popularly linked to either Harold Harefoot or Harold Godwinson, though this connection is unconfirmed. The artist John Martin, who painted The Plains of Heaven while resident there between 1851 and 1853, is among its notable occupants, and the building was also used as a hotel during the Second World War.