An "ugly monstrosity" at the centre of a growing Somerset village is set to be razed for new homes after a successful appeal.