Campaigners against plans to demolish and rebuild a seafront leisure centre held a protest calling for the centre "to be saved".