A local horse riding club claiming to be the state's oldest says it will have to close after being forced to leave its home grounds at West Beach.