An appeal against West Oxfordshire District Council's refusal to grant permission for 35 flats for the elderly on land off The Green, Chipping Norton, has been withdrawn.