I cannot picture any doctor telling you that 2000 calories is not enough for a woman of your height and weight. 2000 calories seems to have been the gold standard for the daily calories for women. It may be that your doctor is afraid you won't get enough nutrients without eating meat and dairy, which is a common misconception.
We can't tell you to change doctors unless you tell us why you are seeing a doctor. What are the health concerns that are taking you to a doctor, and why is your doctor talking to you about your way of eating? You don't really have to change doctors, just go ahead and year your low-fat, plant-based, whole-foods diet, and never mind your doctor's opinion! And if you are healthy and have no health concerns, that goes double! You have no need to visit a doctor, unless you want lab tests or if you break your arm!