Evolution and the Effects of Allele Frequency on Height

I'm just wondering how that connects with what you've been describing. If we observe over time say different populations some staying at a relatively shorter stature compared to others due to nutritional differences. I mean I wouldn't have said that that was evolution because the allele frequencies didn't necessarily change they could just be expressed differently in combination with like different environmental factors. So I guess the question is what here?