I don't think anybody is arguing that people aren't observably smarter than other people; the question is about the metrics we're using, which, I mean, an equally vivid (and equally non-rigorous) argument would be: if you really buy into the IQ/g story, go hang out with a bunch of Mensa people and see how long you hold onto that belief.