PhDs couldn't tell an actor from a renowned scientist
Donald Naftulin, John Ware, and Frank Donnelly who wanted to find out whether student evaluations of teachers had any meaning conducted this experiment1. The actor was Michael Fox. He based his talk on the Scientific American article on Game Theory. He borrowed from the article some phrases, but not any sense. He mixed them up with allusions to unrelated subjects, which on purely verbal level may appear relevant. He conducted himself with great confidence and showed such a mastery of the aforementioned allusions that the audience was convinced that a luminary is standing before them. A 100% had answered in the questionnaire that Dr. Fox had stimulated their thinking; a 90% that he presented material in a well-organized form, and 90% that he put his material across in an interesting way.
This is, of course, an old story. It is still worth repeating since it is almost forgotten and most readers never heard of it. However, I would not repeat it unless I had something new for everybody. I found Dr. Naftulin and got from him the video of the lecture. You can view it here. And here you can view clips from Michael Fox’s other films.
My own interest in such phenomena started with the discovery that 80% of scientific citations are not read by the citing authors but copied from the lists of references used in other papers2. Thus, an act of scientific citing is not a result of independent evaluation of the quality of the cited paper, but merely an imitation of other citer's selection. This way when a paper was once cited it is more likely to be cited again, and after it was cited again it is even more likely to be cited in the future. As a result of this chain reaction the paper can become highly cited independently of its content. The degree of authority of a scientist is determined by the number of citations to his papers. Thus, a scientist can become an authority independently of the content of his papers. This conclusion seemed bizarre to the people who could not imagine that a person who knows nothing can pass as an authority. Dr. Fox lecture demonstrates that it is quite possible. Thus, this forgotten experiment gives additional support to the conclusion of the theory of citing2.
- 1. D. H. Naftulin, J. E. Ware, Jr., and F. A. Donnelly, “The Doctor Fox Lecture: A Paradigm of Educational Seduction.” Journal of Medical Education, 48 (1973) 630.
- 2. M. Simkin and V. Roychowdhury, “Do you sincerely want to be cited? Or: read before you cite” Significance 3 (2006) 179.