Official Solution:
Electrician Magazine surveyed 1,000 electricians who had passed an advanced certification exam. The magazine asked the electricians how many hours they had studied for the exam. It was found that 700 of those who passed had studied for more than 50 hours, and 300 had studied for less than 50 hours. The magazine concluded that the more hours an electrician studied for the exam, the more likely they were to pass.
Which of the following is a flaw in the method that the magazine used to reach its conclusion?
A. The magazine only surveyed electricians who had recently reached five years of experience as an electrician.
B. The exam is required by federal regulations, so the electricians that passed had to take it.
C. The magazine is a member of an industry organization that helps to write the exam.
D. The survey included only electricians who had an undergraduate degree.
E. The survey did not include any electricians that did not pass the exam.
(A) This is actually a strength of the survey, since all of the electricians had similar amounts of experience.
(B) It is irrelevant whether the exam was required or not.
(C) It is irrelevant whether the magazine is a member of an industry organization that helps to write the exam.
(D) This is actually a strength of the survey, since the electricians had similar amounts of education.
(E)
Correct. The conclusion is weak because the magazine did not survey any electricians that did not pass the exam. If the electricians that did not pass studied fewer hours, this would strengthen the conclusion. And it is possible that those who had failed had a much higher % of electricians who had studied for > 100 hours, thus making the conclusion questionable
Answer: E