Newsweek.com
Sorting Out Good Science From the Bad
No one is saying that researchers cheat, but how they design a study of sex education can practically preordain the results.
By Sharon Begley
Newsweek
(snip)
Which brings us to sex ed. In April, scientists released the most thorough study of abstinence-only programs ever conducted. Ordered up by Congress, it followed 2,000 kids, starting in grades 3 through 8, in rural and urban communities who had been randomly assigned to an abstinence-only program or not. Result: kids in abstinence-only "were no more likely to abstain from sex than their control group counterparts ...
had similar numbers of sexual partners and had initiated sex" at the same age.
Earlier studies gave abstinence-only glowing evaluations, as social conservatives publicized. The Heritage Foundation, for one, claimed in 2002 that abstinence-only had been proven "effective in reducing early sexual activity." But this is not a case of dueling studies, with no way to tell which to believe. If you dig into the earlier studies' methodology, you can see how they reached their conclusions.
Many evaluated programs where kids take a virginity pledge. But kids who choose to pledge are arguably different from kids who spurn the very idea. "There's potentially a huge selection issue," says Christopher Trenholm of Mathematica Policy Research, which did the abstinence study for the government. "It could lead to an upward bias on effectiveness." Claims for abstinence-only also rest on measurements not of sexual activity, but attitudes. The Bush administration ditched the former in favor of assessing whether, after an abstinence-only program, kids knew that abstinence can bring "social, psychological, and health gains." If enough answered yes, the program was deemed effective. Anyone who is or was a teen can decide if knowing the right answer is the same as saying no to sex.
Other studies relied on kids' memory. But up to half of kids forget whether they took a virginity pledge, or pretend they never did. Those who fall off the abstinence wagon are likely to "forget" they pledged, while those who remain chaste might attribute it to a pledge they never made. Both factors inflate the measured efficacy of pledge programs. A study of another abstinence program found it did a phenomenal job of getting girls to postpone their first sexual encounter. One problem: it evaluated only girls who stayed in the program, says Maynard. Girls who had sex were thrown out. In a related strategy, some studies of true sex ed, not the just-say-no variety, follow kids for only a few months, says Kirby of ETR Associates, a research contractor. But to see any difference between kids who took the class and those who did not, you have to let enough time go by for kids (in the latter group, one hopes) to have sex and get pregnant. A short time horizon may miss a program's effectiveness.
(snip)
URL: http://www.msnbc.msn.com/id/18368217/site/newsweek/